A Study of Partitioning and Parallel UDF Execution with the SAP HANA Database Extended Abstract

dresden.de Large-scale data analysis relies on custom code both for preparing the data for analysis as well as for the core analy-sis algorithms. The map-reduce framework offers a simple model to parallelize custom code, but it does not integrate well with relational databases. Likewise, the literature on optimizing queries in relational databases has largely ignored user-defined functions (UDFs). In this paper, we discuss annotations for user-defined functions that facilitate opti-mizations that both consider relational operators and UDFs. In this paper we focus on optimizations that enable the paral-lel execution of relational operators and UDFs for a number of typical patterns. A study on real-world data investigates the opportunities for parallelization of complex data flows containing both relational operators and UDFs. 1