Scalability of Hierarchical Meta-Learning on Partitioned Data

In this paper we study the issue of how to scale machine learning algorithms, that typically are designed to deal with main-memory based datasets, to efficiently learn models from large distributed databases. We have explored an approach called metalearning that is related to the traditional approaches of data reduction commonly employed in distributed database query processing systems. We explore the scalability of learning arbiter and combiner trees from partitioned data. Arbiter and combiner trees integrate classifiers trained in parallel from small disjoint subsets. Previous work demonstrated the efficacy of these meta-learning architectures in terms of accuracy of the computed meta-classifiers. Here we discuss the computational performance of constructing arbiter and combiner trees in terms of speedup and scalability as a function of database size and number of partitions. The performance of serial learning algorithms is evaluated. We then analyze the performance of the algorithm..