AUTOGEN: automatic discovery of cache-oblivious parallel recursive algorithms for solving dynamic programs

We present AUTOGEN---an algorithm that for a wide class of dynamic programming (DP) problems automatically discovers highly efficient cache-oblivious parallel recursive divide-and-conquer algorithms from inefficient iterative descriptions of DP recurrences. AUTOGEN analyzes the set of DP table locations accessed by the iterative algorithm when run on a DP table of small size, and automatically identifies a recursive access pattern and a corresponding provably correct recursive algorithm for solving the DP recurrence. We use AUTOGEN to autodiscover efficient algorithms for several well-known problems. Our experimental results show that several autodiscovered algorithms significantly outperform parallel looping and tiled loop-based algorithms. Also these algorithms are less sensitive to fluctuations of memory and bandwidth compared with their looping counterparts, and their running times and energy profiles remain relatively more stable. To the best of our knowledge, AUTOGEN is the first algorithm that can automatically discover new nontrivial divide-and-conquer algorithms.National Science Foundation (U.S.) (Grant CCF-1314547)National Science Foundation (U.S.) (Grant CNS-1409238)National Science Foundation (U.S.) (Grant IS-1447786)United States. National Security Agency (Grant H98230-14-C-1424)Foxconn International Holdings Ltd.United States. Department of Energy. Office of Science (Award DE-SC0008923)Massachusetts Institute of Technology. Undergraduate Research Opportunities Progra