Social Media Data Analysis with IndexedHBase and Iterative MapReduce

As data intensive applications evolve, many research projects involving Big Data require efficient extraction and analysis of specific data subsets, rather than the whole dataset. Social media data analysis is one such example. While social media platforms provide tremendous data about all kinds of social activities, most research analyses focus on specific social events along the lines of presidential elections or protests. In order to support the requirements of such research use cases, the storage platform needs to provide not only a scalable solution for the overall large dataset, but also mechanisms for efficiently querying the target subsets and applying post-query analyses. This paper introduces IndexedHBase, a storage platform specially designed to support end-to-end analysis of social media data. IndexedHBase uses HBase as the storage substrate, and provides a customizabl