Evaluation and Optimization of Big Data Processing in Cloud Computing

Abstract—There is an increasing demand for processing tremendous volumes of data, which promotes the research on systems and techniques to optimize Big Data processing time. Traditional Systems do not offer the required flexibility, scalability and they are often inefficient in processing complex analytical tasks in finite and allowable time and scalable storage to accommodate the growing data. In this paper, we propose a system that improves Big Data processing by implementing a MapReduce program, two Cloud Services and several optimization techniques. The system is implemented in Cloud Computing using Cloud Big Data Platform and compares several frameworks such as Hadoop, Apache Spark, HBase etc. Cloud Computing offers a complete and efficient infrastructure, powerful, scalable, and especially infinite resources during high seasonal demands. The evaluations turn out that the proposed system has more accurate results and the processing time is improved up to 85 times faster than the Traditional System. Keywords: Big data, MapReduce, data processing, Cloud Computing