BigDataGrapes D7.2 - Experimental Report on Current Datasets

The deliverable D7.2 “Experimental Report on Current Datasets” consists of a report describing the outcomes of the experimentation performed on the datasets provided by each pilot, utilizing the Big Data Grapes stack. This report starts by outlining the methodology and metrics we employ for our experimentation. We focus our experimentation on a pilot level, by initially analysing the provided datasets and evaluating them against the Big Data Vs, as suggested and described in detail in D7.1. We move on to identify and document the data flows each pilot adheres to throughout the Big Data Grapes stack. For each of them, we highlight the frameworks and the components involved in the process. We experiment the identified data flow steps by describing, for each of them, three usage scenarios. During the execution of each scenario, for each step we monitor the chosen performance metrics, by showing the respective diagrams and by analysing the outcomes. This deliverable also presents an end to end report for each of the pilot’s data flows, identifying bottlenecks and making suggestions to improve the performance of the BigDataGrapes architecture where needed