Geospatial Monitoring of Areas with an Increased Interest in a Selected Topic Based on the Analysis of Social Media Data

U radu su opisani principi rada s tokovima podataka u stvarnom vremenu. Opisana su osnovna svojstva koja aplikacije koje obrađuju tokove podataka trebaju imati. Kao izvor podataka u stvarnom vremenu odabran je Twitter StreamingAPI te su opisane njegove najbitnije značajke. Zatim su uspoređeni radni okviri Apache Spark i Apache Flink te je napravljen eksperiment kojim se utvrđuje kašnjenje obrade događaja u tim radnim okvirima u ovisnosti o količini generiranih događaja. Na kraju je implementiran sustav koji je u mogućnosti u stvarnom vremenu geografski pratiti objave s društvene mreže Twitter. Implementirani sustav sastoji se od dvije glavne komponente. Jedna vrši obradu u stvarnom vremenu, a druga povijesnu obradu. Na kraju su izrađene geoprostorne vizualizacije pomoću kojih se mogu lako utvrditi trendovi u obrađenim podatcima.This paper describes main principles to follow when dealing with real time data streams. As a source of real time data Twitter StreamingAPI was chosen and main features were described. Later, frameworks Apache Spark and Apache Flink were compared and benchmark was performed over them. That benchmark included measuring processing latency depending on data throughput. In the end, there is description of a system which was implemented to perform real time geospatial monitoring of data from Twitter. That system is contained of two main components. One component performs real time analysis over data stream coming from Twitter while the other component performs analysis over historical Twitter data. Also, geospatial visualizations were implemented which can easily show trends in analysed data