Big data technologies

Ovaj diplomski rad se bavi velikim skupovima podataka i svime što se veže uz njih. Opisana je povijest, sadašnjost i budućnost velikih skupova podataka, kao i njihova primjena u svakodnevnom životu. Kako bi iskoristili potencijal koji nam pružaju veliki skupovi podataka, moramo ih znati obraditi i analizirati s odgovarajućim tehnologijama za rad. U ovom radu opisane su pojedine tehnologije za rad, a najveća pozornost je dana Apache Hadoopu. Istražuje se njegov nastanak, opisuje arhitektura i način rada te njegove prednosti i mane. U praktičnom dijelu diplomskog rada je prikazano kako se koristiti tehnologijama te je cilj dobiti korisne informacije, koje će nam pomoći da dobijemo bolji uvid u ono što nas zanima. Zadatak je prikupiti statuse s Twittera koji govore o covid-19 virusu te ih analizirati. Za prikupljanje statusa korišten je Apache Flume, za spremanje i obradu podataka Apache Hadoop te Apache Hive za njihovu analizu.This master's thesis deals with big data and everything related to them. The history, present and future of big data are described, as well as their application in everyday life. In order to use the potential provided by big data, we must know how to process and analyze them with appropriate technologies. In this thesis, individual technologies for operation are described and the greatest attention is paid to the Apache Hadoop. Its origin is researched, the architecture and way of working are described, as well as its advantages and disadvantages. The practical part of the thesis shows how to use technologies and aims to obtain useful information, which will help us get a better insight into what we are interested in. The task is to collect tweets from Twitter that talk about the covid-19 virus and analyze them. Apache Flume was used to collect the tweets, Apache Hadoop to store and process the data and Apache Hive to analyze it