Analysis of tools and technologies for big data analysis with focus on application in telecommunication systems

Ovim diplomskim radom analizirana su besplatna i komercijalna rješenja za upravljanje i obradu velikih skupova podataka. U prvom dijelu rada opisane su glavne značajke raznih platformi i alata za analizu velikih skupova podataka. Nakon opisa platformi koje su uglavnom komercijalna rješenja dana je i usporedba istih. Osim platformi opisan je i niz besplatnih rješenja za analizu velikih skupova podataka te je i za njih na kraju dana usporedba kako bi se utvrdilo koji je bolji za pojedine vrstu obrade. U drugom dijelu rada detaljno je opisano rješenje Apache Hadoop te je to rješenje odabrano kao najbolje za analizu velikih skupova podataka. Osim opisa svih dijelova sustava Hadoop te modela MapReduce, sustav je uspostavljen i testiran u praksi te su na kraju prikazani rezultati obavljenog testiranja. Na kraju rada napisan je zaključak o cijeloj temi s naglaskom na odabrano rješenje za analizu velikih skupova podataka.This thesis describes the free and commercial solutions for the management and processing of large data sets. The main features of different platforms and tools for the analysis of large data sets are described in the first part of the paper. After describing the platforms, that are mainly commercial solutions, a comparison between platforms is given. In addition to the commercial platforms a number of free solutions for the analysis of large data sets are described. In the second part of this paper Apache Hadoop is described in details. This solution was chosen as the best software for the analysis of large data sets. In addition to the description of all parts of Hadoop and MapReduce model, the system is set up and tested in practice. The results of the performed tests are shown and explained. A conclusion about the whole subject is written at the end of this paper, emphasizing the chosen solution for the analysis of large data sets