Integrating Multi-Source Weather Data for Deep Learning

Big Data has been playing a major role in the domain of Deep Learning applications as many companies and institutions continue to find solutions and extract certain trends in fields of climate change, weather forecasting and meteorology. This project extracts weather events data from multiple data sources that are supported by National Centers for Environmental information (NCEI) [1] and Amazon Web Services (AWS) [2]. Data sources include Next-Generation NEXRAD [3] Doppler radar reflectivity, GOES-16 [4] multi-channel satellite imagery and NCEI [1] storm events. Then, it integrates and refines data in proper formats to be fed to the open-source Detectron [5] Deep learning software package from Facebook. The integration process involves validation on the respective data source as well as generating geospatial and temporal intersections. The project subsequently shifts to generating training datasets along with annotations to be ingested by Mask R-CNN [6] network architecture. Finally, it passes the generated training dataset as an input for Detectron [5] software application and attempts to train network for the given 2017 and 2018 storm events