Harvesting Field Station Data: Automating Raspberry Pi Sensors to Collaborative Websites, and Update

Field stations increasingly leverage remote sensors for large scale environmental data collection. Here we demonstrate a proof-of-concept workflow from data collection from remote sensors to presentation of summary results on a remote, and therefore fast and stable, cloud server. Environmental data is collected via raspberry pi's in several locations and data is streamed to the server on XSEDE's Jetstream, housed at Indiana University, through low-bandwith messaging. The Jetstream server does all the heavy lifting, exporting the data into a database, running automatically updating summary scripts to produce graphs, and hosting a Drupal-based website to present the data to collaborators or the public. While we use compact data in our demo, larger databases can be backed up on XSEDE's Wrangler, also housed at Indiana University. The end product is automatic aggregation and back up of sensor data onto a stable website that does not require a in-house server or large bandwidth on-site. This set-up is packaged into a ready-to-use and publically-available Jetstream image, meaning researchers could use their own sensors and R code for custom graphs with very little individual set up. Alternatively, the set-up can be used to house and display larger scale databases from other data types, such as audio recordings or photography. Future work will be in developing the ability to "pick up" data via drone fly-over and aggregation of citizen science data from multiple sites.This research is based upon work supported by the National Science Foundation under grant No. ABI-1759906 to Indiana University