The data processing pipeline transmits data from origination sites to a controlled directory structure on the ROGER CyberGIS supercomputer.
The data is generally structured as follows:
/sites /ua-mac /raw_data /sensor1 /timestamp /dataset /sensor2 ... /Level_1 /extractor1_outputs /extractor2_outputs ... /danforth /raw_data /sensor3 ... /Level_1 /extractor3_outputs
...where raw outputs from sensors per site are stored in a
raw_data subdirectory and corresponding outputs from different extractor algorithms are stored in
Level_1 (and eventually
Level_2, etc) subdirectories.
When possible, sensor directories will be divided into days and then into individual datasets.
This directory structure is visible when accessing data via the Globus interface.