As studies in Ethica usually involve monitoring one or more automated data source, such as motion sensors or GPS, each study generates large amounts of data for each participant. Such data scale makes accessing and analyzing the data a challenge. There are two methods to access the raw data: one is by downloading a portion of the data as CSV through the dashboard. The second approach is to access the database directly. Each of these methods are described here.
Downloading Data from Dashboard
If you need to download a small portion of the raw data to review or analyze, the simplest form is to use the Raw Data Download section of the dashboard:
- From the left panel select your study, expand Sensor Data, and then click on Raw Data Download.
- From the Criteria section, select the Participant and Data Source. Depending on the Data Source, you may have to select a Year and/or Month as well. In this case, the prepared file will only contain the data from the specified Year and Month.
- Pressing Go will retrieve the file and provides you with the link to download it. The file is stored in the servers for 24 hours, before it's erased.
Compression Issue while Using Chrome
The retrieved data are stored as CSV and compressed using GNU Zip format (
.gz file extension). Certain versions of Chrome browser extract the file as you try to download it, and store the extracted version on disk, though they don't change the file name. For example, the generated file is named
MY_RAW_DATA.csv.gz because the content is compressed, though while it's automatically extracted during download, yet it still has the same extension. This prevents you from opening the file.
To prevent this issue, either rename the file after download and remove the
.gz extension from the name, or use other browsers to download the file.
Direct Database Access
While downloading data as CSV through dashboard is easy and convenient for small amounts of data, it's not feasible for analyzing and querying all available data. In this case, you need to have direct access to the database.
While Ethica still does not automatically provide access to the database based on the study access permissions, you can contact Ethica Support to arrange your direct access to the raw data.