Add script to extract and transform uploaded Auditor2 data

[rudokemper]

Feature Request

Add a script that takes a path for Auditor2 data (in ZIP file format), transforms the data to write to a database, and copies attachments to the datalake.

See work towards defining a data schema for Auditor2 exports here, and a branch with a fixture for testing here.

See also work and discussion towards creating a script for ingesting camera trap data (raw and annotations) from Timelapse which will largely parallel, and inform, this script.

[rudokemper]

@abfleishman Do you feel comfortable with us moving forward with this work over the next two months? In other words, do you expect the exported CSVs and their columns—per the above-linked fixture—to remain largely stable, such that only minor changes to the script will be needed once it's complete?

I'm asking in part because we have a report due to the donor by the end of August, and it would be nice to cite this data ingestion work as completed for both the bioacoustic and camera trap data.

EDIT: Given discussion in https://docs.google.com/document/d/17bBPR4dHGhr3NOcVBdq9dOCuN7NNFkDiPho5g7DYRzY/edit?tab=t.0, we should probably first do another round of revisions to the CSVs before proceeding...

[abfleishman]

@rudokemper yes I think that timeline is reasonable. I will look at these csvs today. Specific changes I am planning:
reef_type ->habitat
add col datetime
review for assuring column names are "generalized" (not reef project specific)

[abfleishman]

OK I looked at the csvs and changed the following:

• added datetime column to the moorea_labels_20250605.csv
• changed the Reef_Type column to habitat in moorea_sites_20250605.csv
• changed all the column names to snake_case (CMI style guide best practices).

I made thees changes in both my original wrapup script and in the csv files on the auditor2 branch see 0de41cc
The files are here:
~\CMI Dropbox\CMI_Team\Analysis\2023\NPT_UCSB_Moorea_2023\Clips\NPT_UCSB_Moorea_2023_R1_FLAC

"moorea_deployments_20250605.csv"
"moorea_labels_20250605.csv"
"moorea_sites_20250605.csv"
"moorea_sound_file_summary_20250605.csv"