Skip to content

convert_on_campus simplification #28

@tjk584

Description

@tjk584

Convert_on_campus shouldn't need a holding_dir to perform conversions, if distribute_borealis_data operates correctly and executes after it finishes. Conversions should be able to occur in-place, simplifying the data flow.

To change this:

  1. convert_on_campus can be changed from operating within RADARID_holding_dir to just the RADARID_data dir. This removes the need to have logic to choose the dest directory within rsync_to_campus, and simplifies convert_on_campus.
  2. To ensure this works, a check should be added to distribute_borealis_data to ensure that if rawacf_array files are being distributed, rawacf_dmap files should as well. If only array files are found, then the convert_on_campus script failed, and the files shouldn't be distributed. We should also be notified of this error.

NOTE: This should be implemented after sites that utilize convert_on_campus are implemented with the inotify data flow (i.e. RKN or CLY), and then tested with the same sites.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions