Skip to content

convert_bufr update: bufr-query bufr2netcdf.x #741

Open
cohen-seth wants to merge 2 commits intodevelopfrom
feature/sicohen/iodaconverters_bufr_query
Open

convert_bufr update: bufr-query bufr2netcdf.x #741
cohen-seth wants to merge 2 commits intodevelopfrom
feature/sicohen/iodaconverters_bufr_query

Conversation

@cohen-seth
Copy link
Contributor

Description

Updating the bufr_to_ioda.py task from the convert_bufr suite to use the new executable bufr2netcdf.x from bufr-query. The previous executable bufr2ioda.x is deprecated. bufr2netcdf.x and bufr2ioda.x each have /require a specific yaml file format so a new yaml directory was added for the bufr2netcdf.x specific yamls for three observation types: amsua (ta) , mtiasi, mhs.

The key changes to bufr_to_ioda.py were:

  • removing steps for generating the mapping yamls (the older method changed the actual contents of the yaml files)
  • changes to account for the (full) CLI command changing from bufr2ioda.x [bufr file] [bufr_mapping.yaml] to bufr2netcdf.x [bufr file] [bufr_mapping.yaml] [output .nc file]
  • added an observation type to the defaults in the convert_bufr/suite_config.py

The suite is working for these 3 observation types; however, these yamls, amsua & mtiasi, should still only by considered placeholders at the moment.

  • bufr_to_ioda.py executable changed from bufr2ioda.x (deprecate) to bufr2netcdf.x
  • New yaml files with format specific to bufr2netcdf.x added to new directory in configuration/jedi/bufr2ioda/bufr2netcdf_x/
  • Working for 3 observation types: amsua (ta) , mtiasi, mhs

Impact

Should make the next set of changes easier if/when we integrate the use of the bufr-query ObsBuilder

…emoved yamls that are not compatible with the new converter. Reworked bufr_to_ioda.py - dont need to generated, or edit, the ioda conv yaml contents with new converter.
…fr2netcdf.x. New yamls added to new directory. Working.
@cohen-seth cohen-seth self-assigned this Mar 17, 2026
@cohen-seth cohen-seth requested a review from Dooruk March 17, 2026 20:29
@cohen-seth cohen-seth added BUFR BUFR related work (convert, store, enjoy) bufr-query Relating to the handling of bufr files specifically with bufr-query ioda converters Relating to the JEDI IODA converters observation yamls Relating to observation yaml files labels Mar 17, 2026
@cohen-seth cohen-seth requested review from mranst and rtodling March 17, 2026 20:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

BUFR BUFR related work (convert, store, enjoy) bufr-query Relating to the handling of bufr files specifically with bufr-query ioda converters Relating to the JEDI IODA converters observation yamls Relating to observation yaml files

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant