Skip to content

Re-enable and upgrade verif-global to use spack-stack 2.0.0, metplus 6, met 12#4455

Open
DavidHuber-NOAA wants to merge 45 commits intoNOAA-EMC:developfrom
DavidHuber-NOAA:feature/vg_update
Open

Re-enable and upgrade verif-global to use spack-stack 2.0.0, metplus 6, met 12#4455
DavidHuber-NOAA wants to merge 45 commits intoNOAA-EMC:developfrom
DavidHuber-NOAA:feature/vg_update

Conversation

@DavidHuber-NOAA
Copy link
Contributor

@DavidHuber-NOAA DavidHuber-NOAA commented Jan 20, 2026

Description

This reenables verif-global on most platforms (except Orion and Hera). The upgrades to verif-global include an overhaul to port the system to MET/METplus v12.0.1/6.0.0 and new support for the satellite suite of products. This also applies fixes to the JGFS_ATMOS_VERIFICATION and verif-global scripts so that the metp* jobs can be run in parallel.

Caveats:

  • Currently, v16 statistics are not compatible with this version of verif-global. New .stat files will need to be generated from v16 products in standalone mode to work with this.
  • Relatedly, .stat files generated by older versions of EMC_verif-global are not compatible with this version. Users will need to generate new .stat files to compare against.
  • Satellite step 1 verification is now enabled in verif-global, but is not (yet) part of the workflow. At this time, there are not plans to incorporate this feature into the workflow. Additionally, this feature (AFAIK) is only supported on Gaea C6.
  • VSDB validation is no longer supported. All validation should be performed using the VALID method. Standalone config files will need to be updated accordingly.

Resolves #4127

Type of change

  • Bug fix (fixes something broken)
  • New feature (adds functionality)
  • Maintenance (code refactor, clean-up, new CI test, etc.)

Change characteristics

How has this been tested?

Will generate .stat files for metpg2g1, metppcp1, and metpg2o1 jobs for both C48_ATM and C96C48_hybatmDA cases (with the latter being extended 48 hours to verify pcp1 statistics) on

  • Ursa
  • Hercules
  • Gaea C6
  • WCOSS2

Checklist

  • Any dependent changes have been merged and published
  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • I have documented my code, including function, input, and output descriptions
  • My changes generate no new warnings
  • New and existing tests pass with my changes
  • This change is covered by an existing CI test or a new one has been added
  • Any new scripts have been added to the .github/CODEOWNERS file with owners
  • I have made corresponding changes to the system documentation if necessary

@DavidHuber-NOAA DavidHuber-NOAA added the needs submodule update Requires submodule PRs to be merged label Feb 17, 2026
@DavidHuber-NOAA DavidHuber-NOAA added needs submodule update Requires submodule PRs to be merged and removed CI-Ursa-Passed (cm) Manual CI passed on Ursa labels Mar 6, 2026
@DavidHuber-NOAA DavidHuber-NOAA marked this pull request as draft March 6, 2026 13:40
@DavidHuber-NOAA DavidHuber-NOAA marked this pull request as draft March 6, 2026 13:40
@malloryprow
Copy link
Contributor

Thanks for delaying a little @DavidHuber-NOAA! I think getting the work in for supporting GRIB2 files is worth the wait!

@DavidHuber-NOAA
Copy link
Contributor Author

Re-opening for review. The verif-global hash is now pointing to the head of authoritative develop. A test on WCOSS2 was successful with this hash update and statistics were checked to have been created.

@DavidHuber-NOAA DavidHuber-NOAA marked this pull request as ready for review March 13, 2026 20:18
@DavidHuber-NOAA DavidHuber-NOAA removed the needs submodule update Requires submodule PRs to be merged label Mar 13, 2026
Copy link
Contributor

@TravisElless-NOAA TravisElless-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Things look good to me. Thanks @DavidHuber-NOAA!

Comment on lines 61 to 63
export g2g1_mv_database_name="mv_${PSLOT}_grid2grid_metplus"
export g2g1_mv_database_group="NOAA NCEP"
export g2g1_mv_database_desc="Grid-to-grid METplus data for global workflow experiment ${PSLOT}"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These have been removed from EMC_verif-global so they can be removed here

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Any g2g1_mv_* along with g2o1_mv and precip1_mv

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated. Thanks!

@DavidHuber-NOAA
Copy link
Contributor Author

I'm now running a fresh set of tests of WCOSS2.

@DavidHuber-NOAA DavidHuber-NOAA added the CI-Wcoss2-Running CI testing on WCOSS for this PR is in-progress label Mar 24, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CI-Wcoss2-Running CI testing on WCOSS for this PR is in-progress

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Update verif-global hash to support newer MET/METplus

4 participants