Skip to content

Allow reading and processing large grib2 files in chgres_cube, such as grib2 RRFSv1 output on native levels #1034

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
natalie-perlin wants to merge 12 commits into
base: develop
Choose a base branch
from
Draft

Allow reading and processing large grib2 files in chgres_cube, such as grib2 RRFSv1 output on native levels #1034

Show file tree
Hide file tree
Changes from 8 commits
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
03e58b6
modulefiles to use spack-stack-1.6.0, fms-2024.1 environment that con…
Feb 26, 2025
d72e37e
updated modulefiles/build.hera.gnu.lua
Feb 26, 2025
2d42c42
changes to build.hera.gnu.lua modulefile to fix linking issues and ru…
Mar 7, 2025
c9d32c1
Add support for large RRFS natlev grib2 files. This requires g2v3.4.9…
LarissaReames Feb 20, 2025
e0bbf3d
Update hsi path on Gaea clusters (#1031)
DavidHuber-NOAA Mar 7, 2025
7cae9f0
cpld_gridgen - Update regression tests to run in parallel (#1027)
GeorgeGayno-NOAA Mar 10, 2025
53321e9
Merge remote-tracking branch 'origin/develop' into ss-1.6.0-large_grib2
Mar 12, 2025
0cf96fb
Merge remote-tracking branch 'origin/develop' into ss-1.6.0-large_grib2
Mar 12, 2025
d451f39
zlib uncommented in hera.intel modulefiles; packages updated in ./ci/…
Mar 13, 2025
d4a3ea0
a fix to the ./ci/spack.yaml
Mar 17, 2025
1883646
set package version in ./ci/spack.yaml: sigio/2.3.3
Mar 18, 2025
3da89c6
Merge remote-tracking branch 'origin2/develop' into ss-1.6.0-large_grib2
Mar 18, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions modulefiles/build.hera.intel.lua
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -41,8 +41,8 @@ load(pathJoin("w3emc", w3emc_ver))
sigio_ver=os.getenv("sigio_ver") or "2.3.2"
load(pathJoin("sigio", sigio_ver))

zlib_ver=os.getenv("zlib_ver") or "1.2.13"
load(pathJoin("zlib", zlib_ver))
--zlib_ver=os.getenv("zlib_ver") or "1.2.13"
--load(pathJoin("zlib", zlib_ver))
Copy link
Collaborator

@GeorgeGayno-NOAA GeorgeGayno-NOAA Mar 13, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Was zlib causing a problem or is it not used?

Copy link
Contributor Author

@natalie-perlin natalie-perlin Mar 13, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

zlib was not used, apparently, and I would put it back into the module.

Copy link
Collaborator

@GeorgeGayno-NOAA GeorgeGayno-NOAA Mar 13, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I removed the module load of zlib for the intelllvm build. Everything built fine. Apparently, zlib is automatically loaded from some other module. I only tried this test on Hera.


png_ver=os.getenv("png_ver") or "1.6.37"
load(pathJoin("libpng", png_ver))
Expand Down
4 changes: 2 additions & 2 deletions sorc/chgres_cube.fd/atm_input_data.F90
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2077,8 +2077,8 @@ subroutine read_input_atm_grib2_file(localpet)
jpdtn = -1 ! Search for any product definition template number.
unpack =.false.

call getgb2(lugb, lugi, j, jdisc, jids, jpdtn, jpdt, jgdtn, jgdt, &
unpack, k, gfld, iret)
call getgb2i2(lugb, lugi , j, jdisc, jids, jpdtn, jpdt, jgdtn, jgdt, &
unpack, 2, k, gfld, iret)

!----------------------------------------------------------------------
! Read first record and check if this is NCEP GEFS data.
Expand Down
6 changes: 3 additions & 3 deletions sorc/chgres_cube.fd/sfc_input_data.F90
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1818,7 +1818,7 @@ subroutine read_input_sfc_grib2_file(localpet)

if (localpet == 0) then

lugb=12
lugb=16
call baopenr(lugb,the_file,rc)
if (rc /= 0) call error_handler("ERROR OPENING GRIB2 FILE.", rc)

Expand All @@ -1832,8 +1832,8 @@ subroutine read_input_sfc_grib2_file(localpet)
jpdt = -9999 ! array of values in product definition template, set to wildcard
unpack = .false. ! unpack data

call getgb2(lugb, lugi, j, jdisc, jids, jpdtn, jpdt, jgdtn, jgdt, &
unpack, k, gfld, rc)
call getgb2i2(lugb, lugi, j, jdisc, jids, jpdtn, jpdt, jgdtn, jgdt, &
unpack, 2, k, gfld, rc)

if (rc == 0) then
if (gfld%idsect(1) == 7 .and. gfld%idsect(2) == 2) then
Expand Down
Loading