Commit 232b6d8
Add compression to SBN atmospheric product generation (NOAA-EMC#4649)
# Description
NCO requires that the total volume of post-processing products to be
transmitted through the SBN <ins>not</ins> exceed current operational
levels. The generation of these products in retrospective runs of GFSv17
have marginally exceeded operational levels, and the files must be
reduced in size (in lieu of the outright removal of some).
This PR simply adds a compression/packing attribute to the generation of
WMO-headed atmospheric products within the script
[exgfs_atmos_awips_20km_1p0deg.sh](https://github.com/ChristopherHill-NOAA/global-workflow/blob/035d50609e23554a20a0c7324e488ee628c1ab1f/dev/scripts/exgfs_atmos_awips_20km_1p0deg.sh#L67),
accomplished by revising the `-set_grib_type` option of WGRIB2 from
"same" to "complex2".
This PR is intended to resolve NOAA-EMC#4614.
# Type of change
- [x] Bug fix (fixes something broken)
- [ ] New feature (adds functionality)
- [ ] Maintenance (code refactor, clean-up, new CI test, etc.)
# Change characteristics
<!-- Choose YES or NO from each of the following and delete the other
-->
- Is this change expected to change outputs (e.g. value changes to
existing outputs, new files stored in COM, files removed from COM,
filename changes, additions/subtractions to archives)? YES (If YES,
please indicate to which system(s))
- [x] GFS
- [ ] GEFS
- [ ] SFS
- [ ] GCAFS
- Is this a breaking change (a change in existing functionality)? NO
- Does this change require a documentation update? NO
- Does this change require an update to any of the following submodules?
NO (If YES, please add a link to any PRs that are pending.)
- [ ] EMC verif-global <!-- NOAA-EMC/EMC_verif-global#1234 -->
- [ ] GDAS <!-- NOAA-EMC/GDASApp#1234 -->
- [ ] GFS-utils <!-- NOAA-EMC/gfs-utils#1234 -->
- [ ] GSI <!-- NOAA-EMC/GSI#1234 -->
- [ ] GSI-monitor <!-- NOAA-EMC/GSI-Monitor#1234 -->
- [ ] GSI-utils <!-- NOAA-EMC/GSI-Utils#1234 -->
- [ ] UFS-utils <!-- ufs-community/UFS_UTILS#1234 -->
- [ ] UFS-weather-model <!-- ufs-community/ufs-weather-model#1234 -->
- [ ] wxflow <!-- NOAA-EMC/wxflow#1234 -->
# How has this been tested?
The GFS workflow was cloned and built on WCOSS. A CI test only confirmed
nominal functionality with the code change, as the products resulting
from the low resolution run were too small for the code change to
produce the necessary effect.
Offline tests executing a segment of `exgfs_atmos_awips_20km_1p0deg.sh`
with files from `products/atmos/grib2/0p25` as input resulted in a
reduction to the size of the products.
It is recommended that the changes from this PR be tested in a single
cycle, high-resolution test of GFSv17, to confirm its intended effect to
reduce SBN product volume to the extent required by NCO.
# Checklist
- [ ] Any dependent changes have been merged and published
- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my own code
- [ ] I have commented my code, particularly in hard-to-understand areas
- [ ] I have documented my code, including function, input, and output
descriptions
- [ ] My changes generate no new warnings
- [ ] New and existing tests pass with my changes
- [ ] This change is covered by an existing CI test or a new one has
been added
- [ ] Any new scripts have been added to the .github/CODEOWNERS file
with owners
- [ ] I have made corresponding changes to the system documentation if
necessary
---------
Co-authored-by: christopher hill <christopher.m.hill@clogin08.cactus.wcoss2.ncep.noaa.gov>
Co-authored-by: christopher hill <christopher.m.hill@clogin04.cactus.wcoss2.ncep.noaa.gov>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>1 parent 9c88dc0 commit 232b6d8
1 file changed
Lines changed: 16 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
184 | 184 | | |
185 | 185 | | |
186 | 186 | | |
| 187 | + | |
| 188 | + | |
| 189 | + | |
| 190 | + | |
| 191 | + | |
| 192 | + | |
| 193 | + | |
| 194 | + | |
187 | 195 | | |
188 | 196 | | |
189 | 197 | | |
| |||
214 | 222 | | |
215 | 223 | | |
216 | 224 | | |
| 225 | + | |
| 226 | + | |
| 227 | + | |
| 228 | + | |
| 229 | + | |
| 230 | + | |
| 231 | + | |
| 232 | + | |
217 | 233 | | |
218 | 234 | | |
219 | 235 | | |
| |||
0 commit comments