update MPAS-Model to the latest v8.3.1-2.15#1356
update MPAS-Model to the latest v8.3.1-2.15#1356MatthewPyle-NOAA merged 10 commits intoNOAA-EMC:rrfs-mpas-jedifrom
Conversation
|
@guoqing-noaa Thanks for bringing up this PR. I will run the retros. |
|
Here is the results from retro runs (no DA).PR1356_20260309 |
@Junjun-NOAA Thanks a lot for conducting retros and sharing the results. Based on Joe's suggestion, I set |
With config_mynn_sfcflux_land=0, the model crashes at 09Z May 12, 2024, "crash in surface energy budget" |
|
@HaidaoLin-NOAA @jordanschnell Could you confirm whether the latest MPAS-Model v8.3.1-2.15 includes all needed changes for cheMPAS? Thanks! |
Hi @guoqing-noaa, this maybe for @haiqinli ? |
Thanks, @HaidaoLin-NOAA. Yes, @haiqinli could you check the chemistry need? Thanks! |
It looks good to me for the chemistry needs. Thanks! |
Great. Thanks, @haiqinli |
|
@hu5970 I think we can move to MPAS-Model v8.3.1-2.15 with this PR. This PR has needed namelist changes and fix files for all versions using TEMPOv3. |
* [v2.1.3-2.2] Hotfix: 1. default PREP_LBC_LOOK_BACK_HRS for retros, 2. herbie_get_GFS_from_aws (NOAA-EMC#1300) * HOTFIX: 1. update default PREP_LBC_LOOK_BACK_HRS for retros after PR NOAA-EMC#1263; 2. update the GFS AWS download script to match the 3-hourly output after f120 * remove the no-longer-needed comment * [rrfs-mpas-jedi] [v2.1.3-2.3] miscellaneous changes needed for running GETKF radar-reflectivity assimilation and other ensemble experiments (NOAA-EMC#1295) * Miscellaneous changes needed for running GETKF radar-reflectivity assimilation and other ensemble experiments. * fix typo in gridspacingdeg * Changes requested by code reviewer Guoqing Ge. * Change suggested by github. * one bug fix, one update requested by reviewer, one update based on collaborative experiments * minor changes suggested by reviewers --------- * [v2.1.3-2.4] Updating configurations for 12km CONUS retros to use fewer cores for MPASSIT on Gaea C6. (NOAA-EMC#1302) * [v2.1.3-2.5] [rrfs-mpas-jed] Feature/addamv da capability (NOAA-EMC#1308) * Addition of GOES AMV ob type 247 obs spaces into rrfs-workflow * Miscellaneous changes needed to run GOES AMV data assimilation * Remove lines for ioda_empty.nc files * Remove pgmout --------- * [v2.1.3-2.6] Add check for mpassit output file size (NOAA-EMC#1315) * Adding check for mpassit output file sizes. * More concise code per Guoqing's suggestion --------- * [v2.1.3-2.7] changes for real-time rrfsx on ursa (NOAA-EMC#1306) * - Add exp files for real-time rrfsx on ursa - Remove ensemble data dependency for real-time runs, and add the option to fall back to 3DVar * minor fixes * Update and rename exp.rrfsx to exp.RRFSv2X * Update and rename exp.rrfsx_ens to exp.RRFSv2X_ens * Update exp.RRFSv2X * Rename exp.RRFSv2X to exp.rrfsv2x * Update exp.RRFSv2X_ens * Update and rename exp.RRFSv2X_ens to exp.rrfsv2x_ens --------- * [v2.1.3-2.8] Hotfixes, update the `VERSION` file, introduce `COM_LBC_RETENTION_CYCS`, and others (NOAA-EMC#1319) * hotfix on undefined ens_dep in jedivar.py * bump VERSION to v2.1.3 to match the commit versions * set default PREP_LBC_LOOK_BACK_HRS to 11 for realtime runs but realtime runs are still expected to set it explicitly in exp files * update convinfo_list_obs to be able to list used observations only * add an example crontab entry in run_rocoto.sh * avoid creating empty directories under COMOUT * hotfix on unexpected {{..}} in abi observers * remove duplicate t2m/lai in keptvars.yaml to be consistent with the latest NCAR changes * add COM_LBC_RETENTION_CYCS to allow removing LBC files from COMROOT sooner, saving more disk spaces for realtime runs * [v2.1.3-2.9] hotfix on finding ensembles (NOAA-EMC#1321) * [v2.1.3-3.0] update the clean task to allow retro and realtime use the same clean mode (NOAA-EMC#1330) * add the capability to only clean old cycles which are done * fine tuning * introduce STMP_KEPT_TASKS to exclude some tasks from the clean task * fine tuning * [v2.1.3-3.1] hotfix on the DO_RADAR_REF check in jedivar.yaml (NOAA-EMC#1331) * [v2.1.3-3.2] align the dependency indentation and fix the prep_ic depencency (NOAA-EMC#1332) * [v2.1.3-3.3] update RDASApp to the latest version to include updates in its submodules, and UPP (NOAA-EMC#1326) * [v2.1.3-3.4] enable smart,flexible mpassit,upp groups at different cycles (NOAA-EMC#1334) * use load_rocoto.sh to load rocoto/1.3.7g until it is officially installed on all suported HPCs * update qrocoto to use rocoto/1.3.7g * use rocoto/1.3.7g in run_rocoto.sh * add smart_post_groups.py * generate appropriate cycledefs for post groups * address the linting comments on smart_post_groups.py * update mpassit.py and upp.py to allow flexible groups at different cycles * consider interval in the automatic grouping, such as 0-18-3 * update exrrfs_mpassit.sh and exrrfs_upp.sh to match flexible grouping * fine tuning; bring back FCST_LEN_HRS_CYCLES in exrrfs_mpassit.sh and exrrfs_upp.sh * fine tuning * go back to POST_GROUP_TOT_NUM, easier to set by users * update all exp files to use POST_GROUP_TOT_NUM * remove the commented-out POST_GROUP_SPEC from exp files, save it in config.base * [v2.1.3-3.5] update `qrocoto/load_qrocoto.sh` and `run_rocoto.sh` to load correct rocoto version automatically (NOAA-EMC#1349) * merge "load_rocoto.sh" into "qrocoto/load_qrocoto.sh" to avoid duplicates, mv "detect_machine.sh" into qrocoto/ and link it to tools/ * fine tuning * Use the correct rocoto versions in run_rocoto.sh for all supported platforms * taskinfo now shows the rrfs.log path as well * [v2.1.3-3.6] Updates to output ASNOW and FRZR in GRIB2 files (NOAA-EMC#1341) * Update stream list and MPASSIT fix files to output ASNOW and FRZR in GRIB2 files, and also update UPP to the latest code to fix DSWRF bug. * Cosmetic change to histlist_2d --------- * [v2.1.3-3.7] add `tools/qrocoto/bkg_rrun_and_notify`, mostly for monitoring realtime runs on Gaea (NOAA-EMC#1352) * add tools/qrocoto/bkg_rrun_and_notify, mostly for monitoring realtime runs on Gaea * fine tuning --------- * [v2.1.3-3.8] [rrfs-mpas-jedi] Combine member save_for_next into one task if do_ensemble (NOAA-EMC#1351) * Combine member save_for_next into one task if do_ensemble * minor fix * Update exrrfs_save_for_next.sh * simplify save_for_next.py, no more spinup nor metatask logic * different NODES_SAVE_FOR_NEXT for ensembles and deterministics * fine tuning * align the dependencies for the save_for_next task --------- * [v2.1.3-3.9] [rrfs-mpas-jedi]Run prep_ic parallelly for ensemble members to avoid long disk I/O time (NOAA-EMC#1354) * Run prep_ic parallelly for ensemble members to avoid long disk I/O time Modify the dependency for the subsequent tasks * Address linter check * Address linter shell check x 2 * use correct indentation when looping through all the ensemble members * different NODES_PREP_IC for ensembles and deterministics * remove the metatask logic from prep_ic.py * aligh the dependencies of the prep_ic tasks * remove unnecessary info --------- * [v2.1.3-4.0] [rrfs-mpas-jedi]Fix the ensemble data check for jedivar (NOAA-EMC#1355) * Fix the ensemble data check for jedivar Minor fix for save_for_next.py * Enable HYB_ENS_TYPE=0 in find_ensembles.sh * Fix indent * Minor fix * [v2.1.3-4.1] [rrfs-mpas-jedi] Various cleanups and refinements (NOAA-EMC#1358) * Add SFC_UPDATE_SOURCE_DIR if needed * Enable IC_ONLY for deterministic run * Add ursa exp file for initializing from RAP, IC_ONLY * Saving log info for forecast job * Reduce the age requirements for the data dependency * make getkf_post optional * Disable shellcheck * minor fix --------- * [v2.1.3-4.2] fix NaN issue on Jet,Hera and Derecho (NOAA-EMC#1360) * [v2.1.3-4.3] Add ensemble forecast grouping (NOAA-EMC#1361) * Add ensemble forecast grouping * Linter checks * Add ENS_FINISH_THRESHOLD to define the success threshold (0.0 to 1.0) for the metatask dependency (the fraction of members that must complete to satisfy the dependency) * Cosmetic changes * Remove blank line * minor fix * minor change * more cosmetic change --------- * [v2.1.3-4.4] allow setting history_interval to none (NOAA-EMC#1383) * allow setting history_interval to none * update parm/streams.atmosphere * fine tuning * [v2.1.3-4.5] hotfix on clean.py and Ursa MPI hangs (NOAA-EMC#1381) * [v2.1.3-4.6] Remove coldda dep (NOAA-EMC#1376) * Fix prep_ic bug * Apply configurable cyclethrottle and etc for real-time and retro runs * Remove DA dependency for coldhrs * Remove print info * Minor fix * Update exp files * Minor fix * Add more graphinfo files for conus3km * Fix dependencies on recenter --------- * [v2.1.3-4.7] update MPAS-Model to the latest v8.3.1-2.15 (NOAA-EMC#1356) * update MPAS-Model to the latest v8.3.1-2.16 * update namelist.atmosphere for hrrrv5 and mpas_global to match the latest MPAS-Model * add new tempo_v3 fix files for hrrrv5 and mpas_global * fix the MPAS-Model compiling issue * set config_mynn_sfcflux_land=0 in namelist.atmosphere * change the MPAS-Model version to v8.3.1-2.15 --------- * [v2.1.3-4.8] simplify the cycledef_spinup setting using 'valid_hours' (NOAA-EMC#1389) * simplify the cycledef_spinup setting using 'valid_hours' * fine tuning * remove unused import in smart_cycledefs.py -------- * [v2.1.3-4.9] Add `CYCLEDEF_PROD_EXCLUDE` to allow excluding some cycles from cycledef_prod (NOAA-EMC#1390) * add CYCLEDEF_PROD_EXCLUDE to allow exclude some cycles * fix a typo * [v2.1.3-5.0] hotfix on smart_post_groups.py after adding CYCLEDEF_PROD_EXCLUDE (NOAA-EMC#1391) * [v2.1.3-5.1] several updates for RRFSv2X (NOAA-EMC#1393) * if no DA at coldstart cycles, remove them from associated cycledef * comment out config_mynn_sfcflux_land in namelist.atmosphere until updating MPAS-Model again * update MPAS-Model - cmake hotfix and output at flexible time levels * update jedivar.py to use correct cycledef if no cold DA * update getkf.py to use correct cycldef if no cold DA * introduce MPASOUT_TIMELEVELS to specify only output mpasout files in the first few hours * address the linter comments * [v2.1.3-5.2] Add ability to specify GOES IDs for nonvariational cloud analysis (NOAA-EMC#1380) * initial attempt to add GOES IDs for nonvar cld ana * initial changes to add GOES IDs for nonvar cld ana pt 2 * Add GOES IDs to nonvar_bufrobs.py * Add automatic checking for GOES IDs * Remove unnecessary curly brackets --------- * [v2.1.3-5.3] Updates related to running nonvar cloud analysis in realtime (NOAA-EMC#1396) * Loosen realtime nonvar cloud ana dependencies * make exrrfs_nonvar_cldana.sh more lenient Updated script does not crash if some processed obs are not available or if the program output is not created * Add ability to skip nonvar cloud analysis task during cold starts * Bug fixes in nonvar_cldana.py * address code review comments --------- * [v2.1.3-5.4] Update the invariant.nc and bumploc files for NSSL L60 (NOAA-EMC#1399) * Update the invariant.nc and bumploc files for conus3km and conus12km, using the NSSL L60.txt * Update exp files to use the NSSL L60 --------- * [v2.1.3-5.5] add blending fix files for conus3km (NOAA-EMC#1400) * [v2.1.3-5.6] Use the MPAS-Model `output_done_marker` files (NOAA-EMC#1401) * update MPAS-Model to allow generating output done marker files * add output_done_marker="yes" in streams.atmosphere * save_for_next now depends on the output done marker files * fine tuning * default MPASOUT_TIMELEVELS to "0 1" --------- * [v2.1.3-5.7] Add mpas blending code as a submodule in sorc directory (NOAA-EMC#1397) * Add mpas blending repository to sorc directory as a submodule * Use GSL_develop branch for mpas blending. * Compile mpas blending code. * Switch MPAS blending submodule to RRFSx space * Add ignore=all for MPASBlend --------- * [v2.1.3-5.8] Update RRFS_UTILS (NOAA-EMC#1403) * [v2.1.3-5.9] mpassit updates: use invariant.nc for grid_file_input_grid and read zs/dzs from hist_file_input_grid (NOAA-EMC#1404) * mpassit updates: use invariant.nc for grid_file_input_grid and read zs/dzs from hist_file_input_grid * add a dependency for the clean task to avoid running many clean tasks at the same time * update the MPASSIT submodule --------- * [v2.1.3-6.0] RRFSv2X hotfix - prep_ic, recenter (NOAA-EMC#1405) * Fix prep_ic bug * Add missing file warning for refl10m * Update exp.rrfsv2x_ens * fix the alignment * Fix fcst dep on recenter * Modify the var list for surface update * minor fix * Change max pool size to 80 to speed up getkf observer * [v2.1.3-6.1] Updates for timing of MRMS reflectivity processing (NOAA-EMC#1408) - settings affecting timing of real-time MRMS reflectivity preprocessing and availability of reflectivity data for GETKF * [v2.1.3-6.2] Add mpas blending task to RRFSv2x (NOAA-EMC#1409) * Add mpas blening scripts to RRFSv2x * Update exp.conus3km and prep_ic script for global blending * Update mpas blending scripts * Update prep_ic script to add blending option. * Update fcst and jedivar python script for indentation of 4. * Update mpas blending python script * Update prep_ic.py script * Remove datadep option for spinup cycles. * Update blending run script and jedivar.py. --------- --------- Co-authored-by: Guoqing Ge <[email protected]> Co-authored-by: daviddowellNOAA <[email protected]> Co-authored-by: EricJames-NOAA <[email protected]> Co-authored-by: keenaneure <[email protected]> Co-authored-by: chunhua zhou <[email protected]> Co-authored-by: Junjun-NOAA <[email protected]> Co-authored-by: ShawnMurdzek-NOAA <[email protected]> Co-authored-by: RuifangLi7 <[email protected]>
This PR updates MPAS-Model to the latest v8.3.1-2.15, modifies
namelist.atmosphereaccordingly and adds required new TEMPO_v3 fix files.@Junjun-NOAA Could you help run retros to compare the forecast performance before and after this PR? Thanks!