Running FKESSLER on Casper

Here are the detailed steps to create, configure, build and run the FKESSLER case on Casper's HTC CPU node (62 CPU cores per node), using the intel compiler.

Clone the StormSPEED github repo on Casper

cd /glade/derecho/scratch/$USER
git clone git@github.com:NCAR/StormSPEED.git
cd StormSPEED

Check out the stormspeed development branch

git checkout stormspeed

Check out the individual components

./bin/git-fleximod update

Create a case

PLEASE: remember to replace /path_to_your_test_dir with your actual path on Casper.

cd cime/scripts
./create_newcase --case /path_to_your_test_dir --mach casper --compset FKESSLER --res ne30_ne30_mg17 --compiler intel --run-unsupported

Configure the case with customized options

General comments

• remember to replace YOUR_PROJECT_ACCOUNT with your actual project allocation on Casper.
• change NTASKS=62 to NTASKS=124 if you want to use two new HTC compute nodes on Casper.
• change CAM_TARGET to cam, theta-l or theta-l_kokkos to test different dycores.

For 2025 DCMIP workshop:

• the line ./xmlchange JOB_QUEUE='workshop' is needed to access the reserved computational resources.
• the line ./xmlchange CIME_OUTPUT_ROOT=/glade/work/$user is needed since Luster filesystem is overheating and we can not access the scratch space.

cd /path_to_your_test_dir
./xmlchange CIME_OUTPUT_ROOT=/glade/work/$user
./xmlchange NTASKS=62
./xmlchange CAM_TARGET=theta-l
./xmlchange STOP_OPTION=ndays,STOP_N=12,RESUBMIT=0
./xmlchange PROJECT=YOUR_PROJECT_ACCOUNT
./xmlchange JOB_WALLCLOCK_TIME=00:30:00
./xmlchange DOUT_S='FALSE'
./xmlchange JOB_QUEUE='workshop'
./case.setup

Make user changes to the namelists

Example: Change CAM namelist to interpolate history output to a lat/lon format to make visualization easier

cat >> user_nl_cam << EOF
 interpolate_output = .true.
 interpolate_nlat = 192
 interpolate_nlon = 288
EOF

Build the case

./case.build

Run the case

./case.submit