Update MOM6 with inline-CDEPS capability

[DeniseWorthen]

Commit Queue Requirements:

• This PR addresses a relevant WM issue (if not, create an issue).
• All subcomponent pull requests (if any) have been reviewed by their code managers.
• Run the full Intel+GNU RT suite (compared to current baselines), preferably on Ursa (Derecho or Hercules are acceptable alternatives). Exceptions: documentation-only PRs, CI-only PRs, etc.
  • Commit log file w/full results from RT suite run (if applicable).
  • Verify that test_changes.list indicates which tests, if any, are changed by this PR. Commit test_changes.list, even if it is empty.
• Fill out all sections of this template.

---

Description:

Updates MOM6 to include CDEPS inline capability.

Commit Message:

 * MOM6 - enable CDEPS inline 

Priority:

• Normal

Git Tracking

UFSWM:

• Closes Add CDEPS inline capability to MOM6 NUOPC cap NOAA-EMC/MOM6#153

Sub component Pull Requests:

• Closes Add CDEPS inline capability to MOM6 cap NOAA-EMC/MOM6#167

UFSWM Blocking Dependencies:

• None

Documentation:

• Documentation update NOT required.
  • Explanation: CDEPS inline documentation exists https://escomp.github.io/CDEPS/versions/master/html/index.html

---

Changes

Regression Test Changes (Please commit test_changes.list):

• No Baseline Changes.

Input data Changes:

• None.

Library Changes/Upgrades:

• No Updates

---

Testing Log:

• RDHPCS
  • Hera
  • Orion
  • Hercules
  • GaeaC6
  • Derecho
  • Ursa
• WCOSS2
  • Dogwood/Cactus
  • Acorn
• CI
• opnReqTest (complete task if unnecessary)

[DeniseWorthen]

@FernandoAndrade-NOAA Don't worry. I was able to compare a single test. I don't have any ideas right now about what is going on, other than I think it has to be in the build to compile the parts of CDEPS I need inside of MOM6.

The debug case is working fine.

[DeniseWorthen]

@FernandoAndrade-NOAA I would prefer you move on today to the next available PR. I don't know how long it will take me to figure out why this is failing on Gaea.

[DeniseWorthen]

@FernandoAndrade-NOAA I'm also not able to even log onto C6 today. I know C5 is having facility work, but we were told that C6 would be unaffected. Are you able to log into C6?

EDIT: I've been able to log into gaea63 now.

[FernandoAndrade-NOAA]

@FernandoAndrade-NOAA I would prefer you move on today to the next available PR. I don't know how long it will take me to figure out why this is failing on Gaea.

Understood, we'll move onto the next PR thank you.

[DeniseWorthen]

@FernandoAndrade-NOAA I've made a fix and tested on C6 for a subset (26) of the failing tests, all of which now pass. I had to modify the Cmake build because on C6, there are special flags applied to MOM6 compilation

ufs-weather-model/cmake/configure_gaeac6.intel.cmake

Line 2 in f8b0802

set(MOM6_Extra_FORTRAN_FLAGS "-xsse2")

And that flag was getting used to build CDEPS. I think I've done things "the right way" now, but other platforms will need to be verified again.

I am seeing excessively long compile times for some jobs on C6. Have you noticed that?

[JessicaMeixner-NOAA]

I've seen weird filesystem / slow runtimes in general today on c6.

[FernandoAndrade-NOAA]

@FernandoAndrade-NOAA I've made a fix and tested on C6 for a subset (26) of the failing tests, all of which now pass. I had to modify the Cmake build because on C6, there are special flags applied to MOM6 compilation

ufs-weather-model/cmake/configure_gaeac6.intel.cmake

Line 2 in f8b0802

set(MOM6_Extra_FORTRAN_FLAGS "-xsse2")

And that flag was getting used to build CDEPS. I think I've done things "the right way" now, but other platforms will need to be verified again.

I am seeing excessively long compile times for some jobs on C6. Have you noticed that?

I've seen weird filesystem / slow runtimes in general today on c6.

I'm wondering if the extended C5 maintenance is somehow affecting this, I'll be sure to compare compile times with the current PR against develop when those finish on C6.

[FernandoAndrade-NOAA]

Just leaving a note here that I do see some relatively significant variation in some of the compile times on C6 with the current PR as well.

[DeniseWorthen]

@FernandoAndrade-NOAA @gspetro-NOAA I ran the full RT on C6. A few compiles were longer, most were w/in normal variablilty. I don't see any pattern which can be attributed to this PR.

[gspetro-NOAA]

Merged via #3044