Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
30 commits
Select commit Hold shift + click to select a range
49ef967
making feature branch, initial testing
cwhitlock-NOAA Mar 28, 2025
83f9f64
working with split-netcdf
cwhitlock-NOAA Apr 28, 2025
7e36fbb
Merge branch 'main' into 51.var.filtering
cwhitlock-NOAA Apr 29, 2025
91db3b7
updating split-netcdf-regrid and split-netcdf-native in flow.cylc to …
cwhitlock-NOAA Apr 29, 2025
a8181a3
adding new tool for splitting vars with variable filtering: fre pp sp…
cwhitlock-NOAA May 1, 2025
0ac1bae
updating for modified var filtering
cwhitlock-NOAA May 9, 2025
8a2168e
Merge branch 'main' into 51.var.filtering
cwhitlock-NOAA May 9, 2025
8a1e95e
removing split-netcdf, split-netcdf-python; slight tweaks to flow.cylc
cwhitlock-NOAA May 9, 2025
4afed24
Update environment.yml
ilaflott May 9, 2025
cbd34b2
moving script definition from env to inherit
cwhitlock-NOAA May 9, 2025
17f9865
adding direct call to yaml config
cwhitlock-NOAA May 13, 2025
404e692
adding --split-all-vars to avoid parsing yaml with $component for var…
cwhitlock-NOAA May 14, 2025
9abd910
keeping up with the changes
cwhitlock-NOAA May 14, 2025
6432623
modfying environment setup, adding developer notes on how to use fre-cli
cwhitlock-NOAA May 16, 2025
59ba6dd
Merge branch 'main' into 51.var.filtering
cwhitlock-NOAA May 16, 2025
0538911
adding fre/{{ VERSION }} module loads to documentation and script
cwhitlock-NOAA May 19, 2025
00ba011
removing mkdir from the sites/$site.cylc files
cwhitlock-NOAA May 19, 2025
41477e5
adding history_file back in
cwhitlock-NOAA May 19, 2025
d3b484a
Merge branch 'main' into 51.var.filtering
cwhitlock-NOAA May 20, 2025
b47cb85
adding set and unset of bash unbound var checking for conda activation
cwhitlock-NOAA May 20, 2025
e6132f3
adding use_subdirs setting back in because it looks like subsequent t…
cwhitlock-NOAA May 20, 2025
8dd6ccf
fixing missing $ in $outputDir
cwhitlock-NOAA May 20, 2025
28e89ed
turning off env call to local fre-cli
cwhitlock-NOAA May 21, 2025
c1a02e7
updating developer notes
cwhitlock-NOAA May 27, 2025
b3fba21
removing module load miniforge from split-netcdf pre-script in flow.cylc
cwhitlock-NOAA Jun 4, 2025
6605019
addking mkdir for split-netcdf into flow.cylc
cwhitlock-NOAA Jun 4, 2025
a6c0050
removing mkdir in flow.cylc that never gets activated; adding mdkir t…
cwhitlock-NOAA Jun 6, 2025
0e647b6
adding full path to experiment yaml in split-netcdf function call
cwhitlock-NOAA Jun 23, 2025
7064267
Merge branch 'main' into 51.turning.on.var.filtering
cwhitlock-NOAA Jul 14, 2025
37bcd27
adding split-netcdf mkdir back into site files
cwhitlock-NOAA Jul 14, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 0 additions & 11 deletions app/split-netcdf-python/README.md

This file was deleted.

94 changes: 0 additions & 94 deletions app/split-netcdf-python/bin/split-netcdf

This file was deleted.

18 changes: 0 additions & 18 deletions app/split-netcdf-python/meta/rose-meta.conf

This file was deleted.

4 changes: 0 additions & 4 deletions app/split-netcdf-python/rose-app.conf

This file was deleted.

182 changes: 0 additions & 182 deletions app/split-netcdf/bin/split-netcdf

This file was deleted.

18 changes: 0 additions & 18 deletions app/split-netcdf/meta/rose-meta.conf

This file was deleted.

4 changes: 0 additions & 4 deletions app/split-netcdf/rose-app.conf

This file was deleted.

19 changes: 12 additions & 7 deletions flow.cylc
Original file line number Diff line number Diff line change
Expand Up @@ -620,28 +620,33 @@ rename-split-to-pp-regrid<regrid_static> => remap-pp-components-static => combin
{% endif %}

[[SPLIT-NETCDF]]
pre-script = mkdir -p $outputDir
script = rose task-run --verbose --app-key split-netcdf

[[[environment]]]
{# $date was used as an input arg in the earlier version of #}
{# split-netcdf without getting referenced in the script itself. #}
{# I think it's a reference to an older script that got removed in #}
{# the first round of cylc rewrites; keeping it here in case #}
{# we turn out to need it during the user testing. #}
date = $CYLC_TASK_CYCLE_POINT

{% if DO_NATIVE %}
[[SPLIT-NETCDF-NATIVE]]
inherit = SPLIT-NETCDF
script = fre pp split-netcdf-wrapper -i $inputDir -o $outputDir -s $history_file -c $component -y $CYLC_WORKFLOW_RUN_DIR/{{ YAML }}
[[[environment]]]
inputDir = $CYLC_WORKFLOW_SHARE_DIR/cycle/$CYLC_TASK_CYCLE_POINT/history/native
outputDir = $CYLC_WORKFLOW_SHARE_DIR/cycle/$CYLC_TASK_CYCLE_POINT/split/native
component = $CYLC_TASK_PARAM_native
history_file = $CYLC_TASK_PARAM_native
{% endif %}

{% if DO_REGRID %}
[[SPLIT-NETCDF-REGRID]]
inherit = SPLIT-NETCDF
script = fre pp split-netcdf-wrapper -i $inputDir -o $outputDir -s $history_file -c $component -y $CYLC_WORKFLOW_RUN_DIR/{{ YAML }} --use-subdirs
[[[environment]]]
inputDir = $CYLC_WORKFLOW_SHARE_DIR/cycle/$CYLC_TASK_CYCLE_POINT/history/regrid-xy
outputDir = $CYLC_WORKFLOW_SHARE_DIR/cycle/$CYLC_TASK_CYCLE_POINT/split/regrid-xy
use_subdirs = 1
component = $CYLC_TASK_PARAM_regrid
history_file = $CYLC_TASK_PARAM_regrid
{% endif %}

{% if DO_NATIVE %}
Expand All @@ -652,7 +657,7 @@ rename-split-to-pp-regrid<regrid_static> => remap-pp-components-static => combin
[[split-netcdf-native<native_static>]]
inherit = SPLIT-NETCDF-NATIVE, <native_static>
[[[environment]]]
component = $CYLC_TASK_PARAM_native_static
history_file = $CYLC_TASK_PARAM_native_static
{% endif %}
{% endif %}

Expand All @@ -664,7 +669,7 @@ rename-split-to-pp-regrid<regrid_static> => remap-pp-components-static => combin
[[split-netcdf-regrid<regrid_static>]]
inherit = SPLIT-NETCDF-REGRID, <regrid_static>
[[[environment]]]
component = $CYLC_TASK_PARAM_regrid_static
history_file = $CYLC_TASK_PARAM_regrid_static
{% endif %}
{% endif %}

Expand Down
Loading
Loading