Commit 33c369f
[issue 1123] restore probabilistic scores (#1128)
* rebase
* add ensemble
* fix deterministic
* fix plotting
* lint
* fix eval_config
* probabilistic scores working now
* lint
* Fix spoofing and refactor handling of multiple source files (#1118)
* Cleaning up spoofing and related code on data preprocessing for model
* Fixed typo
* Updated comments
* Removed merge cells and implemented necessary adjustments
* Fixed forecasting
* Fixed missing handling of NaNs in coordinates and channel data
* Minor clean up
* Fix to removing/renaming variables
* Changed funtion name to improve readability
* Fixed bug with incorrect handling of multiple input datasources.
* Addressed reviewer comments
* resolve conflict
* [1131] fixes circular dependencies (#1134)
* fixes dependencies
* cleanup
* make the type checker not fail
* cleanup
* cleanup of type issues
* Give option to plot only prediction maps (#1139)
* add plot_preds_only feature
* minor changes after comments
* Tell FSDP2 about embedding engine forward functions (#1133)
* Tell FSDP2 about embedding engine forward functions
Note DO NOT add print functions in forward functions of the model, it
will break with FSDP2
* Add comment
* recover 'all' option (#1146)
* Fixed problem in inferecne (#1145)
* implement vrmse (#1147)
* [1144] Extra fixes (#1148)
* Fixed problem in inferecne
* more fixes
* fixes
* lint
* lint
---------
Co-authored-by: Christian Lessig <[email protected]>
* Jk/log grad norms/log grad norms (#1068)
* Log gradient norms
* Prototype for recording grad norms
* Address review changes + hide behind feature flag
* Final fixes including backward compatibility
* Ruff
* More ruff stuff
* forecast config with small decoder
* fixed uv.lock
* test gradient logging on mutli gpus
* update uv.lock to latest develop version
* revert to default confit
* add comment on FSDP2 specifics
* move plot grad script to private repo
* rm seaborn from pyproject
* updating terminal and metrics loggin, add get_tensor_item fct
* check for DTensor instead of world size
* revert forecast fct, fix in separate PR
* rename grad_norm log names to exclude from MLFlow
* add log_grad_norms to default config
---------
Co-authored-by: sophiex <[email protected]>
* Add forecast and observation activity (#1126)
* Add calculation methods for forecast and observation activity metrics in Scores class
* Add new calculation methods for forecast activity metrics in Scores class
* ruff
* fix func name
* Rename observation activity calculation method to target activity in Scores class
* typo
* refactor to common calc_act function for activity
* fix cases
* have calc_tact and calc_fact that use _calc_act for maintainability
* fix small thing in style
---------
Co-authored-by: iluise <[email protected]>
* hotfix: use correct methot `create` instead of `construct` (#1090)
* restore develop
* fix deterministic
* fix plotting
* lint
* fix eval_config
* probabilistic scores working now
* lint
* update utils
* packages/evaluate/src/weathergen/evaluate/score.py
* lint
* removing duplication
---------
Co-authored-by: Christian Lessig <[email protected]>
Co-authored-by: Timothy Hunter <[email protected]>
Co-authored-by: Savvas Melidonis <[email protected]>
Co-authored-by: Sophie X <[email protected]>
Co-authored-by: Julius Polz <[email protected]>
Co-authored-by: Julian Kuehnert <[email protected]>
Co-authored-by: Simon Grasse <[email protected]>1 parent 06188d9 commit 33c369f
File tree
4 files changed
+344
-252
lines changed- packages/evaluate/src/weathergen/evaluate
4 files changed
+344
-252
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
164 | 164 | | |
165 | 165 | | |
166 | 166 | | |
167 | | - | |
168 | 167 | | |
169 | 168 | | |
170 | 169 | | |
| |||
478 | 477 | | |
479 | 478 | | |
480 | 479 | | |
| 480 | + | |
| 481 | + | |
| 482 | + | |
| 483 | + | |
| 484 | + | |
| 485 | + | |
| 486 | + | |
481 | 487 | | |
482 | 488 | | |
483 | 489 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
138 | 138 | | |
139 | 139 | | |
140 | 140 | | |
141 | | - | |
142 | 141 | | |
143 | 142 | | |
144 | 143 | | |
| |||
710 | 709 | | |
711 | 710 | | |
712 | 711 | | |
| 712 | + | |
| 713 | + | |
| 714 | + | |
| 715 | + | |
| 716 | + | |
| 717 | + | |
| 718 | + | |
| 719 | + | |
| 720 | + | |
| 721 | + | |
| 722 | + | |
| 723 | + | |
| 724 | + | |
| 725 | + | |
| 726 | + | |
| 727 | + | |
| 728 | + | |
| 729 | + | |
| 730 | + | |
| 731 | + | |
| 732 | + | |
| 733 | + | |
| 734 | + | |
| 735 | + | |
| 736 | + | |
| 737 | + | |
| 738 | + | |
| 739 | + | |
| 740 | + | |
| 741 | + | |
| 742 | + | |
| 743 | + | |
| 744 | + | |
| 745 | + | |
| 746 | + | |
| 747 | + | |
| 748 | + | |
| 749 | + | |
| 750 | + | |
| 751 | + | |
| 752 | + | |
| 753 | + | |
| 754 | + | |
| 755 | + | |
| 756 | + | |
| 757 | + | |
| 758 | + | |
| 759 | + | |
| 760 | + | |
| 761 | + | |
| 762 | + | |
| 763 | + | |
| 764 | + | |
| 765 | + | |
| 766 | + | |
| 767 | + | |
| 768 | + | |
| 769 | + | |
| 770 | + | |
| 771 | + | |
| 772 | + | |
| 773 | + | |
| 774 | + | |
| 775 | + | |
| 776 | + | |
| 777 | + | |
| 778 | + | |
| 779 | + | |
| 780 | + | |
| 781 | + | |
| 782 | + | |
713 | 783 | | |
714 | 784 | | |
715 | 785 | | |
| |||
737 | 807 | | |
738 | 808 | | |
739 | 809 | | |
740 | | - | |
741 | 810 | | |
742 | 811 | | |
743 | 812 | | |
| |||
0 commit comments