Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Establish pipeline #8

Open
wants to merge 8 commits into
base: master
Choose a base branch
from

Conversation

radistoubalidis
Copy link

@radistoubalidis radistoubalidis commented Aug 1, 2022

Add dvc pipeline to Colombia Case

Description

The goal of this PR is :

  • create a dvc pipeline containing the stages as described in Standalone_GCBM\readme.txt
  • establish an action that when someone pushes a new run from a new branch is uses dvc to publish differences between the post-processing plots or other parameters.

Similar to GCBM.Belize

Type of change

  • New feature (non-breaking change which adds functionality)
  • This change requires a documentation update

Additional Context (Please include any Screenshots/gifs if relevant)

Follow the dvc installation and pipeline execution guide in pipeline.md to run the pipeline locally.

output of dvc stage list

tiler                       Outputs ..\..\logs\tiler_log.txt
recliner2gcbm_x64           Outputs logs\recliner_log.txt
add_species_vol_to_bio      Outputs logs\add_species_vol_to_bio.log
modify_root_parameters      Outputs logs\modify_root_parameters.log
modify_decay_parameters     Outputs logs\modify_decay_parameters.log
modify_turnover_parameters  Outputs logs\modify_turnover_parameters.log
modify_spinup_parameters    Outputs logs\modify_spinup_parameters.log
update_gcbm_configuration   Outputs ..\logs\update_gcbm_config.log
run_gcbm                    Outputs ..\logs\Moja_Debug.log
create_tiffs                Outputs ..\..\logs\create_tiffs.log, ..\..\processed_output\spatial
compile_results             Outputs ..\..\logs\compile_results.log
postprocessing              Reports metrics, Figures/Colombia_Sensitivity_TropicalDry.png, Figures/Colombia

@radistoubalidis radistoubalidis marked this pull request as draft August 1, 2022 13:17
@radistoubalidis radistoubalidis changed the title adds postprocessing directory Establish pipeline Aug 3, 2022
@radistoubalidis radistoubalidis marked this pull request as ready for review August 3, 2022 12:28
@radistoubalidis
Copy link
Author

Pipeline's flowchart

flowchart TD
        node1[add_species_vol_to_bio]
        node2[compile_results]
        node3[create_tiffs]
        node4[modify_decay_parameters]
        node5[modify_root_parameters]
        node6[modify_spinup_parameters]
        node7[modify_turnover_parameters]
        node8[postprocessing]
        node9[recliner2gcbm_x64]
        node10[run_gcbm]
        node11[tiler]
        node12[update_gcbm_configuration]
        node1-->node5
        node2-->node8
        node3-->node2
        node4-->node7
        node5-->node4
        node6-->node12
        node7-->node6
        node9-->node1
        node10-->node3
        node11-->node9
        node12-->node10
Loading

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant