Skip to content

Extend regression testing with more models and increased simulation time #819

Description

@LuukBlom

Kind of request

Adding new functionality

Enhancement Description

Given the merged PR: #793 that sets up the framework and adds 2 models to the regression tests.
We want to add to the regression testing by adding more models / modelvariants AND increasing the simulation time from 3 days to 1 year.

Already discussed with @JoostBuitink and @vers-w:

  • Add more variants of the Moselle model: wflow_kinematic_wave, wflow_local_inertial, wflow_local_inertial_1D, wflow_local_inertial_2D using the workflow.yml below:
Details
steps:
  - setup_config: # options parsed to wflow toml file <section>.<option>
      data:
        time.starttime: 2010-01-01T00:00:00
        time.endtime: 2010-03-31T00:00:00
        time.timestepsecs: 86400
        input.path_forcing: inmaps-era5-2010.nc
        output.netcdf_grid.path: output.nc
        output.netcdf_grid.compressionlevel: 1
        output.netcdf_grid.variables.atmosphere_water__precipitation_volume_flux: precip
        output.netcdf_grid.variables.vegetation_canopy_water__interception_volume_flux: vegetation_interception
        output.netcdf_grid.variables.land_surface_water__depth: land_h
        output.netcdf_grid.variables.land_surface_water__volume_flow_rate: land_q
        output.netcdf_grid.variables.river_water__depth: river_h
        output.netcdf_grid.variables.river_water__volume_flow_rate: river_q

  - setup_basemaps:
      hydrography_fn: merit_hydro # source hydrography data {merit_hydro, merit_hydro_1k}
      basin_index_fn: merit_hydro_index # source of basin index corresponding to hydrography_fn
      upscale_method: ihu # upscaling method for flow direction data, by default 'ihu'
      res: 0.00833 # build the model at a 30 arc sec (~1km) resolution
      region: # model region
        subbasin: [7.58529, 50.36811]
        strord: 4 # snapped to a river with minimum stream order (strord) of 4
        bounds: [5.0, 47.0, 8.0, 51.0] # within the given bounds [xmin, ymin, xmax, ymax] (WGS84)

  - setup_rivers:
      hydrography_fn: merit_hydro # source hydrography data, should correspond to hydrography_fn in setup_basemaps
      river_geom_fn: hydro_rivers_lin # river source data with river width and bankfull discharge
      river_upa: 30 # minimum upstream area threshold for the river map [km2]
      rivdph_method: powlaw # method to estimate depth {'powlaw', 'manning', 'gvf'}
      min_rivdph: 1 # minimum river depth [m]
      min_rivwth: 30 # minimum river width [m]
      slope_len: 2000 # length over which tp calculate river slope [m]
      smooth_len: 5000 # length over which to smooth river depth and river width [m]
      river_routing: kinematic_wave # {'kinematic_wave', 'local_inertial'}

  - setup_river_roughness:

  - setup_reservoirs_simple_control:
      reservoirs_fn: hydro_reservoirs # source for reservoirs shape and attributes
      timeseries_fn: gww # additional source for reservoir are timeseries to compute reservoirs, Either 'gww' using gwwapi or 'jrc' using hydroengine.
      min_area: 1.0 # minimum lake area to consider [km2]

  - setup_reservoirs_no_control:
      reservoirs_fn: hydro_lakes # source for uncontrolled reservoirs (e.g. lakes) based on hydroLAKES: {hydro_lakes}
      min_area: 10.0 # minimum reservoir area to consider [km2]

  - setup_glaciers:
      glaciers_fn: rgi # source for glaciers based on Randolph Glacier Inventory {rgi}
      min_area: 0.0 # minimum glacier area to consider [km2]

  - setup_lulcmaps:
      lulc_fn: globcover # source for lulc maps: {globcover, vito, corine}
      lulc_mapping_fn: globcover_mapping_default # default mapping for lulc classes

  - setup_laimaps:
      lai_fn: modis_lai # source for Leaf Area Index: {modis_lai}

  - setup_soilmaps:
      soil_fn: soilgrids # source for soilmaps: {soilgrids}
      ptf_ksatver: brakensiek # pedotransfer function to calculate hydraulic conductivity: {brakensiek, cosby}

  - setup_outlets:
      river_only: True

  - setup_gauges:
      gauges_fn: grdc # if not None add gaugemap. Either a path or known gauges_fn: {grdc}
      snap_to_river: True # if True snaps gauges from source to river
      derive_subcatch: True # if True derive subcatch map based on gauges.

  - setup_precip_forcing:
      precip_fn: era5 # source for precipitation.
      precip_clim_fn: # source for high resolution climatology to correct precipitation if any.

  - setup_temp_pet_forcing:
      temp_pet_fn: era5 # source for temperature and potential evapotranspiration.
      press_correction: True # if True temperature is corrected with elevation lapse rate.
      temp_correction: True # if True pressure is corrected with elevation lapse rate.
      dem_forcing_fn: era5_orography # source of elevation grid corresponding to temp_pet_fn. Used for lapse rate correction.
      pet_method: debruin # method to compute PET: {debruin, makkink}
      skip_pet: False # if True, only temperature is prepared.

  - setup_constant_pars:
      "subsurface_water__horizontal_to_vertical_saturated_hydraulic_conductivity_ratio": 100
      "snowpack__degree_day_coefficient": 3.75653
      "soil_surface_water__infiltration_reduction_parameter": 0.038
      "vegetation_canopy_water__mean_evaporation_to_mean_precipitation_ratio": 0.11
      "compacted_soil_surface_water__infiltration_capacity": 10
      "soil_water_saturated_zone_bottom__max_leakage_volume_flux": 0
      "soil_wet_root__sigmoid_function_shape_parameter": -500
      "atmosphere_air__snowfall_temperature_threshold": 0
      "atmosphere_air__snowfall_temperature_interval": 2
      "snowpack__melting_temperature_threshold": 0
      "snowpack__liquid_water_holding_capacity": 0.1
      "glacier_ice__degree_day_coefficient": 3
      "glacier_firn_accumulation__snowpack_dry_snow_leq_depth_fraction": 0.001
      "glacier_ice__melting_temperature_threshold": 0

  - config.write:
      filename: wflow_kinematic_wave.toml

  - setup_rivers:
      hydrography_fn: merit_hydro # source hydrography data, should correspond to hydrography_fn in setup_basemaps
      river_geom_fn: hydro_rivers_lin # river source data with river width and bankfull discharge
      river_upa: 30 # minimum upstream area threshold for the river map [km2]
      rivdph_method: powlaw # method to estimate depth {'powlaw', 'manning', 'gvf'}
      min_rivdph: 1 # minimum river depth [m]
      min_rivwth: 30 # minimum river width [m]
      slope_len: 2000 # length over which tp calculate river slope [m]
      smooth_len: 5000 # length over which to smooth river depth and river width [m]
      river_routing: local_inertial # {'kinematic_wave', 'local_inertial'}

  - config.write:
      filename: wflow_local_inertial.toml

  - setup_floodplains: # if 1D floodplains are required
      hydrography_fn: merit_hydro # source hydrography data, should correspond to hydrography_fn in setup_basemaps
      floodplain_type: 1d # If one-dimensional floodplains are required
      flood_depths: # flood depths at which a volume is derived
        - 0.5
        - 1.0
        - 1.5
        - 2.0
        - 2.5
        - 3.0
        - 4.0
        - 5.0

  - config.write:
      filename: wflow_local_inertial_1D.toml

  - setup_floodplains:
      hydrography_fn: merit_hydro
      floodplain_type: 2d
      elevtn_map: land_elevation

  - config.write:
      filename: wflow_local_inertial_2D.toml


  - write:

Use case

No response

Additional Context

original issue: Deltares/hydromt#1408
PR: #793

Increased simulation time raises network errors

When developing the PR, I have tried running the whole pipeline with simulation times of ~1 year.
This would lead to errors similar to the ones below when building the model.

Details
2026-07-30 13:24:24,062 - hydromt.model.model - model - INFO - build: setup_precip_forcing
2026-07-30 13:24:24,063 - hydromt.model.model - model - INFO - setup_precip_forcing.precip_clim_fn=None
2026-07-30 13:24:24,063 - hydromt.model.model - model - INFO - setup_precip_forcing.chunksize=None
2026-07-30 13:24:24,063 - hydromt.model.model - model - INFO - setup_precip_forcing.precip_fn=era5_hourly
2026-07-30 13:24:24,065 - hydromt.data_catalog.sources.data_source - data_source - INFO - Reading era5_hourly RasterDataset data from https://api.earthdatahub.destine.eu/era5/reanalysis-era5-single-levels-v0.zarr
2026-07-30 13:26:04,710 - hydromt - log - ERROR - Unhandled exception occured.
Traceback (most recent call last):
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\hydromt\log.py", line 179, in to_file
    yield
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\hydromt\model\model.py", line 324, in build
    method(**merged)
    ~~~~~~^^^^^^^^^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\hydromt_wflow\wflow_sbm.py", line 3301, in setup_precip_forcing
    precip = self.data_catalog.get_rasterdataset(
        precip_fn,
    ...<3 lines>...
        variables=["precip"],
    )
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\hydromt\data_catalog\data_catalog.py", line 1477, in get_rasterdataset
    return source.read_data(
           ~~~~~~~~~~~~~~~~^
        bbox=bbox,
        ^^^^^^^^^^
    ...<7 lines>...
        single_var_as_array=single_var_as_array,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    )
    ^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\hydromt\data_catalog\sources\rasterdataset.py", line 84, in read_data
    ds: xr.Dataset = self.driver.read(
                     ~~~~~~~~~~~~~~~~^
        uris,
        ^^^^^
    ...<5 lines>...
        metadata=self.metadata,
        ^^^^^^^^^^^^^^^^^^^^^^^
    )
    ^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\hydromt\data_catalog\drivers\raster\raster_xarray_driver.py", line 124, in read
    for ds in self._open_zarrs(filtered_uris, self.options.get_kwargs())
              ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\hydromt\data_catalog\drivers\raster\raster_xarray_driver.py", line 204, in _open_zarrs
    ds = xr.open_zarr(_uri, **read_kwargs)
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\xarray\backends\zarr.py", line 1658, in open_zarr
    ds = open_dataset(
        filename_or_obj=store,
    ...<16 lines>...
        use_zarr_fill_value_as_mask=use_zarr_fill_value_as_mask,
    )
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\xarray\backends\api.py", line 607, in open_dataset
    backend_ds = backend.open_dataset(
        filename_or_obj,
    ...<2 lines>...
        **kwargs,
    )
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\xarray\backends\zarr.py", line 1732, in open_dataset
    store = ZarrStore.open_group(
        filename_or_obj,
    ...<10 lines>...
        cache_members=cache_members,
    )
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\xarray\backends\zarr.py", line 771, in open_group
    ) = _get_open_params(
        ~~~~~~~~~~~~~~~~^
        store=store,
        ^^^^^^^^^^^^
    ...<9 lines>...
        zarr_format=zarr_format,
        ^^^^^^^^^^^^^^^^^^^^^^^^
    )
    ^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\xarray\backends\zarr.py", line 1940, in _get_open_params
    zarr_root_group = zarr.open_consolidated(store, **open_kwargs)
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\zarr\api\synchronous.py", line 234, in open_consolidated
    sync(async_api.open_consolidated(*args, use_consolidated=use_consolidated, **kwargs))
    ~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\zarr\core\sync.py", line 158, in sync
    raise return_result
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\zarr\core\sync.py", line 118, in _runner
    return await coro
           ^^^^^^^^^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\zarr\api\asynchronous.py", line 396, in open_consolidated
    return await open_group(*args, use_consolidated=use_consolidated, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\zarr\api\asynchronous.py", line 831, in open_group
    return await AsyncGroup.open(
           ^^^^^^^^^^^^^^^^^^^^^^
        store_path, zarr_format=zarr_format, use_consolidated=use_consolidated
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    )
    ^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\zarr\core\group.py", line 567, in open
    ) = await asyncio.gather(
        ^^^^^^^^^^^^^^^^^^^^^
    ...<4 lines>...
    )
    ^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\zarr\storage\_common.py", line 162, in get
    return await self.store.get(self.path, prototype=prototype, byte_range=byte_range)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\zarr\storage\_fsspec.py", line 289, in get
    value = prototype.buffer.from_bytes(await self.fs._cat_file(path))
                                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\fsspec\implementations\http.py", line 248, in _cat_file
    async with session.get(self.encode_url(url), **kw) as r:
               ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\aiohttp\client.py", line 1683, in __aenter__
    self._resp: _RetType_co = await self._coro
                              ^^^^^^^^^^^^^^^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\aiohttp\client.py", line 856, in _request
    resp = await handler(req)
           ^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\aiohttp\client.py", line 834, in _connect_and_send_request
    await resp.start(conn)
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\aiohttp\client_reqrep.py", line 558, in start
    message, payload = await protocol.read()  # type: ignore[union-attr]
                       ^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\aiohttp\streams.py", line 705, in read
    await self._waiter
aiohttp.client_exceptions.ServerDisconnectedError: Server disconnected
Traceback (most recent call last):
  File "<frozen runpy>", line 203, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Scripts\hydromt.exe\__main__.py", line 10, in <module>
    sys.exit(main())
             ~~~~^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\click\core.py", line 1569, in __call__
    return self.main(*args, **kwargs)
           ~~~~~~~~~^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\click\core.py", line 1490, in main
    rv = self.invoke(ctx)
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\click\core.py", line 1970, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
                           ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\click\core.py", line 1353, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           ~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\click\core.py", line 907, in invoke
    return callback(*args, **kwargs)
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\click\decorators.py", line 34, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\hydromt\cli\main.py", line 259, in build
    mod.build(steps=steps)
    ~~~~~~~~~^^^^^^^^^^^^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\hydromt\model\model.py", line 324, in build
    method(**merged)
    ~~~~~~^^^^^^^^^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\hydromt_wflow\wflow_sbm.py", line 3301, in setup_precip_forcing
    precip = self.data_catalog.get_rasterdataset(
        precip_fn,
    ...<3 lines>...
        variables=["precip"],
    )
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\hydromt\data_catalog\data_catalog.py", line 1477, in get_rasterdataset
    return source.read_data(
           ~~~~~~~~~~~~~~~~^
        bbox=bbox,
        ^^^^^^^^^^
    ...<7 lines>...
        single_var_as_array=single_var_as_array,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    )
    ^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\hydromt\data_catalog\sources\rasterdataset.py", line 84, in read_data
    ds: xr.Dataset = self.driver.read(
                     ~~~~~~~~~~~~~~~~^
        uris,
        ^^^^^
    ...<5 lines>...
        metadata=self.metadata,
        ^^^^^^^^^^^^^^^^^^^^^^^
    )
    ^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\hydromt\data_catalog\drivers\raster\raster_xarray_driver.py", line 124, in read
    for ds in self._open_zarrs(filtered_uris, self.options.get_kwargs())
              ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\hydromt\data_catalog\drivers\raster\raster_xarray_driver.py", line 204, in _open_zarrs
    ds = xr.open_zarr(_uri, **read_kwargs)
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\xarray\backends\zarr.py", line 1658, in open_zarr
    ds = open_dataset(
        filename_or_obj=store,
    ...<16 lines>...
        use_zarr_fill_value_as_mask=use_zarr_fill_value_as_mask,
    )
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\xarray\backends\api.py", line 607, in open_dataset
    backend_ds = backend.open_dataset(
        filename_or_obj,
    ...<2 lines>...
        **kwargs,
    )
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\xarray\backends\zarr.py", line 1732, in open_dataset
    store = ZarrStore.open_group(
        filename_or_obj,
    ...<10 lines>...
        cache_members=cache_members,
    )
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\xarray\backends\zarr.py", line 771, in open_group
    ) = _get_open_params(
        ~~~~~~~~~~~~~~~~^
        store=store,
        ^^^^^^^^^^^^
    ...<9 lines>...
        zarr_format=zarr_format,
        ^^^^^^^^^^^^^^^^^^^^^^^^
    )
    ^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\xarray\backends\zarr.py", line 1940, in _get_open_params
    zarr_root_group = zarr.open_consolidated(store, **open_kwargs)
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\zarr\api\synchronous.py", line 234, in open_consolidated
    sync(async_api.open_consolidated(*args, use_consolidated=use_consolidated, **kwargs))
    ~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\zarr\core\sync.py", line 158, in sync
    raise return_result
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\zarr\core\sync.py", line 118, in _runner
    return await coro
           ^^^^^^^^^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\zarr\api\asynchronous.py", line 396, in open_consolidated
    return await open_group(*args, use_consolidated=use_consolidated, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\zarr\api\asynchronous.py", line 831, in open_group
    return await AsyncGroup.open(
           ^^^^^^^^^^^^^^^^^^^^^^
        store_path, zarr_format=zarr_format, use_consolidated=use_consolidated
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    )
    ^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\zarr\core\group.py", line 567, in open
    ) = await asyncio.gather(
        ^^^^^^^^^^^^^^^^^^^^^
    ...<4 lines>...
    )
    ^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\zarr\storage\_common.py", line 162, in get
    return await self.store.get(self.path, prototype=prototype, byte_range=byte_range)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\zarr\storage\_fsspec.py", line 289, in get
    value = prototype.buffer.from_bytes(await self.fs._cat_file(path))
                                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\fsspec\implementations\http.py", line 248, in _cat_file
    async with session.get(self.encode_url(url), **kw) as r:
               ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\aiohttp\client.py", line 1683, in __aenter__
    self._resp: _RetType_co = await self._coro
                              ^^^^^^^^^^^^^^^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\aiohttp\client.py", line 856, in _request
    resp = await handler(req)
           ^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\aiohttp\client.py", line 834, in _connect_and_send_request
    await resp.start(conn)
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\aiohttp\client_reqrep.py", line 558, in start
    message, payload = await protocol.read()  # type: ignore[union-attr]
                       ^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\.pixi\envs\default\Lib\site-packages\aiohttp\streams.py", line 705, in read
    await self._waiter
aiohttp.client_exceptions.ServerDisconnectedError: Server disconnected
Traceback (most recent call last):
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\tests\regression\run_pipeline.py", line 119, in <module>
    main()
    ~~~~^^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\tests\regression\run_pipeline.py", line 75, in main
    sbm_root, sbm_build_time = build_sbm(
                               ~~~~~~~~~^
        project_root=project_root,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^
    ...<4 lines>...
        verbosity=args.verbosity,
        ^^^^^^^^^^^^^^^^^^^^^^^^^
    )
    ^
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\tests\regression\regression_utils.py", line 179, in build_sbm
    elapsed = _run(cmd)
  File "C:\ProgramData\devdrive\repos\hydromt_wflow\tests\regression\regression_utils.py", line 132, in _run
    raise RuntimeError(
        f"Command failed with exit code {result.returncode}: {' '.join(cmd)}"
    )
RuntimeError: Command failed with exit code 1: hydromt build wflow_sbm C:\ProgramData\devdrive\repos\hydromt_wflow\tests\regression\.runs\wflow_sbm\piave -i C:\ProgramData\devdrive\repos\hydromt_wflow\tests\regression\piave\build_sbm.yml -d C:\ProgramData\devdrive\repos\hydromt_wflow\examples\data\demand\data_catalog.yml -d C:\ProgramData\devdrive\repos\hydromt_wflow\hydromt_wflow\data\parameters_data.yml -d artifact_data -d deltares_data -d earthdatahub_data --fo -v

Not all errors were exactly this, some were also raised while reading netcdf files from the P drive, which is why I changed the workflows to use earthdatahub instead.
Clearly, this didnt resolve all errors.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions