* breaking up modules

* correction shim for backwards compatibility

* configuration refactor

* descope pipeline to shorten

* show exports in init

* type fix

…135)

* add pydantic

* Introduce Pydantic models for configuration with typed sub-models

* Add unit tests for Pydantic-based correction configuration models

* Refactor: Remove legacy alias handling and update parameter access in configuration

* Refactor dataio module: Update documentation and rename data-loader protocol types

* Refactor CorrectionConfig: Simplify data loading process and enhance validation

* Refactor clarreo_data_loaders: Remove loader protocols and transition to config-driven data loading

* Refactor config: Introduce DataConfig for config-driven data loading and remove legacy loader protocols

* Refactor correction.py: Remove legacy loader functions and integrate DataConfig for improved data handling

* Refactor dataio.py: Remove loader protocols and update documentation for validation helpers

* Refactor image_match.py: Remove ImageMatchingFunc protocol and update output validation

* Refactor image_match.py: Remove ImageMatchingFunc protocol and update output validation

* Refactor pipeline.py: Remove mission-specific loader functions and implement internal file loading for telemetry and science data

* Refactor test_config.py: Add tests for DataConfig and remove legacy loader checks

* Refactor test_correction.py: Replace loader functions with DataConfig for file-based loading

* Refactor test_pairing.py: Remove redundant validation tests for pairing output

* Add CLARREO preprocessing script for telemetry and science data

* Refactor clarreo_data_loaders.py: Remove GCPLoader protocol and implement telemetry and science data loading functions

* load instead of open

* Refactor config.py: Remove GCP-related fields and clarify time field documentation

* Refactor correction.py: Add _resolve_gcp_pairs function to enhance data processing

* Refactor pipeline.py: Add _resolve_gcp_pairs function for GCP key validation

* Refactor test_config.py: Remove GCP-related assertions and simplify DataConfig tests

* Refactor test_correction.py: Remove 'corrected_timestamp' field from DataConfig instances

…137)

* Add SearchStrategy enum for deterministic parameter sweeps

* Add SearchStrategy enum and validation for correction analysis

* Add support for multiple search strategies in parameter set generation

* Add unit tests for parameter-set generation strategies

* Refactor search strategy validation to improve error messaging consistency

* Remove unused conversion functions for sigma to radians and seconds

* Refactor parameter set comparison in tests for consistency and clarity

* check parameter datatype

* Fix formatting in parameters.py for improved readability

* Update curryer/correction/parameters.py

* Update curryer/correction/parameters.py

* Update tests/test_correction/test_parameters.py

* Update tests/test_correction/test_parameters.py

* Add max_grid_sets parameter to limit GRID_SEARCH materialization

* Add search strategy enum for deterministic parameter sweeps and enforce max_grid_sets limit

* Add tests for max_grid_sets enforcement in GRID_SEARCH strategy

* cherry-pick regridding files from MM-104

* add regrid module and update imports in __init__.py

* add RegridConfig model with validation for GCP chip regridding parameters

* deprecate MATLAB file loading utilities in image_match; redirect to curryer.correction.image_io

* update import for load_image_grid_from_mat to use image_io module

* update import for integrated_image_match to use image_io module

* apply rng seed

Co-authored-by: Copilot <[email protected]>

* remove cubic

Co-authored-by: Copilot <[email protected]>

* check interpolation method

Co-authored-by: Copilot <[email protected]>

* user helper for check point in cell

Co-authored-by: Copilot <[email protected]>

* refactor test cases to use default_rng for random data generation

* fix: add missing newline for code readability

* test gcp NetCDF and HDF5 support

* refactor: remove unused tolerance variable in cell check

* Update curryer/correction/data_structures.py

Co-authored-by: Copilot <[email protected]>

* vectorize regard

Co-authored-by: Copilot <[email protected]>

* relax tolerance on grid boundaries

Co-authored-by: Copilot <[email protected]>

* valid pixels only

Co-authored-by: Copilot <[email protected]>

* refactor: improve documentation and streamline code in GCP regridding

* fix: update history attribute formatting in image_io.py

* docs: add gcp_regridding.md to contents

* fix: improve boundary handling in regrid.py to prevent NaN fill values

* feat: add example scripts for regridding GCP chips to NetCDF format

* fix: update variable names in image_io.py for consistency with GCP standards

* fix: enhance variable loading in image_io.py for compatibility with multiple naming conventions

---------

Co-authored-by: Copilot <[email protected]>

…rection loop (#138)

* add verification module for geolocation compliance checks

* add verification module for geolocation compliance checks

* add unit tests for verification module and its components

* handle HDF5 file loading in image_io.py when HDF4 library is unavailable

* improve HDF file loading in image_io.py to handle errors and fallback between HDF4 and HDF5

* add validation function and update verify parameters to include optional work_dir

* update verification tests to include work_dir parameter in verify function calls

* add minimal example for production verification workflow on geolocated observations

* add example script for weekly verification of geolocated observations

* refactor verification module to enhance key attribute handling and improve dataset aggregation logic

* refactor verification module to enhance key attribute handling and improve dataset aggregation logic

* enhance verification module to improve JSON serialization and summary output formatting

…for CLARREO (#146)

* remove tests

* add integration tests package

* refactor pytest configuration for test_correction to improve maintainability

* refactor test_dataio.py to use pytest and improve test structure for maintainability

* refactor test_image_match.py to use pytest and improve test structure for maintainability

* refactor test_pairing.py to use pytest and improve test structure for maintainability

* add __init__.py for CLARREO-specific correction tests

* add image-matching and pipeline runner helpers for CLARREO integration tests

* add synthetic data generation helpers for testing pipeline and e2e scenarios

* add unit tests for kernel operations in test_kernel_ops.py

* add tests for pipeline functions in test_pipeline.py

* add tests for results_io functions in test_results_io.py

* copy config

Co-authored-by: Copilot <[email protected]>

* copy config

Co-authored-by: Copilot <[email protected]>

* Update tests/test_correction/clarreo/_image_match_helpers.py

Co-authored-by: Copilot <[email protected]>

* Fix root_dir duplication and clarreo_cfg mutation in test files

Agent-Logs-Url: https://github.com/lasp/curryer/sessions/6ba9aa43-35f1-476a-a4dc-ad8eae24511b

Co-authored-by: mmaclay <[email protected]>

* Strengthen test_generate_clarreo_config_json and fix JSON round-trip bugs in load_config_from_json

Agent-Logs-Url: https://github.com/lasp/curryer/sessions/bbf5eb75-f1b0-46f8-af24-f2758fd30858

Co-authored-by: mmaclay <[email protected]>

* Refactor assertions in test_clarreo_config.py for clarity and maintainability; streamline field retrieval in config.py

---------

Co-authored-by: Copilot <[email protected]>
Co-authored-by: copilot-swe-agent[bot] <[email protected]>