v9.0.1

What's Changed

• Adding SCLK dependency for all levels of MAG. by @maxinelasp in #926
• Making Prod update by @maxinelasp in #927

Full Changelog: v9.0.09...v9.0.1

v9.0.0

Updates to infrastruture to support launch and immediately post-launch processing.

What's Changed

• I-ALiRT - ingest plots by @laspsandoval in #774
• Ultra - Update dependencies by @laspsandoval in #814
• iimap_processing version 19 by @laspsandoval in #815
• Create pointing schedule lambda by @torimarbois in #810
• Add Calibration File for SWAPI by @torimarbois in #804
• Update GLOWS L1B dependencies for ancillary and SPICE by @maxinelasp in #818
• FIX: Update the packet_downloader_lambda trigger for new location by @greglucas in #822
• I-ALiRT - Incorporate change in imap_processing into architecture by @laspsandoval in #820
• ULTRA l1c earth culling spice kernels by @lacoak21 in #819
• Updates to the start date and to pass repoint into CLI call by @maxinelasp in #796
• Add time kernel dep to glows by @maxinelasp in #821
• I-ALiRT - bug fix for dynamodb query by @laspsandoval in #825
• Rollback commit when sqlalchemy Integrity error is raised by @lacoak21 in #827
• Removing duplicate L1D dependencies by @maxinelasp in #826
• MNT: Update webpoda downloader to handle single files by @greglucas in #824
• Ialirt bugfixes - MAG fix by @laspsandoval in #829
• I-ALiRT - add logging by @laspsandoval in #830
• FIX: Pad the repointing number with 5 digits by @greglucas in #831
• MNT: Update imap_processing and imap-data-access versions by @greglucas in #832
• ULTRA l1b fix ancillary descriptors by @lacoak21 in #833
• Fixing format of repoint event because of SQS requirements by @tech3371 in #835
• I-ALiRT - version bump and minor fixes by @laspsandoval in #834
• ULTRA l1b add missing lookup table by @lacoak21 in #837
• ULTRA l1b and l1c dependency updates by @lacoak21 in #838
• ULTRA l1b use 90 calibration data for now. by @lacoak21 in #839
• I-ALiRT - MAG CDF Bug Fix by @laspsandoval in #841
• Quicklook: Adding DB table and update existing APIs by @tech3371 in #840
• ENH: Restrict APIs to not show unreleased files by @tech3371 in #836
• ENH: make ancillary public by @tech3371 in #846
• BUG: rebase fix for deploy failure by @tech3371 in #847
• Initial implementation for daily job triggering by @pleasant-menlo in #787
• MNT: Add IMAP_DATA_ACCESS_URL to job definitions by @greglucas in #843
• Skip spice query for initial upstream look by @lacoak21 in #842
• Revised Schedule Job Triggering: Now submitting each job with a unique start_date by @pleasant-menlo in #851
• DOC: Add more API Key documentation by @greglucas in #852
• Spice download s3 by @greglucas in #853
• I-ALiRT - api privacy and various bugfixes by @laspsandoval in #848
• MNT: Make the test_data folder unrestricted release for CI purposes by @greglucas in #857
• Update SWAPI energy-gf lookup table to have SW and PUI versions by @pleasant-menlo in #849
• FIX/ENH: Add authenticated routes to rest of API endpoints by @greglucas in #858
• I-ALiRT - Alarm added for missing packets by @laspsandoval in #775
• FIX: Add database connection to download handler for auth queries by @greglucas in #862
• I-ALiRT - small documentation update by @laspsandoval in #863
• Mag add spin dependency by @maxinelasp in #859
• api updates by @laspsandoval in #860
• I-ALiRT - Increased timeout by @laspsandoval in #867
• MNT: Add HEAD route to the download API endpoint by @greglucas in #868
• Added Lo L1B DE and L1C PSET anc, repoint, spin dependencies by @sdhoyt in #866
• ENH: Add API Key and data access url to packet downloader by @greglucas in #870
• I-ALiRT - remove todo for coverage plots by @laspsandoval in #869
• FIX: Packet downloader lambda needs to get SSM during runtime not cdk deploy by @greglucas in #871
• I-ALiRT - add db layer to alirt api manager by @laspsandoval in #875
• Update Hi L2 dependencies by @subagonsouth in #873
• FIX: Handle non-started batch jobs by @greglucas in #881
• Update L1D dependencies for MAG by @maxinelasp in #879
• I-ALiRT - bugfix archive lambda - REALLY NICE BEFORE LAUNCH BUT NOT NECESSARY by @laspsandoval in #880
• update version of imap_processing by @laspsandoval in #883
• MNT: HIT rename ancillary dependency files by @greglucas in #888
• Handle when left interval is before the sclk kernel is valid by @subagonsouth in #893
• I-ALiRT - update url by @laspsandoval in #894
• Add scope to authorizer - NOT NEEDED PRIOR TO LAUNCH by @laspsandoval in #877
• I-ALiRT - log format change by @laspsandoval in #895
• BUG fix: fix spacecraft reprocessing by @lacoak21 in #899
• MNT/FIX: Switch API key storage from SSM Parameter to DynamoDB by @greglucas in #904
• version bump for imap_processing by @laspsandoval in #905
• I-ALiRT - add realtime api by @laspsandoval in #897
• Packet download cron based by @greglucas in #915
• Change how start date is calculated for repoint table triggers by @subagonsouth in #910
• I-ALiRT - Pointing schedule completion by @laspsandoval in #898
• Add triggers in cron-job CSV for mapping products by @pleasant-menlo in #884
• Remove all L3 survival corrected map dependenci...

v8.0.0

What's Changed

• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci[bot] in #717
• MNT: Remove EFS and refactor SPICE indexer by @tech3371 in #707
• BUG: SPICE fix from last PR by @tech3371 in #721
• ENH: Add API Key authorization by @greglucas in #727
• CRID Calculation Revisit by @lacoak21 in #725
• Mag config updates by @maxinelasp in #726
• Duplicate job handling by @lacoak21 in #730
• I-ALIRT - Coverage plots by @laspsandoval in #734
• ULTRA l1b LUT dependencies by @lacoak21 in #731
• Add capability to query by ingest date within SPICE API by @bryan-harter in #740
• Added Lo 1yr map dependencies for ENA and ISN by @sdhoyt in #738
• SPICE Indexer Intervals Calculation Change (and Metakernel API speed-up) by @bryan-harter in #742
• I-ALiRT - Construct for Coverage Plots by @laspsandoval in #747
• Add SPICE dependencies to Lo and Hi L3 ENA maps by @pleasant-menlo in #748
• Use DependencyFilePath instead of CadenceFilePath by @lacoak21 in #756
• ENH: Add Repoint date range for ENA and GLOWS and kickoff pointing attitude job by @tech3371 in #728
• MNT: updated 'best' to historical where needed. by @tech3371 in #757
• Fix CRID tests by @lacoak21 in #758
• MNT: updated index_pointing_data to address last PR feedback by @tech3371 in #759
• updates to dependency config for L1D by @maxinelasp in #762
• IDEX combine l2b and l2c by @lacoak21 in #763
• MNT: Repoint ingestion Fixes by @tech3371 in #766
• BUG cadence maps contain overlapping data by @lacoak21 in #764
• Add hash to dependency file by @lacoak21 in #767
• Update hit l1b dependencies by @vmartinez-cu in #769
• Version bump 18 by @laspsandoval in #773
• API Endpoints by @daralynnrhode in #746
• Add l1b_hk and esa-energies dependencies to hi_l1b_de by @subagonsouth in #771
• MNT/FIX: Use account specific configurations in APIs by @greglucas in #780
• API Landing Page Redirect by @daralynnrhode in #777
• ENH: Public release setup by @tech3371 in #782
• CI/REL: Add automated production release workflow by @greglucas in #778
• Separate lambda for API Redirect by @daralynnrhode in #784
• FIX: Add spice kernels to quaternions processing by @greglucas in #788
• I-ALiRT - Quick update based on new endpoint by @laspsandoval in #741
• I-ALiRT - added spacecraft body in GSM coordinates by @laspsandoval in #744
• Refactor duplicate job handling to avoid s3 tag by @lacoak21 in #790
• ENH: limit upload API in production account by @tech3371 in #794
• Fix initial time kernel indexing by @lacoak21 in #791
• MNT/FIX: Get batch logs from the head by @greglucas in #797
• FIX: Add APIGateway CORS headers allow list by @greglucas in #795
• MNT: update imap-data-access v0.34.0 for POC by @tech3371 in #798
• Pckcov fix by @bryan-harter in #801
• IDEX l2a calibration curve ancillary files by @lacoak21 in #803
• I-ALiRT - adding cors by @laspsandoval in #802
• CRID calculation bug fix by @lacoak21 in #805
• Cadence bulk reprocessing by @lacoak21 in #792
• MNT: better upload error message by @tech3371 in #807
• ENH: Adding logics for 'spin-data' API query by @tech3371 in #808
• GLOWS: adding spin to l1b hist job by @tech3371 in #806
• Version 8.0.0 Release by @sdhoyt in #811

Full Changelog: v7.1.0...v8.0.0

v7.1.0

This release includes changes needed for the SIT-4 Re-run.

What's Changed

• Revert "Remove cadence start and end date parameters (used for SIT4)" by @tech3371 in #714
• Add json header to query API by @alastairtree in #711
• I-ALiRT - minor revision to grab latest calibration file by @laspsandoval in #715
• v7.1.0 Release by @bourque in #718

New Contributors

• @alastairtree made their first contribution in #711

Full Changelog: v7.0.0...v7.1.0

v7.0.0

This release includes updates to be used for the IMAP SDC Software Integration Test 4 (SIT-4) Re-run. More information can be found in this galaxy page.

What's Changed

• Remove cadence start and end date parameters (used for SIT4) by @lacoak21 in #687
• Improve error message for duplicate ancillary file uploads (#478) by @kvj-085 in #668
• Adds SPICE dependencies for GLOWS L3e, SWE L3, and SWAPI L3a by @pleasant-menlo in #688
• Add more spice dependencies to SWAPI L3a by @pleasant-menlo in #693
• I-ALiRT - algorithm db ingest by @laspsandoval in #624
• I-ALiRT - Added way to furnish the SPICE kernels by @laspsandoval in #694
• MNT: SPICE ingest time by @tech3371 in #696
• ENH: Adding batch logs API by @tech3371 in #695
• I-ALiRT - added ancillary data by @laspsandoval in #697
• I-ALiRT - name change for database parameters by @laspsandoval in #699
• Write all dependencies for processing to a JSON file by @lacoak21 in #690
• I-ALiRT - S3 packets query by @laspsandoval in #700
• imap processing version bump by @laspsandoval in #702
• Ialirt sit testing by @laspsandoval in #703
• version bump 0.16.1 by @laspsandoval in #704
• I-ALiRT - imap_processing version bump v.0.16.2 by @laspsandoval in #706
• MNT: Change routes for batch jobs API by @greglucas in #708
• Switch IDEX l2b to be a 1 month cadence job by @lacoak21 in #701
• MNT/FIX: Bump aws-cdk-lib to avoid Lambda log breaking change by @greglucas in #709
• Updating all queues and some tests by @maxinelasp in #710
• v7.0.0 Release by @bourque in #712

New Contributors

• @kvj-085 made their first contribution in #668

Full Changelog: v6.0.0...v7.0.0

v6.0.0

This release includes updates to be used for the IMAP SDC Software Integration Test 4 (SIT-4). More information can be found in this galaxy page.

Highlights

• Various improvements/updates to I-ALiRT processing including:
  • Simplification of containerization
  • Adding idle timeout settings
  • Improvements to dynamodb schema
  • Setup of API lambda
  • Adding API endpoint for catalog
  • Renamed download API endpoint
  • Added IP address to security group for Kiel
  • Added access for OPS software
• Updated supported version of imap-data-access
• Various improvements/updates to API endpoints including:
  • Added dependency API endpoint
  • Added support for Ancillary file management and querying
  • Added support for querying by file ingestion start/end date
  • Added metakernel generation API
  • Improvements to batch job query API
  • Improved logging
  • Added authorization API
• Updated dependencies for SWE L3 + ancillary files, Ultra L1b, HIT L1-L3 + ancillary, IDEX L1b and L2a, HI L2, L2-L3, GLOWS L3b-L3e SWAPI L1-L3 + ancillary files, ULTRA L1c and L2 and L3, MAG ancillary, Lo L1c and L3, CoDICE L1-L3
• Improved support for SPICE kernel handling/management and querying
• Added dependency management logging
• Added spacecraft instrument dependency to processing job kickoff
• Automated packet downloads
• Added processing time to ProcessingJob database table
• Implemented soft dependency handling
• Added spin table
• Added SPICE to batch starter and dependency tree
• Added support for bulk reprocessing
• Added SPICE kernel for spacecraft pointing
• Added support for cadence processing events

What's Changed

• poetry update by @laspsandoval in #432
• I-ALiRT: Combine tools NLB and ECS Cluster by @laspsandoval in #417
• I-ALiRT - Reduced to single running container by @laspsandoval in #433
• I-ALiRT: Readthedocs bug by @laspsandoval in #424
• Fixing workflow runner for deploys by @maxinelasp in #440
• I-ALiRT: add idle timeout settings by @laspsandoval in #441
• I-ALiRT - updated format of dynamodb by @laspsandoval in #443
• I-ALiRT: Initial setup of catalog API lambda by @torimarbois in #444
• I-ALiRT - Updates for SITA by @laspsandoval in #445
• I-ALiRT - s3 bucket name change by @laspsandoval in #447
• I-ALiRT - Add Static EIP to NLB by @laspsandoval in #448
• I-ALiRT: Remove NLB by @laspsandoval in #449
• MNT: imap-data-access version updates by @tech3371 in #454
• MNT: Update imap-data-access version by @tech3371 in #457
• I-ALIRT - Dynamodb api by @laspsandoval in #460
• I-ALiRT - Remove NLB 2 by @laspsandoval in #456
• I-ALiRT: Catalog endpoint by @torimarbois in #461
• Reconfigure lambda to use non-proxy integration and queryStringParameters by @torimarbois in #467
• Add dependency api endpoint and lambda function by @lacoak21 in #466
• Add the SWE L3 dependencies by @pleasant-menlo in #465
• Upload lambda changes for Ancillary Support by @daralynnrhode in #463
• Ancillary File Support for Query Lambda by @daralynnrhode in #459
• Upstream/daralynnrhode patch 1 by @daralynnrhode in #471
• Fixing requirements.txt file for lambda by @maxinelasp in #472
• Adding SWE ancillary dependency by @tech3371 in #476
• Refactor of indexer lambda to support ancillary file ingestion by @tech3371 in #474
• Ultra l1b dependencies - update to ultra dependencies by @laspsandoval in #469
• Update HIT dependencies for L1-L2 by @vmartinez-cu in #480
• Add the HIT L3 dependencies by @pleasant-menlo in #479
• Rename I-ALiRT Download Endpoint by @torimarbois in #482
• MNT: update imap-data-access with ancillary filename convention fix by @tech3371 in #488
• IDEX l2a dependency by @lacoak21 in #486
• MNT: Ran poetry export command to fix psycopg issue by @tech3371 in #489
• I-ALiRT - Add IP address to security group for Kiel by @laspsandoval in #490
• MNT: update imap-data-access==v0.16.0 by @tech3371 in #493
• MNT: Ran poetry export locally to fix the psycopg bug by @tech3371 in #494
• Spice Handling Setup by @bryan-harter in #491
• MNT/FIX: Only build Lambda Layers and use Lambdas with x86 architecture by @greglucas in #496
• Add Ancillary file handling in batch starter lambda by @lacoak21 in #481
• Query parameter variable name bug in batch_starter.py by @lacoak21 in #497
• Add dependency management logging and bug fixes by @lacoak21 in #499
• I-ALiRT - root certificate by @laspsandoval in #500
• Adding Query by Ingestion Start and End Date by @daralynnrhode in #484
• 1564 hi dependencies updates by @subagonsouth in #503
• Database Bump and Protections Added by @laspsandoval in #507
• I-ALiRT - Lambda layers by @laspsandoval in #508
• Layers - separate layers by @laspsandoval in #513
• Fix bug in dependency api by @lacoak21 in #512
• Bugfix: batch starter skipped files by @maxinelasp in #516
• ENH: Add spacecraft instrument dependency to the processing job kickoff by @greglucas in #505
• Automated packet downloads by @greglucas in #517
• Add GLOWS L3b dependencies by @pleasant-menlo in #521
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #519
• Updating data access version by @maxinelasp in #520
• Spice indexing by @bryan-harter in #495
• MNT: Make sure all default/external loggers get INFO logs by @greglucas in #523
• SPICE Query API by @bryan-harter in #522
• Adding processing time to ProcessingJob table by @tech3371 in #525
• SWAPI: Adding SWAPI ancillary dependents for L2 by @tech3371 in #529
• I-ALiRT - Import imap processing by @laspsandoval in #515
• BUG: Fix SPICE Indexer lambda handler path by @tech3371...

v5.0.0

Features

• Updated dependencies for HIT, GLOWS, and SWAPI
• Removed old spin DB table
• Various improvements and updates to I-ALiRT infrastructure
• Added I-ALiRT query and download API
• Updates to SPICE file ingestion
• Improvements to monitoring and logging

What's Changed

• Update HIT dependencies for L1B and L2 by @vmartinez-cu in #383
• removing old spin DB table by @tech3371 in #391
• I-ALiRT: OpsSW test updates by @laspsandoval in #388
• I-ALiRT: Add a way to delete stack despite using autoscaling by @laspsandoval in #374
• Update imap-data-access version by @tech3371 in #397
• BUG - Undid Code that breaks tests due to psycopg import error by @tech3371 in #395
• Create subfolder and updated path accordinly by @tech3371 in #393
• Remove and update SPICE files ingestion and how it's written to EFS by @tech3371 in #400
• I-ALiRT: Add query api to s3 bucket by @laspsandoval in #398
• BUG: Removing pytest-postgresql temporarily by @tech3371 in #409
• I-ALiRT: Added Download API by @laspsandoval in #411
• I-ALiRT: Domain Name Update by @laspsandoval in #412
• Dependency Association updates by @tech3371 in #416
• Adding monitoring to send clean logging emails by @maxinelasp in #420
• Add GLOWS L2 as a dependency for L3a GLOWS processing by @pleasant-menlo in #408
• I-ALiRT: Add Outbound Test by @laspsandoval in #415
• I-ALiRT: Added IP range for BlueNet (tlm relay) by @laspsandoval in #421
• SWAPI dependency updates by @tech3371 in #425

New Contributors

• @vmartinez-cu made their first contribution in #383

Full Changelog: v4.0.0...v5.0.0

v4.0.0

This release includes changes since the last Software Integration Test (SIT-3) and roughly serves as a 'half way' mark to the next SIT (SIT-4, scheduled for April 2024).

Features

• API query results are now sorted
• A single database session is used and passed around the code instead of new instances being created
• Various updates to database schema
• Added S3 mounts to containers for I-ALiRT
• Implemented SQS processing
• Now using shared Lambda layer for all lambdas
• Added region to the S3 presigned URLs
• Added AWS stack for SDC website deployments
• Various updates to instrument dependency table
• Added a database synchronizer to file database
• Now using separate database tables for different file types

What's Changed

• MNT: Sort query return results when returning from the API by @greglucas in #303
• MNT: Remove unused dependencies by @greglucas in #304
• MNT: Pass around database session rather than creating new ones by @greglucas in #307
• DB unique constraint by @greglucas in #308
• Db refactor by @greglucas in #309
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #310
• Db session fix by @tech3371 in #313
• Add S3 Mount to Containers for I-ALiRT by @laspsandoval in #305
• Sqs processing by @maxinelasp in #315
• Share Lambda layer for all lambda(s) by @tech3371 in #323
• I-ALiRT: Added DynamoDB Streams for Packet Ingest by @laspsandoval in #314
• Stack to construct by @greglucas in #326
• MNT: Use direct inheritance for simple resource like LambdaLayer by @greglucas in #331
• FIX: Add region to the s3 presigned urls by @greglucas in #330
• ENH: Add a stack for website deployments by @greglucas in #333
• MNT: Refactor batch processing by @greglucas in #332
• Harrison 1692 - SWYN/TLAY - added L3 SWAPI dependency configuration by @pleasant-menlo in #336
• Updated IDEX dependency to distinguish l1a and l1b by @bourque in #335
• SWAPI L2 dependency by @tech3371 in #338
• Lo dependency table update by @sdhoyt in #340
• Changes to DynamoDB to accomodate query patterns by @laspsandoval in #337
• HIT - Use Raw L0 File as Single L1A Dependency by @sdhoyt in #347
• ENH: Add a DB synchronizer for our file database by @greglucas in #342
• Fixing unique constraint for dependency table by @maxinelasp in #349
• Update EventBridge Rule to match new spice path in data bucket by @tech3371 in #345
• Adding SWE L2 dependency by @tech3371 in #354
• MNT: Change the dependency database table into a local lookup by @greglucas in #352
• MNT/ENH: Separate database tables for different file types by @greglucas in #344
• BUG - Adding fixes for psycopg by @tech3371 in #365
• Add Final DynamoDB Table by @laspsandoval in #353
• Add dependency entry for swapi l3b combined by @pleasant-menlo in #363
• update with versioning command by @laspsandoval in #369
• I-ALiRT: Switch out ECR for Nexus by @laspsandoval in #370
• I-ALiRT: update to readthedocs by @laspsandoval in #371
• V4.0.0 Release by @bourque in #378

New Contributors

• @pleasant-menlo made their first contribution in #336

Full Changelog: v3.0.0...v4.0.0

v3.0.0

This release includes updates to be used for the IMAP SDC Software Integration Test 3 (SIT-3). More information can be found in this galaxy page.

Features

• Added tests for backup S3 buckets
• Added RDS database schemas and tables
• Now using shared resources in a common environment/account
• Added support for ancillary data access from EFS
• Added cloudwatch monitoring
• Added API endpoint for the universal spin table
• Various updates to /upload, /download, and /query endpoints
• Added documentation on how to use personal AWS accounts for deployment
• Removed use of OpenSearch and StepFunctions
• Replaced processing step stack with Batch job stack
• Added batch job event handler to indexer lambda
• Added pre-processing dependency table
• Added I-ALiRT architecture for IOIS
• Standardized logging across the package
• Now using imap-data-access for file validation
• Added SNS Notification
• Added ECS to I-ALiRT Architecture
  Enabled SPICE file uploads to the SDC
• Added dependencies for all instruments
• Removed char limit on descriptor
• Automated Docker processing deployments

What's Changed

• Remove API Wrapper Scripts by @sdhoyt in #126
• Backup bucket tests by @maxinelasp in #146
• SIT-2 Release [dev] by @bourque in #151
• First pass at processing architecture by @laspsandoval in #154
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #155
• Starting point for RDS by @laspsandoval in #180
• Share resources in a common environment/account and auto deploy resources by @greglucas in #181
• CI: Update codecov configuration by @greglucas in #189
• CI: Use poetry run when deploying resources by @greglucas in #190
• Ancillary data access from EFS by @tech3371 in #188
• Remove old processing pipeline from SIT1 by @tech3371 in #195
• ENH: Add cloudwatch monitoring by @greglucas in #197
• Added endpoint to the API for universal spin table by @tech3371 in #199
• RDS with Schema Creation Custom Resource by @sdhoyt in #196
• CI: Remove version pin on npm cdk version installation by @greglucas in #201
• Processing Trigger Mechanisms by @laspsandoval in #191
• fix to upload folder path by @tech3371 in #198
• Setup Personal AWS Deploy Documentation by @sdhoyt in #200
• Added some more info to personal AWS account docs by @bourque in #205
• Upload config remove by @tech3371 in #202
• Create spin table by @tech3371 in #204
• ENH: Add redirect response from download url by @greglucas in #206
• Remove OpenSearch by @sdhoyt in #207
• Metadata Schema by @sdhoyt in #209
• update to batch env by @laspsandoval in #212
• Metadata Ingest by @sdhoyt in #210
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #211
• Remove Step Functions by @laspsandoval in #214
• Reorganize sds manager stack by @tech3371 in #215
• Replace processing step stack with Batch job stack by @tech3371 in #216
• Indexer events by @tech3371 in #217
• Api dockerfile for testing by @laspsandoval in #219
• InstrumentLambda from Construct to Stack by @laspsandoval in #220
• Update to indexer lambda to make pytest work locally by @tech3371 in #224
• Update File Catalog and Add Status Table by @sdhoyt in #223
• Query RDS with API by @sdhoyt in #228
• Added pre-processing dependency table by @tech3371 in #231
• I-ALiRT: First pass at architecture for IOIS by @laspsandoval in #208
• Batch starter by @laspsandoval in #230
• Indexer events by @tech3371 in #229
• added batch job event handler to indexer lambda by @tech3371 in #233
• Add event rule to batch starter lambda by @tech3371 in #236
• Various updates to database schema by @bourque in #232
• Added custom PutEvent to Batch Starter Lambda by @tech3371 in #234
• Updates to Batch Job by @laspsandoval in #238
• setup to send event from indexer lambda. by @tech3371 in #237
• FIX: Change to path params instead of query params in APIs by @greglucas in #235
• Batch starter fix by @tech3371 in #239
• Rename s3 uri by @tech3371 in #240
• Return list of dicts in query API by @bourque in #241
• Added name for database extensions enum by @sdhoyt in #243
• Prevent database duplicates by @sdhoyt in #244
• Fixes from Integration tests by @tech3371 in #245
• FIX: Change download API responses by @greglucas in #248
• MNT: Standardize logging across the package by @greglucas in #247
• Indexer lambda update post demo by @tech3371 in #253
• Updated ruff by @sdhoyt in #256
• update to use imap-data-access file validator by @tech3371 in #255
• Batch starter updates by @tech3371 in #257
• updated --data_level to --data-level to follow best practices by @tech3371 in #259
• Update dependency from json to database by @tech3371 in #260
• Consistent ruff checks with imap_processing by @bourque in #258
• added few instruments to list by @tech3371 in #261
• Infrastructure changes to match filename convention updates by @tech3371 in #262
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #263
• Added SNS Notification by @laspsandoval in #266
• Add ECS to I-ALiRT Architecture by @laspsandoval in #265
• ENH: Enable SPICE file uploads to the SDC by @greglucas in https://githu...

v2.0.0

This release marks the successful completion of SIT-2. Further information about what was tested in SIT-2 can be found in this galaxy page and the SIT-2 GitHub Project Board.

Features

• Ability to deploy and test software in the SDC Staging environment.
• Software can be successfully promoted from the SDC Staging Environment to the SDC Data Production Environment.
• Delivery of data files to the SPDF for routine archival purposes.
  • Backing up both OpenSearch and the data bucket to the backup account.
• Use of the API data interfaces by both SDC personnel as well as instrument teams. APIs:
  • The /upload endpoint for uploading new data to SDC
  • The /download endpoint for downloading data from SDC
  • The /query endpoint for querying information about data and data location.
• Demonstrate the SDC's ability to trigger jobs based on data availability and launch necessary processing containers.
  • Implementing a data watcher (Database) that keeps track of processing status.
  • Establishing a processing pipeline that initiates processing tasks.

What's Changed

• Primarily adding more fine-grained permissions to the lambda by @bryan-harter in #30
• Adding a way to create unique stack names each deploy by @bryan-harter in #29
• Adding the upload API to the stack and adding the Upload API code by @bryan-harter in #33
• MNT: Style updates by @greglucas in #19
• Adding poetry to the project by @maxinelasp in #38
• TST: Add test for s3 bucket properties by @greglucas in #42
• MNT: Ignore deprecation warnings by @greglucas in #44
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #51
• 1 create a spot to store configjson in a centralized location on aws by @sdhoyt in #50
• Improve stack creation testing by @sdhoyt in #52
• Update issue templates to include spike by @maxinelasp in #58
• 24 mock opensearch for unit testing by @sdhoyt in #69
• PR template by @sdhoyt in #70
• moved pull request template one directory up by @sdhoyt in #78
• Code of Conduct by @bourque in #77
• Modularize CDK code by @laspsandoval in #101
• API Gateway by @laspsandoval in #102
• TST: Reorganizing tests and moving to pytest-style by @greglucas in #103
• Removing templates now that we have a project-wide template for issues by @maxinelasp in #106
• Documentation by @maxinelasp in #109
• Add pre-commit hooks by @bourque in #115
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #80
• Updated infrastructure tests by @laspsandoval in #118
• adding .rst to docs/cdk by @GFMoraga in #114
• MNT: Add more information in the app template file by @greglucas in #112
• Implementation of Track Data Availability by @tech3371 in #120
• Changing the Upload API to use a GET rather than a POST by @bryan-harter in #110
• Initial Implementation of Trigger jobs based on data availability by @tech3371 in #119
• Opensearch snapshot by @sdhoyt in #121
• S3 backups by @maxinelasp in #125
• Updating permissions for data bucket role - SIT2 fix by @maxinelasp in #128
• SIT-2 Release [main] by @bourque in #150

Full Changelog: v1.0.1...v2.0.0