v0.13.0
This is the April 2025 Release.
Highlights
- Instrument Processing
- Improvements to CoDICE processing
- Added support for processing segmented packets
- Implemented and validated L1a
lo-pha(direct events) data product - Implemented initial L1b processing pipeline
- Improvements to Hi processing
- Added housekeeping metadata for L1b
- Converted exposure time to seconds for L1c
- Renamed time delta variables to TOF for L1b DE
- Epoch value is now start time for PSET
- Implemented pointing set class for L2
- Improvements to HIT processing
- Implemented sectored rates algorithm for L1b
- Implemented sectored fluxes algorithm for L2
- Added total uncertainties information
- Renamed statistical uncertainty variables
- Improvements to IDEX processing
- Added support for downloading test files from S3 during test build
- Validated L1b CDFs
- Updated APID list to removed extraneous APIDs and include missing APIDs to process
- Implemented L2b CDFs
- Fixed bug in L1b validation testing
- Updates to L2a pipeline to complete L2a processing
- Added decommutation for housekeeping data
- Improvements to Lo processing
- Set the spin cycle and epoch time for L1b DE
- Fixed loop bug in CLI
- Calculated TOF1 for Golden Triplets
- Set the coincidence type for L1b DE
- Converted TOF Dns to EU for L1b DE
- Implemented species identification for L1b DE
- Set badtime for L1b DE
- Improvements to MAG processing
- Implemented initial L2 pipeline
- Implemented L2 calibration and offsets
- Updates to L1c for I-ALiRT
- Fixed bug in CLI
- Validated L1c CDFs
- Removed test that was causing Actions build to crash
- Improvements to SWAPI processing
- Updated SWAPI to work with new CLI changes
- Implemented LUT/ADP changes for L2
- Added ancillarfy dependents of L2
- Improvements to SWE processing
- Updates to L1 algorithm implementation
- Created L2 CDFs
- Refactored L1b pipeline to work with updated LUT
- Improvements to Ultra processing
- Added new XTCE file for L1a
- Added energy interval for L1c
- Updates to L1b annotated event items
- Updates to attributes in L1a
- Added efficiency, FWHM, and geometric functions for L1b
- Added l1c pset sensitivity calculation
- Completed L1b DE processing
- Added pytest fixture to download external data for L1c
- Added Healpix outful to L2 main code
- Improvements to CoDICE processing
- Infrastructure
- Now only building lambda layers using x86 architecture
- Added ancillary file handling in batch starter lambda
- Added dependency management logging
- Fixed query parameter variable name bug in
batch_starter.py - Added capability for passing in
alloption for querying for dependencies - Added soft dependency handling to batch starter and dependency lambda
- Updated database/S3 sync lambda to handle ancillary files
- Updated DPS frame code to include universal pointing table for ENA
- Now passing
start_dateand repointing info intowrite_cdffrom CLI - Implemented proper conversion from HealPixSkyMap to RectangularSkyMap for ENA
- Created Healpix Tessellated SkyMap objects for ENA
- Fixed bug in
build_solid_angle_apfor 6 degree spacing for ENA - Updated L3 dependencies for GLOWS, HIT, SWAPI, and SWE
- Added L3 to list of valid data levels
- Creeated CDF sekelton for L2 ENAs
- Fixed bug with Parent files attribute in
write_cdf - Added processing time to ProcessingJob table
- Fixed bug in SPICE indexer lambda handler path
- Improvements to SPICE
- Added on-demand SPICE metakernal generation API
- Added SPICE indexing to the infrastructure
- Added an API to API gateway to enable querying for SPICE files
- Updated naming conventions for SCLK kernel
- Added protection for RDS and S3
- Updates to include subsection start and end fields to SPICE repointing
- Updated spin and repoint tables to have UTC columns
- Added MOC metakernal to list of expected kernels
- Added logs for download API
- Fixed bug in eventbridge rules to match new paths
- Improvements to I-ALiRT processing
- Separated lambda layers as dependent on the type
- Implemented decommutation for SWAPI data
- Data Access API
- Added new
ingestion_[start|end]_datequery parameters and updated documentation to reflect this - Added filename parsing capability for SPICE files
- Added ability to download from webpoda based on repointing time
- Released versions 0.18.1, 0.19.0, 0.20.0, 0.20.1, 0.21.0
- Consolidated lookup for valid file extensions during file name validation
- Now using
requestslibrary for URL requests instead ofurllib - Fixed bug in repoint keyword for querying
- Various updates to documentation
- Added new
- Misc
- Now ignoring too many arguments in list of pre-commit rules
- Added command line option to pre-fetch external data in a single process before running tests
- Updates to file naming convention documentation
What's Changed
- I-ALiRT - SWE Algorithm Part 1 by @laspsandoval in #1451
- Lo L1B - Add spin cycle to direct events by @sdhoyt in #1546
- Correcting minor bug in L1B by @maxinelasp in #1553
- HIT - Refactor processing to use functions in hit utils by @vmartinez-cu in #1554
- MNT: Updating cli.py code with latest dependency code. by @tech3371 in #1473
- Update pointing table to include subsecond fields by @subagonsouth in #1500
- IDEX L1B validation by @lacoak21 in #1557
- MNT: Add network marks to IDEX test files to avoid downloading by @greglucas in #1571
- BUG: Update write_cdf to handle parent_files by @tech3371 in #1570
- 1270 hi l1b hk direct from L0 by @subagonsouth in #1563
- SWAPI: update SWAPI to work with new cli changes by @tech3371 in #1573
- Mag L2 first pass by @maxinelasp in #1551
- Mag l1c updates by @maxinelasp in #1542
- Ultra l1c pset - add energy interval by @laspsandoval in #1562
- ENH: Add a spacecraft CLI parser by @greglucas in #1567
- Fixing CLI by @maxinelasp in #1576
- Ultra l1a cleanup by @laspsandoval in #1550
- Unpack I-ALiRT SWAPI data, update utils by @torimarbois in #1495
- Ultra l1b - add efficiency and fwhm by @laspsandoval in #1560
- IDEX l2b processing and tests. by @lacoak21 in #1558
- MAG L1C Validation by @maxinelasp in #1574
- Lo L1B - Fixed CLI dependency loop by @sdhoyt in #1581
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1580
- 1575 spice update spin and repoint table to have utc columns by @subagonsouth in #1584
- HIT L1B - process sectored rates dataset by @vmartinez-cu in #1577
- MNT: Bring parent file handling into the post-processing step by @greglucas in #1592
- Version consolidation by @greglucas in #1593
- Ultra l1a new xtce by @laspsandoval in #1591
- SWAPI: Update to read energy from LUT at L2 and cli changes related to that by @tech3371 in #1587
- Covert exposure times from units of clock-ticks to seconds by @subagonsouth in #1601
- Lo L1B - Set Direct Event Epoch Field by @sdhoyt in #1588
- Lo L1B - Calculate TOF1 and Set Coincidence Type for Direct Events by @sdhoyt in #1609
- MAG L1C updates for i-alirt by @maxinelasp in #1610
- Fix build_solid_angle_map for 6 degree spacing by @pleasant-menlo in #1607
- Lo L1B - Convert TOF Data Numbers to Engineering Units by @sdhoyt in #1612
- Lo L1B - Species Identification and Badtimes Initialization by @sdhoyt in #1615
- Moved and updated naming conventions by @maxinelasp in #1617
- TST: Add pytest-xdist to run tests in parallel by @greglucas in #1600
- Ultra l2 healpix by @nkerman in #1578
- Ultra l1b - add params as a dependency to the extendedspin by @laspsandoval in #1622
- L2a processing updates by @lacoak21 in #1603
- Docs Update For Ingestion Params by @daralynnrhode in #1618
- ENA Maps: Convert HealpixSkyMap to RectangularSkyMap by @nkerman in #1596
- MNT: Add too many arguments to list of rules to ignore by @greglucas in #1626
- Ultra l1a - added depends0 to every attribute by @laspsandoval in #1629
- ENA - dps frame code updated to include universal pointing table by @laspsandoval in #1623
- Mag L2 Calibration and offsets by @maxinelasp in #1616
- 1625 hi pset epoch value should be start time by @subagonsouth in #1627
- Ultra - cdf attribute update by @laspsandoval in #1632
- Ultra l1c pset sensitivity calculation and minor organization by @laspsandoval in #1604
- CoDICE L1a lo-pha (direct events) implementation by @bourque in #1595
- HIT L2 - add algorithm for sectored intensity by @vmartinez-cu in #1619
- Removing crashing mag test by @maxinelasp in #1635
- Yaml timeout by @laspsandoval in #1642
- Lo L1B: Direct Event Pointing Bins by @sdhoyt in #1633
- HIT - Rename uncertainty variables by @vmartinez-cu in #1637
- SWE: lut update and refactor of L1B and L2 by @tech3371 in #1620
- Ultra l1c - added fixture for downloading data by @laspsandoval in #1645
- Pass start_date and repointing into write_cdf from CLI by @maxinelasp in #1634
- TST/CI: Add pre-download utility and cache mechanism for data by @greglucas in #1655
- HIT L2 - add total uncertainties by @vmartinez-cu in #1652
- I-ALiRT - SWE Algorithm Part 2 by @laspsandoval in #1585
- MNT: update imap-data-access to v0.21.0 by @tech3371 in #1659
- Ultra - L1b Cleanup by @laspsandoval in #1640
- 1657 mapping pointingset class should use abstractproperty by @subagonsouth in #1662
- Ultra l1c pset helio by @laspsandoval in #1653
- IDEX - decom catalog list summary packet by @lacoak21 in #1649
- CoDICE: Initial L1b pipeline by @bourque in #1663
- I-ALiRT - MAG l1b equivalent by @laspsandoval in #1661
- I-ALiRT - SC packet check by @laspsandoval in #1665
- Updating API docs by @maxinelasp in #1668
- 1590 hi l2 pointing set class by @subagonsouth in #1654
- IDEX l1b - modify copy of test dataset by @lacoak21 in #1656
- Remove obs day calculation from glows l1a by @maxinelasp in #1658
New Contributors
- @pleasant-menlo made their first contribution in #1607
Full Changelog: v0.12.0...v0.13.0