Recent Releases of imap_processing

imap_processing - v0.19.0

This is the August 2025 release

What's Changed

Ultra geo culling by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1999
CoDICE: Change energy bin deltas to delta minus and delta plus by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1979
ULTRA L1C Dead time correction function by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2005
Remove "ensurespice" decorator by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/2011
CoDICE: Updated acq time lookup table values by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2019
I-ALiRT - MAG Gradiometry Code by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2023
I-ALiRT - MAG frame transformation to ECLIPJ2000 using Spacecraft Packet by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2021
HIT - implement handling for data spanning midnight by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2001
Temporary fix for the externalkernel pytest marker by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/2029
IDEX combine L2B and L2C by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2020
2003 hi l1b function to generate esa step to esa energy step lut by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2004
Replace earth pck spice kernel by @torimarbois in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2024
CoDICE: Implement despinning algorithm for lo-(n)sw-[angular|priority] products by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2022
Minimal updates to gitignore by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2028
Ultra l1b - ebins by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2008
779 hi l1b function to convert hi esa step to esa energy step by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2030
Supporting maps in different coordinate systems by @pleasant-menlo in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2018
HIT L1B - Update dependency handling by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2034
Add ancillary file handling for GLOWS L1B by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1998
Lo L1A - Histogram Dimension Order Bug by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2033
Upgrade cdflib to 1.3.6 by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2025
MNT: Ruff target update by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2038
I-ALiRT - added code for GSM, GSE, RTN frames by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2040
2039 hi l1a mem dump packet parsing by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2041
Add scattering calibration data LUT by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2046
Update default validmin/validmax attrs for epoch by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2050
CoDICE: Add some placeholder code for L2 processing by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2051
MAG L1C Metadata update by @mhairifin in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2062
I-ALiRT - ingest plots by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2031
I-ALiRT - MAG combination and minor updates by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2049
Ultra l1c pset background rates by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2063
GLOWS: Adding SPICE parameters to L1B by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2026
CI: Upload codecov even on test failure by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2067
Mag l1d fixes by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2037
MNT: Remove extraneous ultra import log by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2070
Ultra l1c - added uncertainty by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2073
Update expected esa voltages for each energy step in template/test file by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2066
Flag Ultra l1b Scattering by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2069
Ultra l1c - Add background rates to the data product by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2071
Add spin-phase filtering to Hi L2 by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2036
IDEX handle missing science acquisition events by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2072
Remove uses of spiceypy.kclear() and spiceypy.furnsh() from tests by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2096
IDEX l2a calibration curve implementation by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2093
1681 hi l2 geometric factor and esa energy lookup by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2087
Deadtime correction application by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2068
Lo L1C - Pointing Set pointing times and spin numbers by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2061
MNT: Update Lo L1c pointing set dimensions and attribute naming by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2091
SWAPI: fill ESA step 0 with nan value. Update acquisition time by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2102
CoDICE L1a: Turn some validation steps back on by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2079
ULTRA L1C sensitivity calculation for helio and spacecraft psets by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2104
I-ALiRT SWAPI Validation by @torimarbois in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2090
Ultra - L1b DE culling by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2092
ENH: Add Lo ancillary file handling by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2103
ULTRA l1c boundary scale factor application by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2108
Ultra l1c load scattering thresholds from lookup table by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2106
2053 spin update instrument spin phase definition by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2089
Ultra l1c - adding species filtering prior to pset calculations by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2107
Codice - add L2 attributes to yaml by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2098
ULTRA l1c optimize tests and code by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2112
Create text file generation function by @torimarbois in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2045
Updated CoDICE descriptors naming conventions by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2109

New Contributors

@mhairifin made their first contribution in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2062

Full Changelog: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.18.0...v0.19.0

- Python
Published by sdhoyt 6 months ago

imap_processing - v0.18.0

This is the July 2025 Release.

What's Changed

[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci[bot] in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1914
CoDICE: Changed references of 'pha' to 'direct-events' by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1917
IDEX l2c team updates by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1918
MAG L2 Validation by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1916
ULTRA l1a phx tof high energy by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1919
Mag L2 completion by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1922
Coverage plots by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1921
CoDICE: consistent dimension order by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1920
I-ALiRT - quick update Kiel coordinates by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1930
CoDICE: Updated instaz labels for lo-(n)sw-angular products by @bourque in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/1928
ULTRA l1a tof high time APID 885 by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1923
ULTRA L1A ExTOF high angular by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1935
Ultra L1b extendedspin validation changes by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1929
ULTRA L1A ExTOF high time by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1937
Default to mag frame, rotate into SRF by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1932
Created cdf for Ultra l1c pset helio frame by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1911
Ultra l1b - add geometric factor by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1933
HIT L1A - fix attributes by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1924
HIT L2 - Fix missing value for Ne particle by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1942
HIT L1B - Add a factor to the sectored rates calculation by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1943
ULTRA l1a extof high energy processing code by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1938
I-ALiRT - update swe to be broken into half cycles by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1939
I-ALiRT - account for outages by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1944
L1b wrapup items by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1951
CoDICE: update compression lookup tables by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1973
SPICE - switch out science frame kernel by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1968
ULTRA L1b - Move LUTS to s3 by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1961
Add k-factor to CoDICE L1 datasets by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1977
ENH: Add more Lo APIDs by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1971
MAG L1D by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1970
SPICE - Add new frames to geometry.py by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1981
Ultra l1b - Add Pulse Height Correction by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1986
I-ALiRT Mag l1d - Part 1 of 3 (Probably) by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1989
I-ALiRT - Update ialirt cdf based on feedback by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1980
SWE: L2 validation by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1950
Add ability to retreive spacecraft spin phase using J2000ns by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1985
IDEX L2B rename attrs by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1967
ULTRA L1C Dead time correction calculation by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1997
I-ALiRT - added DSN to the coverage by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1955
SWAPI: add sweeptable check in ADP steps by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/1899
Bump imap-data-access by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/2002
Return paths to generated CDFs from postprocessing by @pleasant-menlo in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/2000

Full Changelog: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.17.0...v0.18.0

- Python
Published by bourque 7 months ago

imap_processing - v0.17.0

This release includes changes needed for the SIT-4 Re-run.

What's Changed

MNT: Remove unused utils grouping functions by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1851
FIX: Remove duplicate packets from dataset by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1850
Mag l1a dupe packets by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1848
MNT: update dependency document by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1846
Ultra l1a - added cdf for apid 882 by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1854
Ultra l1a - energy events (apid 897) by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1865
HIT L2 - ISTP compliance updates by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1852
Add new xtce file for Hi packet definitions that includes new MEMDMP … by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1866
Ultra l1a 897 - update to packet definitions by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1879
SWAPI: adding sci start time and update epoch to center time by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1882
Ultra l1a - add more apids 898, 899, 900, 901 by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1878
1885 write cdf default compression to 6 by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1886
Ultra l1a - add apid 889 by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1898
Add Lo star tracker packet processing by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1864
Fix mag value error by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1908
Ultra l1 - Adding memdump (868) and macdump (871) by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1905
Ultra l1a - adding cmdecho (apid 865) by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1904
Implement center/delta epoch values for most CoDICE L1a products by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1906
SWE: add uncertainty in L1B and L2 by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1884
New CoDICE L1a validation data by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1910
Ultra l1a - add apid 872 (macroschecksum) by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1907
IDEX l2b add counts and reorganize CDF structure by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1855

Full Changelog: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.16.2...v0.17.0

- Python
Published by bourque 8 months ago

imap_processing - v0.16.2

This release includes bug fixes and minor updates for I-ALiRT SIT-C.

What's Changed

Added missing validation/ subdirectory to CoDICE validation data paths by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1847
I-ALIRT - Quick fix to return empty list by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1849

Full Changelog: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.16.1...v0.16.2

- Python
Published by bourque 9 months ago

imap_processing - v0.16.1

This release includes bug fixes and minor updates for I-ALiRT SIT-C.

What's Changed

HIT L1A - Add attributes to science datasets by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1835
HIT L0 - Fix angle dimension order error by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1837
HIT L0 - change epoch to center collection time by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1839
Improved external test data file handling by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1828
Mock CoDICE I-ALiRT data now returns empty lists instead of a FILLVAL by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1843
1840 bug hi l1b hi constants tof2 bad values by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1844
minor updates for sit by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1841

Full Changelog: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.16.0...v0.16.1

- Python
Published by bourque 9 months ago

imap_processing - v0.16.0

This release includes updates to be used for the IMAP SDC I-ALiRT Software Integration Test.

What's Changed

Revert small fixes needed for CoDICE for SIT-4 by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1820
1822 hi restructure hi modules by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1823
Simplify CoDICE I-ALiRT processing into one module by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1830
Add verification of hk packet decom by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1829
I-ALiRT: Create SWAPI count rate optimization function by @torimarbois in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1705
HIT L1B - Handle data gaps in sectored counts by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1827
I-ALiRT - added mettoutc by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1833
Changes to CoDICE I-ALiRT processing in prepration for I-ALiRT SIT by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1832
I-ALiRT - update energies to list by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1834

Full Changelog: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.15.0...v0.16.0

- Python
Published by bourque 9 months ago

imap_processing - v0.15.0

This release includes updates to be used for the IMAP SDC Software Integration Test 4 (SIT-4). More information can be found in this galaxy page.

Instrument Processing
- Improvements to CoDICE processing
  - Improved ISTP compliance for L1a and L1b data products
  - Completed initial L1b processing
  - Implemented initial L2 processing pipeline for direct events
  - Fixed CLI to work with extra input files
  - Added SPASE metadata for L2
- Improvements to GLOWS processing
  - Fixed CLI to work with extra input files
  - Added SPASE metadata for L2
- Improvements to IDEX processing
  - Fixes to CDF atttributes
  - Added SPASE metadata for L2
- Improvements to Lo processing
  - Updates to CLI
  - Bug fixes to product dimensions
  - Implemented priority 1 Flux HAE Uncorrected for L2
  - ISTP fixes for L2
- Improvements to MAG processing
  - Renamed input files for SIT-4
  - Minor fixes to L2 products
- Improvements to SWE processing
  - Implemented L1b housekeeping CDFs
  - Added L2 processing to CLI
- Improvements to Ultra processing
  - Implemented obs_date_range with iterative standard deviation
  - Fixed bugs for delta_energy with epoch as first dimension
  - Incorporated ancillary and SPICE support
  - Added SPASE metadata
Data Access API
- Fixed bug in querying by table

What's Changed

SWE: produce l1b hk CDF and added L2 to CLI by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1790
Ultra L2: obsdaterange with iterative standard deviation by @nkerman in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1789
Explicitly define table for querying by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1792
Lo L1 - Update CLI and Minor Fixes to Dimensions by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1794
CoDICE L1a Updates for ISTP compliance by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1791
Lo L2 - Priority 1 H Flux HAE Uncorrected by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1797
Lo L2 - Added L2 CLI processing and ISTP fixes by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1800
IDEX attribute fixes from Andriy by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1802
CoDICE L1a: More ISTP fixes by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1798
I-ALiRT - cdf creation by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1777
SIT-4 updates for MAG - renaming input files by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1803
Even more CoDICE L1a ISTP updates! by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1804
minor fixes for L2 by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1805
Ultra SIT 4 - Incorporating anc and spice into code by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1801
Finish implementing CoDICE L1b for SIT-4 by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1806
Fix GLOWS CLI to work with extra input files by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1811
Spase metadata ✨ by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1809
Tiny bugfix: fix energy independent obs_date_range metadata by @nkerman in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1808
Final l2 changes for menlo compatibility by @nkerman in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1793
Fix CoDICE CLI to work with extra input files by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1812
Bugfixes for deltaenergy with epoch as first dim by @nkerman in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/1813
Tiny: Add dictkey for some support/metadata vars by @nkerman in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/1814
Initial CoDICE L2 processing for SIT-4 by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1810
Ultra 90 - removed row with nans by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1815
CoDICE L2 lo/hi direct-event SPASE metadata by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1816
IDEX L2 add missing SPASE metadata by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1817
Lo and HIT - SIT-4 Bug fixes by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1818
CoDICE: Some hotfixes to get things working with MSIM3 data and SIT-4 by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1819

Full Changelog: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.14.0...v0.15.0

- Python
Published by bourque 9 months ago

imap_processing - v0.14.0

This is the May 2025 Release.

Highlights

Official release notes will be available soon!

Instrument Processing
- Improvements to CoDICE processing
  - Finished implementing the L1a lo-pha, hi-pha, lo-ialirt, and hi-ialirt data products
  - Completed validation of hi-omni, lo-pha, hi-pha, and lo-ialirt data products
- Improvements to GLOWS processing
  - Various CDF updates
- Improvements to Hi processing
  - Fixes to direct event metadata
  - Various improvements/additions to L2 processing
- Improvements to HIT processing
  - Added ancillary files as dependencies for L2
  - Created standard, summed, and sectored fluxes CDFs for L2
  - Fixed dimension name in sector rates data variable for L1a
  - Fixed ISTP errors for L2
- Improvements to IDEX processing
  - Recalculating epoch time with respect to fine grained time for housekeeping data product
  - Additions/improvements to L2b attributes
  - Renamed some L2a variables and added some utility functions
  - Implemented initial L2c processing
  - Added science acquisition times for L2b
  - Added L1b SPICE time kernels
- Improvements to Lo processing
  - Initialized L1C pointing set including counts and exposure times
- Improvements to MAG processing
  - Finalized L1a CDFs
  - Removed code to split MAG packets by day
  - Implemented 24 hours calculation for L2
  - Implemented ancillary files for L1b
- Improvements to SWAPI processing
  - Updates to dimension variables to match nomenclature
  - Fixed bug in fine steps energy to avoid reverse order
  - Created L1a and L1b housekeeping CDF
  - Updated packet definition to use latest SEGMENTED feature
  - Updated L1b dependencies
- Improvements to Ultra processing
  - Updates to L1b and L1c CDFs
  - Improvements to L1b badtimes and cullingmask epoch
  - Added pset exposure, sensitivity, helio, and spacecraft calculation sfor L1c
  - Added APIDs and modified the rates for ISTP compliance for L1a
  - Major projection changes to L2
  - Added L2 to the CLI
  - Calculated the mean sensitivity, mean background rate, mean energy, and total exposure time in the spacecraft frame for L2
  - Added dependencies for 36 maps in L2
  - Now setting energy_delta_minus/plus attrs corectly for L2
  - Added SPASE metadata for L2
  - Now tracking map duration for L2
Infrastructure
- Added more filtering capabilities to processInputCollection
- Refactored ancillary fetching
- Simplified dependency API
- Fixed ancillary filtering for bulk reprocessing and cadence
- Fixed bug in version issue when the dependency has "ALL" in the descriptor
- Fixed bug in batch starter version calculation
- Implemented bulk reprocessing Event
- Removed API domain name from batch starter
- Added IDEX L2 and MAG ancillary dependencies
- Fixed bug in SPICE furnishing
- Now skipping /spice folder in database synchronizer
- Added API endpoint to trigger bulk reprocessing
- Added environment variables to Batch Processing Jobs
- Added ancillary end date handling to batch starter
- Added special case processing for IDEX, Ultra, Lo, and Hi L3 maps
- Added CLI path for manual reprocessing
- Removed processed SQS messages
- Added dps filename convention for ENA maps
- Moved ancillary file tools into imap_processing
- Created naming utility functions for ENA maps
- Improved tests for healpix to rectangular transformation
- Refactored ENA map naming tools into a class
- Parsed map descritpros and created output map structures for them
- Adjusted descriptors for Hi L2 and L3 to match new format
- Added dependency configuration for CoDICE L3, GLOWS L3d and L3e, IMAP-Lo L3
- Improvements to ENA SkyMap inheritance
- Created Spin table
- Fixes to spin query logics
- Added SPin and Repoint to the deserialize() function
- Added SPICE EventBridge rule to trigger jobs
- Improvements to SPICE
  - Added logic in SPICE indexer to skip indexing repoint file
  - Various SPICE metakernal improvements
  - Added support for YYYYMMDD format in metakernal
  - Added SPICE dependencies for Ultra
  - Added pointing frame kernel generation algorithm, per pointing kernel
  - Added kernel furnishing to preprocessing step
  - Added pointing frame kernel job to CLI
  - Updated imap_dps kernel naming convention
  - Now caching spin and repoint dependencies in pre_processing
  - Added utils functions to query and load spin data
  - Added pointing kernel generation to dependency CSV
  - Added SPICEInput capabilities
  - Implemented SPICE dependency in batch starter
Data Access API
- Added support for querying by ingestion date
- Added support for specifying which table to query via a --table parameter
- Added test to test_io.py for downloading ancillary files
- Released versions 0.22.0 through 0.31.0
- Now consolidating filepath errors into the base class
- Now including l2c as a valid data level for IDEX
- Added CR filename support

What's Changed

remove repointing attr by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1670
HIT L2 - Add CDF attributes to yaml by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1666
Ultra l1c pset helio histogram by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1669
Naming utilities and tests by @nkerman in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1664
add placeholder function for computing PSET backgrounds by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1671
HIT L2 - Add ancillary dependencies by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1680
Ultra L2: Enable Rectangular Output and Attribute Handling by @nkerman in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1646
IDEX housekeeping - Recalculate epoch time with respect to fine grained time by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1674
Glows cdf updates by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1678
IDEX L2B Attributes by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1687
Optionally energy-dependent exposure_factor by @nkerman in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1692
Glows type updates by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1689
PULL exposurefactor rather than PUSH by @nkerman in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/1676
I-ALiRT - Calculate current s/c attitude from raw spin phase and angular momentum by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1694
Add Ultra L2 to the CLI by @nkerman in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1701
Add a query to check if the file exists pre-upload by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1703
I-ALiRT - MAG validation with SC data by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1704
Fixing ultra L2 test by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1711
MNT: update imap-data-access to v0.24.0 by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1710
IDEX L1a Error handling for missing event data by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1693
HIT L2 - Add attributes to L2 CDFs by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1709
HIT - Rename 'declination' to 'zenith' by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1712
add kernel furnishing to InstrumentProcessing.preprocessing by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/1715
Ultra L2: Minor projection changes by @nkerman in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1719
Ultra l1c - cdf updates by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1707
CoDICE L1a hi-pha (direct events) implementation/validation by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1716
IDEX l2a rename variables and add util functions by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1672
1685 hi l2 l2 processing structure by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1706
Remove code to split MAG packets by day by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1702
HIT L2 - Fix ISTP errors by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1725
Updates to pointing kernel generation by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1723
Ultra l1b - cdf formatting by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1734
1730 ena skymap inheritance improvements by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1732
Ultra L2: define delta_minus/delta_plus for energy bins WRT geometric mean by @nkerman in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1708
CoDICE L1a hi-omni validation by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1737
Lo L1C - Initialize PSET by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1714
Add spice time conversions by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1739
BUG fix for SPICE furnishing and idex l1b processing check by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1748
IDEX L2A attributes by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1724
Lo L1C - PSET Counts by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1751
1727 hi l2 dataset metadata for cdf by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1743
I-ALiRT - Create a way to mimic attitude kernels by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1742
Ultra l1c - pset exposure and sensitivity by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1684
Ultra l1c SIT4 Prep by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1731
Ultra L2: Add epochdelta and map duration by @nkerman in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/1756
Lo L1C - PSET Exposure Time by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1758
Ancillary file combiner by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1728
Allow for JSON dependency in parseargs by @nkerman in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/1741
Initial SPASE metadata for Ultra/ENA Maps by @nkerman in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1721
Mag l2 24hours by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1745
MapDescriptor Naming Class and Descriptor Parsing in Ultra L2 by @nkerman in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1755
Move ancillary file tools into imapprocessing by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/1764
IDEX Initial L2c processing by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1682
Ultra l1a - Add apids and modify the rates so that it is istp compliant by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1749
Add L2 to Hi doprocessing by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/1759
BUG: Fixing SWAPI fine steps energy in correct order by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1771
SWAPI: Update Nomenclature and added SPASE metadata by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1767
Document Update For Query '--table' Param by @daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1772
Ultra L2 Metadata improvements by @nkerman in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1775
IDEX L2B Add science acquisition times from IDEX housekeeping dataset by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1769
IDEX pipeline fixes by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1773
1729 add pointing frame kernel job to clipy by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1776
1760 cache spin and repoint dependencies in pre processing by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1765
I-ALiRT - SIT Prep Draft by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1763
IDEX L1b update expected number of dependencies check by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1780
BUG: setting Dataversion in writecdf by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1738
Implement/Validate CoDICE L1a lo-ialirt by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1768
Mag ancillary files for L1B by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1784
Hi Processing fixes for SIT4 by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1785
SWAPI: Segmented fix and adding l1a and l1b HK CDF files by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1787
Update imap-data-access version by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1781
Implement CoDICE L1a hi-ialirt by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1786

Full Changelog: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.13.0...v0.14.0

- Python
Published by bourque 9 months ago

imap_processing - v0.13.0

Highlights

Instrument Processing
- Improvements to CoDICE processing
  - Added support for processing segmented packets
  - Implemented and validated L1a lo-pha (direct events) data product
  - Implemented initial L1b processing pipeline
- Improvements to Hi processing
  - Added housekeeping metadata for L1b
  - Converted exposure time to seconds for L1c
  - Renamed time delta variables to TOF for L1b DE
  - Epoch value is now start time for PSET
  - Implemented pointing set class for L2
- Improvements to HIT processing
  - Implemented sectored rates algorithm for L1b
  - Implemented sectored fluxes algorithm for L2
  - Added total uncertainties information
  - Renamed statistical uncertainty variables
- Improvements to IDEX processing
  - Added support for downloading test files from S3 during test build
  - Validated L1b CDFs
  - Updated APID list to removed extraneous APIDs and include missing APIDs to process
  - Implemented L2b CDFs
  - Fixed bug in L1b validation testing
  - Updates to L2a pipeline to complete L2a processing
  - Added decommutation for housekeeping data
- Improvements to Lo processing
  - Set the spin cycle and epoch time for L1b DE
  - Fixed loop bug in CLI
  - Calculated TOF1 for Golden Triplets
  - Set the coincidence type for L1b DE
  - Converted TOF Dns to EU for L1b DE
  - Implemented species identification for L1b DE
  - Set badtime for L1b DE
- Improvements to MAG processing
  - Implemented initial L2 pipeline
  - Implemented L2 calibration and offsets
  - Updates to L1c for I-ALiRT
  - Fixed bug in CLI
  - Validated L1c CDFs
  - Removed test that was causing Actions build to crash
- Improvements to SWAPI processing
  - Updated SWAPI to work with new CLI changes
  - Implemented LUT/ADP changes for L2
  - Added ancillarfy dependents of L2
- Improvements to SWE processing
  - Updates to L1 algorithm implementation
  - Created L2 CDFs
  - Refactored L1b pipeline to work with updated LUT
- Improvements to Ultra processing
  - Added new XTCE file for L1a
  - Added energy interval for L1c
  - Updates to L1b annotated event items
  - Updates to attributes in L1a
  - Added efficiency, FWHM, and geometric functions for L1b
  - Added l1c pset sensitivity calculation
  - Completed L1b DE processing
  - Added pytest fixture to download external data for L1c
  - Added Healpix outful to L2 main code
Infrastructure
- Now only building lambda layers using x86 architecture
- Added ancillary file handling in batch starter lambda
- Added dependency management logging
- Fixed query parameter variable name bug in batch_starter.py
- Added capability for passing in all option for querying for dependencies
- Added soft dependency handling to batch starter and dependency lambda
- Updated database/S3 sync lambda to handle ancillary files
- Updated DPS frame code to include universal pointing table for ENA
- Now passing start_date and repointing info into write_cdf from CLI
- Implemented proper conversion from HealPixSkyMap to RectangularSkyMap for ENA
- Created Healpix Tessellated SkyMap objects for ENA
- Fixed bug in build_solid_angle_ap for 6 degree spacing for ENA
- Updated L3 dependencies for GLOWS, HIT, SWAPI, and SWE
- Added L3 to list of valid data levels
- Creeated CDF sekelton for L2 ENAs
- Fixed bug with Parent files attribute in write_cdf
- Added processing time to ProcessingJob table
- Fixed bug in SPICE indexer lambda handler path
- Improvements to SPICE
  - Added on-demand SPICE metakernal generation API
  - Added SPICE indexing to the infrastructure
  - Added an API to API gateway to enable querying for SPICE files
  - Updated naming conventions for SCLK kernel
  - Added protection for RDS and S3
  - Updates to include subsection start and end fields to SPICE repointing
  - Updated spin and repoint tables to have UTC columns
  - Added MOC metakernal to list of expected kernels
  - Added logs for download API
  - Fixed bug in eventbridge rules to match new paths
- Improvements to I-ALiRT processing
  - Separated lambda layers as dependent on the type
  - Implemented decommutation for SWAPI data
Data Access API
- Added new ingestion_[start|end]_date query parameters and updated documentation to reflect this
- Added filename parsing capability for SPICE files
- Added ability to download from webpoda based on repointing time
- Released versions 0.18.1, 0.19.0, 0.20.0, 0.20.1, 0.21.0
- Consolidated lookup for valid file extensions during file name validation
- Now using requests library for URL requests instead of urllib
- Fixed bug in repoint keyword for querying
- Various updates to documentation
Misc
- Now ignoring too many arguments in list of pre-commit rules
- Added command line option to pre-fetch external data in a single process before running tests
- Updates to file naming convention documentation

What's Changed

I-ALiRT - SWE Algorithm Part 1 by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1451
Lo L1B - Add spin cycle to direct events by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1546
Correcting minor bug in L1B by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1553
HIT - Refactor processing to use functions in hit utils by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1554
MNT: Updating cli.py code with latest dependency code. by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1473
Update pointing table to include subsecond fields by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1500
IDEX L1B validation by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1557
MNT: Add network marks to IDEX test files to avoid downloading by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1571
BUG: Update writecdf to handle parentfiles by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1570
1270 hi l1b hk direct from L0 by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1563
SWAPI: update SWAPI to work with new cli changes by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1573
Mag L2 first pass by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1551
Mag l1c updates by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1542
Ultra l1c pset - add energy interval by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1562
ENH: Add a spacecraft CLI parser by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1567
Fixing CLI by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1576
Ultra l1a cleanup by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1550
Unpack I-ALiRT SWAPI data, update utils by @torimarbois in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1495
Ultra l1b - add efficiency and fwhm by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1560
IDEX l2b processing and tests. by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1558
MAG L1C Validation by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1574
Lo L1B - Fixed CLI dependency loop by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1581
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1580
1575 spice update spin and repoint table to have utc columns by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1584
HIT L1B - process sectored rates dataset by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1577
MNT: Bring parent file handling into the post-processing step by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1592
Version consolidation by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1593
Ultra l1a new xtce by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1591
SWAPI: Update to read energy from LUT at L2 and cli changes related to that by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1587
Covert exposure times from units of clock-ticks to seconds by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1601
Lo L1B - Set Direct Event Epoch Field by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1588
Lo L1B - Calculate TOF1 and Set Coincidence Type for Direct Events by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1609
MAG L1C updates for i-alirt by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1610
Fix buildsolidanglemap for 6 degree spacing by @pleasant-menlo in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/1607
Lo L1B - Convert TOF Data Numbers to Engineering Units by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1612
Lo L1B - Species Identification and Badtimes Initialization by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1615
Moved and updated naming conventions by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1617
TST: Add pytest-xdist to run tests in parallel by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1600
Ultra l2 healpix by @nkerman in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1578
Ultra l1b - add params as a dependency to the extendedspin by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1622
L2a processing updates by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1603
Docs Update For Ingestion Params by @daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1618
ENA Maps: Convert HealpixSkyMap to RectangularSkyMap by @nkerman in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1596
MNT: Add too many arguments to list of rules to ignore by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1626
Ultra l1a - added depends0 to every attribute by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1629
ENA - dps frame code updated to include universal pointing table by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1623
Mag L2 Calibration and offsets by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1616
1625 hi pset epoch value should be start time by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1627
Ultra - cdf attribute update by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1632
Ultra l1c pset sensitivity calculation and minor organization by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1604
CoDICE L1a lo-pha (direct events) implementation by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1595
HIT L2 - add algorithm for sectored intensity by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1619
Removing crashing mag test by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1635
Yaml timeout by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1642
Lo L1B: Direct Event Pointing Bins by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1633
HIT - Rename uncertainty variables by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1637
SWE: lut update and refactor of L1B and L2 by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1620
Ultra l1c - added fixture for downloading data by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1645
Pass startdate and repointing into writecdf from CLI by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1634
TST/CI: Add pre-download utility and cache mechanism for data by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1655
HIT L2 - add total uncertainties by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1652
I-ALiRT - SWE Algorithm Part 2 by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1585
MNT: update imap-data-access to v0.21.0 by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1659
Ultra - L1b Cleanup by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1640
1657 mapping pointingset class should use abstractproperty by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1662
Ultra l1c pset helio by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1653
IDEX - decom catalog list summary packet by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1649
CoDICE: Initial L1b pipeline by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1663
I-ALiRT - MAG l1b equivalent by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1661
I-ALiRT - SC packet check by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1665
Updating API docs by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1668
1590 hi l2 pointing set class by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1654
IDEX l1b - modify copy of test dataset by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1656
Remove obs day calculation from glows l1a by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1658

New Contributors

@pleasant-menlo made their first contribution in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1607

Full Changelog: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.12.0...v0.13.0

- Python
Published by bourque 10 months ago

imap_processing - v0.12.0

This is the March 2025 release.

Highlights

Instrument Processing
- Improvements to CoDICE processing
  - Implemented code to validate the following L1a data products: hskp, hi-counters-aggregated, hi-counters-singles, hi-sectored, hi-priority, and lo-counters-aggregated
  - Added unit tests to validate L1a data product 'support' variables (e.g. energy tables, acquisition times, etc.)
- Improvements to Hi processing
  - Implemented pset find_second_de_packet_data for L1c
  - Implemented exposure times for L1c
  - Implemented pset get_de_clock_ticks_for_esa_step for L1c
  - Validated hist data for L1c
  - Implemented bin L1b counts into pset bins for L1c
  - Implemented decommutation of DIAG_FEE packets for L1a
  - Implemented conversion of strings to coincidence type values in L1c pset calibration product config
  - Validated L1a DE data
- Improvements to HIT processing
  - Validated L1b housekeeping data
  - Implemented summed rates algorithm for L1b
  - Added ancillary tables and table handling for L2
  - Added check for housekeeping APID in L1b
  - Implemented summed fluxes algorithm for L2
  - Updated logical sources
  - Validated L1a raw housekeeping CDF
  - Added sectorate angles for L0
  - Implemented standard fluxes algorithm for L2
  - Refactored processing for summed intensity for L2
  - Updated sectored rates dimensions for L1a
- Improvements to IDEX processing
  - Implemented initial L2a processes with unit tests
  - Validated IDEX L1a CDFs
- Improvements to Lo processing
  - Implemented initial L1b processing and DE dataset
  - Implemented calculation for average spin duration for each ASC
  - Added SHCOARSE and MET fields to L1a DE
  - Implemented Spin bin for L1b DE
- Improvements to MAG processing
  - Implemented L1b processing
  - Implemented initial processing for L1c
- Improvements to SWAPI processing
  - Fixed processing with duplicate SHCOARSE value in housekeeping data
- Improvements to SWE processing
  - Minor improvements to L2 processing
  - Created L2 CDF attrs file
  - Added XTCE back in non-science data processing
  - Added acq_duration to L1b and L2
  - Created CDF for non-science packets and defined their CDF attrs
- Improvements to Ultra processing
  - Fixed bug in theta and phi calculations for L1b
  - Fixed bug in extendedspin calculation for L1b
  - Added unique ID in L1a processing
  - Created spacecraft histogram for L1c healpix
  - Enabled spacecraft exposure in healpix
  - Implemented structure for L1c sensitivity
  - Updated file parsing for L1a
  - Implemented spacecraft pset data processing for L1c
  - Reordered Ultra map code dimensions to (epoch, energy, az, el)
  - Implemented L2 CDF structure
  - Implemented mock L1c data on healpix grid
Infrastructure
- Added support for spacecraft quanternion processing
- Added script that enables webpoda download capability
- Added support for segmented polynomials in XTCE files
- Created lambda and API endpoint for dependency tracking
- Updated dependencies for IDEX L2a, Ultra L1b, SWE L3, and HIT L1-L3
- Converted ENA map time from TT J2000ns to TBD ET
- Implemented "pull" index matching and value projection method for ENA maps
- Replaced internal angles in radians with degrees for ENA maps
- Implemented index mapping util for rectangular grids
- Now producing xarray datasets from ENA maps
- Removed ISTP check for L1 files and set terminate_on_warning to False
- Added ancillary file to dependency tree
- Updated indexer lambda to ingest ancillary files
- Improvements to SPICE
  - Changed default angular unit to degrees
  - Implemented pointing table query code
- Improvements to I-ALiRT processing
  - Implemented I-ALiRT MAG decommutation
  - Added IP address for security group in Kiel
  - Reconfigured lambda to use non-proxy integration and queryStringParameters
  - Renamed I-ALiRT download endpoint
Data Access API
- Added support for querying for ancillary files including unit tests
- Added I-ALiRT and spacecraft as valid instruments
- Fixed bug in ancillary filename convention
- Updated get_files function and added a download function
Misc
- Fixed bug in release GitHub Actions build for imap_processing and imap_data_access repos
- Removed some unused test files from the imap_processing repo
- Removed pyyaml dependency from imap_processing repo
- Fixed poetry/psycopg import issue

What's Changed

MAG L1B by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1376
HIT L1B - add algorithm for summed rates product by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1369
SWE: L2 update from SWE and I-ALiRT Discussion and added SPASE metadata by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1379
Mag l1B timeshift by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1380
1401 hi l1c pset find second de packet data by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1403
Fix CoDICE-lo L1a validation discrepencies by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1400
Exclude certain variables in CoDICE housekeeping products by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1399
Ultra l1a - Add unique id by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1390
SWE: adding back in SWE non-science APID to processing pipeline by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1388
Reorder ultra map code dimensions -> (epoch, energy, az, el) by @nkerman in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1414
Ultra l1b - phi theta corrections by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1405
Add repoint module, test coverage, and general conftest fixture for g… by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1415
1402 hi l1c pset get de clock ticks for esa step by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1404
1416 hi l1a decom diag fee packets by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1420
TST: Remove unused test files by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1422
Implement "Pull" Index matching method and value binning/projection; Convert TT -> TDB by @nkerman in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1396
ENH: XTCE: Add support for segmented polynomials by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1409
Add auto generation of calibration product integer values column from… by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1408
MNT: Remove pyyaml from our direct dependencies by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1425
SWE: L1 and L2 CDF attrs fixes identified by SKTEditor by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1428
SWE: Add CDF attrs for non-science apid by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1430
Mag cdf metadata from instrument team by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1411
HIT L2 - add summed flux algorithm by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1419
XTCE - Strip spaces from strings by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1434
1151 hi l1c exposure times by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1424
add segmented polynomial handling to convertrawtoeu() by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/1429
SWE: Added acqduration in L1B and L2 for L3 purposes by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/1432
HIT L1B - validate housekeeping data by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1433
Changes to rename hi l1b deltat variables to tof by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/1438
IDEX l2a processing by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1382
MNT: Removing ISTP check for l1 data files by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1443
HIT L1B: add check for housekeeping apid by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1444
Ultra l1b aux quality flags by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1412
SWAPI: Fixing case when there is duplicate value in HK data by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1445
HIT L1B: Fix key error by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1446
Healpix Sky Maps by @nkerman in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1423
Add energy table data to CoDICE-Hi L1a products by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1421
Ultra l1b - remove aux dependency by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1439
I-ALiRT - decom mag by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1406
Use degrees internally for ENA Maps by @nkerman in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1450
Ultra l1c healpix - create spacecraft histogram by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1453
Set terminateonwarning to False for L1 products by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1458
HIT - Update logical sources by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1468
Ultra l1b - Spacecraft exposure in HEALPIX by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1462
CoDICE L1a hi-sectored Validation by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1456
Ultra l1c pset - Structure for Ultra l1c Sensitivity by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1477
1150 hi l1c bin l1b counts into pset bins by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1452
CoDICE L1a hi-priority implementation by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1465
Update parsing of DE binary blob to match updated order of DE fields by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1494
HIT L0 - Add sectorate angles by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1493
ENA Maps: Change UltraPointingSet to Healpix by @nkerman in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1484
Ultra l1a - updates to parsing by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1499
CoDICE L1a hi-counters-singles validation by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1466
HIT L1 - update housekeeping attributes by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1503
Mag L1C first pass by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1455
Lo - Add SHCOARSE and MET to L1A Direct Events by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1511
HIT L2 - add algorithm for standard intensity by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1490
Lo - Initialize the L1B DE Processing by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1522
IDEX L1A CDF Validation by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1479
CoDICE L1a hi-counters-aggregated validation by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1467
Lo L1B - Average Spin Duration Calculation by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1524
Remove bincenter from coord by @nkerman in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/1505
MNT: Update SWAPI DataLevel metadata by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1527
Update release build to ignore metadata by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1526
ENH: Add spacecraft quaternion processing by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1525
Conversions for ena map dictionaries to xarray DataArray/Datasets by @nkerman in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1485
HIT L2 - refactor summed intensity processing by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1534
MNT: Add testdata directory to gitignore file by @greglucas in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/1536
Codice l1a support variable validation by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1488
HIT L1A - update sector rates data by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1540
MNT: Remove Datalevel as a field from the CDF variables by @greglucas in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/1535
FIX: L0 is not a valid processing step, we only process l1a+ by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1532
Ultra l1c - Basic spacecraft pset data by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1486
CoDICE L1a lo-counters-aggregated Validation by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1544
Lo L1B - Create Lo Spin Bin Direct Event Field by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1538
Updating conftest by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1549

Full Changelog: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.11.0...v0.12.0

- Python
Published by bourque 12 months ago

imap_processing - v0.11.0

This release fixes issues form the 0.10.0 release and contains new changes/features ahead of the February 2025 Science Team Meeting

Highlights

Instrument Processing
- Improvements to CoDICE processing
  - Improved how individual data product dimensions are defined to allow more flexibility
  - Implemented validation for L1a lo-(n)sw-species and lo-(n)sw-priority data products
  - Now downloading test L0 data from AWS S3 instead of storing the file in the repository
  - Improvements to L1a housekeeping validation; now comparing directly against validation CDFs instead of telemetry lookup files
- Improvements to GLOWS processing
  - Fixed to L1a attributes
- Improvements to Hi processing
  - Defined mapping from coincidence to calibration product for L1c
  - Added optional fill_value keyword to data array creation functions
  - L1c esa_energy_step now uses unique step values from input L1b
  - Updated CDF definition for L1a DE
  - Replaced MET ns with float64 seconds for L1a/L1b
- Improvements to HIT processing
  - Implemented validation for L1b standard rates data
  - Implemented validation for L1a uncertainty fields data
- Improvements to IDEX processing
  - Added decompression logic to L1a processing
- Improvements to Lo processing
  - Implemented L1a Spin CDF
- Improvements to MAG processing
  - Added new test data
- Improvements to SWAPI processing
  - Updated packet definition
- Improvements to SWE processing
  - Improvements to nomenclature
  - Added initial L2 data variables and CDF attributes
  - Now organizing data by energy and spin phase
- Improvements to Ultra processing
  - Added attitude culling and 6 sigma to L1b
Infrastructure
- Improvements to SPICE
  - Now using np.vectorize throughout
  - Implemented general spin table query
  - Fixed bug in upload metakernel
  - Fixed bug in repointing csv filename mapping
- Improvements to I-ALiRT processing
  - Implemented decom processing for SWE
  - Implemented dynamodb API
SDC Website
- Added materials to "About" and "Software" pages
- Added data availability calendar features
- Improved parameter selection in data portal
- Added placeholder for "Publications" page
Documentation
- Added documentation page that describes the various technologies that the SDC uses
- Updated Data Access API demo notebook to showcase latest capabilities
Misc
- Fixed bug in cdf.utils.load_cdf that was adding xarray specific attributes to the loaded CDF file
- Added File_naming_conventions to global CDF attribute schema
- Fixed bug in cdf_manager.add_global_attribute()

What's Changed

Make vectorization consistent across all time conversion functions by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1324
I-ALiRT SWAPI decom by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1311
CoDICE: More flexible way to defining dimensions by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1320
FIX: Handle wrap-around in issequential check by @greglucas in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/1325
MNT: Update SWE nomenclature in L1A and L1B by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1343
1266 spice general spin table query by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1337
HIT L1A - validate uncertainties by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1333
SWE: Adding initial L2 data variables and CDF attrs by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1344
Add decompression code for IDEX L1A. by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1335
fix: restrict poetry version for devcontainer by @mfacchinelli in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1340
Download CoDICE L0 test file from AWS by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1336
1341 hi l1a de update to cdf definition by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1346
Ultra l1b extendedspin Six Sigma + Attitude Culling by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1323
CoDICE L1a lo-(n)sw-species and lo-(n)sw-priority validation by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1345
MNT: Update SWAPI packet definitions by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1347
I-ALiRT - Decom for SWE by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1355
Ultra l1b - Bugs fixed for cdf creation by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1354
BUG - Dependency query input date parameter by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1318
1170 hi l1c define mapping from coincidence to calibration product by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1293
BUG - fix to not write if no science or xr.dataset exists by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1315
HIT L1B - validate standard rates data by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1351
Add fillvalue keyword to dataarray creation utilities by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/1364
Create Lo L1A Spin CDF by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1339
Update how the esaenergystep of a PSET is generated by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1365
glows L1A attribute fixes by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1356
SWE: Put data into spin angle bins and add remaining CDF attrs by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1357
Technology Stack docs by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/551
CoDICE L1a lo-counters-aggregated and lo-counters-singles validation by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1358
Updates/improvements to CoDICE L0 and L1a hskp testing/validation by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1361
frametransform checks for same frame by @nkerman in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/1368
Added new members to contributors section of README by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1371
MAG new tests and a bugfix for range by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1367
adding tests back into release by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1375
Ultra l1b data products by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1359
1366 hi l1a l1b replace met ns with float64 seconds by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1374
ENA Maps: UltraPointingSet and RectangularMap objects by @nkerman in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1319

New Contributors

@mfacchinelli made their first contribution in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1340

Full Changelog: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.10.0...v0.11.0

- Python
Published by maxinelasp about 1 year ago

imap_processing - v0.10.0

This is the January 2025 release.

Highlights

Instrument Processing
- Improvements to CoDICE processing
  - Updated energy and acquisition time lookup tables for CoDICE-Lo
  - Improved consistency and added missing values for some L1A CDF attributes
  - Applied conversion factor for spin_period values in L1a processing
  - Now calculating epoch values from acq_start_(sub)seconds instead of shcoarse
- Improvements to GLOWS processing
  - Set up basic processing for L2
  - Updates to obs day
- Improvements to Hi processing
  - Added direct casting for IntEnums to Numpy
  - Refactored L1c pset in preparation for algorithm development
  - Now populating despun_z for L1c
  - Added hae coordinates for pset bins for L1c
  - Documented that epoch is center of time bin
- Improvements to HIT processing
  - Added new test data for L1a
  - Added uncertainty fields to count rate dataset for L1a
  - Wrote standard rates algorithm code for L1b
- Improvements to IDEX processing
  - Added trigger settings to L1a output CDFs
  - Added SPICE data to L1b CDFs
- Improvements to Lo processing
  - Added decom and organization of L1a spin data
- Improvements to SWE processing
  - Added in-flight calibration file tracking
  - Now reading in and applying in-flight calibration factors to counts using simulated data
  - Fixes to units and angles
  - Corrected flux units and updates conversion factors
- Improvements to Ultra processing
  - Added velocity magnitude and extended spin calculations in L1b processing
  - Made velocity revisions
  - Set up extendedspin data structure
  - Set up bin arrays based on matched indices for L2 ENA maps
  - Fixed bug in spatial utils and indexing in rectangular az_el grids
  - Now allowing spacial_utils.build_az_el_grid to return non-reversed elevation values
  - Now returning az/el bin edges along with bin centers in build_az_el_grid utility function
Infrastructure
- Improvements to SPICE
  - Added function to transform az/el coordinates between frames
  - Epoch time is now in TDT instead of TDB
  - Fixed bug when importing spicepy as spice
- Improvements to I-ALiRT processing
  - Reduced processing to a single running container
  - Added idle timeout settings
  - Combined tools NLB and ECS cluster
  - Updated format of dynamodb
  - Rewrote doppler calculation
Documentation
- Updates to ancillary file documentation
Misc
- Upgraded Poetry version to 2.0
- Upgraded cdflib version to 1.3.3
- Upgraded sammi-cdf version to 1.0
- Created common utility function to convert spin phase to angle in degree or radian
- Now excluding tests from build

What's Changed

poetry version pin at 1.8.0 by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1251
1225 hi l1c refactor l1c pset in preperation for algorithm development by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1235
1148 hi l1c populate despun z by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1253
IDEX l1b add trigger settings to output CDF by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1244
I-ALiRT - Rewrite doppler calculation by @torimarbois in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1233
I-ALiRT: CoDICE-Hi Decom by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1248
Document that PSET epoch represents the center time bin in the pointing set by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1252
Ultra l1b velocity revisions by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1242
1255 spice write function to transform azel coordinates between frames by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1256
Update docstring as requested by Nat in PR by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1261
Glows L2 Base processing by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1239
CoDICE L1a CDF attrs improvements by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1268
CoDICE lo-(n)sw-angluar validation by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1254
Updating Ancillary Documentation by @daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1269
ENA Maps: Bin values at indices by @nkerman in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1264
Update CoDICE-Lo energy table by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1273
CoDICE: conversion factor for spin period by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1275
HIT L1A - add new test data by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1278
Ultra l1b - Extendedspin First Pass by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1265
Upgrade dependencies - cdflib and sammi by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1279
CoDICE: Calculate epoch values from acqstartseconds instead of shcoarse by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1262
MNT: Add direct casting for IntEnums to Numpy by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1291
SWAPI: Pipeline test by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1238
HIT L1B standard rates by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1302
SWE: Adding ability to read in-flight calibration file by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1267
SWE: Flux units and conversion factor correction by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1303
HIT L1A - add uncertainty data by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1307
Add SPICE data (ephemeris, attitude, and celestial coords) to IDEX l1b CDF by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1284
1292 bug epoch time should be tdt instead of tdb by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1295
Replace IDEX use of j2000nstoj2000s with updated function name by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1310
Ultra l1b - extendedspin data structure by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1288
Move Spatial Utils, Fix bug in Spatial Utils with indexing of the azimuth and elevation grids by @nkerman in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1300
MNT: Rename spice -> spiceypy by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1312
Excluding tests from build by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1321
Decom and Organize Lo L1A Spin Data by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1308
Glows obs day updates by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1301

Full Changelog: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.9.0...v0.10.0

- Python
Published by bourque about 1 year ago

imap_processing - v0.9.0

This is the December 2024 release.

Highlights

Instrument Processing
- Improvements to CoDICE processing
  - Fixed error in CoDICE-Lo product data array shapes
- Improvements to Hi processing
  - Updates to SCI_DE packet definition and parsing
  - Updates to histogram tests
  - Updated packet definition XTCE
  - Refactored L1A histogram code
  - Refactored L1A parsing of DE_TOF binary blob
  - Added Hi-90 APIDs to processing
- Improvements to HIT processing
  - Implemented L0 science packet decommutation
  - Refactored L1A code to use hit_utils for processing housekeeping
  - Created initial L1A count rates and pulse heights CDFs
  - Added validation for L1A count rates data
  - Added validation for L1A pulse height events
  - Added validation for L1A housekeeping data
- Improvements to IDEX processing
  - Added support for L1B data products
  - Added more telemetry items to L1A data products
- Improvements to Lo processing
  - Updated XTCE to fix housekeeping enum state bug
  - Updated event parsing to handle counts and passes in binary chunk
  - Implemented L1A DE processing
- Improvements to MAG processing
  - Fixes to calibration
  - Fixed bug in L1B calibration matrix
- Improvements to SWAPI processing
  - Updates to packet definition
  - Improvements to SWE processing
  - Fixes to phase space density units
  - Added calculation of electron flux
  - Added calculation of spin phase
- Improvements to Ultra processing
  - Added velocity magnitudes for L1B
  - Updated species functions for L1B
  - Created rectangular grids for L2 and calculations for solid angle
Infrastructure
- Improvements to SPICE
  - Added function to convert MET to UTC
  - Updated instrument boresight vectors
- Improvements to I-ALiRT processing
  - Added processing of ephemeris
  - Added static assignment of IP address containers running in AWS
  - Added query and download API
  - Added IP range for BlueNet

- Python
Published by bourque about 1 year ago

imap_processing - v0.8.0

This is the November 2024 release.

Highlights

Instrument Processing
- Improvements/additions to CoDICE processing
  - Added capability to process multiple APID from a single input L0 file
  - Updated input test L0 file and updated affected unit tests
- Improvements to IDEX processing
  - Updated list of valid data levels to include new L2a, L2b, and L2c data levels
  - Updated input L0 test data and made corresponding changes to unit tests
- Improvements to Ultra processing
  - Updates to L1c pset
  - Updates to annotated events
- Improvements to GLOWS processing
  - Set up initial L2 processing pipeline
- Improvements to MAG processing
  - Various cleanup for L1b CDFs
- Improvements to Lo processing
  - Added support for segmentated packet DE fields that are spread across packets
  - Updated XTCE DE to group count and passing fields into the binary chunk
- Improvements to Hi processing
  - Implemented support for L1b spin phase
  - Implemented support for L1b computation of nominal bin
  - Added calibration product coordinate to pset for L1c
- Improvements to SWE processing
  - Implemented L1b science validation
- Improvements to HIT processing
  - Implemented L1b housekeeping CDFs
  - Updated dependencies for L1b and L2
  - Implemented subcommutation for L0 sector rates
  - Implemented data decompression for L0
Infrastructure
- Designed how SPICE dependency is tracked and associated
- Removed old database tables for spin and repointing
- Updated upload API lambda to accept spin and repointing csv data
- Added spin and repointing data extension to SPICE checks
- Updated EFS write lambda's event rule according to new SDC-maintained spin and repoint files
- Updated EFS write lambda to move ingested files to correct EFS path
- Added rest of IMAP kernels to the SPICE directory mapping
- Now grouping lambda code into its functional group
Documentation updates
- Updated all-contributors section of the README
- Updated release procedure workflow documentation
- Updated list of expected descriptors for CoDICE and IDEX
- Updated 'Getting Started' documentation
- Added documentation for Work Management Process
- Updated CDF documentation
Misc
- Implemented cartesian to spherical function for SPICE
- Now using the SAMMI library for CDF attribute management
- Excel to XTCE now can handle hexadecimal state values
- Added placeholder function for esa_step -> esa_energy_step
Bug Fixes
- Fixed bug in CoDICE L1a pipeline in which byte_count was not being used to determine length of data to decompress
- Fixed bug in MAG decompression
- Fixed Lo case 4 decompression table
- Fixed psycopg error in pytests

What's Changed

Add function for getting basis vectors from spice by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1080
Small bug fix - MAG by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1114
SWE: L1B validation data by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1103
865 hi l1b spin phase by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1102
HIT L1B - Create housekeeping dataset by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1118
All Contributors cleanup by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1120
Add calculation of Hi L1B nominalbin by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/1116
Add some more notes to the release workflow by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1121
Small update CoDICE and IDEX data product naming conventions by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1123
Updates to MAG L1B to scale based on compression flags by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1117
update link on documentation by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1137
Adding poetry installation steps to docs by @nkerman in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1138
Switch to using SAMMI for CDF attribute management by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1122
Documentation for Work Management Process by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/879
Fixing mag tests, removing temp fix by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1142
Removed Lo DE segmented packet string commas by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1144
Add placeholder function for converting from esastep to esaenergystep by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/1146
HIT L0 - subcommutate sector rates by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1160
Update Lo XTCE for Segmented DE packets by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1079
Update Lo DE Case Decoder for 4, 1 TOF2 by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1167
Add Hexadecimal state handling to exceltoxtce by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1159
Process multiple CoDICE APIDs per input file by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1162
Glows L2 initial setup by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1156
Mag l1b CDF cleanup by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1173
Ultra: Updates to annotated events and create l1b cdf. by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1081
Ultra l1c pset updates by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1059
Use bytecount to determine size of CoDICE data arrays by @bourque in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/1171
CDF document updates by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1179
HIT L0 - data decompression by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1169
HIT L1A - update hskp processing to use hit utils functions by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1176
Update IDEX l1a and l0 tests to work with new l0 test data by @lacoak21 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1181
1147 hi l1c add calibration product coordinate to pset by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1172

New Contributors

@lacoak21 made their first contribution in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1137
@nkerman made their first contribution in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1138

Full Changelog: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.7.0...v0.8.0

- Python
Published by bourque over 1 year ago

imap_processing - v0.7.0

This is the October 2024 release.

Highlights

Instrument Processing
- Improvements/additions to Ultra processing
  - Added spatial and energy binning equations
  - Added exposure time and pointing frame
  - Updates to L1B Annotated products
  - Added PSET spacecraft frame and PSET helio frame exposure times
- Improvements/additions to I-ALiRT processing
  - Added HIT algorithm lambda
- Improvements/additions to GLOWS processing
  - Updates to L1 CDF dtypes for outputs
  - Added validation tests for L1A and L1B
- Improvements/additions to MAG processing
  - L1a compression fixes
- Improvements/additions to Lo processing
  - Updates to use new decompression tables
  - Refactored L1A direct event data class to function
  - Combined segmented direct event data
- Improvements/additions to Hi processing
  - Added extract method for generating L1B direct event DataArrays
  - Populated L1A direct event CDF files with simulated data
  - Updated product definition esa_step
  - Added computation of coincidence_type and time deltas
  - Added computation of HAE lattitude and longitude
  - Added logical source parser
- Improvements/additions to SWAPI processing
  - Updated tests and validation data
  - Updated L2 variable names
  - Updated L1 to store other housekeeping variables
- Improvements/additions to SWE processing
  - Improvements to L1 for L2 processing
  - Added L1A CDF validation
  - Added conversion of counts to phase space density
- Improvements/additions to HIT processing
  - Refactored L1A processing to use packet_file_to_datasets function
Misc
- Updated Poetry documentation
- Added SPICE directory to the documentation build
- Added epoch to J2000 seconds function for SPICE
- Added calculations for instrument spin phase for SPICE
- Upgraded cdflib version
- Upgraded space_packet_parser version
Bug Fixes
- Fixed bug in I-ALiRT deployment
- Fixed bug in Lo unpacking scheme definitions
- Fixed bug in SPICE function get_spacecraft_spin_phase to avoid returning all nans

What's Changed

calculate partical energy by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/888
SWAPI new test and validation data by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/891
913 hi l1a update hi product definition esa step by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/914
Fixed Lo DE unpacking scheme by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/901
GLOWS L1 updates by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/889
795 spice instrument pointing at specified time by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/903
Fixing histogram attrs missed in last PR by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/919
Add Ultra spatial and energy binning equations. by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/875
Ultra: Added exposure time for pointing frame by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/967
Updated New Lo Histogram Decompression Tables by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/921
Extract L1B DE function for better code modularization by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/969
SWE L1 Improvement to store acquisition time of each measurement by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/881
Lo L1A Direct Event Refactor by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/971
MNT: Cdflib update by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/991
864 hi l1b compute coincidence type and time deltas by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/995
Add spice module to documentation by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1010
1020 bug get spacecraft spin phase always returns nans by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1021
1019 calculate instrument spin phase by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1022
Update to poetry docs by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1027
Add function to convert j2000ns to j2000s by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1025
Poetry doc update by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1029
MNT: spacepacketparser update by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1007
867 hi l1b compute hae latitude and longitude by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1032
swe l1a validation data by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1038
SWAPI: rename CDF variable names to match algorithm document by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1042
Lo DE Segmented Packets by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1016
bugfix for apid by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1046
Ultra PSET Spacecraft Frame + PSET Helio Frame Exposure Times by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1040
Update Ultra l1b Annotated by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/989
1026 logical source parser by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1044
SWE: calculate phase space density by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1041
SWAPI: Add additional support data to SWAPI L1 and L2 by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1043
1045 hi l1b modify processing workflow to use xarraydatasetupdate by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1054
Mag l1a compression fixes by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1082

Full Changelog: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.6.0...v0.7.0

- Python
Published by bourque over 1 year ago

imap_processing - v0.6.0

This is the September 2024 release.

Highlights

Data Access API
- Added query parameter for returning files acquired in the last 24 hours
- Added query parameter for returning files acquired in the last Ndays
- Improvements to query parameter validation and handling of 502 errors
Instrument Processing
- Improvements to CoDICE L1a processing:
  - Updated XTCE definitions
  - Implemented packet_file_to_datasets utility function, which simplifies the processing algorithm
  - Added support for variable length packet data
  - Updating CDF variable/attribute names to match expected nomenclature
  - Added CATDESC and FIELDNAM descriptions to housekeeping attributes
  - Refactored pipeline to allow more flexibility in configuring the 18 different CoDICE L1 data products *Improvements to Ultra L1 processing:
  - Created Ultra pset energy bins
  - Implemented Ultra L1b extended ssd and extended energy
  - Implemented Ultra particle velocity and SSD TOF
- Improvements to Lo L1 processing:
  - Improved Lo L1a CDF YAML definitions
  - Updated Lo L1a dependency table
  - Refactoredpacket_file_to_datasets utility function for Lo
- Improvements to HIT L1 processing:
  - Now using raw L0 file as a single L1a dependency
  - Implemented unpacing of L0 count rates data
  - Now grouping L0 science packets into science frames
  - Updated L0 dependency table
  - Updated sci deom to group packets and parse count rates
  - Implemented packet_file_to_datasets utility function, which simplifies the processing algorithm
- Improvements to SWAPI processing:
  - Updated L1 quality flags to work with numpy v2.0+
  - Added quality flags for L2 algorithm
  - Added L3 levels to list of valid levels
  - Updated L2 dependency table
- Improvements to SPICE:
  - Implemented SPICE frame transform function
  - Implemented some SPICE infrastructure and simple geometry function
  - Implemented spin phase query utils function, using spin start and spin rate data
  - Implemented spin phase calculation using spin data
- IDEX L1 processing is now split into L1a and L1b processing/data products
- Implemented packet_file_to_datasets utility function for SWE pipeline, which simplifies the processing algorithm
- Implemented HIT CCSDS packet generation for I-ALiRT
- Updated met_to_j200ns function
- Updated Hi product definition to have int64 data instead of uint64
Misc
- Refactored AWS infrastructure to use Constructs instead of Stacks
- Initial set of materials sent to web team for initial implementation of SDC website
- Added AWS stack to handle website deployment
- Added Parents attribute to CDF files that indicate parent data products used to create the CDF
- Added wheel build to releases
- Improvements to dependency management documentation
- Now ignoring conftest.py modules in Codecov reporting
- Updated EventBridge rule to match new SPICE path in data bucket
Bug Fixes
- Fixed bug in SPICE batch job
- Fixed bug that was causing SPICE to fail loading metakernel
- Fixed unique constraint for dependency table

Full Changelog

Ultra l1b extended ssd by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/789
Docstring, variable name, formatting updates to IDEX L1 by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/799
Implement packetfiletodatasets function for CoDICE by @bourque in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/804
SPICE geometry enums and IMAP state function by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/791
SWAPI Quality Flag by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/805
WIP/MNT: Update SWE to use packetfiletodatasets by @greglucas in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/802
Create Ultra pset energy bins by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/811
Added new tof test data by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/807
Define spatial bins for pset by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/819
689 spice update met to j2000ns by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/818
Ultra particle velocity and SSD TOF by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/823
Updated CoDICE XTCE files from imapxtce tool by @bourque in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/812
Updated various CDF attributes/variable names to match expected nomenclature by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/813
Added FIELDNAMs, LABLAXISs, and CATDESCs for housekeeping attributes by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/816
I-ALiRT - Test decom for HIT CCSDS by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/757
Pointing frame updates by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/814
BUG - fix for time kernels not loading during imap_cli command by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/838
Separate IDEX L1 into L1a and L1b by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/831
ignore conftest.py files in codecov by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/846
Dependency documention by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/844
Test infrastructure for external spice kernels by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/842
Ultra l1b extended energy by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/825
Added SWAPI L3 levels to the list of valid levels by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/847
Lo L1A Histogram packettodataset() Refactor and CDF Creation by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/788
Spin data and Spin Phase function setup by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/824
FIX: Update SWAPI quality flags to work with numpy 2+ by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/848
Mag l1a compression by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/801
HIT sci decom - group packets & parse count rates by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/815
Lo L1A CDF YAML Reorganization by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/860
ENH: Add "Parents" global attribute to datasets by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/858
MNT: Change default to use raw value in packetfiletodatasets by @greglucas in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/857
Refactor hitl1a.py to use packetfiletodatasets function by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/828
CoDICE data product organization refactor by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/826
Convert all hi instances of uint64 CDF variables to int64 by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/872
Spin phase calculation using spin data by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/852
859 spice frame transform function by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/861
Ultra l1b species + start to l1b Annotated by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/851
REL/CI: Add wheel build to release by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/878

Full Changelog: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.5.0...v0.6.0

- Python
Published by bourque over 1 year ago

imap_processing - v0.5.0

This is the release for August 2024.

Highlights

Data Access API:
- Improvements to documentation and help menus
- Added demo/examples notebook
- Added support for filename query parameter
- Fixed output table formatting
Instrument Processing:
- Updated CDF attributes for GLOWS
- Implemented proper unpacking and restructuring of data arrays for CoDICE-lo L1 data products
- Updates to global CDF attribute metadata
- Added Ultra Extended L1B lookup tables
- Added support for bitflags
- Added DynamoDB Streams for i-alirt packet ingest
- Added Ultra pulse height calculations
- Added SPICE pointing frame
- Updated Lo and HIT XTCE files
- Created module structure for SPICE functions
- Added SPICE kernel furnishing decorator
- Migrated HI L1a housekeeping to use CdfAttributeManager
- Refactored epoch attributes
- Initial implementation of SWAPI L2 alrgorithm
Misc
- Various updates to XTCE generator script and improved documentation
- Enabled support for numpy v2.x
Bug Fixes:
- Fixed bug in --end-date query parameter in Data Access API
- Fixed bug in mypy pre-commit check so now it covers entire code base

Full Changelog

Refactor epoch attrs by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/718
MNT/ENH: Add FLOAT and FILL options for spreadsheet dataType by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/701
MNT: Minimize the datatypes created from spacepacketparser by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/723
SWAPI l2 Implementation - counts to rate by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/721
Bitflags by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/694
MNT: Change to a period separator for XTCE definitions by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/726
Ultra Extended L1b Lookup tables by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/696
Data access api by @anamanica in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/720
packetfiletodatasets NOT in IDEX by @anamanica in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/743
Define the imapprocessing spice structure by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/733
Mypy Update by @daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/731
Glows cdf attrs update by @anamanica in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/725
MNT: Update global CDF attribute metadata by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/747
Ultra Extended L1b Front Coordinates by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/730
Calculate the path length for L1b Ultra by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/749
Various CoDICE L1 Updates by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/711
728 spice kernel furnishing decorator by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/734
Updated/Combined Lo XTCE by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/754
MNT: Enable numpy 2+ installs by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/758
DOC: Update XTCE generator documentation by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/766
Pointing frame code by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/759
Add Pulse Height Calculations by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/750
MNT: Add useful error message when packet to datasets fails by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/763
FIX: Avoid loss of precision when casting in packet loading (alternative) by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/786
CoDICE L1 decompression and unpacking data updates by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/762
ENH: Add Enumeration states to XTCE parser by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/783

Full Changelog: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.4.0...v0.5.0

- Python
Published by bourque over 1 year ago

imap_processing - v0.4.0

This is the release for (most of) June and July 2024, and the latest release before the IMAP Science Team Meeting on Aug 1st and 2nd.

Highlights

Added automated numpydoc and mypy checks to pre-commit hooks
Added end-date parameter to CLI script
Added unit tests for new CDF attribute management code
All instrument pipelines now return xarray dataset objects instead of filepaths
Added support for array-like time conversions
Updated IDEX, HI, HIT, MAG, and SWAPI pipelines to use new yaml-based CDF attribute management code instead of dataclasses
Updated citation info
Updates to XTCE generator script to be instrument-agnostic
Added generalized dataset creation code

Full Changelog

FIX: CLI help needs to be strings not tuples by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/646
Add numpydoc Pre-Commit Hook Pt.1 by @daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/639
Add numpydoc pre-commit For SWE Pt.2 by @daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/641
Add numpydoc Pre-Commit For Ultra & Swapi Pt.3 by @daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/643
Add numpydoc Pre-Commit For Mag & Lo Pt.4 by @daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/644
Add numpydoc Pre-Commit For ialirt & idex Pt.5 by @daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/647
Add numpydoc Pre-Commit for Hit & Hi Pt.6 by @daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/651
Add numpydoc Pre-Commit For Codice & Glows Pt.7 Last One by @daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/652
Updates to the CLI to include the end-date by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/658
Cdf attribute tests by @anamanica in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/637
Git workflow update by @anamanica in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/650
MNT: Pass around dataset objects rather than file objects by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/657
ENH/MNT: Allow array-like time conversion by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/653
CDF Updates by @anamanica in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/660
662 migrate remaining hi products to use cdfattributemanager by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/671
Fix Hi L1b test marked xfail by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/681
Update Management of HIT CDF Attributes to use YAMLs by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/679
XTCE generator scripts by @anamanica in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/680
Update citation info by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/685
Add mypy Pre-commit Hook and Fix tools folder Pt.1 by @daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/659
Add mypy Pre-Commit Hook for files Pt.2 by @daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/661
Add mypy Pre-Commit For Ultra Pt.3 by @daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/663
Add mypy Pre-Commit for swe Pt.4 by @daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/666
Add mypy Pre-commit for swapi Pt.5 by @daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/667
Add Pre-Commit For mag Pt.6 by @daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/668
Add mypy Pre-Commit For Lo Pt.7 by @daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/669
Add mypy Pre-Commit For idex Pt.8 by @daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/670
Add mypy Pre-Commit For ialirt Pt.9 by @daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/673
Add mypy Pre-Commit For hi & hit Pt.10 by @daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/674
Add mypy Pre-Commit for glows Pt.11 by @daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/676
Add mypy Pre-Commit for codice Pt.12 Last by @daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/678
Improvement to correct numpy update issue for Ultra by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/638
CLI Type cleanup/standardization by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/692
Glows l1a cdf by @anamanica in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/688
Update IDEX by @anamanica in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/695
Xtce combined by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/654
ENH/MNT: Add a common initial dataset creation routine by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/687
682 imap hi use imapcdfattributes instead of cdfattributemanager by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/684
Hi test data and fixture refactor by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/709
switched SWAPI CDF attrs to use YAML by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/704
Move MAG L1A to CDF attribute manager by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/693
Cleanup CDF dataclass by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/714

Full Changelog: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.3.0...v0.4.0

- Python
Published by bourque over 1 year ago

imap_processing - v0.3.0

This release includes updates to be used for the IMAP SDC Software Integration Test 3 (SIT-3). More information can be found in this galaxy page.

Features

Updated L0 decommutation algorithms for Ultra
Added unit tests for L0 decommutation for SWAPI
Added support for L1 processing for several instruments (CoDICE, GLOWS, Hi, HIT, Lo, MAG, SWAPI, SWE, Ultra)
Moved to YAML-based solution for defining CDF attributes
Updated cli script for triggering processing for instruments; added support for all instruments; added functionality for downloading dependencies and uploading produced files; added support for descriptor field.
Updated logging in L1 processing pipelines to use module-level logs
Updated documentation, particularly for CDF attributes and file structure, file naming conventions, and git/GitHub workflow
Added SPICE examples for Annotated Events
Added codespell pre-commit check
Updated version of space_packet_parser and cdflib
Added citation information and DOI badge for citing the repository
Added load_cdf helper function
Added launch_time parameter to cdf.utils.calc_start_time to allow instruments to define their own launch time.
Now defining repository version dynamically

What's Changed

FIX: Make sphinx-contrib an optional dependency only needed for doc builds by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/333
FIX: Make sure configurations are synced between packages by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/336
Fix IDEX and HIT tests by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/337
Update ruff by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/343
HIT housekeeping data class by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/342
Limit bitstring usage by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/344
Mag cdf by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/340
Updated naming conventions for CoDICE by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/334
CLI updates by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/341
MAG CDF updates by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/349
L0 Decom Ultra by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/347
Create l1a cdfs for auxiliary data packet by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/352
Update CoDICE CDFs to use datetime64 for EPOCH by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/354
Swapi decom tests by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/355
update to docker example that is used to build batch job image by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/351
Update decom for APID 881 due to changes in packet definitions by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/353
SWE updates to be compliant with new cdflib releases by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/357
Lo SciDE data class fix - multiple DEs in a packet by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/339
Updated naming and data product versioning conventions by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/358
MNT: Cleanup extra file in repository by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/361
TST: Rely on temp directory for test file cleanup by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/360
MNT: Use module-level logger by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/362
Added l1a cdf generation for all apids by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/356
MNT: Update file naming convention via imap-data-access upgrade by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/363
Remove Warnings by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/365
MNT: Rename Epoch to epoch lowercased for variable names by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/366
hi direct event l1a processing by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/364
Docs for calibration files by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/367
Initial CoDICE L1a algorithm for lo-sw-species data by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/300
Update documentation variable names by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/368
Various fixes and improvements to CDF documentation by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/372
Updating mag CDF generation to match new filenames by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/370
IMAP-Hi L1A DE after Discussion with Paul by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/369
MNT: Change default displaytype to be noplot by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/375
MNT: Remove unused extra test file by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/373
TST: Move codice xfail into a separate test by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/377
MNT: Change IDEX packet definition to be formatted like others by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/376
MNT: Remove unused extra file by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/381
MNT: Add codespell and fix spelling mistakes found by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/382
Update IMAP-Hi DE CDF attrs by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/374
Process IMAP-Hi Housekeeping data and create CDF file by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/371
TST: Avoid xarray.dims deprecation by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/380
MNT: Remove directory option from writecdf by @greglucas in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/379
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/385
Add vmartinez-cu to contributors by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/388
docs: add subagonsouth as a contributor for review by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/389
Added SPICE examples for Annotated Events by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/386
Update spacepacketparser version by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/387
Add citation file by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/392
Mag l1a processing by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/384
CDF attrs bug fix by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/393
CoDICE L1a for lo-sw-species-counts (and improvements to housekeeping) by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/391
Small updates to the CDF documentation by @bryan-harter in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/383
Added SWAPI science data CDF attribute by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/394
added SWAPI housekeeping processing and CDF attrs by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/398
Science Direct Event Decompression Re-write by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/397
Initial Lo L1A Science DE CDF by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/396
Lo Star Sensor and Science Counts data classes with bit decompression by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/319
MAG L1A CDF by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/395
Remove individual IMAP-Hi packet definition xtce files by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/401
Updating CLI to fix MAG by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/404
CoDICE lo-sw-species-counts test data by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/402
CoDICE L1a lo-nsw-species-counts by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/530
updates to utils createdateset function by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/532
Updates based on SPDF feedback by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/533
IMAP Hi Histogram L1A processing by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/535
Initial Codice L1A validation tests by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/534
docs: add subagonsouth and vmartinez-cu as a contributor for code by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/539
MNT: Remove direct bitstring dependency by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/536
CoDICE L1a lo-sw-priority-counts by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/540
CoDICE L1a Lo Sunward Angular Counts by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/544
loadcdf helper function by @bourque in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/537
Cleaning up some L1A hist CDF issues found when reviewing output file by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/547
CI: Add codecov upload token by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/554
Add launchtime parameter to cdf.utils.calcstarttime by @bourque in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/552
Add a DOI badge to the README by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/555
Refactor imapprocessing.cli.ProcessInstrument by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/550
WIP - Define L0 data class attributes for HIT science packet by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/549
Removed all non-science data for SWE by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/558
CoDICE L1a various fixes by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/557
Updates to SWE based on new test data by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/560
203 imap hi l1b processed housekeeping by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/559
L1A SIT-3 Preparation by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/556
Update to SWE processing in cli.py by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/561
Added SWAPI and IDEX to cli.py by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/565
CI: remove minor/patch version pin from codecov by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/568
CoDICE L1A cli by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/570
[WIP] New file defining HIT CDF attributes by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/563
Codice L1A updates for SIT-3 by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/567
L1b outline for Ultra by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/566
Glows l1a cdf first draft by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/546
SwxSOC cdf investigation by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/564
MNT: Minimize warnings and prepare for the future by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/572
ENH/tools: Add metadata helper script to convert excel to yaml by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/562
Dynamic version by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/571
Move CoDICE to YAML-based CDF attribute definition by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/582
Sit 3 Ultra L1b and L1c by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/581
Create HIT L1A CDF for Housekeeping by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/583
Created SWE CDF Attrs YAML by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/584
CoDICE L1a lo-counters-aggregated and lo-counters-singles by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/585
TST/FIX: cast to datetime64[ns] to avoid warnings by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/598
docs: add daralynnrhode as a contributor for code, and doc by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/601
docs: add anamanica as a contributor for code, and doc by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/602
MNT/TST: Prepare for cdflib upgrade by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/600
Adding LABLPRTi to 2D or higher Dimension Data Type - SWE by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/603
Update CLI for HIT L1A by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/590
Lo L1A processing and CDF For SIT-3 by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/599
Text update to API doc Explanation by @daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/586
CDF file requirements example by @anamanica in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/587
BUGFIX - loadcdf results in added xarray specific attributes by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/597
Workflow Edits by @anamanica in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/596
Codice L1a hi products for SIT-3 by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/608
MNT: Docs Updates by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/610
205 imap hi l1b annotated direct events by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/604
Lo L1B CDF Creation for SIT-3 by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/607
Add back in Filenamingconvention to CDF global attribute schema file by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/613
Glows l1b processing by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/605
Fix for dataversion in file output, using SWE as an example by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/611
Data version update by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/619
Codice l1a CDF fixes by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/617
HIT L1B CDF Creation for SIT-3 by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/616
Lo L1C CDF Creation for SIT-3 by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/614
Data version fixes for SWE and SWAPI by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/621
Dataversion updates to Lo L1C by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/625
Glows l1b cdf by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/618
REL/CI: Add build job dependency to release process by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/624
Inital Codice L1b processing (for SIT-3) by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/622
HIT Dataversion fixes by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/626
Mag L1B/L1C cdf by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/623
609 imap hi l1c pointing set cdf by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/627
630 final hi updates for sit 3 by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/631
Glows fixes for deployment by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/629
Add to SIT-3 data variables by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/589
Add Hi sensor name to imaphil1bhk products by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/633
Mag hotfix by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/636
Update for Sit 3 by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/635
MNT: Add optional descriptor field to the cli by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/640
Add back Lo Data Version input for lol1c in cli.py by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/642

Full Changelog: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.2.0...v0.3.0

- Python
Published by bourque over 1 year ago

imap_processing - v0.3.0rc2

What's Changed

Lo L1C CDF Creation for SIT-3 by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/614
Data version fixes for SWE and SWAPI by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/621
Dataversion updates to Lo L1C by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/625
Glows l1b cdf by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/618
REL/CI: Add build job dependency to release process by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/624
Inital Codice L1b processing (for SIT-3) by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/622
HIT Dataversion fixes by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/626
Mag L1B/L1C cdf by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/623
609 imap hi l1c pointing set cdf by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/627
630 final hi updates for sit 3 by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/631
Glows fixes for deployment by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/629
Add to SIT-3 data variables by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/589
Add Hi sensor name to imaphil1bhk products by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/633
Mag hotfix by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/636
Update for Sit 3 by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/635
MNT: Add optional descriptor field to the cli by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/640

Full Changelog: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.3.0rc1...v0.3.0rc2

- Python
Published by bourque over 1 year ago

imap_processing - v0.3.0rc1

What's Changed

v0.2.0 Release by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/332
FIX: Make sphinx-contrib an optional dependency only needed for doc builds by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/333
FIX: Make sure configurations are synced between packages by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/336
Fix IDEX and HIT tests by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/337
Update ruff by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/343
HIT housekeeping data class by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/342
Limit bitstring usage by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/344
Mag cdf by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/340
Updated naming conventions for CoDICE by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/334
CLI updates by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/341
MAG CDF updates by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/349
L0 Decom Ultra by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/347
Create l1a cdfs for auxiliary data packet by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/352
Update CoDICE CDFs to use datetime64 for EPOCH by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/354
Swapi decom tests by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/355
update to docker example that is used to build batch job image by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/351
Update decom for APID 881 due to changes in packet definitions by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/353
SWE updates to be compliant with new cdflib releases by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/357
Lo SciDE data class fix - multiple DEs in a packet by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/339
Updated naming and data product versioning conventions by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/358
MNT: Cleanup extra file in repository by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/361
TST: Rely on temp directory for test file cleanup by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/360
MNT: Use module-level logger by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/362
Added l1a cdf generation for all apids by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/356
MNT: Update file naming convention via imap-data-access upgrade by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/363
Remove Warnings by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/365
MNT: Rename Epoch to epoch lowercased for variable names by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/366
hi direct event l1a processing by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/364
Docs for calibration files by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/367
Initial CoDICE L1a algorithm for lo-sw-species data by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/300
Update documentation variable names by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/368
Various fixes and improvements to CDF documentation by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/372
Updating mag CDF generation to match new filenames by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/370
IMAP-Hi L1A DE after Discussion with Paul by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/369
MNT: Change default displaytype to be noplot by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/375
MNT: Remove unused extra test file by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/373
TST: Move codice xfail into a separate test by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/377
MNT: Change IDEX packet definition to be formatted like others by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/376
MNT: Remove unused extra file by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/381
MNT: Add codespell and fix spelling mistakes found by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/382
Update IMAP-Hi DE CDF attrs by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/374
Process IMAP-Hi Housekeeping data and create CDF file by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/371
TST: Avoid xarray.dims deprecation by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/380
MNT: Remove directory option from writecdf by @greglucas in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/379
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/385
Add vmartinez-cu to contributors by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/388
docs: add subagonsouth as a contributor for review by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/389
Added SPICE examples for Annotated Events by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/386
Update spacepacketparser version by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/387
Add citation file by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/392
Mag l1a processing by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/384
CDF attrs bug fix by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/393
CoDICE L1a for lo-sw-species-counts (and improvements to housekeeping) by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/391
Small updates to the CDF documentation by @bryan-harter in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/383
Added SWAPI science data CDF attribute by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/394
added SWAPI housekeeping processing and CDF attrs by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/398
Science Direct Event Decompression Re-write by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/397
Initial Lo L1A Science DE CDF by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/396
Lo Star Sensor and Science Counts data classes with bit decompression by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/319
MAG L1A CDF by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/395
Remove individual IMAP-Hi packet definition xtce files by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/401
Updating CLI to fix MAG by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/404
CoDICE lo-sw-species-counts test data by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/402
CoDICE L1a lo-nsw-species-counts by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/530
updates to utils createdateset function by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/532
Updates based on SPDF feedback by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/533
IMAP Hi Histogram L1A processing by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/535
Initial Codice L1A validation tests by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/534
docs: add subagonsouth and vmartinez-cu as a contributor for code by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/539
MNT: Remove direct bitstring dependency by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/536
CoDICE L1a lo-sw-priority-counts by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/540
CoDICE L1a Lo Sunward Angular Counts by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/544
loadcdf helper function by @bourque in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/537
Cleaning up some L1A hist CDF issues found when reviewing output file by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/547
CI: Add codecov upload token by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/554
Add launchtime parameter to cdf.utils.calcstarttime by @bourque in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/552
Add a DOI badge to the README by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/555
Refactor imapprocessing.cli.ProcessInstrument by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/550
WIP - Define L0 data class attributes for HIT science packet by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/549
Removed all non-science data for SWE by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/558
CoDICE L1a various fixes by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/557
Updates to SWE based on new test data by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/560
203 imap hi l1b processed housekeeping by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/559
L1A SIT-3 Preparation by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/556
Update to SWE processing in cli.py by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/561
Added SWAPI and IDEX to cli.py by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/565
CI: remove minor/patch version pin from codecov by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/568
CoDICE L1A cli by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/570
[WIP] New file defining HIT CDF attributes by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/563
Codice L1A updates for SIT-3 by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/567
L1b outline for Ultra by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/566
Glows l1a cdf first draft by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/546
SwxSOC cdf investigation by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/564
MNT: Minimize warnings and prepare for the future by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/572
ENH/tools: Add metadata helper script to convert excel to yaml by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/562
Dynamic version by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/571
Move CoDICE to YAML-based CDF attribute definition by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/582
Sit 3 Ultra L1b and L1c by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/581
Create HIT L1A CDF for Housekeeping by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/583
Created SWE CDF Attrs YAML by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/584
CoDICE L1a lo-counters-aggregated and lo-counters-singles by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/585
TST/FIX: cast to datetime64[ns] to avoid warnings by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/598
docs: add daralynnrhode as a contributor for code, and doc by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/601
docs: add anamanica as a contributor for code, and doc by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/602
MNT/TST: Prepare for cdflib upgrade by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/600
Adding LABLPRTi to 2D or higher Dimension Data Type - SWE by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/603
Update CLI for HIT L1A by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/590
Lo L1A processing and CDF For SIT-3 by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/599
Text update to API doc Explanation by @daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/586
CDF file requirements example by @anamanica in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/587
BUGFIX - loadcdf results in added xarray specific attributes by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/597
Workflow Edits by @anamanica in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/596
Codice L1a hi products for SIT-3 by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/608
MNT: Docs Updates by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/610
205 imap hi l1b annotated direct events by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/604
Lo L1B CDF Creation for SIT-3 by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/607
Add back in Filenamingconvention to CDF global attribute schema file by @subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/613
Glows l1b processing by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/605
Fix for dataversion in file output, using SWE as an example by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/611
Data version update by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/619
Codice l1a CDF fixes by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/617
HIT L1B CDF Creation for SIT-3 by @vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/616

New Contributors

@vmartinez-cu made their first contribution in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/392
@subagonsouth made their first contribution in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/401
@daralynnrhode made their first contribution in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/586
@anamanica made their first contribution in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/587

Full Changelog: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.2.0...v0.3.0rc1

- Python
Published by bourque over 1 year ago

imap_processing - v0.2.0

This release includes updates to be presented at the IMAP Science Team Meeting at LASP in February 2024. More information can be found in this galaxy page.

Features

Additions and Updates to project documentation, including Poetry, CDFs, PR reviews, Release Workflow, Versioning, File Naming Conventions, Issue Management, SDC Test Planning, Data Access API, and general code documentation
Improved test coverage, including validation of CCSDS headers, processing algorithms
Added XTCE generation code and XTCE packet definitions
Implemented class-based CDF creation system
Implementation of L0 processing for all instruments
Implementation of L1 processing for IDEX, SWE, SWAPI
Partial implementation of L1 processing for CoDICE, HIT, GLOWS, IMAP-Lo
Added instrument processing command line utility
Added SPICE foundational tools
Added Docker template for access to EFS
Added/updated pre-commit hooks
Added support for Python 3.12

What's Changed

XTCE decom with CoDICE example by @GFMoraga in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/72
Poetry docs by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/76
fixed linting issues by @GFMoraga in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/87
docs: add sdhoyt as a contributor for doc by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/89
docs: add GFMoraga as a contributor for maintenance by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/90
DOC: Update sphinx references by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/92
TST: Add coverage to testing pipeline by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/80
Adding documenation for pull request review standards by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/82
Made tools directory and updated .toml by @GFMoraga in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/84
Issue management documentation by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/85
SDC Test Plan docs by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/88
Init commit of IDEX packet parser by @bryan-harter in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/79
Adding CoDICE Event data + Species counts packet definitions for L0 by @GFMoraga in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/106
Xtce generator by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/145
Xtce generator updates by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/155
Lo pkt definitions for housekeeping, sectored, angular,and priority counts by @GFMoraga in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/158
Xtce IntegerParameterType fixes by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/159
Commit for the devcontainer/dockerfile needed for Codespaces by @bryan-harter in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/78
Handle Telem Def Nans by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/161
SWE science L1A algorithm by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/154
Added rest of SWE packet definitions by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/160
New tools documentation by @GFMoraga in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/163
Updated xtce files with updated xtce-generator by @GFMoraga in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/173
L0 Decom for Ultra by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/128
DOC: Add autosummary templates and update docstrings for code by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/171
Ruff docs by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/174
Extracting and adding new data to the IDEX L1 by @bryan-harter in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/162
docs: add laspsandoval as a contributor for code by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/181
docs: add bryan-harter as a contributor for code by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/182
SIT-2 Release [dev] [v0.1.x] by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/180
New SWE test and validation data by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/178
Glows Decom work by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/175
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/183
Fixed xtce typo and updated codice xtce files by @GFMoraga in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/185
MNT: Updating settings for codecov by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/245
Updating GLOWS XTCE files with generator bugfix by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/244
Test CCSDS header across all instrument packet definitions by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/184
Update release workflow to reflect use of 'version' branches by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/257
Glows L0 changes to data class to accomodate L1A needs by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/264
Housekeeping data testing and validation for CoDICE l0 by @GFMoraga in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/176
L1 cdf creation by @bryan-harter in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/179
initial hit l1a decom by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/164
I-ALiRT: L0 parsing by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/246
CDF documentation update by @bryan-harter in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/273
Create CDF class based system by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/272
SWE L1B implementation and updates to L1A by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/253
CoDICE decompression algorithms for science data by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/278
IMAP-Hi XTCE and initial Decom work by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/282
updates to IMAP-Hi and SWE's document by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/283
IMAP Lo XTCE Definitions by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/275
Add CoDICE API reference docs by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/285
CI: Update codecov to target 90% for the project by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/284
Doc configuration updates by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/286
Initial CoDICE L1A Processing Algorithm by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/288
SWAPI XTCE and utils code by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/291
Add file naming conventions documentation to style guide by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/292
Documentation cleanup/renaming effort by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/290
Added eu analog conversion to testdecom by @GFMoraga in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/274
Instrument processing command line utility by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/266
Foundational SPICE tools by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/279
Add ruff check for module docstrings by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/294
Updated the pkt def xtce by @GFMoraga in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/298
Add instructions for rebasing in git workflow docs by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/299
Include expected descriptors in filename conventions docs by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/297
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/301
Mag L0/Decom work by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/289
Glows L1A Processing Algorithm by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/287
Setup docker template access to EFS by @laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/302
SWAPI Level 1 Implementation by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/304
MNT: Switch from black to ruff by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/306
MNT: Enable Python 3.12 support by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/305
PERF: Speed up bitstring conversions in idex by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/309
DOC: Add package description to the top-level namespace by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/307
TST: Move test structure to a single test directory by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/308
TST: Move MAG tests over by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/312
TST: Re-use test fixtures within the module if possible by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/311
PERF: Remove buffer size limitation by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/310
Make a default data directory by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/303
MNT: Rename description to descriptor in filename variable by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/313
MNT: Cleanup ruff codes by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/314
MNT: cleanup pyproject file by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/315
REST API docs via OpenAPI by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/316
IMAP-Lo Science Direct Event Decompression by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/296
Change name of style guide API documentation by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/318
Fixed typo in pypi URL by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/320
docs: add tech3371 as a contributor for doc by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/321
docs: add laspsandoval as a contributor for infra, and ideas by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/322
docs: add sdhoyt as a contributor for maintenance by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/323
docs: add bourque as a contributor for maintenance by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/324
docs: add GFMoraga as a contributor for doc by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/325
docs: add maxinelasp as a contributor for maintenance by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/326
docs: add bryan-harter as a contributor for doc by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/327
docs: add mstrumik as a contributor for review by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/328
Imap cli updates by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/330
Updates to API docs by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/329
Use "extension" instead of "format" in naming conventions by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/331

Full Changelog: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.1.0...v0.2.0

- Python
Published by bourque about 2 years ago

imap_processing - v0.1.0

This release marks the successful completion of SIT-2. Further information about what was tested in SIT-2 can be found in this galaxy page and the SIT-2 GitHub Project Board.

Features

Added project documentation (via Sphinx & ReadTheDocs), including Style Guide, development practices, and API reference
Added Actions workflow to automatic documentation builds
Added Actions workflow to automatic deployment to PyPI upon release
Added pre-commit hooks
Added Issue and Pull Request templates
Added all-contributors section in README

What's Changed

PR template by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/3
SWE packet decom example by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1
Code of Conduct by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/4
MNT: Adding more pre-commit hooks by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/5
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/14
Merge main to dev by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/20
Adding documentation builds by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/15
Add All Contributors section to README by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/25
docs: add greglucas as a contributor for code, bug, and 5 more by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/27
docs: add tech3371 as a contributor for code, bug, and 5 more by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/28
docs: add sdhoyt as a contributor for code, bug, and 5 more by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/32
docs: add GFMoraga as a contributor for code, bug, and 5 more by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/33
docs: add bourque as a contributor for code by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/26
docs: add maxinelasp as a contributor for code, and review by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/34
adding templates for issues by @GFMoraga in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/18
Style Guide by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/19
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/21
Added yaml file for read the docs by @sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/42
BLD: Update Poetry lock file for Poetry v1.5.0 by @greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/41
Updating documentation by @maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/46
adding module path in imapprocessing - fixes by @tech3371 in https://github.com/IMAP-Science-Operations-Center/imapprocessing/pull/47
Add no-commit-to-branch pre-commit hook by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/50
Convert style guide from markdown to rst by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/51
Break up style guide into multiple pages by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/53
docs: add maxinelasp as a contributor for doc by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/56
docs: add GFMoraga as a contributor for review by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/57
docs: add greglucas as a contributor for review by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/58
docs: add bourque as a contributor for review by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/59
docs: add tech3371 as a contributor for review by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/60
docs: add sdhoyt as a contributor for review by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/62
docs: add laspsandoval as a contributor for review by @allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/61
Document Versioning Schemes by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/54
Document Release Workflow by @bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/55

Full Changelog: https://github.com/IMAP-Science-Operations-Center/imap_processing/commits/v0.1.0

- Python
Published by bourque over 2 years ago