Recent Releases of caldp
caldp - v0.2.21
- default base docker image set to CALDP20230208CAL_final
- default crds update to hst_1064.pmap
- significant refactoring to generalize processing terms and support
HAP processing workflows
- enabled S3 output tests and made related adjustments
- overhauled logging, dropping Python logging for print(), to:
- reduce complexity
- obtain log output running under pytest
- avoid writing to same log file from two processes concurrently: the .py’s and caldp-process
- re-enable console output of caldp .py logs
- Python
Published by raswaters about 3 years ago
caldp - v0.2.20
- overhauled scripts and github actions to shift to 100% Docker based development and test. native development and test is still possible but no longer supported and discouraged.
- default base docker image set to CALDP20221010CAL_final
- default crds update to hst_1038.pmap
- Python
Published by github-actions[bot] over 3 years ago
caldp - v0.2.19
- default base docker image set to CALDP20220527CAL_final
- default crds update to hst_1015.pmap
- bugfix for processing env in base image using new conda env
- update wcstools to 3.9.7 as the 3.9.5 download link is no longer available
- Python
Published by github-actions[bot] almost 4 years ago
caldp - v0.2.15
- handle OSError memory failure types
- default crds context update to 0968
- default base docker image update to CALDP20211119CAL_final
- python version update from 3.6 to 3.8.11 (matching the base caldp environment released by stsci)
- Python
Published by github-actions[bot] over 4 years ago
caldp - CALDP_20210827_CAL_final and hst_0943.pmap
updated default base image and default CRDS context
- Python
Published by github-actions[bot] over 4 years ago
caldp - CALDP_20210721_CAL_final and hst_0932.pmap
- github action workflows added to aid in gitflow admin
- base image update to CALDP20210721CAL_final and crds context default at 0932
- README improvements
- Python
Published by bhayden53 over 4 years ago
caldp - subprocess exit codes
- improved error messages when a subprocess in the shell crashes
- dockerfile cleanup
- default crds context update to 0922
- Python
Published by bhayden53 over 4 years ago
caldp - default crds context updated to hst_0920.pmap
- Python
Published by bhayden53 almost 5 years ago
caldp - default base image and crds context updates
- default base image updated to CALDP20210505CAL_final
- default CRDS context updated to hst_0910.pmap
- Python
Published by bhayden53 almost 5 years ago
caldp - default base image and crds context updates
- Python
Published by bhayden53 almost 5 years ago
caldp - crds retries
- 2 different forms of crds retries, including a general retry decorator in sysexit which may come in handy in other places
- fix for sysexit sometimes not logging the traceback of exceptions that were outside of exitonexception context handlers
- Python
Published by bhayden53 almost 5 years ago
caldp - include fits files in output when process fails
for developer debugging, include whatever fits and previews were created in the outputs tar even if the job fails in processing
- Python
Published by bhayden53 almost 5 years ago
caldp - more robust cleanup code
- improved cleanup logic
- Python
Published by bhayden53 almost 5 years ago
caldp - minor bugfixes
- caldp + calcloud no longer raises a ValueError on unhandled exit code
- Python
Published by bhayden53 almost 5 years ago
caldp - pull CRDS from processing S3 bucket
- due to limitations of the AWS Batch job definition, the CRDS context is being pinned with a file directly in the S3 bucket.
- Python
Published by bhayden53 almost 5 years ago
caldp - base image increment, S3 CRDS, runastrodriz cpu restriction
- update the default base calibration image
- operations-ready CRDS S3 config
- restrict astrodrizzle to 1 cpu to try to prevent infinite hanging
- Python
Published by bhayden53 almost 5 years ago
caldp - messages quickfix
- fixed processed-ipppssoot.trigger message not appearing due to cleanup happening too soon
- Python
Published by bhayden53 almost 5 years ago
caldp - Custom error codes
- custom exit statuses to be synced with CALCLOUD v0.3.0
- ecr image vulnerability scan security improvements
- uncommented cleanup code to be run from within image before exiting; could help with IO-related docker timeouts
- Python
Published by bhayden53 almost 5 years ago
caldp - HST Keywords and env file
- Properly populates the HST Keywords for AWSYSVER, CSYS_VER, and AWSDPVER. Requires calcloud >= v0.2.2 for setting the variables in the job definition environment. These are set in the raw files using
fits.setvalwhich updates or inserts, then the calibration code propagates them through to new products. - uses env file from inputs tar to set some env variables needed by calibration code, then puts the file into a directory in the outputs for ease of debugging.
- Python
Published by bhayden53 almost 5 years ago
caldp - filenames only for calibration code
- use os.path.basename for files passed to the calibration code
- turn off appending to trailer files, as the trailers seem to be populated more fully for associations with the above change
- Python
Published by bhayden53 almost 5 years ago
caldp -
getting an up-to-date tagged release for deployment testing
- Python
Published by bhayden53 about 5 years ago