Recent Releases of lstosa
lstosa - v0.11.3
What's Changed
- Update crontab by @contrera in https://github.com/cta-observatory/lstosa/pull/351
- Check if sequences are completed only up to level DL1AB by @marialainez in https://github.com/cta-observatory/lstosa/pull/350
Full Changelog: https://github.com/cta-observatory/lstosa/compare/v0.11.2...v0.11.3
- Python
Published by marialainez 7 months ago
lstosa - v0.11.2
What's Changed
- Add sequencercatBtailcuts script to reprocessing.py by @marialainez in https://github.com/cta-observatory/lstosa/pull/343
- Add option to overwrite the existing Cat-B calibration files by @marialainez in https://github.com/cta-observatory/lstosa/pull/344
- Change exit code to 0 if catB files are not produced yet by @marialainez in https://github.com/cta-observatory/lstosa/pull/342
- Force autocloser to exit if cron.lock exists by @marialainez in https://github.com/cta-observatory/lstosa/pull/345
- Write all arguments of reprocessing in lowercase by @marialainez in https://github.com/cta-observatory/lstosa/pull/349
Full Changelog: https://github.com/cta-observatory/lstosa/compare/v0.11.1...v0.11.2
- Python
Published by marialainez 7 months ago
lstosa - v0.11.0
What's Changed
- Allow to decide if the longterm symlink should be created or not by @marialainez in https://github.com/cta-observatory/lstosa/pull/324
- Adapt script to use lstcam_calib for Cat-B calibration by @marialainez in https://github.com/cta-observatory/lstosa/pull/326
- Changes about the calibration prod_id - Issue #322 by @rcervinoucm in https://github.com/cta-observatory/lstosa/pull/325
- Add RAWR0DIR parameter to sequencer.cfg by @marialainez in https://github.com/cta-observatory/lstosa/pull/328
- Consider only files produced with version vX.Y.Z to create the symlink by @marialainez in https://github.com/cta-observatory/lstosa/pull/330
- Update to lstchain v0.11 by @marialainez in https://github.com/cta-observatory/lstosa/pull/327
- Update R0 path in showrunsummary script by @marialainez in https://github.com/cta-observatory/lstosa/pull/331
- Change calibration directory names following names in the cfg by @marialainez in https://github.com/cta-observatory/lstosa/pull/333
- Skip temporarily calibration steps test by @marialainez in https://github.com/cta-observatory/lstosa/pull/335
- Make sequencercatBtailcuts script compatible with calibration scripts from lstchain and lstcam_calib by @marialainez in https://github.com/cta-observatory/lstosa/pull/334
- Use the configuration file to define paths in updatesourcecatalog script by @marialainez in https://github.com/cta-observatory/lstosa/pull/332
- Produce and look for calibration files with lstcam_calib version by @marialainez in https://github.com/cta-observatory/lstosa/pull/337
- Search the calibration files using the lstcam_calib version by @marialainez in https://github.com/cta-observatory/lstosa/pull/338
- Allow to decide in the cfg file if the lstcam-env should be used or not by @marialainez in https://github.com/cta-observatory/lstosa/pull/339
Full Changelog: https://github.com/cta-observatory/lstosa/compare/v0.10.19...v0.11.0
- Python
Published by marialainez 8 months ago
lstosa - v0.10.19
What's Changed
- Look for the closest declination line and adequate NSB random forest model for DL2 production by @marialainez in https://github.com/cta-observatory/lstosa/pull/280
- Application of Cat-B calibration (option1) by @marialainez in https://github.com/cta-observatory/lstosa/pull/302
Full Changelog: https://github.com/cta-observatory/lstosa/compare/v0.10.18...v0.10.19
- Python
Published by marialainez 11 months ago
lstosa - v0.10.18
What's Changed
- Bump codecov/codecov-action from 4 to 5 by @dependabot in https://github.com/cta-observatory/lstosa/pull/319
- Use lstcam_calib instead of lstchain for the calibration by @marialainez in https://github.com/cta-observatory/lstosa/pull/310
Full Changelog: https://github.com/cta-observatory/lstosa/compare/v0.10.17...v0.10.18
- Python
Published by marialainez about 1 year ago
lstosa - v0.10.17
What's Changed
- Use the SLURM account specified in the cfg also for the gainsel and autocloser jobs by @marialainez in https://github.com/cta-observatory/lstosa/pull/317
Full Changelog: https://github.com/cta-observatory/lstosa/compare/v0.10.16...v0.10.17
- Python
Published by marialainez over 1 year ago
lstosa - v0.10.16
What's Changed
- Add release drafter action by @morcuended in https://github.com/cta-observatory/lstosa/pull/309
- Check if history files of a run exist before creating .closed files by @marialainez in https://github.com/cta-observatory/lstosa/pull/313
- Avoid running sequencer again if there is any timeout by @marialainez in https://github.com/cta-observatory/lstosa/pull/314
- Fix issue in function "timeoutinsequencer" by @marialainez in https://github.com/cta-observatory/lstosa/pull/316
- Write the prod_id corresponding to each step in the history files by @marialainez in https://github.com/cta-observatory/lstosa/pull/315
Full Changelog: https://github.com/cta-observatory/lstosa/compare/v0.10.15...v0.10.16
- Python
Published by marialainez over 1 year ago
lstosa - v0.10.15
What's Changed
- Gain sel tracker by @rcervinoucm in https://github.com/cta-observatory/lstosa/pull/295
- Update gainsel_webmaker.py by @rcervinoucm in https://github.com/cta-observatory/lstosa/pull/296
- Update gainsel_webmaker.py by @rcervinoucm in https://github.com/cta-observatory/lstosa/pull/297
- Update gainsel_webmaker.py table output by @contrera in https://github.com/cta-observatory/lstosa/pull/299
- Add option in the cfg to select the SLURM account by @marialainez in https://github.com/cta-observatory/lstosa/pull/300
- Add dependantbot by @morcuended in https://github.com/cta-observatory/lstosa/pull/304
- Bump actions/checkout from 3 to 4 by @dependabot in https://github.com/cta-observatory/lstosa/pull/308
- Bump actions/setup-python from 3 to 5 by @dependabot in https://github.com/cta-observatory/lstosa/pull/307
- Bump mamba-org/setup-micromamba from 1 to 2 by @dependabot in https://github.com/cta-observatory/lstosa/pull/305
- Bump codecov/codecov-action from 3 to 4 by @dependabot in https://github.com/cta-observatory/lstosa/pull/306
- Improvements for gain selection automation by @marialainez in https://github.com/cta-observatory/lstosa/pull/293
New Contributors
- @rcervinoucm made their first contribution in https://github.com/cta-observatory/lstosa/pull/295
- @contrera made their first contribution in https://github.com/cta-observatory/lstosa/pull/299
- @dependabot made their first contribution in https://github.com/cta-observatory/lstosa/pull/308
Full Changelog: https://github.com/cta-observatory/lstosa/compare/v0.10.14...v0.10.15
- Python
Published by marialainez over 1 year ago
lstosa - v0.10.14
What's Changed
- Add argument to allow the selection of the tool for the gain selection by @marialainez in https://github.com/cta-observatory/lstosa/pull/289
- Check for UCTS or TIB info only when using the lstdvr tool (not necessary for lstchainr0tor0g) by @marialainez in https://github.com/cta-observatory/lstosa/pull/290
- Add no-gainsel option to reprocessing.py by @marialainez in https://github.com/cta-observatory/lstosa/pull/291
Full Changelog: https://github.com/cta-observatory/lstosa/compare/v0.10.13...v0.10.14
- Python
Published by marialainez almost 2 years ago
lstosa - v0.10.13
What's Changed
- Fix comment in gain_selection script by @marialainez in https://github.com/cta-observatory/lstosa/pull/285
- Upload crontab by @marialainez in https://github.com/cta-observatory/lstosa/pull/286
- Add no-gainsel option to sequencer_webmaker by @marialainez in https://github.com/cta-observatory/lstosa/pull/288
Full Changelog: https://github.com/cta-observatory/lstosa/compare/v0.10.12...v0.10.13
- Python
Published by morcuended almost 2 years ago
lstosa - v0.10.11
What's Changed
- Wait until the longterm datacheck file is created to make the link by @marialainez in https://github.com/cta-observatory/lstosa/pull/279
- Move the launch of some jobs before in closer by @marialainez in https://github.com/cta-observatory/lstosa/pull/282
- Remove showrunsummary + rename showrunsummary_tcu by @marialainez in https://github.com/cta-observatory/lstosa/pull/283
- Change "&" by "and" in the while checking the status of autocloser jobs by @marialainez in https://github.com/cta-observatory/lstosa/pull/284
Full Changelog: https://github.com/cta-observatory/lstosa/compare/v0.10.10...v0.10.11
- Python
Published by marialainez almost 2 years ago
lstosa - v0.10.10
What's Changed
- Undo the possible symlink to longterm file before making the new one by @marialainez in https://github.com/cta-observatory/lstosa/pull/278
Full Changelog: https://github.com/cta-observatory/lstosa/compare/v0.10.9...v0.10.10
- Python
Published by marialainez about 2 years ago
lstosa - v0.10.9
What's Changed
- Solve problem with autocloser in v0.10.8 by @marialainez in https://github.com/cta-observatory/lstosa/pull/277
- Check state of the jobs launched by autocloser by @marialainez in https://github.com/cta-observatory/lstosa/pull/269
- Make link of the updated longterm datacheck file in a common directory by @marialainez in https://github.com/cta-observatory/lstosa/pull/273
Full Changelog: https://github.com/cta-observatory/lstosa/compare/v0.10.8...v0.10.9
- Python
Published by marialainez about 2 years ago
lstosa - v0.10.8
What's Changed
- Launch lstchaincherenkovtransparency.py script as a new step of closer by @marialainez in https://github.com/cta-observatory/lstosa/pull/271
Full Changelog: https://github.com/cta-observatory/lstosa/compare/v0.10.7...v0.10.8
- Python
Published by marialainez about 2 years ago
lstosa - v0.10.7
What's Changed
- Bump lstchain version in pyproject and conda env by @morcuended in https://github.com/cta-observatory/lstosa/pull/265
- Use first event time in update catalog script by @morcuended in https://github.com/cta-observatory/lstosa/pull/264
- Update gain selection tool by @marialainez in https://github.com/cta-observatory/lstosa/pull/267
- Do not pin matplotlib version by @morcuended in https://github.com/cta-observatory/lstosa/pull/268
- Do not create the DL2 directory if --no-dl2 option is given by @marialainez in https://github.com/cta-observatory/lstosa/pull/266
Full Changelog: https://github.com/cta-observatory/lstosa/compare/v0.10.6...v0.10.7
- Python
Published by marialainez about 2 years ago
lstosa - v0.10.6
What's Changed
- Add help messages for arguments in gain selection script by @marialainez in https://github.com/cta-observatory/lstosa/pull/258
- Do not produce provenance for DL2 if --no-dl2 option is given by @marialainez in https://github.com/cta-observatory/lstosa/pull/259
- Update search_filters function to lstchain v0.10.5 by @marialainez in https://github.com/cta-observatory/lstosa/pull/260
Full Changelog: https://github.com/cta-observatory/lstosa/compare/v0.10.5...v0.10.6
- Python
Published by marialainez about 2 years ago
lstosa - v0.10.5
What's Changed
- Use CALIBPRODID instead of pro to search for calibration files by @marialainez in https://github.com/cta-observatory/lstosa/pull/239
- Update README by @morcuended in https://github.com/cta-observatory/lstosa/pull/255
- Add start and end time of gain selection as input arguments by @marialainez in https://github.com/cta-observatory/lstosa/pull/256
Full Changelog: https://github.com/cta-observatory/lstosa/compare/v0.10.4...v0.10.5
- Python
Published by marialainez over 2 years ago
lstosa - v0.10.4
What's Changed
- Update CaCo DB server by @morcuended in https://github.com/cta-observatory/lstosa/pull/251
- Use pyproject toml and update documentation by @morcuended in https://github.com/cta-observatory/lstosa/pull/252
- Copy datacheck files to webserver by @marialainez in https://github.com/cta-observatory/lstosa/pull/254
Full Changelog: https://github.com/cta-observatory/lstosa/compare/v0.10.3...v0.10.4
- Python
Published by marialainez over 2 years ago
lstosa - v0.10.3
What's Changed
- Move also interleaved files to the final directory by @marialainez in https://github.com/cta-observatory/lstosa/pull/240
- Add interleaved files to cleanup + update datacheck directory by @marialainez in https://github.com/cta-observatory/lstosa/pull/249
Full Changelog: https://github.com/cta-observatory/lstosa/compare/v0.10.2...v0.10.3
- Python
Published by marialainez over 2 years ago
lstosa - v0.10.2
What's Changed
- Update .readthedocs.yml by @morcuended in https://github.com/cta-observatory/lstosa/pull/234
- Add pipefail to bash execution in CI tests by @morcuended in https://github.com/cta-observatory/lstosa/pull/235
- Add new TCU database server by @morcuended in https://github.com/cta-observatory/lstosa/pull/237
- Add script that updates the LST source catalog by @marialainez in https://github.com/cta-observatory/lstosa/pull/241
- add possibility to select the prod id by @marialainez in https://github.com/cta-observatory/lstosa/pull/244
- Add entry point for updatesourcecatalog script by @marialainez in https://github.com/cta-observatory/lstosa/pull/245
- Only search run info in the DB for actual data runs by @morcuended in https://github.com/cta-observatory/lstosa/pull/246
Full Changelog: https://github.com/cta-observatory/lstosa/compare/v0.10.1...v0.10.2
Contributors
@morcuended, @marialainez
- Python
Published by morcuended over 2 years ago
lstosa - v0.10.0
Update lstosa to work with lstchain v0.10.x
Main update is the file naming of the drive pointing files
What's Changed
- add possibility to analyze data for nights without DRS4 or PEDCALIB runs by @marialainez in https://github.com/cta-observatory/lstosa/pull/202
- Add also de calibration scripts to clean_up by @marialainez in https://github.com/cta-observatory/lstosa/pull/207
- Be able to set the flat-field heuristic option via osa cfg by @morcuended in https://github.com/cta-observatory/lstosa/pull/208
- Avoid reading the exception lines printed by sequencer by @marialainez in https://github.com/cta-observatory/lstosa/pull/209
- Use micromamba in CI by @morcuended in https://github.com/cta-observatory/lstosa/pull/212
- Copy directly the files of runs that don't appear in the run summaries by @marialainez in https://github.com/cta-observatory/lstosa/pull/214
- Summary from TCU observation summaries by @morcuended in https://github.com/cta-observatory/lstosa/pull/216
- Fix run summary from TCU script by @morcuended in https://github.com/cta-observatory/lstosa/pull/217
- Avoid running gain selection during night time and check slurm queue by @marialainez in https://github.com/cta-observatory/lstosa/pull/215
- Check the slurm queue and if it's night time for each new run (instead of checking it for each new date) by @marialainez in https://github.com/cta-observatory/lstosa/pull/218
- Add missing line in the gain selection by @marialainez in https://github.com/cta-observatory/lstosa/pull/219
- Reduce the maximum number of pending jobs to continue launching gain_… by @marialainez in https://github.com/cta-observatory/lstosa/pull/220
- Update the osa database only if the file is defined in the cfg file by @marialainez in https://github.com/cta-observatory/lstosa/pull/222
- update warning email sending hour by @morcuended in https://github.com/cta-observatory/lstosa/pull/224
- Skip temporarily sequencer webmaker test as it is hard to handle all possible error cases in tests by @morcuended in https://github.com/cta-observatory/lstosa/pull/231
- Updates to lstchain v0.10.0 by @morcuended in https://github.com/cta-observatory/lstosa/pull/211
- Use stdlib importlib instead of importlib_resources by @morcuended in https://github.com/cta-observatory/lstosa/pull/232
Full Changelog: https://github.com/cta-observatory/lstosa/compare/v0.9.5...v0.10.0
- Python
Published by morcuended over 2 years ago
lstosa - v0.9.4 - 2022-05-20
It mainly fixes the sequencer monitor web maker.
- Python
Published by morcuended almost 4 years ago
lstosa - v0.9.2 - 2022-05-11
What's Changed since v0.9.1
- Update license in setup.cfg to make it compatible with PyPi
Contributors
@morcuended
- Python
Published by release-drafter[bot] almost 4 years ago
lstosa - v0.9.0 – 2022-05-11
What's Changed since v0.8.0
- Add release drafter config (#157) @morcuended
- Auto-deploy package to pypi (#155) @morcuended
- Fix docs, add version and update authors (#156) @morcuended
- Problem reading the config file (#154) @marialainez
- add a warning in case the considered run is not in the summary table (#153) @marialainez
- Change getrundate function to get the date corresponding to a given… (#152) @marialainez
- Autocloser refactoring (#131) @morcuended
- Rename master branch as main in gh actions workflow (#151) @morcuended
- Add osa cfg to package data (#150) @morcuended
- Use git versioning (#149) @morcuended
- Update CI (#148) @morcuended
- Do not export conda env in closer, since it is already captured by provenance module (#147) @morcuended
- Bump lstchain and ctapipeiolst versions (#144) @morcuended
- Remove unused bash scripts (#145) @morcuended
- Add script to run gain selection over a list of dates, using the "lstselectgain" script (#141) @marialainez
- The datacheck directories are created and copied to the webserver even if there is no data. Create the datacheck directories only if there is data. (#142) @marialainez
- Being able to use lstchain config file in r0 to dl1 script (#140) @morcuended
- lstchain new version v0.9.4 (#139) @morcuended
- remove hyphen from short argument (#134) @morcuended
- Allow using simulate option in reprocessing script (#133) @morcuended
- Allow using reprocessing with any other script sequencer, closer or copy_datacheck (#132) @morcuended
- Check that all check files are copied to the webserver. (#130) @morcuended
- Add script to reprocess existing longterm files from a given production (#129) @morcuended
- Specify the sbatch walltime (#128) @morcuended
- Bump lstchain to v0.9.3 and io_lst to v0.16.0 (#127) @morcuended
- Implement script to reprocess a list of dates (#125) @morcuended
- Remove pyparsing requirement from setup (#124) @morcuended
- Make sure that only YYYYMMDD date directories are considered in glob when looking for run date (#123) @morcuended
- bump lstchain to 0.9.2 and ctapipeiolst to 0.15.1 (#122) @morcuended
- Refactor DL3+ stages (#121) @morcuended
- Refactor and move path related functions to new module (#118) @morcuended
- Minor fix in provenance capture (#119) @Bultako
- No need for copying index.php for listing files in datacheck web server (#117) @morcuended
- Fix provenance (#116) @Bultako
- Bump lstchain bugfix version 0.9.1 (#114) @morcuended
- Restore mylogger format in data and calibration sequences scripts (#113) @morcuended
- Refactor extract sequences, improve logging and cleanup (#112) @morcuended
- Write sacct job info to csv file (#111) @morcuended
- Allows setting how many days look back when fetching sacct job information (#110) @morcuended
- Use pedestal ids files in r0 to dl1 script provided they exists (#109) @morcuended
- Use systematic correction factor file in r0 to dl1 script (#108) @morcuended
- Refactor copy datacheck functions and script (#106) @morcuended
- Update setup and env to lstchain v0.9.0, ctapipe 0.12.0, ctapipeiolst 0.15.0 (#107) @morcuended
- Remove unused longterm script from cfg (#105) @morcuended
- Remove pedestal cleaning option in provenance tracking (#104) @Bultako
- Change name of the longterm script (#98) @marialainez
- Remove pedestal cleaning option in dl1ab command (#103) @marialainez
- Merge DL1b files on a run basis (#100) @morcuended
- Adjust sequencer webmaker to new number of columns (#97) @morcuended
- Script to update source coordinates in RunCatalog files (#93) @morcuended
- Store source info from TCU db in ECSV files to be reused (#92) @morcuended
- Being able to use calibration files from a different day (#90) @morcuended
- Fix ci hangs due to coverage 6.3 by pinning to 6.2 (#91) @Bultako
- Theta2 next-day results (#89) @morcuended
- Check if calibration files are already produced (#86) @morcuended
- DL2 to DL3 step implementation (#81) @morcuended
- Format data flow diagram as rst (#83) @morcuended
- [no ci] Add workflow diagram (#82) @morcuended
- Retrieve source information from TCU database (#80) @morcuended
- Add calibration to provenance tracking (#74) @Bultako
- Handle job info from squeue when there are other jobs (#79) @morcuended
- Properly handle sequencer job info from sacct (#78) @morcuended
- Update environment.yml and setup.py to lstchain 0.8.3 (#77) @morcuended
- Keep symlink to dl1ab in dl1 subdirectory (#76) @morcuended
- Delete run_summary.sh (#72) @morcuended
- Update paths in provenance info (#70) @morcuended
- Exit sequencer when no runs are found (#71) @morcuended
- Exit if no runs are found (#69) @morcuended
- Logging improvement (#68) @morcuended
Contributors
@Bultako, @marialainez, @morcuended
- Python
Published by release-drafter[bot] almost 4 years ago