Recent Releases of https://github.com/cta-observatory/ctapipe

https://github.com/cta-observatory/ctapipe - v0.26.0 – 2025-06-06

Summary

See the changelog in the documentation for a high-level description of what has changed and find the list of merged pull requests below.

Contributors

@TjarkMiener, @burmist-git, @kosack, @maxnoe and Tjark.Miener

What has changed since v0.25.1

Pull-requests containing changes of multiple nature are repeated.

  • Add option single_ob to HDF5Merger for merging chunks of the same ob (#2436) @maxnoe
  • Muon fit improvement (#2736) @burmist-git
  • Use telescope frame for muon test instead of manual transform (#2752) @maxnoe
  • Use actual muon PDF for toy model ring (#2751) @maxnoe

New features

  • Add option to skip R1 (cat-A) calibration for MCs (#2753) @TjarkMiener
  • Add support for start, stop to chunked reading (#2757) @maxnoe

Bug Fixes

  • Two small CameraDisplay fixes: subfigures and optional psi_uncertainty (#2762) @maxnoe

Maintenance

  • Fix setuptools deprecation warnings (#2747) @maxnoe

- Python
Published by github-actions[bot] 12 months ago

https://github.com/cta-observatory/ctapipe - v0.25.1 – 2025-04-28

Summary

This is a small bug-fix release containing two minor fixes. See the changelog for more details and the list of merged pull requests and contributors below.

Contributors

@kosack and @maxnoe

Bug Fixes

  • Catch any exception in _get_username (#2741) @maxnoe
  • Do not require subarray pointing in HDF5EventSource (#2744) @maxnoe

- Python
Published by github-actions[bot] about 1 year ago

https://github.com/cta-observatory/ctapipe - v0.25.0 – 2025-04-16

Summary

This is mainly a Bugfix release but with one new feature adding two new fields to the hillas parameters.

See the changelog and the list of merged pull requests below.

Contributors

@kosack, @maxnoe, @mexanick and @ruoyushang

What has changed since v0.24.0

Pull-requests containing changes of multiple nature are repeated.

  • Improve handling of missing true images (#2735) @maxnoe
  • Hillas psi uncertainty ruo (#2629) @ruoyushang
  • Fix wrong proba column being used for disp sign (#2738) @maxnoe
  • Docs: Rename data model -> data format, update (#2734) @maxnoe

Bug Fixes

  • Force absences of units for skewness and excess_kurtosis (#2732) @mexanick

Maintenance

  • Prepare 0.25.0 (#2739) @maxnoe

- Python
Published by github-actions[bot] about 1 year ago

https://github.com/cta-observatory/ctapipe - v0.24.0 – 2024-04-01

Summary

This is a release adding major, long-awaited new features to ctapipe, including the optimization of event selection "cuts" and the computation of basic IRFs. This task is by no means finished, rather a first working version to build from. Please test and give feedback in issues and discussions.

See the full changelog in the documentation and the list of merged pull requests and contributors below.

Contributors

@Hckjs, @LukasBeiske, @TjarkMiener, @Tobychev, @ctoennis, @dependabot[bot], @jstvdk, @kosack, @maxnoe, @mdebony, @mexanick

What has changed since v0.23.2

Pull-requests containing changes of multiple nature are repeated.

  • Add tutorial for mono dl1b to dl2 and update docs (#2691) @LukasBeiske
  • Add CI run running on oldest supported versions of core dependencies (#2619) @maxnoe
  • Muon parameters update (#2670) @jstvdk
  • Update DVR status bits (#2725) @maxnoe
  • Store event times using CTAO high resolution timestamps (#2707) @maxnoe
  • Fix show config (#2703) @maxnoe
  • Adding meta_convention option to SubarrayDescription.to_table() method (#2722) @Hckjs
  • Add a method to read scheduling information with TableLoader (#2709) @mdebony
  • Fix sonar for PRs from forks (#2710) @maxnoe
  • Use sysmon coverage (#2697) @maxnoe
  • Store subarray description in the output file of the stats tool (#2696) @TjarkMiener
  • Bump SonarSource/sonarqube-scan-action from 4 to 5 (#2701) @dependabot[bot]
  • Fix name of cut-optimizer tool in example config (#2700) @Hckjs
  • Fix telescope grouping for uint telescope id (#2692) @maxnoe
  • Irf maker and cut optimiser (#2473) @Tobychev
  • Make PSF work with nd-input (#2689) @maxnoe
  • Fix SubarrayDescription.info for non-unique telescope description strings (#2673) @maxnoe
  • Stats calc tool (#2628) @TjarkMiener

New features

  • Chunk interpolation to select calibration data (#2634) @ctoennis
  • PSF model (#2643) @ctoennis

Bug Fixes

  • Make sure config is fully serialized to provenance json (#2688) @maxnoe
  • Processing gain-selected dl1 data with the pixel stats tool (#2715) @TjarkMiener

Maintenance

  • Fix checkout cleaning up coverage report in sonar ci (#2713) @maxnoe
  • Add CI job testing on python 3.13 (#2687) @maxnoe
  • Perform changelog check only for pull requsts targeting main (#2690) @maxnoe
  • Make sonar coverage badge link point to coverage (#2686) @maxnoe

- Python
Published by github-actions[bot] about 1 year ago

https://github.com/cta-observatory/ctapipe - v0.23.2 – 2025-01-21

Summary

This is a quick bugfix / maintenance release to make ctapipe compatible with recent numba (0.61) and numpy releases (2.1 and 2.2).

See the changelog here: https://ctapipe.readthedocs.io/en/latest/changelog.html#ctapipe-v0-23-2-2025-01-21 and list of merged PRs below.

Contributors

@ChAr-De, @Hckjs, @kosack, @maxnoe and @morcuended

What has changed since v0.23.1

Pull-requests containing changes of multiple nature are repeated.

  • Prepare 0.23.2 (#2684) @maxnoe
  • Update the link to the CI status badge in README (#2679) @morcuended
  • Fix broken Numpy style guide link. (#2677) @ChAr-De

Bug Fixes

  • Fill containers.SimulatedCameraContainer.true_image_sum in HDF5eventsource (#2680) @Hckjs

Maintenance

  • Add explicit cast necessary in numpy >=2.1 (#2682) @maxnoe
  • Fix sonar for pull requests (#2671) @maxnoe

- Python
Published by github-actions[bot] over 1 year ago

https://github.com/cta-observatory/ctapipe - v0.23.1 – 2024-12-05

Summary

This is a bugfix release, mainly to address issues that arose from trying to process prod6 files on the grid.

See changelog here: https://ctapipe.readthedocs.io/en/latest/changelog.html#change-log and list of merged pull requests below.

Contributors

@Hckjs, @LukasBeiske, @kosack and @maxnoe

What has changed since v0.23.0

Pull-requests containing changes of multiple nature are repeated.

  • Prepare 0.23.1 (#2667) @maxnoe
  • Fix dtype of tel_id in subarray hdf table (#2622) @maxnoe
  • Fixed unknown configs being silently ignored (#2666) @kosack
  • Switch to use Minio hosted by DESY for testdata (#2664) @maxnoe
  • Fix tool exit order (#2662) @maxnoe
  • Fix error in ctapipe-process in case telescope event is missing true image (#2659) @maxnoe
  • Fix uncertainty calculation in StereoMeanCombiner (#2658) @LukasBeiske
  • Use sphinx-changelog (#2657) @maxnoe
  • Support astropy 7.0 (#2639) @maxnoe

Maintenance

  • Update image.cleaning docs (#2669) @Hckjs

- Python
Published by github-actions[bot] over 1 year ago

https://github.com/cta-observatory/ctapipe - v0.23.0 – 2024-11-20

Summary

For the changelog, please see https://ctapipe.readthedocs.io/en/latest/changelog.html#ctapipe-v0-23-0-2024-11-18

For contributors and list of merged PRs, see below.

Contributors

@TjarkMiener, @ctoennis, @dependabot, @dependabot[bot], @kosack, @maxnoe, @mexanick and Christoph Toennis

What has changed since v0.22.0

Pull-requests containing changes of multiple nature are repeated.

  • Prepare 0.23.0 (#2654) @maxnoe
  • Improve reference metadata handling for EventSource (#2648) @maxnoe
  • Fix CTAO link in docs (#2653) @maxnoe
  • Variance calibration (#2636) @ctoennis
  • Update / add reprs for reference metadata objects (#2650) @maxnoe
  • Bump SonarSource/sonarqube-scan-action from 3 to 4 (#2652) @dependabot
  • Make some dependencies optional (#2641) @maxnoe
  • Refactor how shower distributions are written, write them for all EventSources, implement for HDF5EventSource (#2633) @maxnoe
  • Add calibration calculators (#2609) @TjarkMiener
  • Set null island as fallback reference location in Subarray.from_hdf (#2627) @maxnoe
  • Bump mamba-org/setup-micromamba from 1 to 2 (#2624) @dependabot
  • Add 0.22 to version switcher (#2618) @maxnoe

New features

  • Improve changelog checks (#2637) @mexanick
  • Add Hipparcos as second star catalog, apply space motion (#2625) @ctoennis

Bug Fixes

  • Restore reading of pointing for files written with ctapipe<0.21 (#2655) @maxnoe
  • Fix changelog checks (#2642) @mexanick
  • Improve changelog checks (#2637) @mexanick

- Python
Published by github-actions[bot] over 1 year ago

https://github.com/cta-observatory/ctapipe - v0.22.0 – 2024-09-13

Summary

See the full changelog in the docs for the release notes.

Below, you can find the contributors and merged PRs.

Contributors

@Hckjs, @TjarkMiener, @aaguasca, @ctoennis, @dependabot, @dependabot[bot], @kosack, @maxnoe, @mexanick

What has changed since v0.21.2

Pull-requests containing changes of multiple nature are repeated.

  • Convert metadata Instrument.site to free string instead of enum (#2616) @maxnoe
  • Fix error messages for non-existing path (#2591) @maxnoe
  • Move interpolator from io to monitoring (#2615) @maxnoe
  • Check uniqueness of input paths and obs_ids in merge tool (#2611) @maxnoe
  • Fix typo CameraGeometry docs (#2613) @aaguasca
  • Add support for numpy 2.0 (#2580) @maxnoe
  • Fix warning in sonarqube (#2588) @maxnoe
  • Fix typo waveform in docs (#2608) @aaguasca
  • Bump SonarSource/sonarqube-scan-action from 2 to 3 (#2605) @dependabot
  • Input reference meta (#2598) @maxnoe
  • OutlierDetector components (#2604) @TjarkMiener
  • Update AUTHORS, add to release procedure (#2590) @maxnoe
  • Variance extractor (#2543) @ctoennis
  • Delete tel attribute from MonitoringCameraContainer in NSBImageCleaner (#2602) @Hckjs
  • Fix deprecation warning in provenance, fixes #2592 (#2599) @maxnoe
  • Fix provenance in case broken packages are in the environment (#2595) @maxnoe
  • Fix traitlets test by ignoring test modules and _dev_version (#2593) @maxnoe
  • Fix docs build (#2589) @maxnoe
  • Treat deprecation warnings as errors (#2581) @maxnoe
  • Fix sonar (#2586) @maxnoe
  • Fix sonarqube for forks (#2585) @maxnoe
  • Fix missing SONAR_HOST_URL (#2584) @maxnoe
  • use correct sonar action (#2583) @maxnoe
  • Fix filename in sonar action (#2582) @maxnoe
  • Run sonar in separate step to enable PRs from forks again (#2578) @maxnoe
  • Bugfix: don't intercept normal SystemExit(0) in Tool (#2575) @mexanick

New features

  • Interpolator (#2600) @ctoennis
  • Add StatisticsAggregator API (#2554) @TjarkMiener
  • Update exception handling in tools (#2594) @mexanick
  • Implement lstchains image cleaning (#2541) @Hckjs

Maintenance

  • Update intersphinx mapping and sphinx-gallery-conf (#2572) @Hckjs

- Python
Published by github-actions[bot] over 1 year ago

https://github.com/cta-observatory/ctapipe - v0.21.2 – 2024-06-27

Summary

Small bugfix release to fix ctapipe with scipy 1.14.

Find the changelog in the docs: https://ctapipe.readthedocs.io/en/latest/changelog.html#ctapipe-v0-21-2-2024-06-27 and the list of merged pull requests below.

Contributors

@kosack, @maxnoe, @mexanick and @morcuended

What has changed since v0.21.1

Pull-requests containing changes of multiple nature are repeated.

  • Support scipy 1.14, fixes #2568 (#2569) @maxnoe
  • Use debug logging for plugin loading details (#2560) @kosack
  • Add new version to docs switcher (#2558) @maxnoe

New features

  • Feature/custom exit codes in tools (#2566) @mexanick

Maintenance

  • Remove unsed config files for old test and quality control systems (#2562) @morcuended

- Python
Published by github-actions[bot] almost 2 years ago

https://github.com/cta-observatory/ctapipe - v0.21.1 – 2024-05-15

Summary

This is a small bugfix and maintenance release for 0.21.0.

Find the changelog in the docs: https://ctapipe.readthedocs.io/en/latest/changelog.html#ctapipe-v0-21-1-2024-05-15 and the list of merged pull requests below.

Contributors

@gschwefer and @maxnoe

What has changed since v0.21.0

Pull-requests containing changes of multiple nature are repeated.

  • Render changelog for 0.21.1 (#2557) @maxnoe
  • Fix StereoTrigger non-deterministically discarding LST-1 in prod6 files (#2552) @maxnoe
  • Impact code cleanup (#2551) @gschwefer

Maintenance

  • Remove upload to pages ci, replaced by using readthedocs (#2553) @maxnoe

- Python
Published by github-actions[bot] about 2 years ago

https://github.com/cta-observatory/ctapipe - v0.21.0 – 2024-04-26

Summary

This is a pretty large release with lots of changes, new features and a couple of API breaking changes, see below.

The headline feature is that through a lot of work, the ImPACT reconstructor works again.

For the full changelog, see https://ctapipe.readthedocs.io/en/stable/changelog.html#ctapipe-v0-21-0-2024-04-26, for contributors and list of merged PRs, see below.

Contributors

@Hckjs, @LukasBeiske, @LukasNickel, @StFroese, @Tobychev, @aknierim, @ccossou, @dependabot, @dependabot[bot], @gschwefer, @kosack, @maxnoe, @morcuended and @nbiederbeck

What has changed since v0.20.0

Pull-requests containing changes of multiple nature are repeated.

  • Prepare changelog for 0.21.0 (#2550) @maxnoe
  • Update to bokeh 3 (#2549) @maxnoe
  • Compute deconvolution parameters in FlashCamExtractor only as needed (#2545) @maxnoe
  • Fix possible out of bounds error in FlashCamExtractor (#2544) @maxnoe
  • Fix CI (#2547) @maxnoe
  • Add function to get point on shower axis in altaz (#2537) @maxnoe
  • Update ImPACT code to work again (#2305) @Tobychev
  • Bump JamesIves/github-pages-deploy-action from 4.5.0 to 4.6.0 (#2538) @dependabot
  • Interpolate pointing in TableLoader and HDF5EventSource (#2409) @maxnoe
  • add SonarQube badges & remove codecov (#2531) @kosack
  • Overburden-to-height conversion functions (#2422) @gschwefer
  • Add a trait for astropy quantities (#2524) @LukasBeiske
  • Add configuration for using CTAO sonarqube to check code (#2463) @maxnoe
  • Add a note to CameraGeometry docs about from_name() (#2485) @kosack
  • Fix entry point specification (#2516) @maxnoe
  • Use signal_fraction for training particle classifier (#2465) @LukasBeiske
  • fix some documentation bugs (#2514) @kosack
  • Test on python 3.12 (#2486) @maxnoe
  • Bump pre-commit/action from 3.0.0 to 3.0.1 (#2510) @dependabot
  • Bump codecov/codecov-action from 3 to 4 (#2509) @dependabot
  • Bump release-drafter/release-drafter from 5 to 6 (#2508) @dependabot
  • Bump andstor/file-existence-action from 2 to 3 (#2506) @dependabot
  • Improve logging colorization, fixes #2504 (#2505) @maxnoe
  • Fix wrong branch name in README (#2502) @maxnoe
  • Fix pydata sphinx theme is not safe for parallel writing warning (#2500) @maxnoe
  • Bump actions/cache from 3 to 4 (#2498) @dependabot
  • Load constant pointing in TableLoader (#2481) @maxnoe
  • Accept CEP 002 (#2400) @kosack
  • Bump actions/checkout from 3 to 4 (#2492) @dependabot
  • Bump JamesIves/github-pages-deploy-action from 3.7.1 to 4.5.0 (#2494) @dependabot
  • Bump actions/upload-artifact from 3 to 4 (#2493) @dependabot
  • Bump actions/setup-python from 4 to 5 (#2495) @dependabot
  • Update citation year and add link (#2487) @maxnoe
  • Write out cross-validation results immediately (#2483) @LukasBeiske
  • Update and add missing docstrings related to ML functionalities (#2456) @LukasBeiske
  • Let the DispReconstructor also compute a score for the sign prediction (#2479) @maxnoe
  • Allow passing of ax to Subarray.peek, do not always call tight_layout (#2369) @maxnoe
  • Change how DataWriter writes simulation pointing (#2438) @maxnoe
  • Add missing cache=True to numba compilation (#2477) @maxnoe
  • Docs: Fix Headings in Docs Closes #2472 @aknierim
  • Allow setting n_jobs on tool invocation (#2430) @LukasNickel
  • Update citation (#2470) @maxnoe
  • Make ML config files more readable and add comments. (#2455) @LukasBeiske
  • Remove python warnings (#2421) @LukasNickel
  • Enable str/Path as input to get_hdf5_datalevels (#2451) @maxnoe
  • Add true_impact_distance to cross validation output (#2468) @LukasBeiske
  • Chunked loading of training data (#2423) @LukasBeiske
  • Rename single changelog file (#2435) @StFroese
  • Removed stray : from ctapipe.io page (#2448) @Tobychev
  • Bump setuptools and setuptools scm versions (#2447) @morcuended
  • Propose CEP 3: remove image parameters in camera frame (#2405) @maxnoe
  • run test only if labels don't contain 'documentation' (#2227) @nbiederbeck
  • Fix unwanted default columns in disp output (#2440) @maxnoe
  • Add docstring for ctapipe-train-disp-reconstructor (#2420) @LukasBeiske
  • Check pointing coordinate frame in DispReconstructor (#2431) @LukasBeiske
  • Check if tel_id exists when looking up TelescopeParameters (#2429) @maxnoe
  • Fix broken urls in README (#2408) @aknierim
  • Fix h_max definition (#2403) @kosack
  • Do not use hidden attribute reconstructor._models in ctapipe-apply-models (#2418) @LukasBeiske
  • Changed some numpy calls following the numpy 2.0 migration guide (#2406) @Tobychev
  • Include example config for ctapipe-train-disp-reconstructor in quickstart tool (#2414) @LukasBeiske
  • Fix empty reference location (#2402) @kosack

New features

  • Change R1- and DL0-waveforms shape to (n_channels, n_pixels, n_samples) (#2529) @Hckjs
  • Change ImageCleaner API (#2511) @Hckjs
  • Use intmin for invalid pixel positions, allow empty arguments (#2397) @maxnoe
  • Add option to override obs_id in SimTelEventSource (#2411) @maxnoe

API Changes

  • Change ImageCleaner API (#2511) @Hckjs
  • Refactor/rename datawriter options (redux) (#2520) @kosack
  • Move TableLoader traits to read_...-methods (#2482) @Hckjs

Data Model Changes

  • Change R1- and DL0-waveforms shape to (n_channels, n_pixels, n_samples) (#2529) @Hckjs
  • Change definition of leakage_pixel_{1,2} (#2432) @maxnoe
  • Improve column names for disp (#2443) @LukasBeiske
  • Add option to override obs_id in SimTelEventSource (#2411) @maxnoe

Bug Fixes

  • Properly transform between camera and telescope frame in muon fitter (#2464) @maxnoe

Refactoring and Optimization

  • Prevent import of ctapipe.image at import time of ctapipe.io (#2488) @maxnoe

Maintenance

  • Use macos 14 (apple arm) in CI (#2534) @maxnoe
  • Fix docs build, use sphinxcontrib-bibtex for bibliography (#2536) @maxnoe
  • Drop python 3.9 (#2526) @maxnoe
  • Fix sonar complaining about statements in notebooks (#2527) @maxnoe
  • Update sonar key (#2525) @maxnoe
  • Update python version in deploy config (#2523) @maxnoe
  • Use ruff for linting (#2416) @maxnoe
  • Move options from setup.cfg to pyproject.toml (#2512) @maxnoe
  • Switch to src based repository structure (#2459) @maxnoe
  • pin scikit-learn to < 1.4, breaks with astropy tables (#2496) @maxnoe
  • Add config to let dependabot update github actions (#2490) @maxnoe
  • Fix some minor issues found by sonarqube (#2466) @maxnoe
  • Move TableLoader traits to read_...-methods (#2482) @Hckjs
  • Fix docstring of EventSource (#2419) @maxnoe
  • Support for astropy 6 (#2475) @maxnoe
  • Fix indentation in docs resulting in wrong rendering (#2462) @maxnoe
  • Fix CI after pytest-xdist update (#2469) @maxnoe
  • Use editable install to fix coverage (#2460) @maxnoe
  • Fix coverage report not being found by codecov (#2458) @maxnoe
  • Add more nitpick ignores to fix docs build after traitlets update (#2412) @maxnoe
  • Fix docs by adding more traitlets nitpick ignores (#2399) @maxnoe

- Python
Published by release-drafter[bot] about 2 years ago

https://github.com/cta-observatory/ctapipe - v0.20.0 – 2023-09-11

Summary

This release has a couple of bug fixes, new features and mainly documentation theme updates, see below for the merged pull requests and find the full changelog on readthedocs

Contributors

@StFroese, @TjarkMiener, @Tobychev, @aknierim, @gschwefer, @jstvdk, @kosack, @maxnoe and Vadym Voitsekhovskyi

What has changed since v0.19.3

Pull-requests containing changes of multiple nature are repeated.

New features

  • Add fit status fields to output container of MuonIntensityFitter (#2381) @jstvdk
  • R0 and R1 waveform merging (#2386) @TjarkMiener
  • Make provenance information in log optional (#2328) @Tobychev

API Changes

  • Use int minval instead -1 for invalid telescope ids in SubarrayDescription.tel_index_array, improve docstrings (#2376) @maxnoe
  • Remove EventSource.from_config, fixes #2258 (#2384) @maxnoe
  • Remove dump-triggers, enable ctapipe-process to store only trigger and simulation data (#2375) @maxnoe

Data Model Changes

  • Add fields defined in CTAO DL0 and R1 data models (#2338) @maxnoe
  • Remove SimulationConfigContainer.injection_height, add SimulatedShowercontainer.starting_grammage (#2343) @maxnoe

Bug Fixes

  • Fix HillasIntersection error for badly reconstructed events (#2265) @gschwefer
  • Bug fix in full numeric pixel likelihood calculation (#2388) @gschwefer

Maintenance

  • Add changelog for 0.20.0 (#2394) @maxnoe
  • Convert all notebooks to sphinx gallery format (#2377) @StFroese
  • Use int minval instead -1 for invalid telescope ids in SubarrayDescription.tel_index_array, improve docstrings (#2376) @maxnoe
  • Update doc structure and dev guide (#2383) @maxnoe
  • Remove no-longer needed importlib_resources (#2389) @maxnoe
  • Replace deprecated provision-with-micromamba action with setup-micromamba (#2387) @maxnoe
  • Drop support for python 3.8, update env file (#2342) @maxnoe
  • Update docs (#2373) @aknierim
  • Try to fix readthedocsbuild (#2365) @maxnoe

- Python
Published by github-actions[bot] over 2 years ago

https://github.com/cta-observatory/ctapipe - v0.19.3 – 2023-06-21

Summary

This is a bugfix release, find the list of merged pull requests below, the changelog is available on readthedocs.

Contributors

@LukasBeiske, @clara-escanuela, @kosack and @maxnoe

What has changed since v0.19.2

Pull-requests containing changes of multiple nature are repeated.

  • Render changelog for 0.19.3 (#2362) @maxnoe
  • Improve docstring and validation of parameters in CameraGeometry (#2361) @maxnoe
  • Fix removal of telescope events in software trigger, fixes #2356 (#2357) @maxnoe
  • Add support for using toymodel in telescope frame (#2349) @maxnoe
  • Fix pixel picking for multiple displays in same figure (#2358) @maxnoe
  • Fill reference_location into SubarrayDescription.tel_coords (#2354) @maxnoe
  • fix help string in disp reconstructor (#2352) @maxnoe
  • Add support for hillas parameters in TelescopeFrame to CameraDisplay (#2347) @maxnoe
  • Fix typo in merge tool flag definition (#2341) @LukasBeiske
  • Fix return value of NullDataVolumeReducer (#2340) @maxnoe
  • Peak time units conversion for the FlashCam reconstructor (#2337) @clara-escanuela

Maintenance

  • Improve error messages of expression engine (#2350) @maxnoe

- Python
Published by maxnoe almost 3 years ago

https://github.com/cta-observatory/ctapipe - v0.19.2 – 2023-05-17

Summary

This is a bugfix release, see the full changelog in the docs and merged Pull Requests below.

Contributors

@clara-escanuela and @maxnoe

What has changed since v0.19.1

Pull-requests containing changes of multiple nature are repeated.

  • Fix peak_time estimation in FlashCamExtractor (#2333) @clara-escanuela

Maintenance

  • Render changelog for 0.19.2 (#2334) @maxnoe
  • Fix links to docs (#2330) @maxnoe

- Python
Published by github-actions[bot] about 3 years ago

https://github.com/cta-observatory/ctapipe - v0.19.1 – 2023-05-11

Summary

This is mainly a bug fix and maintenance release containing one feature addition.

See the full changelog in the documentation and the list of merged PRs below.

This is also the first release to support python 3.11.

Contributors

@kosack and @maxnoe

What has changed since v0.19.0

Pull-requests containing changes of multiple nature are repeated.

Bug Fixes

  • Do not use pathlib for hdf5 datasets, fixes #2318 (#2319) @maxnoe
  • Fix SoftwareTrigger for actual simtel files (#2320) @maxnoe
  • Allow training without cross validation (#2310) @maxnoe
  • Fix --overwrite for ApplyModel tool (#2311) @maxnoe
  • Fix neighbor matrix for no pixels, fixes #2316 (#2317) @maxnoe
  • Fix activity start order (#2312) @maxnoe

New Features

  • Add possibility to compute multiplicities using FeatureGenerator (#2308) @maxnoe

Maintenance

  • Support python 3.11 (#2107) @maxnoe
  • Render changelog to prepare for v0.19.1 release (#2327) @maxnoe
  • Remove unused codecov (got yanked from pypi) (#2306) @maxnoe
  • Deduplicate tomas in mailmap (#2314) @maxnoe

- Python
Published by release-drafter[bot] about 3 years ago

https://github.com/cta-observatory/ctapipe - v0.19.0 – 2023-03-31

Summary

This release has only one headline feature: the addition of the FlashCamExtractor to support the signal shaping needed to properly analyze the data of FlashCam.

See the changelog in the documentation and the list of merged PRs down below.

Contributors

@Tobychev, @clara-escanuela, @kosack, @maxnoe and @zinob

What has changed since v0.18.1

Pull-requests containing changes of multiple nature are repeated.

  • Flashcam extractor (#2188) @clara-escanuela
  • Better errors in case of no events in train tools (#2295) @maxnoe
  • Rename GeometryReco to HillasGeometryReco (#2293) @Tobychev

Maintenance

  • Render 0.19 changelog using towncrier (#2300) @maxnoe
  • Adapt default config for flashcam, bring in line with current grid production (#2299) @maxnoe
  • Fix status of CEP-001, add link to PR (#2298) @maxnoe
  • Remove or move examples to documentation (#2266) @kosack
  • Fixing link to cta-observatory.org (#2297) @zinob
  • Install ffmpeg on readthedocs (#2302) @maxnoe

- Python
Published by release-drafter[bot] about 3 years ago

https://github.com/cta-observatory/ctapipe - v0.18.1 – 2023-03-17

Summary

This is a bugfix release fixing three bugs and including some maintenance changes to the repository.

See the detailed changelog in the documentation and the list of merged PRs down below.

This release is also the first to include CEP 1, the definition of the CEP process, in the released ctapipe documentation.

Contributors

@LukasBeiske, @StFroese, @Tobychev, @kosack, @maxnoe and @nbiederbeck

What has changed since v0.18.0

Pull-requests containing changes of multiple nature are repeated.

  • Render changelog for 0.18.1 (#2290) @maxnoe
  • Fix wrong activity meta being written into output files (#2261) @maxnoe
  • Only remove sort index from table if input did not contain it (#2288) @maxnoe
  • Fix overwrite not working for ctapipe-apply-models (#2287) @maxnoe
  • require lint CI before testing (#2281) @nbiederbeck
  • Use pre-commit/action (#2276) @nbiederbeck
  • Added favicon (#2263) @Tobychev
  • Update CI config after default branch renaming (#2254) @maxnoe
  • Add pypi badge to readme (#2253) @maxnoe

New features

  • CEP-001: Definition of the proposal process (#2256) @Tobychev

Maintenance

  • Add missing enter_context for TableLoader in train tools (#2286) @maxnoe
  • CEP-001: Definition of the proposal process (#2256) @Tobychev
  • Update pre-commit to isort 5.12.0 (#2271) @LukasBeiske
  • Make devs aware of debugging and ipdb in docs (#2220) @StFroese
  • Fix deprecation warning due to pkg_resources (#2259) @maxnoe

- Python
Published by release-drafter[bot] about 3 years ago

https://github.com/cta-observatory/ctapipe - v0.18.0 – 2023-02-09

Summary

For the detailed changelog, please visit https://ctapipe.readthedocs.io/en/latest/changelog.html#ctapipe-v0-18-0-2023-02-09

Below, you can find a list of contributors and grouped list of all merged pull requests.

Contributors

@LukasBeiske, @LukasNickel, @RuneDominik, @StFroese, @Tobychev, @henningpt, @kosack, @maxnoe and @nbiederbeck

What has changed since v0.17.0

Pull-requests containing changes of multiple nature are repeated.

  • Render 0.18 changelog using towncrier (#2251) @maxnoe
  • Implement part of common reconstructor API (#2229) @maxnoe
  • Fix wrong overwrite config in train_* tools (#2243) @maxnoe
  • Simplify ChunkIterator, return start, stop, table (#2241) @maxnoe
  • Notify users about test_plugin install (#2245) @RuneDominik
  • Add HDF5Merger Component, use in MergeTool (#2179) @maxnoe
  • Added a bit of clarification of how important classes attribute is to the tool doc (#2231) @Tobychev
  • Implement transformation from GroundFrame to EarthLocation (#2167) @maxnoe
  • Fix numba version to 0.56 (#2222) @maxnoe
  • Move reading of stereo data before skipping empty events in HDF5EventSource (#2189) @maxnoe
  • Rename towncrier bug to bugfix (#2202) @nbiederbeck
  • Add coordinate overlay plotting to CameraDisplay (#2203) @maxnoe
  • Fix unit handling in muon ring_completeness (#2197) @maxnoe
  • Add changelogs for PRs merged since 0.17.0 (#2186) @maxnoe
  • Fix version requirement for eventio, fixes #2185 (#2187) @maxnoe
  • Fix byteorder fitshistogram (#2183) @maxnoe
  • Add quality query to display dl1 tool (#2172) @maxnoe
  • Run changelog check only on PRs, add support for no-changelog-needed … (#2176) @maxnoe
  • Change default behaviour of run_tool (#2175) @nbiederbeck
  • Fix docs build for traitlets 5.8 and array field defaults (#2173) @maxnoe
  • Improve output of Tool in case of TraitError (#2171) @maxnoe
  • Fix loading of observation info in TableLoader (#2163) @LukasBeiske
  • Replace usage of deprecated astropy matrix functions (#2166) @maxnoe
  • Make number of training events a telescope parameter (#2140) @maxnoe
  • Don't use $HOME, use Path.home() instead (#2155) @kosack
  • Error deprecationwarnings 2 (#2153) @nbiederbeck
  • Improve missing field warning (#2148) @maxnoe
  • Add ipython to docs requirements (#2150) @maxnoe
  • Chunked model application (#2133) @maxnoe
  • Allow lookup of telescope parameters by type (#2120) @maxnoe
  • Fix flake8 complaint (#2137) @maxnoe
  • fix set_line_hillas (#2134) @StFroese
  • remove sort index after sorting (#2132) @maxnoe
  • Allow using predicted energy in particle classifier (#2121) @maxnoe
  • Speed up loader by using hstack instead of merge where possible (#2126) @maxnoe
  • Speed up rotations, closes #2097 (#2098) @StFroese
  • Update mailmap (#2117) @maxnoe
  • Simplify apply_models (#2113) @maxnoe

New features

  • Refactor apply tool to use HDF5Merger, read data only once (#2249) @maxnoe
  • Disp reconstruction (#2138) @LukasBeiske
  • Add option to configure ml prefixes (#2217) @LukasBeiske
  • Improve likelihood muon intensity fitter (#2161) @StFroese
  • Implement stereo trigger for subarray triggers (#2136) @maxnoe
  • Support different frames for set_line_hillas (#2131) @StFroese
  • Machine learning reconstruction (#1767) @maxnoe
  • Add and use ComponentName traitlet instead of create_class_enum_trait, fixes #2100, #1874 (#2102) @maxnoe
  • Allow overriding url via env variable (#2109) @maxnoe
  • Atmosphere models for h_max to X_max conversion (#2000) @kosack

API Changes

  • Raise error in case expected telescope-data is missing in HDF5EventSource (#2244) @RuneDominik
  • Make muon analysis part of the processing tool (#2168) @StFroese

Bug Fixes

  • Add rng attribute back to TrainEnergyRegressor (#2247) @maxnoe
  • fix import error in metadata: fails on systems without pwd (#2152) @kosack
  • Correctly setup components in dump-instrument-info, add test (#2106) @maxnoe

Refactoring and Optimization

  • Use entry_points for plugins (#2101) @maxnoe
  • Consistent overwrite (#2213) @LukasNickel
  • Tool exit stack (#1926) @maxnoe
  • Load observation info with TableLoader; standardize id fields in containers (#2096) @LukasBeiske
  • Move impact_distance to coordinates to avoid circular import (#2095) @maxnoe

Maintenance

  • Use entry_points for plugins (#2101) @maxnoe
  • Consistent overwrite (#2213) @LukasNickel
  • Use https links where possible (#2232) @maxnoe
  • Fix sonarqube issues (#2215) @maxnoe
  • Fix docstring in ImageProcessor (#2180) @maxnoe
  • Update README (#2208) @StFroese
  • Use weakref.proxy where parent=self. (#2223) @nbiederbeck
  • Move test to correct module (#2225) @maxnoe
  • Change actions for mamba / pip install methods. (#2207) @nbiederbeck
  • Refactor initialization of telescope parameters, move to own module (#2190) @maxnoe
  • Upload build docs as artifacts in CI (#2195) @nbiederbeck
  • Fix frame name in coordinates warning (#2198) @maxnoe
  • Create proper links to the PR in changelog (#2192) @maxnoe
  • Raise error if run_tool encounters non-zero exit code and raises is True (#2191) @maxnoe
  • Use towncrier for change log (#2144) @StFroese
  • Add and use ComponentName traitlet instead of create_class_enum_trait, fixes #2100, #1874 (#2102) @maxnoe
  • Update test data url (#2108) @maxnoe
  • Only use setup.cfg, automatically include correct python requires in docs (#2093) @maxnoe
  • Remove debug print (#2105) @maxnoe
  • Fix warnings from deploy workflow (#2085) @maxnoe
  • Update citations in README.rst (#2086) @maxnoe

- Python
Published by maxnoe over 3 years ago

https://github.com/cta-observatory/ctapipe - v0.17.0 – 2022-09-27

Summary

There are three major changes in this release:

1) It is now possible to configure multiple reconstructors to be applied (at the moment, this means you can both run HillasReconstructor and HillasIntersection using ctapipe-process).

2) The naming scheme of telescope wise quantities at dl2 changed. In 0.16, e.g. the reconstructed impact distance to a specific telescope was HillasReconstructor_tel_distance, missing the prefix of the container the field was defined in. This is now fixed and the same column is now HillasReconstructor_tel_impact_distance.

3) The HillasReconstructor was optimized to remove pure-python loops over telescopes which resulted in a ca. 5x speed up when running on a La Palma prod6 run.

For smaller changes and bug fixes, see blow list of merged PRs.

Contributors

@Hckjs, @HealthyPear, @LukasNickel, @StFroese, @kosack, @maxnoe and @nbiederbeck

What has changed since v0.16.0

Pull-requests containing changes of multiple nature are repeated.

New features

  • add --datamodel option to ctapipe-info (#2047) @kosack
  • Merge DL2 tables. (#2050) @nbiederbeck

API Changes

  • Improve ShowerProcessor API, fixes #2071 (#2073) @StFroese

Data Model Changes

  • Use _impact_ instead of _tel_, fixes #2051 (#2060) @nbiederbeck

Bug Fixes

  • Fix invalid case in HillasReconstructor and HillasIntersection (#2082) @maxnoe
  • Convert float32 pi/2 value to float64 pi/2 value in SimTelEventSource (#2077) @maxnoe
  • Allow data model version 4 in HDFEventSource, actually check which frame is used for hillas parameters (#2079) @maxnoe
  • Fix unreachable assertion in Provenance unit test (#2072) @HealthyPear
  • Fix wrong container used for camera frame in ImageProcessor, fixes #2062 (#2070) @maxnoe
  • Fix tables.Node.__del__ throwing exceptions on interpreter exit when writing index tables, fixes #2067 (#2069) @maxnoe
  • Sort unique cameras/types/optics to generate stable indices in hdf5, fixes #2063 (#2066) @maxnoe
  • Make ExpressionEngine be no Component. Fixes #2065. (#2068) @nbiederbeck
  • Fix camera rotation in examples/camera_rotation.py (#2056) @Hckjs
  • Report HDF5EventSource as compatible for dl2 only files, fixes #2058 (#2059) @LukasNickel
  • Merge simulated impact (#2049) @nbiederbeck
  • Fix Container.as_dict for case of flatten=True and add_prefix=True (#1887) @maxnoe

Refactoring and Optimization

  • Vectorize operations in HillasReconstructor (#2036) @maxnoe

Maintenance

  • Change recommendation on reusing ArrayEvent in EventSources (#2076) @maxnoe
  • Update mailmap (#2053) @maxnoe

- Python
Published by maxnoe over 3 years ago

https://github.com/cta-observatory/ctapipe - v0.16.0 – 2022-08-01

Summary

This next major release of ctapipe includes a large number of improvements and new features, as well as significant changes to the API and data model that fix outstanding problems with both. Due to the nature of these required changes and to keep the code reasonably maintainable (in this pre-1.0 release), files written by earlier versions of ctapipe are not guaranteed to be readable with this one.

Contributors

@aknierim, @kosack, @maxnoe, @nbiederbeck, @satoshifukami0115 and @vuillaut

What has changed since v0.15.0

Pull-requests containing changes of multiple nature are repeated.

New features

  • ObsConfig data model (#1973) @kosack
  • Add abstract InvalidPixelHandler and NeighborAverage implementation, apply in CameraCalibrator and TwoPassWindowSum. Pass invalid pixels to extractors. (#2023) @maxnoe
  • Get reference_location and optics/camera name from simtel metadata if available (#2018) @maxnoe
  • Add methods to read run config and shower distribution to TableLoader (#2010) @maxnoe
  • added a better template for release-drafter (#1880) @kosack
  • Add another cleaning method in cleaning.py (#1672) @satoshifukami0115
  • Round floats for hashing in instrument module, use __slots__ (#1986) @maxnoe
  • Add location of subarray reference point to SubarrayDescription (#1980) @maxnoe
  • recursively validate containers (#1976) @kosack
  • Improve units code in hillas_parameters (#1988) @maxnoe
  • Add TableLoader.read_telescope_events_by_type_chunked (#1984) @maxnoe
  • Maintain event order of input file in TableLoader, fixes #1966 (#1968) @maxnoe
  • Chunked table loader (#1935) @maxnoe
  • Read dl2 in hdf5eventsource (#1940) @maxnoe
  • add joined option to SubarrayDescription.to_table (#1939) @maxnoe
  • compute impact distance to shower axis (#1899) @kosack
  • Improved configuration of reference metadata (#1889) @kosack
  • Allow passing already opened h5file to table loader (#1933) @maxnoe
  • Add overwrite option to write_table (#1932) @maxnoe
  • Support reading files created with extract_calibevent (#1929) @maxnoe
  • improve array display (#1911) @kosack

API Changes

  • Use n_ prefix consistently, (rename all num_ to n_), fixes #986 (#2046) @maxnoe
  • Remove cutflow (#1766) @maxnoe
  • Add pixel, channel, sample information to CameraReadout, update OpticsDescription (#2019) @maxnoe
  • Remove support for by_type split files (#2032) @maxnoe
  • Rework h5 metadata (#2003) @maxnoe
  • Use pytest fixtures in unit tests instead of from_name methods (#1985) @maxnoe
  • Store both equivalent and effective focal length in OpticsDescription, add __slots__ (#1923) @maxnoe
  • Replace deepcopying defaults with default_factory (#1991) @maxnoe
  • Use module of Tool to setup logging (#1964) @maxnoe
  • Add QualityQuery.get_table_mask, compile python code (#1943) @maxnoe
  • Load all dl2 available groups in TableLoader (#1934) @maxnoe
  • Use container classes for TableReader.read method, do not reuse same container instance (#1921) @maxnoe

Data Model Changes

  • ObsConfig data model (#1973) @kosack
  • Rename ReconstructedContainer.tel_ids -> telescopes, fixes 1953 (#2044) @maxnoe
  • Use n_ prefix consistently, (rename all num_ to n_), fixes #986 (#2046) @maxnoe
  • Add pixel, channel, sample information to CameraReadout, update OpticsDescription (#2019) @maxnoe
  • Rework h5 metadata (#2003) @maxnoe
  • Fix datalevels (#2004) @maxnoe
  • Store both equivalent and effective focal length in OpticsDescription, add __slots__ (#1923) @maxnoe
  • Rework container prefix handling (#1949) @maxnoe
  • Add location of subarray reference point to SubarrayDescription (#1980) @maxnoe
  • compute impact distance to shower axis (#1899) @kosack

Bug Fixes

  • Fix missing f-string (#2043) @nbiederbeck
  • Fix columns order when string column present, fixes #2041 (#2042) @maxnoe
  • Fix writing and merging of dl2 statistics, fixes #1884 (#1885) @maxnoe
  • Fix pixel rotation for very large offsets in NominalFrame (#2037) @maxnoe
  • Fix wrong pixel area and rotation in nominal frame, fixes #2028 (#2029) @maxnoe
  • Fix error message for missing effective focal length (#2026) @maxnoe
  • Remove restriction on existing file in EventSource.input_url, fixes #1821 (#1998) @maxnoe
  • Fix TableLoader reading empty table (#2013) @nbiederbeck
  • Fix datalevels (#2004) @maxnoe
  • Include number of mirror tiles in guessing keys to be able to distinguish between MAGIC 1 and MAGIC 2 (#1977) @maxnoe
  • Use correct traitlet for event type enum in eventtypefilter (#2002) @maxnoe
  • Add dl2 datalevel in hdf5 source, add datalevel tests (#2001) @maxnoe
  • Ignore unknown column metadata in read_table (#1992) @maxnoe
  • Fix comparison of timestamps in calibration code (#1987) @maxnoe
  • Fix missing start/stop for reading impact table, use correct type in simteleventsource (#1982) @maxnoe
  • Hash rounded versions of floats for CameraGeometry (#1956) @maxnoe
  • Fix impact being written for non-triggered telescopes, fixes #1961 (#1967) @maxnoe
  • fixed bug that prevented printing of QualityQuery (#1958) @kosack
  • Fix ArrayDisplay creating legend in wrong axes with multiple axes active (#1946) @maxnoe
  • Store true_image_sum also when true image is not written (#1893) @maxnoe
  • Better error message in case unknown telescopes are selected, fixes #1924 (#1925) @maxnoe
  • Minor visual bugfix: better html repr for Tool and Component (#1905) @kosack

Refactoring and Optimization

  • Use tel_id consistently (replacing telid -> tel_id), fixes #1457 (#2045) @maxnoe
  • Remove cutflow (#1766) @maxnoe
  • Add 'raises' to run_tool, which raises exceptions instead of logging them. (#2038) @nbiederbeck
  • ExpressionEngine for QualityQuery and FeatureGenerator (#2014) @nbiederbeck
  • Return tuples from SubArray properties, add suport for single value in get_tel_ids (#2027) @maxnoe
  • Use pytest fixtures in unit tests instead of from_name methods (#1985) @maxnoe
  • Ignore containers and maps by default in HDF5Writer (#1945) @maxnoe
  • Hdf5EventSource performance improvements and skip empty events, fixes #1916 (#1917) @maxnoe
  • Directly return peak position from neighbor average waveform (#1914) @maxnoe

Maintenance

  • updated incorrect comments in base_config.yaml (#2040) @kosack
  • Remove support for by_type split files (#2032) @maxnoe
  • Fixed Typo in docstring (#2009) @aknierim
  • added a better template for release-drafter (#1880) @kosack
  • Add flake8 pre-commit hook. Change black hook to also format notebooks. (#1993) @nbiederbeck
  • Avoid warning in case of reading DL1a only files with HDF5EventSource (#1994) @maxnoe
  • Automatically include fields in docstrings for containers (#1990) @maxnoe
  • Create a fresh ArrayEventContainer for each event in HDF5EventSource (#1970) @maxnoe
  • Create a fresh ArrayEventContainer for each event in SimTelEventSource (#1952) @maxnoe
  • Update CI actions versions (#1951) @maxnoe
  • Simplify units code in subarray (#1950) @maxnoe
  • Use a simple kwarg instead of a traitlet for TableLoader.h5file (#1937) @maxnoe
  • Improve TableLoader docs, fixes #1930 (#1931) @maxnoe
  • Print version info in pytest header (#1919) @maxnoe

- Python
Published by release-drafter[bot] almost 4 years ago

https://github.com/cta-observatory/ctapipe - v0.15.0 – 2022-05-23

What's Changed since v0.14.0

The main change in this release is that the SimTelEventSource will use the effective focal length, which is the focal length corrected for the mean effect of aberrations like coma, by default. This will raise an error if this information is not available in the input file (which is the case for files from before prod5).

To analyze these files with ctapipe 0.15, you need to pass the SimTelEventSource.focal_length_choice="nominal". Using the effective focal length much improves the off-axis angular resolution of e.g. the HillasReconstructor.

  • Use effective focal length by default, always guess telescope names from nominal (#1910) @maxnoe
  • Fix ctapipe license in tutorial (#1907) @maxnoe
  • Fix merge tool in case --skip-images is given but no images in input file (#1906) @maxnoe
  • Keep z coordinate in tilted ground frame (#1903) @maxnoe
  • Fix HDF5EventSource.len to take max_events into account (#1897) @maxnoe
  • Add alias for prov log (#1890) @maxnoe
  • update README for v0.14.0 (#1886) @kosack
  • Fix setting up logging hierarchy, fixes #1882 (#1883) @maxnoe

Contributors

@kosack and @maxnoe

- Python
Published by release-drafter[bot] about 4 years ago

https://github.com/cta-observatory/ctapipe - v0.14.0 – 2022-04-14

What's Changed since v0.13.0

This release fixes an important issue in the stereo reconstruction: the quality criteria for individual telescope events to enter into the stereo reconstruction were not applied correctly. Fixing this required an API change. The quality criteria are now part of the Reconstructor as StereoQualityQuery, not part of the ShowerProcessor any more. As part of this change, we also added back support for using the HillasIntersection additionally to the HillasReconstructor.

The second large change is the addition of support for two better formats for config files. Additionally to the json supported before, ctapipe now also supports yaml and toml configuration files and tools support giving multiple configuration files.

  • Fix bug in ShowerProcessor / HillasReconstructor not using QualityQuery correctly, add support for HillasIntersection in ShowerProcessor (#1875) @maxnoe
  • allow YAML and TOML config files and multiple configs (#1856) @kosack
  • Remove parallel=True for neighborwaveformsum, fixes #1532 (#1878) @maxnoe
  • Add switch to ImageProcessor to enable/disable ImageModifier (#1873) @maxnoe

Contributors

@kosack and @maxnoe

- Python
Published by release-drafter[bot] about 4 years ago

https://github.com/cta-observatory/ctapipe - v0.13.0 – 2022-04-08

This is mainly a maintenance release updating the versions of some core depedencies (python >= 3.8, astropy >= 5.0) but there are also some changes to the data model and format and a couple of new features and bug fixes.

What's Changed since v0.12.0

  • Components to modify dl1 images (#1723) @LukasNickel
  • Compute and record shower's core position also in the TiltedFrame when using HillasReconstructor (#1745) @HealthyPear
  • Extractor status flag (#1810) @kosack
  • Unify source.simulation_config return value (#1872) @LukasNickel
  • Update black version (#1871) @LukasNickel
  • Only upload codecov from one build (#1869) @maxnoe
  • Fix traitlets deprecation warning (#1866) @maxnoe
  • Implement public interface for 2d index to/from id (#1854) @maxnoe
  • Implement merging dl2 subarray data, fixes #1861 (#1864) @maxnoe
  • Enable Subarray.tohdf/fromhdf for already opened file (#1868) @maxnoe
  • Update CI os/install-method/python-version combinations (#1865) @maxnoe
  • Use write_table for image statistics (#1863) @maxnoe
  • Close event source in ProcessorTool.finish (#1862) @maxnoe
  • Update bokeh viewers to version 2.0, remove bokeh viewer tool and WaveformDisplay for now (#1494) @maxnoe
  • Add writetable and use it in SubarrayDescription.tohdf, fixes #1449 (#1817) @maxnoe
  • resolve environment variables in Path traitlets (#1855) @kosack
  • Require python 3.8, astropy 5 (#1859) @maxnoe
  • Do not run "push" build for Pull Requests, fix mamba build in CI (#1858) @maxnoe
  • Fix CameraFrame transformations for arrays of focal_length, fixes #1850 (#1851) @maxnoe
  • Add macos-latest to CI workflow jobs (#1718) @HealthyPear
  • Add event type filter to ctapipe-process (#1841) @maxnoe
  • Fix scipy deprecation warning (#1846) @maxnoe
  • Point to readthedocs in the README (#1842) @maxnoe
  • Implement treatment of invalid values in FixedPointColumnTransform, fixes #1815 (#1816) @maxnoe
  • Just use a for loop in HDF5TableReader (#1845) @maxnoe
  • Remove print statements from hdf5eventsource (#1844) @maxnoe
  • Add RTD config (#1840) @maxnoe
  • Fix devversion being included in wheel (#1839) @maxnoe
  • Raise error for missing focal length (#1835) @maxnoe
  • Rename DL1EventSource to HDF5EventSource, add support for reading R1 waveforms as written by DataWriter (#1837) @maxnoe
  • show Frame in CameraGeometry repr (#1834) @kosack
  • Fix pixel picker for square pixels (#1833) @maxnoe
  • Use .ecsv extension in dump instrument to enable Table.read. (#1722) @maxnoe
  • Add BrightestPixelsPeakWindowSum extractor (#1823) @maxnoe
  • Remove outdated tools (#1827) @maxnoe
  • Fix incorrect usage of configuration system in calibration calculators and tool example (#1831) @maxnoe
  • Make tests pass independent of cwd (#1818) @maxnoe
  • Read trueimagesum, fixes #1180 (#1814) @maxnoe
  • options to write R0 and R1 waveforms (#1799) @kosack
  • Fix CameraGeometry.transform for camrotations != 0, fix pixrotation for square pixels (#1819) @maxnoe
  • Exclude coverage 6.3 in CI due to nedbat/coveragepy#1310 (#1830) @maxnoe
  • add a simple method to read metadata as a dictionnary from an hdf5 file and allow writing metadata to any path (#1796) @vuillaut
  • Create some issue templates (#1824) @kosack
  • Make sure a fixed random seed is used for toymodel test (#1811) @maxnoe

Contributors

@HealthyPear, @LukasNickel, @kosack, @maxnoe and @vuillaut

- Python
Published by release-drafter[bot] about 4 years ago

https://github.com/cta-observatory/ctapipe - v0.12.0 – 2021-11-23

What's Changed since v0.11.0

The main changes in this release are related to expanding the data model to include DL2 and the computation of DL2 parameters. This also required changing the units of some DL1 parameters from the CameraFrame to the TelescopeFrame to make them easier to compare between telescopes, which includes an overhaul of how the HillasReconstructor works (supporting both frames as input), and adds include a new Component ShowerProcessor that generates DL2(a) information. The data model was expanded to include DL2 and to support a more general InstrumentDescription serialization. DL1Writer was refactored into a general DataWriter that writes the full data model. TableLoader provides a user interface to load all events at once from ctapipe output files, joining them as needed, which is useful for benchmarking.

The ctapipe-stage1 tool was removed and replaced with the more general ctapipe-process, which can now handle any transformation from R0 to DL2a, depending on what configuration file it is given. A ctapipe-quickstarttool was added to generate some starting config files, and a ctapipe-fileinfo tool to show file header information for any files written by ctapipe.

New Features

  • Add flag to use camera frame for ctapipe-process (#1790) @maxnoe
  • TableLoader (#1771) @maxnoe
  • Add flags to enforce recomputation of dl1/dl2 (#1776) @LukasNickel
  • ctapipe-quickstart tool (#1774) @kosack
  • Add condition option to read_table (#1769) @maxnoe
  • Implement allow_none=False for Path trait, fixes #1759 (#1760) @maxnoe
  • ctapipe-fileinfo (#1756) @kosack
  • Configurable contact information for DataWriter (#1757) @maxnoe
  • Generalize image converter for square pixels (#1728) @LukasNickel
  • Implement ctapipe-process (#1726) @kosack
  • Add support for calibration scale and shift in R1 (#1749) @HealthyPear
  • Direction reconstruction (also) from Telescope Frame (#1408) @HealthyPear
  • Add no-flags, add short aliases, make aliases more consistent (#1748) @nbiederbeck
  • Adapt subarray for 'allowedtels' option in mergertool (#1736) @Hckjs
  • Implement a shower processor (#1675) @HealthyPear
  • DL2 data model and output (#1673) @kosack
  • Allow regexp in table name for TableWriter.exclude() (#1717) @kosack
  • Shortform aliases (#1713) @maxnoe
  • implements addcolumntransform_regexp feature (#1690) @kosack
  • Use iminuit>=2 (#1714) @nbiederbeck

Breaking Changes

Both of these change the data model, but the code remains backward-compatible.

  • Use indices for camera / optics lookup in from_hdf / to_hdf (#1426) @maxnoe
  • Hillas parameters in telescope frame (optionally) (#1591) @LukasNickel
  • ctapipe-stage1 refactored into ctapipe-process (#1726)

Performance Improvements

  • Do not guess pixel area when transforming (#1794) @maxnoe
  • Improve performance of calcpixelneighbors, fixes #1791 (#1792) @maxnoe
  • Precompile table regex for column exclusion, fixes #1719 (#1720) @maxnoe

Bug Fixes and Refactoring

  • Compare to numpy integer (#1801) @LukasNickel
  • Fix negative vmin/vmax raising error with mpl3.5, fixes #1805 (#1807) @maxnoe
  • Fix display dl1 (#1795) @maxnoe
  • Fix writing FITS in fileinfo for unicode (#1789) @maxnoe
  • Fix TelescopeParameter for traitlets 5.1 (#1784) @maxnoe
  • Remove unnecessary is_simulation for ImageProcessor (#1773) @maxnoe
  • Remove debug prints, fixes #1764 (#1765) @maxnoe
  • Remove redundant test code in simtel event source test code (#1747) @maxnoe
  • Change REF_WIDTH to REFWIDTH to fit into 8 characters for FITS, fixes #1452 (#1753) @maxnoe
  • Rename function. Fix #1733. (#1734) @nbiederbeck
  • Fix ctapipe-merge with --allowed-tels (#1712) @nbiederbeck
  • Set errordef for taubin fit (#1716) @maxnoe

Documentation, Testing, and Build updates

a big change is that tests are now parallelizable, leading to faster results from the CI system.

  • Removing unwanted quotes for code block in readme (#1808) @vuillaut
  • Add note about PYTHONNOUSERSITE to README (#1806) @maxnoe
  • Fix deprecated keys in setup.cfg (#1804) @maxnoe
  • Fix several warnings during tests (#1787) @maxnoe
  • Unit tests: fix mutated camera geometry fixtures (#1793) @maxnoe
  • Build docs using two cores, fix name of step (#1781) @maxnoe
  • Do not use sphinx action for building docs (#1780) @maxnoe
  • include stage1_config.json in package (#1752) @nbiederbeck
  • Switch on doctests in the CI (#1731) @maxnoe
  • Add tests for download functions (#1763) @maxnoe
  • Fix docs for Path (#1758) @maxnoe
  • Use pypa/build for packaging (#1725) @maxnoe
  • Cache the test data (#1746) @maxnoe
  • Improve dl1 fixtures and fix test concurrency issues (#1741) @maxnoe
  • Parallel tests (#1740) @maxnoe
  • Pyflakes in CI (#1735) @maxnoe
  • Add citing information for version 0.11 (#1710) @LukasNickel

Contributors

@Hckjs, @HealthyPear, @LukasNickel, @kosack, @maxnoe, @nbiederbeck and @vuillaut

- Python
Published by release-drafter[bot] over 4 years ago

https://github.com/cta-observatory/ctapipe - v0.11.0

What's Changed since v0.10.5

This is a major upgrade due to the removal of some deprecated and internally unused modules and functions. We also changed the default of CameraCalibrator.apply_waveform_timeshift and invalid configuration options will now raise an error, so some configs might need updates.

One major change is that the event sources now will adapt the subarray and trigger info if allowed_tels is used.

Breaking changes

  • Change default of CameraCalibrator.applywaveformtimeshift to False (#1692) @maxnoe
  • Consistent use of allowed_tels (#1697) @LukasNickel
  • Raise error in CameraReadout.from_name if no corresponding file can be found (#1703) @maxnoe
  • Remove unused io modules, fixes #1527 (#1693) @maxnoe
  • Change definition of concentration_cog, fixes #1571 (#1572) @maxnoe
  • Transform warning into error for wrong config (#1658) @maxnoe
  • Remove charge resolution tools, fixes #1634 (#1646) @maxnoe

New features

  • Store package versions in provenance (#1685) @maxnoe
  • Store used simtel R1 calibration in event.monitoring (#1691) @maxnoe
  • Add start, stop, step to read_table (#1684) @maxnoe
  • Support http(s):// and dataset:// for path traitlet (#1638) @maxnoe
  • Add brightest_island function (#1587) @maxnoe
  • Allow specifying extractors per telescope, fixes #1660 (#1661) @maxnoe
  • Use new random API (#1708) @maxnoe
  • Pin sphinx to 3.5 for now (#1709) @maxnoe
  • Allow appending of rows to existing tables in HDF5TableWriter, fixes #1655 (#1657) @maxnoe

Bug fixes / maintenance

  • Fix bugs in TwoPassWindowSum and define better unit-test (#1698) @HealthyPear
  • Update documentation Makefile (#1705) @HealthyPear
  • Fix hillas intersection for "missing" telescope ids, fixes #1635 (#1702) @maxnoe
  • Update mailmap (#1700) @maxnoe
  • Fix two numpy deprecation warnings (#1704) @maxnoe
  • Fix pixel picking in mpl display, add test (#1701) @maxnoe
  • Fix dl1source (#1696) @LukasNickel
  • Make sure hdf5 file is closed when necessary in read_table, fixes #1694 (#1695) @maxnoe
  • Treat sphinx warnings as erros, fix deploy workflow name (#1686) @maxnoe
  • Do not use numba cache for ltslinearfit (#1680) @maxnoe
  • Fix syntax typo in call of TwoPassWindowSum with 2ndPass disabled (#1681) @HealthyPear
  • Remove DL1Writer.setup, just properly initialize in init (#1667) @maxnoe
  • Fix codecov missing coverage for cli tools (#1652) @maxnoe
  • Use tqdm.auto (#1659) @maxnoe
  • Require at least astropy 4.0.5, drop restriction to h5py 2.x (#1676) @maxnoe
  • Fix some documentation warnings (#1677) @HealthyPear
  • Create cache dir only when needed (#1670) @maxnoe
  • Use conda-forge channel in README and add some notes (#1671) @maxnoe
  • Update dl1writer.py docstring (#1666) @vuillaut
  • Fix time_delta cleaning (#1656) @LukasNickel
  • Update badge to 0.10.5 (#1650) @maxnoe
  • Generalize URL for downloading test data (#1651) @HealthyPear
  • Update README.rst (#1647) @orelgueta

Contributors

@HealthyPear, @LukasNickel, @maxnoe, @orelgueta and @vuillaut

- Python
Published by release-drafter[bot] about 5 years ago

https://github.com/cta-observatory/ctapipe - v0.10.5

What's Changed since v0.10.4

  • fix a bug in twopass extractor where the timing slope was wrong (#1639) @kosack
  • Add missing f-string in dl1-merge to see broken filenames, fixes #1643 (#1644) @Hckjs
  • Make sure each test gets a copy of event/subarray (#1637) @maxnoe

Contributors

@Hckjs, @kosack and @maxnoe

- Python
Published by release-drafter[bot] about 5 years ago

https://github.com/cta-observatory/ctapipe - v0.10.4

This is a bugfix release for ctapipe 0.10 fixing several issues with creating and reading merged DL1 files as well as a coordinate bug in the HillasIntersection together with several minor fixes.

What's Changed since v0.10.3

  • Show installed io plugins in ctapipe info, fixes #1540 (#1630) @maxnoe
  • Mixed up positions in hillas_intersection direction assignment (#1620) @ParsonsRD
  • List logfile and quiet help once (#1633) @nbiederbeck
  • Try fixing docs version (#1628) @maxnoe
  • Fix dl1 merge tool not writing correct metadata / stage1 not being able to read merged files (#1614) @maxnoe
  • Remove travis-sphinx from docs dependencies (#1622) @HealthyPear
  • use simpler algorithm to group telescope id ranges in info() (#1609) @kosack
  • Tilted groundframe conversion (#1606) @nbiederbeck

Contributors

@HealthyPear, @ParsonsRD, @kosack, @maxnoe and @nbiederbeck

- Python
Published by release-drafter[bot] over 5 years ago

https://github.com/cta-observatory/ctapipe - v0.10.3

This is a hotfix release for the 0.10 series. It fixes applying the stage1 tool and reading its output. We also updated the example configuration to contain better cleaning levels. These are however still only roughly optimized.

What's Changed since v0.10.2

  • fix read_table (#1605) @kosack
  • Update stage1 example config with new cleaning levels (#1603) @maxnoe
  • Fix error when my true image does not meet quality query (#1604) @maxnoe

Contributors

@kosack and @maxnoe

- Python
Published by release-drafter[bot] over 5 years ago

https://github.com/cta-observatory/ctapipe - v0.10.2

What's Changed since v0.10.1

  • Match data types of default values and calculated parameters (#1601) @LukasNickel
  • Refactor conversions, implement possibility to transform images and peak times to int (#1586) @maxnoe
  • Add corsikaio, fixes #1497 (#1602) @maxnoe
  • Traverse classes attribute in classes_with_traits to enable more complete --help-all (#1580) @maxnoe
  • Fix tutorial text (#1592) @LukasNickel
  • Add black code formatter to environment. (#1600) @nbiederbeck
  • Fix numpy deprecations warnings for numpy 1.20 (#1593) @maxnoe
  • signal extractor SlidingWindowMaxSum (#1568) @jsitarek
  • Remove shower max estimator, fixes #1595 (#1596) @maxnoe
  • Set default of event.simulation to None to accomodate observed data (#1570) @maxnoe
  • Cache files by full url/path (#1589) @maxnoe
  • Mailmap update (#1581) @maxnoe
  • Change DL1EventSource.is_compatible() check to meta DATA LEVEL, fixes #1578 (#1579) @Hckjs
  • fix bug in CameraDisplay.overlay_moments (#1590) @kosack
  • Add test for tailcuts with threshold arrays (#1582) @maxnoe
  • Faster muon reconstruction using numba (#1583) @RuneDominik
  • bump version of ctapipe-extra directory to v0.3.2 (#1588) @kosack
  • Include more submodules in docs, fix some doc warnings (#1569) @maxnoe
  • to support eventio 1.5 update dtype of true_image (#1585) @kosack
  • Fix 1566, telescope parameter cli (#1567) @maxnoe

Contributors

@Hckjs, @LukasNickel, @RuneDominik, @jsitarek, @kosack, @maxnoe and @nbiederbeck

- Python
Published by release-drafter[bot] over 5 years ago

https://github.com/cta-observatory/ctapipe - v0.10.1

This is a bug-fix and performance improvement release for v0.10.0

What's Changed since v0.10.0

Bug Fixes

  • Fix handling of telescope parameters from cli for string values, fixes #1559 (#1560) @maxnoe
  • minor fix to print each line of subarray info (#1561) @kosack
  • correctly print subarray info for prod5 (#1557) @kosack
  • Fix DL1 EventSource (#1546) @LukasNickel
  • Fix dl1 event source for use in tools (#1542) @maxnoe
  • Do not use hash in eq (#1549) @maxnoe
  • Update MergerTool examples, adding allowed_tels and tests. Fixes #1533 and #1534 (#1551) @Hckjs
  • Compare cam geom with allclose instead of exact equality (#1543) @maxnoe
  • Fix missing traceback in colored formatter, fixes #1528 (#1541) @maxnoe

Refactoring and Performance Improvements

  • Only convert to angle if not already (#1539) @maxnoe
  • Avoid deepcopying defaults for containers in stage1 (#1538) @maxnoe
  • Add cache=True to numba functions (#1537) @maxnoe
  • Speed up trigger time creation in SimTelEventSource (#1536) @maxnoe

Packaging and Testing

  • Move from travis to github actions (#1544) @maxnoe
  • Fix badge url (#1547) @maxnoe
  • Fix CI status linkes (#1550) @maxnoe
  • Fix minuit version to 1.x (#1553) @maxnoe
  • increase minimum astropy requirement to 4, fixes #1554 (#1555) @kosack
  • Small change to test actions on fork (#1548) @maxnoe

Contributors

@Hckjs, @LukasNickel, @kosack and @maxnoe

- Python
Published by release-drafter[bot] over 5 years ago

https://github.com/cta-observatory/ctapipe - v0.10.0.post1

v0.10.0.post1

Add v0.10.0 doi to README, test for automatic pypi deployment.

- Python
Published by maxnoe over 5 years ago

https://github.com/cta-observatory/ctapipe - v0.10.0

What's Changed since v0.9.1

DL1 file support is much improved with DL1Writer and DL1EventSource components, which together allow one to write and read DL1 data trivially. Any code that used EventSource to read data will automatically be able to read DL1 data with no change needed. R0-DL0 data can be analyzed and written to DL1 using the Tool ctapipe-stage1 and merged together using ctapipe-merge

ctapipe-extra is no longer needed (but still supported). Test files are downloaded automatically from the data server.

The analysis and calibration has been improved, with time shift corrections now applied when available, and uncertainties on Hillas parameters.

The event_source helper function was removed and you don't need to use EventSource.from_url or EventSource.from_config anymore, using EventSource('/path/to/file') will "just work" and return the compatible event source if one is available.

New Features

  • Dl1 event source (#1357) @LukasNickel
  • Dl1 merge tool (#1447) @Hckjs
  • Implement time_shift dl1 correction (#1463) @maxnoe
  • Implementation of Hillas Parameters uncertainties (#1443) @andres-baquero
  • Automatically Download test files (#1498) @maxnoe
  • Make sure getdatasetpath returns Path, fix event source test, fixes #1517 (#1519) @maxnoe
  • Apply time calib simtel (#1465) @maxnoe
  • dump CameraReadout files in ctapipe-dump-instrument (#1451) @kosack
  • Add --quiet/-q option and --logfile (#1310) @nbiederbeck
  • support user table in OpticsDescription.from_name (#1358) @kosack
  • Use traits for TelescopeParameter (#1473) @maxnoe
  • Make data volume reducer configurable for CameraCalibrator (#1392) @maxnoe
  • Create a DL1Writer and ImageProcessor to simplify stage1 (#1499) @kosack

API Changes

  • Remove redundant runarraydirection from SimulationCnfig container (#1521) @maxnoe
  • Remove need for fromurl / fromconfig. Remove now unneeded event_source (#1515) @maxnoe
  • Use enum for pixel shapes (#1491) @maxnoe
  • Refactor simulation event info (#1495) @kosack
  • Remove telswithdata, fixes #852 (#1489) @maxnoe
  • Remove need for add_subcomponent include subcomponents in Component.getcurrentconfig (#1444) @maxnoe

Packaging and Docs

  • add DOI link for v0.9.1 in readme (#1520) @kosack
  • Use setuptools_scm for versioning, fixes #1333 (#1334) @maxnoe
  • use 2020 resolver for pip installs on travis (#1501) @kosack
  • Update maintainer info, fixes #1466 (#1485) @maxnoe
  • Use eventio from conda-forge (#1486) @maxnoe
  • Require python >= 3.7 (#1467) @maxnoe
  • Bump traitlets to version 5 (#1472) @maxnoe

Bug Fixes

  • Add removed exclude back. (#1529) @maxnoe
  • Fix EventSource.__new__already calling __init__ of source (#1523) @maxnoe
  • Fix exclusion filter for pointing table (#1525) @maxnoe
  • Fix parent handling in EventSource.from_config (#1514) @maxnoe
  • Fix dl1 writer for observed data (#1511) @maxnoe
  • reduce erroneous warnings in code style checkers (#1509) @kosack
  • Fix naming of image -> true_image for simulated containers. (#1507) @nbiederbeck
  • Run tools in tmpdir during tests, do not write provlog if only help was run (#1475) @maxnoe
  • Make time shift corrections optional (#1492) @maxnoe
  • Enable setting input_url through config, fixes #1502 (#1503) @maxnoe
  • Add camera frame in TelescopeDescription.from_name (#1496) @maxnoe
  • Fix bug in h5tableto_astropy and HDF5TableWriter (#1471) @kosack
  • DOC: Add black pre-commit hook, fix #1410. (#1488) @nbiederbeck
  • Do not calculate errors on time fit parameters, fixes #1420 (#1487) @maxnoe
  • Fix Path.validate for None (#1481) @maxnoe
  • Fix enum deserialization in HDF table writer (#1483) @maxnoe
  • (Re)move trigger related fields from R0/R1/DL0 Container (#1477) @maxnoe
  • Do not write tels with trigger in pointing table (#1479) @maxnoe
  • Add correct frame to CameraGeometry in SubArrayDescription.from_hdf, fixes #1469 (#1476) @maxnoe
  • Correct pedestal before extracting the pulse, fixes #1460 (#1461) @maxnoe
  • remove no-longer-used EnergyRegressor and EventClassifier (#1464) @kosack
  • Fix missing config=True, add test so this never happens again (#1462) @maxnoe
  • Simplify pixel log-likelihood. (#1403) @nbiederbeck

Contributors

@Hckjs, @LukasNickel, @andres-baquero, @kosack, @maxnoe and @nbiederbeck

- Python
Published by github-actions[bot] over 5 years ago

https://github.com/cta-observatory/ctapipe - v0.9.1

This is a primarily a bugfix release, other than one new feature: ctapipe.io.astropy_helpers.h5_table_to_astropy()

What's Changed since v0.9.0

Bug Fixes

  • Fix loss of performance in TwoPassWindowSum (#1442) @HealthyPear
  • Fix rewrite subarray (#1446) @maxnoe
  • Return nan for non-invertible matrices in ctapipe.fitting.lts_fit (#1439) @maxnoe
  • Add fits option to meta.to_dict, silences warnings (#1433) @maxnoe

Features

  • add function to get astropy table from ctapipe hdf5 file (#1427) @kosack

other

  • replace Release Drafter App with Workflow (#1454) @kosack

Contributors

@HealthyPear, @kosack and @maxnoe

- Python
Published by release-drafter[bot] over 5 years ago

https://github.com/cta-observatory/ctapipe - v0.9.0

This release should be compatible with v0.8.0, but with some bug fixes, speed improvements.

Notable bug fix:

  • the DL1 format generated by v0.8.0 was missing the telescope trigger time, due to a bug which was fixed in this version.

API changes:

  • EventSeeker (which provides random access to event sources) now relies on the get_event_index() and get_event_id() methods to move between events, rather than an implicit __get__ function. Code that used it should change as follows:

previously: py3 event = seeker[12] # move to event at index 12 event = seeker["1233"] # move to event id 1233 now: py3 event = seeker.get_event_index(12) event = seeker.get_event_id(1233)

What's Changed since v0.8.0

  • Use lts regression instead of siegel slopes for timing parameters (#1419) @MaxNoe
  • add column description to attrs (#1437) @kosack
  • Calculate log likelihood analytically in muon intensity fit (#1390) @MaxNoe
  • Fix reading of optics table, write version number, fixes #1416, fixes #1359 (#1417) @MaxNoe
  • Remove unused code (#1378) @MaxNoe
  • Make reading subarray name optional, fixes reading of 0.8.0 dl1 files (#1428) @MaxNoe
  • Add config options to disable integration correction, fixes #1418, fixes #1376 (#1429) @MaxNoe
  • TailCutsDataVolumeReducer now instantiates TailCutsImageCleaner, fixes #1399 (#1404) @Hckjs
  • Fix writing of camera description in subarray.to_hdf, fixes #1422 (#1423) @MaxNoe
  • Add missing factor of 0.5 in muon efficiency fit, fixes #1377 (#1379) @MaxNoe
  • cosmetic change to CameraDisplay (#1409) @kosack
  • Read and write subarray to hdf methods (#1405) @MaxNoe
  • Fix CameraGeometry coordinate conversion for spherical frames (#1407) @kosack
  • Update EventSeeker (#1401) @watsonjj
  • Add support to read multiple containers from one table at once (#1374) @LukasNickel
  • Fix README formatting. (#1402) @nbiederbeck
  • Use sparse matrix approach for neighbor window sum (#1398) @MaxNoe
  • Override from_name for TelescopeComponent to be able to provide subarray (#1393) @MaxNoe
  • Mask for muons, fixes #1373 (#1389) @moralejo
  • Make gain_selector a trait of SimTelEventSource, fixes eventsource plugins (#1385) @MaxNoe
  • Add missing is_simulation guards to stage1 tool (#1386) @MaxNoe
  • Fix missing units of MuonEfficiencyContainer defaults (#1380) @MaxNoe
  • Make sure event source provides R1 or DL0, fix datalevels of SimTelEventSource (#1387) @MaxNoe
  • Update README (DOI + install) (#1366) @vuillaut
  • Improve clarity of FixedWindowSum (#1370) @watsonjj
  • Add support to read from prefixed columns (#1364) @LukasNickel
  • fix exclusion pattern that accidentally removed telswithtrigger (#1369) @kosack
  • Fix FACT focal length in guessing key (#1365) @MaxNoe
  • improve TwoPassWindowSum extractor (#1356) @kosack
  • numbaofislands (#1361) @MaxNoe
  • Compare .value of quantity to 0 in cocentration (#1363) @MaxNoe

Contributors

@Bultako, @Hckjs, @LukasNickel, @MaxNoe, @kosack, @moralejo, @nbiederbeck, @vuillaut and @watsonjj

- Python
Published by release-drafter[bot] over 5 years ago

https://github.com/cta-observatory/ctapipe - v0.8.0

Main features/changes:

  • ctapipe-stage1-process: standard Tool to generate DL1 outputs, along with many related changes to the internal data model
  • Improved/refactored calibration and ImageExtraction code (including a 2-Pass image extractor using time gradient information)
  • Improved/refactored Muon reconstruction code
  • SubarrayDescription is now accessed directly from the EventSource, rather than the event itself, and now includes a CameraDescription class that aggregates CameraGeometry and CameraReadout.
  • Toy model EventSource and Waveform generators
  • improved configuration with per-telescope (Type or ID) parameters
  • plus many more!

What's Changed since v0.7.0

  • Improve performance of concentration by 2x by stripping units internally (#1350) @MaxNoe
  • Use precomputed mean/std to compute skewness and kurtosis (#1349) @MaxNoe
  • Update mailmap (#1346) @MaxNoe
  • last fixes for release of v0.8 (#1348) @kosack
  • reformat with black (#1345) @kosack
  • add vitables to user environment (#1344) @kosack
  • Make sure unit is really a unit, use fits format (#1343) @MaxNoe
  • remove mcheader attributes accidentally added in merge (#1342) @kosack
  • DL1 writer tool (ctapipe-stage1-process) (#1163) @kosack
  • fix bug when ignoretelescopes was used in simtelarray (#1338) @yrenier
  • fix bug where image was 64-bit in case where no extraction is needed (#1339) @kosack
  • Fix examples, fixes #1331 (#1332) @MaxNoe
  • Make sure extractors return 32bit image / peak_time (#1336) @MaxNoe
  • use float32 for images, and validate (#1329) @kosack
  • Fix bokeh to version 1 (#1326) @MaxNoe
  • Fix hillas parameters divide by 0 warning, fixes #1327 (#1328) @MaxNoe
  • Rename muon containers to make naming more consistent (#1324) @MaxNoe
  • Add telescope trigger times, move event type to trigger (#1322) @MaxNoe
  • Make input_url possible as positional argument, cleanup factory tests (#1321) @MaxNoe
  • Calculate ring containment analytically (#1256) @MaxNoe
  • Add more properties to EventSource, implement for SimTelEventSource, fixes #1286 (#1313) @MaxNoe
  • Update tests with new ctapipe-extra, remove hessio remnants (#1318) @MaxNoe
  • Fix parent propagation in hdf writer (#1320) @MaxNoe
  • 2-Pass waveform integration à-la-CTA/MARS (#1215) @HealthyPear
  • Calculate muon image parameters (#1316) @MaxNoe
  • Replace more usages of Unicode with Path (#1319) @MaxNoe
  • Fix writing of default image parameters container (#1311) @MaxNoe
  • Add missing config, parent to hdfwriter (#1312) @MaxNoe
  • Remove empty or misleading files (#1314) @MaxNoe
  • Hdf5 column order (#1308) @MaxNoe
  • Container Improvements and Cleanup for DL1 (#1301) @kosack
  • Make arguments to enumtrait consistent, rename to createclassenumtrait, fixes #1282 (#1306) @MaxNoe
  • Add array pointing to pointing, use .tel map (#1303) @MaxNoe
  • remove HESSIOEventSource (#1304) @kosack
  • Rename coordinates of NominalFrame and TelescopeFrame, fixes #1260 (#1299) @MaxNoe
  • Remove deprecated instrument from event container (#1294) @MaxNoe
  • Toy source (#1298) @MaxNoe
  • Use pointing container in examples and docs (#1296) @MaxNoe
  • Remove old, untested plotting code (#1297) @MaxNoe
  • Update documentation for CameraCalibrator and ImageExtractor (#1283) @watsonjj
  • Store filters and use for new datasets in HDFWriter (#1285) @MaxNoe
  • Added tailcuts data volume reducer (#1121) @Hckjs
  • Drop dead code in simtel event source (#1288) @MaxNoe
  • Muon intensity improvements (#1261) @MaxNoe
  • Remove sst1m specific containers (#1292) @MaxNoe
  • Update travis badge to new travis link (#1291) @MaxNoe
  • Fix calculation of pixel area guessing (#1290) @MaxNoe
  • Path improvements (#1284) @MaxNoe
  • CTA Reference Metadata handling (#1221) @kosack
  • add option to use effective focal length, fixes #1223 (#1262) @kosack
  • Make ImageExtractor TelescopeComponent, remove duplicated code (#1280) @MaxNoe
  • Add BoolTelescopeParameter, expose all options of TailCutsCleaner (#1281) @MaxNoe
  • Remove unused and untested muon fitting code (#1254) @MaxNoe
  • Fix bug in ImageExtractor and WaveformModel concerning waveform sampling rate (#1276) @watsonjj
  • add support of float16 in PYTABLESTYPEMAP (#1273) @vuillaut
  • Ignore unmentioned references (#1269) @MaxNoe
  • Muon refactoring (#1253) @MaxNoe
  • Fix tests for Tools, fixes #1214 (#1027) @dneise
  • Move containers from io to base (#1267) @MaxNoe
  • Fix input url handling in display_dl1 (#1251) @MaxNoe
  • Test with 3.8 (#1174) @MaxNoe
  • Replace muon container defaults with nan, remove redundant fields (#1248) @MaxNoe
  • Waveform toy model (#1244) @watsonjj
  • Various bug fixes and improvements in muon ring analysis (#1245) @moralejo
  • fix codacy badge (use cta-observatory org) (#1250) @kosack
  • Add pyproject toml (#1246) @MaxNoe
  • Created CameraDescription refactor CameraGeometry (#1241) @watsonjj
  • Add a Selector class for keeping track of quality cuts (#1207) @kosack
  • ensure command-line args have higher precedence than config options (#1168) @kosack
  • Cleaning for biggest cluster (#1131) @HealthyPear
  • Improvements to ImageExtractor wrt integration_correction and sampling rate (#1242) @watsonjj
  • Fix hillas width 0, fixes #772 (#1240) @MaxNoe
  • Replace np.power with power operator, fixes #1028 (#1239) @MaxNoe
  • Move pulse shape attributes from mc container to CameraGeometry (#1227) @watsonjj
  • Do not mutate geometry in camera display, fixes #1190 (#1237) @MaxNoe
  • Convert config file argument to path type, fixes #1196 (#1236) @MaxNoe
  • Improvement of integration_correction testing, implementation, and docstring (#1233) @watsonjj
  • Make subarray a required argument to CameraCalibrator and ImageExtractor (#1228) @watsonjj
  • Remove extractpulsetimearoundpeak (#1234) @watsonjj
  • Fix bokeh viewer for new bokeh version (#1232) @MaxNoe
  • Fix array display for mpl 3.2, fixes #1229 (#1231) @MaxNoe
  • Add Monitoring container to MC data (#1115) @FrancaCassol
  • Fix TelescopeParameter config, bug #1216 (#1218) @kosack
  • fix #1217 by removing unused _hyperbinning() function (#1219) @kosack
  • bump astropy version requirement to allow v4.0 (#1213) @kosack
  • Fixes for astropy 4.x (#1212) @kosack
  • Pypi upload (#1208) @MaxNoe
  • add Taubin fit (#1154) @momorning
  • Add guessing MAGIC telescope (#1206) @adonini
  • configurable image cleaners (#1201) @kosack
  • remove deprecation warning: replace log.warn --> log.warning (#1204) @dneise
  • add helper function, might be nice for parametrized tests (#1203) @dneise
  • Create CODEOWNERS (#1151) @watsonjj
  • colorbar default axes as CameraDisplay.axes (#1193) @vuillaut
  • Add directions to GroundFrame docstring as described in #1183 (#1185) @nbiederbeck
  • fix typo in contributors for release drafter (#1189) @vuillaut
  • Update ImageExtractors to utilise TelescopeParameters (#1155) @watsonjj
  • Extra TelescopeParameter use cases (#1175) @watsonjj
  • Return global value from TelescopeParameterLookup when passed None (#1173) @watsonjj
  • Scalar default values in TelescopeParameter (#1171) @watsonjj
  • Fixes for CameraCalibrator and extractaroundpeak (#1172) @watsonjj
  • Remove inheritance on list for TelescopeParameterList (#1162) @watsonjj
  • Add application of DL1 charge calibration to CameraCalibrator (#1160) @watsonjj
  • Enable access to subarray information from file before event loop (#1157) @watsonjj
  • Add sampling_rate to instruments description (#1142) @watsonjj
  • Combine sample loops (#1146) @watsonjj
  • Update eventio version in setup.py (#1169) @watsonjj
  • Move gain selection from CameraCalibrator to EventSource (#1167) @watsonjj
  • Add resolving to the TelescopeParameter (#1158) @watsonjj
  • Pointing container (#1141) @vuillaut
  • fixed bug in TelescopeParameterResolver (#1156) @kosack
  • Add instructions for Slack (#1152) @watsonjj
  • increase nbsphinx cell timeout (#1153) @kosack
  • added DOI for release v0.7.0 (#1150) @kosack
  • Improvements to Container classes (#1123) @kosack
  • Improve extractpulsetimearoundpeak to ignore negative samples (#1143) @watsonjj
  • Remove 3-dimension extractors (#1144) @watsonjj
  • Add provenance.log to .gitignore (#1145) @watsonjj
  • Also test ctapipe with a pure pip installation (no conda) (#1137) @MaxNoe
  • Fix/core tool (#1124) @kosack
  • Fix unit error in SkewedGaussian toymodel (#1120) @MaxNoe
  • TelescopeParameter Trait (#1129) @kosack
  • Use astropys own version of quantity_approx (#1128) @MaxNoe
  • Ci warnings (#1136) @MaxNoe
  • Fix dtype of island labels (#1134) @MaxNoe
  • Use count_nonzero instead of sum for bool arrays (#1133) @MaxNoe
  • a few small random cleanups (#1126) @kosack
  • ensure gain selection returns uint8, not 64-bit int (#1125) @kosack
  • timing_parameters cleaning mask (#1119) @vuillaut

Contributors

@FrancaCassol, @Hckjs, @HealthyPear, @MaxNoe, @adonini, @dneise, @kosack, @momorning, @moralejo, @nbiederbeck, @vuillaut, @watsonjj and @yrenier

- Python
Published by release-drafter[bot] about 6 years ago

https://github.com/cta-observatory/ctapipe - v0.7.0

What's Changed since v0.6.2

This is a major release with breaking API changes from the 0.6.x series. Scripts using ctapipe-0.6.x may need to be updated.

Notable API changes:

  • gain-channel selection is applied at the DL1 level, so event.dl1.tel[i].image is now 1D (whereas before it was 2D, with the first index as the gain channel)
  • removed Factory classes (factories now in constructor)
  • EventSources are now constructed using EventSource.from_url() or EventSource.from_config(), thought the convenience function event_source() still works as before.
  • The default EventSource for MC data is now the SimTelEventSource instead of HESSIOEventSource. This means libhessio is no longer required, as SimTelEventSource uses a pure-python implementation called pyeventio.
  • Other EventSources are now plug-ins that are automatically detected if installed.
  • the camera calibration code and ChargeExtractor have been totally re-factored and simplified. Note that it's lower-level API has thus changed.
  • ctapipe-extra is not longer strictly required to be installed (though some functionality will not work if it is not installed like constructing a CameraGeometry from name if no CTAPIPESVCPATH is set by the user).
  • New EngineeringCameraFrame coordinate system that allows one to draw a camera as it would look when parked (rather than the standard SimTelArray coordinate system).
  • naming scheme for telescopes has changed in the instrument module (it is now <optics type>_<optics_subtype>_<camera type>, e.g. LST_LST_LSTCam or SST_ASTRI_CHEC)

Improvements:

  • ctapipe no longer needs any compilation (the c code in CameraCalibrator has been removed and replaced with Numba functionality for speed and maintainability improvements), which means the package can be made architecture-independent (though python must generate the *.pyc files on install, which takes a bit longer)
  • HDF5TableWriter now can write tables to any group(s) in an HDF5 file, and can optionally append prefixes to the output columns of a Container (e.g. widthhillas_width)
  • HillasReconstructor now supports non-parallel (e.g. divergent or convergent) pointings
  • many speed improvements for calibration and neighbor matrix operations.
  • New tailcuts (picture/boundary) function for multiple nearest-neighbor cleaning (MARS-like)

Detailed Changelog

  • Clean up setup.py (#1118) @kosack
  • remove unused dependencies in environment.yml (#1113) @vuillaut
  • Reduce numba signatures to improve import time (#1108) @watsonjj
  • Remove unused utils (#1112) @MaxNoe
  • Add method to read bright star catalog and find bright stars in sky region (#1105) @moritzhuetten
  • Add Fields to calibration containers (#1111) @FrancaCassol
  • Reconstruction fix (also for Divergent Pointing) (#946) @thomasgas
  • updated AUTHORS with latest mailmap (#1107) @kosack
  • Restore applytimedelta_cleaning as a public method (#1106) @watsonjj
  • Update mailmap (#1103) @MaxNoe
  • Add uncertainties to TimingParemeters (#1101) @MaxNoe
  • Close simtel eventsource in exit (#1104) @MaxNoe
  • Delete .coverage.dapmcw186.24220.071001 (#1099) @cdeil
  • First version of the MARS tailcut (1st pass) (#1096) @HealthyPear
  • Add gain selection to calibration chain (#1095) @watsonjj
  • Added my emails to mailmap (#1098) @HealthyPear
  • Restore returning selected channels in gain selection (#1094) @watsonjj
  • Refactoring of GainSelector (#1093) @watsonjj
  • Integer hdftable (#1089) @MaxNoe
  • Add EngineeringCameraFrame (#1085) @MaxNoe
  • Coordinates notebook pr (#1075) @MaxNoe
  • Fix HillasReconstructor in case of too few telescopes (#994) @LukasNickel
  • Fix writing of booleans, fixes #1082 (#1083) @MaxNoe
  • Add deviation parameter to timing_parameters (#1079) @watsonjj
  • Fix broken telescope id string, Fixes #1058 (#1069) @kosack
  • Improvements to Tool and Component functionality (#1052) @kosack
  • Allow tables in arbitrarily deep hdf5 groups (#1068) @kosack
  • Set python_requires in setup.py (#1074) @MaxNoe
  • Camera calibration code (#1067) @FrancaCassol
  • adding support for int8 in PYTABLESTYPEMAP (#1072) @vuillaut
  • normalize index column name in subarray table (#1065) @kosack
  • Fix HDF5TableWriter to ensure user-defined col transforms are applied (#1060) @kosack
  • Update eventio to 0.20 (#1062) @MaxNoe
  • Fix number of mirrors, fixes #1057 (#1061) @MaxNoe
  • Consolidate camera calibration in a single class (#1048) @watsonjj
  • Use sparse matrix to calculate neighbormatrixwhere (#1056) @MaxNoe
  • Cache camera geometries by camera name (#1054) @MaxNoe
  • Suggestion: Retire CameraR1Calibrator (#1046) @watsonjj
  • Create numba ufunc for sum of samples within charge extraction window (#1038) @watsonjj
  • Implement nan-handling like matplotlib high-level api (#1050) @MaxNoe
  • Fix See Also docs for sphinx 2 (#1051) @MaxNoe
  • Create improved algorithm for pulse time (#1045) @watsonjj
  • Update bokeh plotters to handle nan (#1039) @watsonjj
  • Fix passing config to CameraCalibrator (#1042) @watsonjj
  • Replace WaveformCleaner and ChargeExtractor with WaveformExtractor (#1033) @watsonjj
  • Only detect plugins when they need to exist in global (#1036) @watsonjj
  • Make ctapipe-extra truly optional (#1002) @MaxNoe
  • Fix for TargetIOR1Calibrator (#1035) @watsonjj
  • Replace C function getsumarray with a Numba implementation (#1032) @watsonjj
  • ChargeExtractor tests and simplification (#1023) @watsonjj
  • allow enums in containers and support in tableio (#978) @dneise
  • Add tests to Tools to check that help message works (#1034) @watsonjj
  • Fix neighbors (#1015) @MaxNoe
  • Fix component docs (#1016) @MaxNoe
  • Remove targetio event source and calibrator (#1012) @MaxNoe
  • remove sst1meventsource (#1011) @dneise
  • Update requirements (#1008) @MaxNoe
  • Use conda packages instead of pip (#989) @kosack
  • Fix traitlets config (#998) @MaxNoe
  • Use new conda syntax for activate (#999) @MaxNoe
  • Set defaults only for fields not passed in init (#1001) @MaxNoe
  • Remove LSTEventsource, (#992) @MaxNoe
  • Remove nectarcam event source, now in ctapipeionectarcam (#993) @MaxNoe
  • Refactor toymodel, add SkewedGaussian (#996) @MaxNoe
  • Refactor instrument module (#982) @MaxNoe
  • fixed bug in coordinate transformation (#997) @seinecke
  • Pass allowed_tels down to eventio in simtel event source (#987) @MaxNoe
  • Add missing imports for event sources (#991) @MaxNoe
  • Waveform cleaner (#973) @FrancaCassol
  • Moved a bunch of examples to tools (#955) @kosack
  • Use eventio v0.17.1 (#966) @dneise
  • Remove HorizonFrame and use AltAz directly from astropy, fixes #949 (#975) @MaxNoe
  • Move getshowercoordinates to hillas, fixes #934 (#976) @MaxNoe
  • Fix setlinehillas (#974) @kpfrang
  • Alternative Take on Factories (#916) @dneise
  • Passing masked array to hillas_parameters (#969) @watsonjj
  • make pyhessio not necessary for normal users (#957) @dneise
  • Do not call everything stable (#956) @MaxNoe
  • Avoid underscore replacement empty prefixes. (#951) @kbruegge
  • Improve Component argument consistency (#947) @watsonjj

- Python
Published by release-drafter[bot] almost 7 years ago

https://github.com/cta-observatory/ctapipe - v0.6.2

Algorithmic Changes:

  • Fixes major bug in impact-parameter reconstruction where an incorrect value was calculated in the case of diffuse simulations

What's Changed since v0.6.1

  • Fix unknown section example warning (#800) @MaxNoe
  • fixed ranges of cam-display so they correspond to fixed toymodel sims (#808) @kosack
  • Implement number of islands (#801) @LukasNickel
  • fix package name for yaml (should be pyyaml) (#810) @kosack
  • fix ctapipe build failure (#811) @kosack
  • Add test that shows slicing breaks cam geom and fix it (#782) @MaxNoe
  • freeze ctapipe-extra to version 0.2.14 since 0.2.15 has a bug (#815) @kosack
  • Bokeh plotter (#714) @watsonjj
  • scaling factor in muon_integrator (#774) @AMWMitchell
  • quick fix of example coordinate_transformation (#816) @thomasarmstrong
  • Modifying check_calib.ipynb to work with the new CameraCalibrator API (#814) @vuillaut
  • Fix impact reco, fixes #828, #829 (#830) @MaxNoe
  • First version of notebook for LST analysis bootcamp (#825) @MaxNoe
  • Fix warning about already closed hessio file (#834) @MaxNoe
  • fix errordef > 0. (#839) @rlopezcoto
  • Add test how it should be (#842) @MaxNoe
  • Use sparse neighbor matrix (#826) @MaxNoe
  • SimTelEventSource using pyeventio (#864) @MaxNoe
  • Fix subarray peek. No more warnings. (#841) @thomasgas
  • Add .mailmap (#894) @MaxNoe
  • Add scikit learn to install requires (#877) @dneise
  • Additional metadata from pyhessio (#895) @dneise
  • Cleaning the ctapipe folder. (#892) @thomasgas
  • Remove flow submodule (got moved to its own package) (#893) @MaxNoe
  • remove config=None, tool=None in some tests (#897) @dneise
  • Implemented FACT image cleaning (#862) @LukasNickel
  • Updates of NectarCam and LSTCam real data eventsource class (#812) @FrancaCassol
  • Fix a few test warnings (#902) @MaxNoe
  • Fix SST-1M to be DC and not SC. Solves #905 (#908) @thomasgas
  • Import bokeh.palletes correctly, fixes #911 (#912) @MaxNoe
  • Do not set autodownload, fixes doc build (#910) @MaxNoe
  • Fix docstring of EventSeeker, fixes #768 (#914) @MaxNoe
  • Remove all hillas_paramters but version 5, fixes #866 (#904) @MaxNoe
  • deleted summary.html - accidentally committed file (#919) @kosack
  • Remove serializer, fixes #887 (#913) @MaxNoe
  • Charge Resolution Update (#827) @watsonjj
  • remove optional deps in order to fix tests (#925) @dneise
  • Prefix containers (#833) @MaxNoe
  • speed up iscompatible; makes eventsource factory faster (#927) @dneise
  • Major coordinate refactoring, fixes #899, #900, #505, #416 (#896) @MaxNoe
  • Print duration of notebooks on travis (#928) @dneise
  • clean up environment.yml (#932) @kosack
  • cleanup examples/notebooks to increase test speed (#933) @kosack
  • fix pandas to 0.23.4 for the time being (#937) @dneise
  • fix bug where wrong value was filled for nummirrortiles (#939) @kosack
  • Add additional tests to Component (#935) @watsonjj
  • Add getpixelid method (#918) @moritzhuetten
  • fixed examples that use pandas to read hdf5 (#940) @kosack
  • Example notebooks in Sphinx documentation (#941) @kosack
  • Correct filling of photoelectronimage container in SimtelEventSource (#943) @watsonjj
  • replace "make develop" with "pip install -e ." (#945) @dneise
  • Added additional MC header information (#921) @LukasNickel
  • Rename averagesize to averageintensity (#953) @mackaiver
  • Filter HorizonFrame warnings during reconstruction (#954) @mackaiver
  • modernize formatting code for python 3.6+ (#944) @kosack

- Python
Published by release-drafter[bot] over 7 years ago

https://github.com/cta-observatory/ctapipe - v0.6.1

What's Changed since v0.6.0

  • Fix broken build (#743) @kosack
  • Add example script for a simple event writer (#746) @jjlk
  • Fix camera axis alignment in HillasReconstructor (#741) @mackaiver
  • Lst reader (#749) @FrancaCassol
  • replace deprecated astropy broadcast (#754) @mackaiver
  • A few more example notebooks (#757) @kosack
  • Add MC xmax info (#759) @mackaiver
  • Use Astropy Coordinate Transofmations For Reconstruction (#758) @mackaiver
  • Trigger pixel reader (#745) @thomasarmstrong
  • Change requested in #742: init Hillas skewness and kurtosis to NaN (#744) @STSpencer
  • Fix call to np.linalg.leastsq (#760) @kosack
  • Fix/muon bugs (#762) @kosack
  • Implement hillas features usen eigh (#748) @MaxNoe
  • Use HillasParametersContainer only (#763) @MaxNoe
  • Regression features in RegressorClassifierBase (#764) @vuillaut
  • Adding an example notebook no how to convert hex geometry to square and back (#767) @vuillaut
  • Wrong angle in ArrayDisplay. changed phi to psi. (#771) @thomasgas
  • Unstructured interpolator (#770) @ParsonsRD
  • Lst reader (#776) @FrancaCassol
  • Fixing core reconstruction (#777) @kpfrang
  • Leakage (#783) @MaxNoe
  • Revert "Fixing core reconstruction" (#789) @kosack
  • Fixing the toy image generator (#790) @MaxNoe
  • Fix bad builds by changing channel name (missing pyqt package) (#793) @kosack
  • Implement concentration image features (#791) @MaxNoe
  • updated main documentation page (#792) @kosack
  • Impact intersection (#778) @mackaiver
  • add test for sliced geometries for hillas calculation (#781) @mackaiver
  • Simple HESS adaptations (#794) @ParsonsRD
  • added a config file for github release-drafter plugin (#795) @kosack
  • Array plotting (#784) @thomasgas
  • Minor changes: mostly deprecationwarning fixes (#787) @mireianievas
  • Codacy code style improvements (#796) @dneise
  • Add unit to h_max in HillasReconstructor (#797) @jjlk
  • speed up unit tests that use test_event fixture (#798) @kosack
  • Update Timing Parameters (#799) @LukasNickel

- Python
Published by release-drafter[bot] over 7 years ago

https://github.com/cta-observatory/ctapipe - v0.6.0

This is an interim release, after some major refactoring, and before we add the automatic gain selection and refactored container classes. It's not intended yet for production.

Some Major changes since last release:

  • new EventSource class hierarchy for reading event data, which now supports simulation and testbench data from multiple camera prototypes (notably CHEC, SST-1M, NectarCam)
  • new EventSeeker class for (inefficient) random event access.
  • a much improved Factory class
  • re-organized event data structure (still evolving) - all scripts not in ctapipe must be changed to work with the new data items that were re-named (a migration guide will be given in the 0.7 release)
  • better HDF5 table output, supporting merging multiple Containers into a single output table
  • improvements to Muon analysis, and the muon example script
  • improvements to the calibration classes
  • big improvements to the Instrument classes
  • lots of cleanups and bug fixes
  • much more...

- Python
Published by kosack about 8 years ago

https://github.com/cta-observatory/ctapipe - v0.5.2

- Python
Published by kosack almost 9 years ago

https://github.com/cta-observatory/ctapipe - instrument restructuring

  • instrument module now has much more rich functionality (SubarrayDescription, TelescopeDescription, OpticsDescription classes added
  • no more need to construct CameraGeometry and others manually, they are created in the hessio_event_source
  • all new code should use event.inst.subarray
  • the old inst.tel_pos, inst.optics_foclen, etc, will be phased out in the next point release (but still exist in this release)

- Python
Published by kosack almost 9 years ago

https://github.com/cta-observatory/ctapipe - ready for sensitivity plots

Lots of improvements and bug fixes, some highlights listed below.

Major framework changes:

  • removed astropyhelpers and ctapipeextras sub-repos (the latter is now a seprate module)
  • improved setup, versioning, and package system
  • improved documentation
  • working unit tests
  • support for travisCI documentation builds
  • simplified instrument module
  • faster and more unified CameraGeometry, with support for cameras in FITS files
  • basic provenance system to record input/output/parameter metadata
  • improved coordinate systems
  • event-wise HDF5 table io
  • improved camera and array displays
  • ctapipe-dump-instrument tool

Major algorithm changes:

  • complete Muon analysis
  • complete Hillas reconstruction (HillasReconstructor)
  • energy estimation with machine learning
  • ImPACT reconstruction and fast table interpolation
  • cleaned up ChargeExtractors and WaveFormCleaners
  • simplified calibration (and added CameraCalibrator helper)

- Python
Published by kosack almost 9 years ago

https://github.com/cta-observatory/ctapipe - v0.4.0

API Changes

  • New Container structure that follows CTA data levels better

All Changes:

0.4.0 / 2017-03-13

  • updated conda environment.yml and setup instructions to use it
  • add History.md
  • update notebook
  • add example provenance notebook
  • add Provenance.clear() method
  • revert .9 -> .1
  • forgot adding this file to staging
  • removed rotation of astri cameras
  • typo
  • moved uncertainty from predict to fitcorecrosses
  • add automatic provenance in Tool and io
  • added uncertainty on position fit
  • fixed missing camera rotation
  • fix bug in ctapipe-dump-triggers tool
  • use Singleton metaclass for provenance
  • refactoring
  • separate activity provenance from global provenance
  • cleanups to proveance class and core init
  • update provenence
  • mini change in doc string
  • first attempt at system provenance and time sampling
  • Corrected tests for charge_resolution
  • Corrected example cmdline arguments
  • some updates to example notebooks
  • Corrected r0 to dl0
  • merge and apply fixes to PR#284
  • Replaced event.dl0 calls to event.r0
  • small fix to example
  • add --all option to ctapipe-info
  • fix broken --dependencies option in ctapipe-info
  • fix in camera_rotation
  • fix bug in CameraDisplay
  • mask in geometry now uses bools instead of int
  • minor camera display update
  • use cta-observatory conda channel for pyhessio install
  • remove version cache from git repo and make sure it's in .gitignore
  • improve camdemo tool
  • add version cache to gitignore
  • remove import of unused npLinAlgError
  • replaced least chi2 calculation with numpy build-in
  • stuff
  • Added pedestalpath and tfpath to CameraR1CalibratorFactor, as real cameras require these separate files for calibration
  • Corrected bug in Factory
  • When saving the pickle file, the directory will created if it doesn't exist
  • Some refactoring
  • Update Charge Resolution
  • Small change to how integration window is plotted
  • Included extra external children
  • Corrected container
  • Corrected @observe logging
  • Corrected container for DL0
  • Updated examples/display_integrator.py to use new calibration steps
  • Updated calibration pipeline to use new calibration steps
  • Renamed examples/dl1calibration.py back to examples/calibrationpipeline.py as it now contains the whole calibration chain from r0 to dl1
  • Corrections to pass tests
  • Added tests for calibrators
  • Removed calibrate_source
  • Corrected check*exists
  • Renamed test files Renamed MCR1Calibrator to HessioR1Calibrator
  • Created function check*exists in each calibration step to allow them to be ran even if the data has been read at a later calibration step
  • Created dl0.py to handle to data volume reduction in the conversion from r1 to dl0. Created reductors.py to contain the date volume reductors that can be passed as an argument to CameraDL0Reducer in dl0.py.
  • Corrected r1.py to loop through all telescopes that have data in the event
  • Removed dl0 correction for mc files - this is now handled by r1.py
  • Removed mc.py and mycam.py as they do not fit in the new calib methodology
  • Created r1 calibrator component - should replace mc.py
  • Added origin attribute to EventFileReader class - useful for components that depend on the file type
  • Updated docstring
  • Renamed ctapipe/calib/camera/calibrators.py to ctapipe/calib/camera/dl1.py
  • Removed clearing of dl2
  • Imported external classes that should be included in the factory
  • Refactored dl0 container to r0 container Created new containers: r1 (containing r1 calibrated data) and dl0 (containing data volume reduced data)

- Python
Published by kosack about 9 years ago

https://github.com/cta-observatory/ctapipe - v0.3.4

- Python
Published by kosack over 9 years ago

https://github.com/cta-observatory/ctapipe - new package

- Python
Published by kosack over 9 years ago

https://github.com/cta-observatory/ctapipe - small bug fixes

- Python
Published by kosack over 9 years ago

https://github.com/cta-observatory/ctapipe - release for first conda package

first release to support conda packages

- Python
Published by kosack over 9 years ago

https://github.com/cta-observatory/ctapipe - First tagged release

This is a first tagged release before some major restructuring in ctapipe that may break scripts based on it. Therefore this has been tagged and a stable branch created to allow migration.

- Python
Published by kosack almost 10 years ago