Data

Tools

Indexes

Applications

Experiments

Open Source Science

Recent Releases of caput

caput - 25.3.1

What's Changed

  • Update citation file by @ljgray in https://github.com/radiocosmology/caput/pull/294

Full Changelog: https://github.com/radiocosmology/caput/compare/v25.3.0...v25.3.1

- Python
Published by ljgray 11 months ago

caput - 25.3.0

What's Changed

  • Pipeline tasks can return multiple outputs to unpack by @jrs65 in https://github.com/radiocosmology/caput/pull/263
  • refactor: move test suite out of caput by @ketiltrout in https://github.com/radiocosmology/caput/pull/274
  • Interactive pipeline debugging by @ljgray in https://github.com/radiocosmology/caput/pull/275
  • Fix inadvertent StopIteration in MPIArray which triggers the pipeline to end by @ljgray in https://github.com/radiocosmology/caput/pull/277
  • Numpy 2.0 support by @ljgray in https://github.com/radiocosmology/caput/pull/276
  • Fix deprecated 'newbyteorder' and doctests by @ljgray in https://github.com/radiocosmology/caput/pull/279
  • Add macos-latest to ci pipeline by @ljgray in https://github.com/radiocosmology/caput/pull/229
  • Faster fft with pyfftw by @ljgray in https://github.com/radiocosmology/caput/pull/281
  • Fix README URL by @ketiltrout in https://github.com/radiocosmology/caput/pull/282
  • Fix mpiarray global_slice Ellipsis check by @ljgray in https://github.com/radiocosmology/caput/pull/284
  • Properly propagate error in bit_truncate_relative by @ljgray in https://github.com/radiocosmology/caput/pull/285
  • Pass the same key object to task with multiple process arguments by @ljgray in https://github.com/radiocosmology/caput/pull/286
  • Require zarr < 3 by @ljgray in https://github.com/radiocosmology/caput/pull/287
  • fix(fileformats): fix compression check by @ssiegelx in https://github.com/radiocosmology/caput/pull/289
  • feat(time): add objectcoords and cirsradec method to Observer class by @ssiegelx in https://github.com/radiocosmology/caput/pull/290
  • Bump minimum python to 3.10 by @ljgray in https://github.com/radiocosmology/caput/pull/292
  • Import pyfftw before numpy by @ljgray in https://github.com/radiocosmology/caput/pull/291

Full Changelog: https://github.com/radiocosmology/caput/compare/v24.8.0...v25.3.0

- Python
Published by ljgray 12 months ago

caput - 24.8.0

What's Changed

  • Increase minimum python to 3.9 by @ljgray in https://github.com/radiocosmology/caput/pull/267
  • Allow a task to receive the same input for setup and process method by @ljgray in https://github.com/radiocosmology/caput/pull/268
  • feat(interferometry): Import from ch_util and driftscan by @ketiltrout in https://github.com/radiocosmology/caput/pull/269
  • fix(time): Make Star.names iterable in skyfieldstarfromradec by @ketiltrout in https://github.com/radiocosmology/caput/pull/270
  • feat(time): Solar/lunar ephemerides by @ketiltrout in https://github.com/radiocosmology/caput/pull/271
  • fix(memh5): fix a bug where shared datasets weren't actually shared by @ljgray in https://github.com/radiocosmology/caput/pull/239
  • Convert build to pyproject.toml by @ljgray in https://github.com/radiocosmology/caput/pull/272
  • Remove deprecated cachedproperty in favour of functools.cachedproperty by @ljgray in https://github.com/radiocosmology/caput/pull/273

Full Changelog: https://github.com/radiocosmology/caput/compare/v24.6.0...v24.8.0

- Python
Published by ketiltrout over 1 year ago

caput - v24.6.0

What's Changed

  • fix(pyx): ensure distutil directives are read and pin max numpy version by @ljgray in https://github.com/radiocosmology/caput/pull/246
  • fix(runner): reset the environment to stop crash at job start by @jrs65 in https://github.com/radiocosmology/caput/pull/248
  • fix numpy median by @jrs65 in https://github.com/radiocosmology/caput/pull/249
  • Add email notification options for batch jobs by @sjforeman in https://github.com/radiocosmology/caput/pull/250
  • Extra ruff rules by @ljgray in https://github.com/radiocosmology/caput/pull/243
  • fix: upgrade versioneer and change to non-vendored mode for Python 3.12 by @jrs65 in https://github.com/radiocosmology/caput/pull/257
  • parallel load with no attributes by @jrs65 in https://github.com/radiocosmology/caput/pull/253
  • Enforce linting rule RUF012 by @ljgray in https://github.com/radiocosmology/caput/pull/259
  • Avoid redistribute copy if using a single mpi process by @ljgray in https://github.com/radiocosmology/caput/pull/256
  • Runner: module force purge and module use by @ljgray in https://github.com/radiocosmology/caput/pull/255
  • Pipeline runner improvements by @ljgray in https://github.com/radiocosmology/caput/pull/258
  • feat(pipeline): better handling for key rejection by @ljgray in https://github.com/radiocosmology/caput/pull/265
  • Pin numpy < 2 by @ljgray in https://github.com/radiocosmology/caput/pull/266

Full Changelog: https://github.com/radiocosmology/caput/compare/v23.6.0...v24.6.0

- Python
Published by ljgray over 1 year ago

caput - 23.6.0

What's Changed

  • perf(movingweightedmedian): transpose 2D array if window size [0] is less than size[1] by @ljgray in https://github.com/radiocosmology/caput/pull/220
  • Move cython _invert_no_zero into caput by @ljgray in https://github.com/radiocosmology/caput/pull/221
  • Add data directory to gitignore by @rikvl in https://github.com/radiocosmology/caput/pull/228
  • fix(mpiarray.MPIArray.gather): Wait for send to complete. by @tristpinsm in https://github.com/radiocosmology/caput/pull/231
  • Observer property to get current LSD/CSD by @ljgray in https://github.com/radiocosmology/caput/pull/227
  • fix(pipeline): remove erroneous compression options that caused a crash by @jrs65 in https://github.com/radiocosmology/caput/pull/233
  • build: Bump minimum supported version to 3.8 by @ljgray in https://github.com/radiocosmology/caput/pull/235
  • Reduce memory used by MPIArray.redistribute by @ljgray in https://github.com/radiocosmology/caput/pull/218
  • Provide .copy methods for MemDataset and MemDiskGroup by @ljgray in https://github.com/radiocosmology/caput/pull/236
  • Allow fileformat to be set by fileformat subclass by @ljgray in https://github.com/radiocosmology/caput/pull/237
  • Move invertnozero testing from draco repo by @ljgray in https://github.com/radiocosmology/caput/pull/240
  • Use ruff for CI linting by @ljgray in https://github.com/radiocosmology/caput/pull/238
  • MPIArray reshape fixes by @jrs65 in https://github.com/radiocosmology/caput/pull/241
  • Timstamp Alignment (1/4): Add index_attrs property to BasicCont to access attrs of index maps by @ljgray in https://github.com/radiocosmology/caput/pull/234
  • feat(mpiarray): helper function to apply a selection to an array by @ljgray in https://github.com/radiocosmology/caput/pull/242

New Contributors

  • @rikvl made their first contribution in https://github.com/radiocosmology/caput/pull/228

Full Changelog: https://github.com/radiocosmology/caput/compare/v22.10.0...v23.6.0

- Python
Published by ljgray over 2 years ago

caput - 22.10.0

What's Changed

  • fix(time): timescale wasn't returned when pulled from mirror by @jrs65 in https://github.com/radiocosmology/caput/pull/224
  • feat(fileformats): make guessfileformats compatible with pathlib.Pa… by @ljgray in https://github.com/radiocosmology/caput/pull/225

Full Changelog: https://github.com/radiocosmology/caput/compare/v22.9.0...v22.10.0

- Python
Published by jrs65 over 3 years ago

caput - 22.9.0

What's Changed

  • Skyfield refactor and transit/rise/set time routines by @jrs65 in https://github.com/radiocosmology/caput/pull/146
  • fix(transit_times): Handle small intervals better by @ketiltrout in https://github.com/radiocosmology/caput/pull/150
  • Remove Python 2 support by @jrs65 in https://github.com/radiocosmology/caput/pull/151
  • Pipeline script linting by @nritsche in https://github.com/radiocosmology/caput/pull/147
  • Docs build by @nritsche in https://github.com/radiocosmology/caput/pull/140
  • Fix sphinx build by @nritsche in https://github.com/radiocosmology/caput/pull/153
  • fix(time.Observer.transit_times): Use sidereal day. by @tristpinsm in https://github.com/radiocosmology/caput/pull/154
  • Fix issues with line in config by @jrs65 in https://github.com/radiocosmology/caput/pull/158
  • Fix linter by @nritsche in https://github.com/radiocosmology/caput/pull/160
  • chore(pipeline): add deprecated PipelineConfigError by @nritsche in https://github.com/radiocosmology/caput/pull/156
  • fix(scripts.runner): Broken pathlib usage. by @tristpinsm in https://github.com/radiocosmology/caput/pull/161
  • CI: Run flake8 and pylint by @nritsche in https://github.com/radiocosmology/caput/pull/157
  • fix(OneAndAone): move validation to special function by @nritsche in https://github.com/radiocosmology/caput/pull/163
  • Fix pylint to version 2.7.0 and fix new warnings from that version by @nritsche in https://github.com/radiocosmology/caput/pull/166
  • fix(runner): change allocation from rpp-krs to rpp-chime by @anjakefala in https://github.com/radiocosmology/caput/pull/170
  • build: update versioneer by @anjakefala in https://github.com/radiocosmology/caput/pull/174
  • feat(runner): add modules conf variable, specify module environment of a pipeline job by @anjakefala in https://github.com/radiocosmology/caput/pull/168
  • feat(memh5): add a _memh5distributed_axis hint by @ssiegelx in https://github.com/radiocosmology/caput/pull/176
  • feat(truncate): a new module for precision truncation of data by @jrs65 in https://github.com/radiocosmology/caput/pull/175
  • Allow variable substitution into pipeline scripts by @jrs65 in https://github.com/radiocosmology/caput/pull/172
  • fix(runner): need absolute paths in the imports by @jrs65 in https://github.com/radiocosmology/caput/pull/178
  • build: build using the oldest supported numpy version by @anjakefala in https://github.com/radiocosmology/caput/pull/182
  • Useful enhancements for running the pipeline by @jrs65 in https://github.com/radiocosmology/caput/pull/184
  • Merging master into Rick's profiling improvements for caput.pipeline by @anjakefala in https://github.com/radiocosmology/caput/pull/180
  • feat(runner): add psutil based profiling to caput-pipeline by @anjakefala in https://github.com/radiocosmology/caput/pull/185
  • fix(mpiarray): ensure global_shape for new MPIArray is a tuple by @anjakefala in https://github.com/radiocosmology/caput/pull/187
  • Remove Nyquist frequency from PFB by @leungcalvin in https://github.com/radiocosmology/caput/pull/191
  • feat(mpiarray.MPIArray): Handle index selections. by @tristpinsm in https://github.com/radiocosmology/caput/pull/192
  • feat(runner): add an option to control overwritiing old pipeline runs by @jrs65 in https://github.com/radiocosmology/caput/pull/188
  • feat(memh5): zarr support by @nritsche in https://github.com/radiocosmology/caput/pull/169
  • feat(mpiarray): ufunc, array_finalize, and getitem handling for MPIArray by @anjakefala in https://github.com/radiocosmology/caput/pull/162
  • fix(memh5): ensure contained numpy arrays have a native dtype.byteorder by @anjakefala in https://github.com/radiocosmology/caput/pull/194
  • fix(mpiarray): handling Ellipsis and np.newaxis when slicing by @jrs65 in https://github.com/radiocosmology/caput/pull/197
  • fix(time): try downloading mirrored data by @jrs65 in https://github.com/radiocosmology/caput/pull/199
  • fix(mpiarray): crash testing for an Ellipsis when given an ndarray index by @jrs65 in https://github.com/radiocosmology/caput/pull/200
  • fix(tod.concatenate): Convert index map to unicode. by @tristpinsm in https://github.com/radiocosmology/caput/pull/201
  • fix(mpiarray): only give warning when compression is disabled by the pipeline by @jrs65 in https://github.com/radiocosmology/caput/pull/202
  • HFB container fixes by @jrs65 in https://github.com/radiocosmology/caput/pull/198
  • fix(tod): issues copying data from h5py datasets by @jrs65 in https://github.com/radiocosmology/caput/pull/208
  • MPIArray cleanups and speedups by @jrs65 in https://github.com/radiocosmology/caput/pull/204
  • feat(MPIArray): property for getting global bounds of local array. by @ljgray in https://github.com/radiocosmology/caput/pull/211
  • perf(MPIArray): Write redistributed chunks directly into target array by @ljgray in https://github.com/radiocosmology/caput/pull/214
  • build(setup.py, .github/workflows/main.yml): un-pin numcodecs version by @sjforeman in https://github.com/radiocosmology/caput/pull/212
  • feat: add CFF file for Github/Zenodo by @jrs65 in https://github.com/radiocosmology/caput/pull/215
  • fix(memh5): issue with distribution of zarr datasets by @jrs65 in https://github.com/radiocosmology/caput/pull/216
  • docs(pipeline): add description of outputs of python-based pipeline by @sjforeman in https://github.com/radiocosmology/caput/pull/219
  • feat(memh5): add zipped zarr file support by @jrs65 in https://github.com/radiocosmology/caput/pull/222

New Contributors

  • @leungcalvin made their first contribution in https://github.com/radiocosmology/caput/pull/191

Full Changelog: https://github.com/radiocosmology/caput/compare/v20.10.0...v22.9.0

- Python
Published by jrs65 over 3 years ago

caput - 20.10.0

Bug Fixes

  • config: incorrect exception error message (645b47c)
  • memh5: change makeselections to be a classmethod (9869122)
  • memh5: modify BasicCont.redistribute to prevent reference cycles (0b7efaa)
  • memh5: pass on detect_subclass and warn when axis selections won't work (f1d2e28)
  • misc: change lock_file() behavior to match docstring (5aed55e)
  • mpiarray: bug when selecting data during distributed read (3c5392a)
  • mpiarray: upper limit incorrectly set in private function _reslice (4e2e1e4)
  • setup: load install_requires from the requirements.txt file (9f25a57)
  • time: allow zero length arrays as arguments (1a4b324)

Features

  • interferometry: add routines use for interferometry (2bf97e1)
  • pfb: routines for calculating and correcting the effects of a PFB (a044741)
  • pipeline: allow construction and control of pure Python pipelines (81af488)
  • runner: support profiling caput-pipeline runs (9b72e7c)

Performance Improvements

  • weighted_median: use quickselect to calculate the static median (cfddefb)

- Python
Published by jrs65 over 5 years ago

caput - 20.5.1

Bug Fixes

  • memh5: json serialize numpy ndarray (e8156da)

- Python
Published by jrs65 almost 6 years ago

caput - 20.5.0

Note: we have switched to calendar versioning for this release.

Bug Fixes

  • Fixed circular references in memh5 containers (#60)
  • Fixed a race condition when creating output directories (#64)
  • Fixed bug in tod.concatenate
  • memh5: explicitly set h5py read mode in routines and tests (e5c0016)
  • memh5: no comm attribute on group in redistribute (be655b0)
  • memh5: allow writing unicode datasets into h5py (25c5b2d)
  • memh5: change default convertattributestrings for backwards compatibility (bc8261b)
  • memh5: comm property was set when distributed=False (a9acd90)
  • memh5: detect and convert types annotated with metadata (ef4ebc8)
  • memh5: Mapping has moved into collections.abc in Python 3.8 (631412e)
  • memh5: serialise datetimes with dict attributes without crashing (5d30194)
  • memh5: sort items when copying to/from HDF5 to eliminate MPI errors (7af91fe)
  • mpiarray: partition parallel IO to be under the 2GB HDF5 limit (bee591e)
  • mpiarray: workaround for h5py collective IO bug (9c68fe3), closes #965
  • mpiutil: disable the MPI excepthook (6fba9f6)
  • parallel_map: fixed crash (2462a2f)
  • pipeline: changed incorrect proargspec.keywords to proargspec.varkw (906d753), closes #121
  • pipeline: use safe_load to avoid warning when loading pipeline conf (8f2d7c3)
  • runner: Add call to group at end of file. (e48ef60)
  • runner: use copyfile instead of copy (3da9976), closes #102
  • time: include required skyfield data in the repo (via Git LFS) (39f357d)
  • time: set SkyfieldWrapper default expire=False (#126) (8e84719)
  • tod: fixes bug where data variable overwritten (0ed8b2c)

Features

  • Context Manager for all memh5 container types (#60). You can now do: with memh5.BasicCont.from_file("filename.h5"): pass
  • Support for new CHIME stacked data with reverse_map (#58)
  • Better handling of missing config information (#56)
  • IO for distributed memh5 containers is now MPI parallel if possible (#66). This should make a big difference to write times of large containers.
  • config: add a list Property for validating input lists (b32ad1d)
  • BasicCont: make history an h5 attribute (fbc5034)
  • caput-pipeline: add option to run job from a temporary dir (90043f5)
  • Manager: add metadata options (47432ee), closes #104
  • memh5: add compression and chunking of memh5 datasets (c0886c8)
  • memh5: sel_* parameters (6743098), closes #108
  • misc: context manager for lockfiles (af67279)
  • MPIArray: add gather and allgather for collecting the full array (2da95ae)
  • pipeline: improve log level config (f418299)
  • pipeline: use locking when writing output (2ab01ed)
  • setup.py: support building without OpenMP (e478a03)
  • tod: allow control of string conversion in tod.concatenate (249face)
  • util: moving weighted median (f3e1a2c)
  • versioneer: add versioneer for better version naming (fa9cccb)

- Python
Published by nritsche almost 6 years ago