Data

Tools

Indexes

Applications

Experiments

Open Source Science

Recent Releases of ch_pipeline

ch_pipeline - 25.3.3

This release includes an updated citation file which should have been included in previous releases.

What's Changed

  • Add one more person to citations by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/290

Full Changelog: https://github.com/chime-experiment/ch_pipeline/compare/v25.3.2...v25.3.3

- Python
Published by ljgray 11 months ago

ch_pipeline - 25.3.2

This release includes an updated citation file which should have been included in previous releases.

What's Changed

  • Defining a function to compute sensitivity metric by @yukari-u in https://github.com/chime-experiment/ch_pipeline/pull/288
  • Update citation file by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/289

New Contributors

  • @yukari-u made their first contribution in https://github.com/chime-experiment/ch_pipeline/pull/288

Full Changelog: https://github.com/chime-experiment/ch_pipeline/compare/v25.3.1...v25.3.2

- Python
Published by ljgray 11 months ago

ch_pipeline - 25.3.1

Release to include #287, which is required for numpy 2.0 compatibility.

What's Changed

  • refactor(analysis): Use object_coords Observer method by @ketiltrout in https://github.com/chime-experiment/ch_pipeline/pull/286
  • Switch deprecated 'np.issubclass' to 'issubclass' by @ljgray in https://github.com/chime-experiment/chpipeline/pull/287

Full Changelog: https://github.com/chime-experiment/ch_pipeline/compare/v25.3.0...v25.3.1

- Python
Published by ljgray 11 months ago

ch_pipeline - 25.3.0

What's Changed

  • Fix variable name changes in ch_ephem by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/268
  • Fix import extra processing types by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/270
  • Check for tags which do not have data available anywhere by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/271
  • Apply source masks to mask containers by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/273
  • fix(sidereal): fix typo causing invalid format specifier in log by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/277
  • Numpy 2.0 support by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/269
  • ss/sidereal mean by @ssiegelx in https://github.com/chime-experiment/ch_pipeline/pull/276
  • Rename pixel and track maps to be clearer about functionality by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/280
  • fix(sidereal): fix incorrect container reference by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/281
  • Extend MaskSource to mask antipodal transits by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/282
  • Tasks to generate a CHIME rfi mask using HFB data by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/284
  • Ar/offline telescope by @sareda26 in https://github.com/chime-experiment/ch_pipeline/pull/283
  • Bump minimum python to 3.10 by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/285
  • Check for duplicate jobs and cancel all but one of them by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/279
  • fix(beam): properly re-center HA grid after unwrapping long transits by @sareda26 in https://github.com/chime-experiment/ch_pipeline/pull/272

Full Changelog: https://github.com/chime-experiment/ch_pipeline/compare/v24.8.0...v25.3.0

- Python
Published by ljgray 11 months ago

ch_pipeline - 24.8.0

What's Changed

  • build: Change build to use pyproject by @ketiltrout in https://github.com/chime-experiment/ch_pipeline/pull/264
  • Update README.md for pyproject.toml by @ketiltrout in https://github.com/chime-experiment/ch_pipeline/pull/265
  • fix: Use chephem directly by @ketiltrout in https://github.com/chime-experiment/chpipeline/pull/266
  • Ruff linting by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/231
  • ci: fix doc generation by @ketiltrout in https://github.com/chime-experiment/ch_pipeline/pull/267

New Contributors

  • @ketiltrout made their first contribution in https://github.com/chime-experiment/ch_pipeline/pull/264

Full Changelog: https://github.com/chime-experiment/ch_pipeline/compare/v24.6.1...v24.8.0

- Python
Published by ketiltrout over 1 year ago

ch_pipeline - v24.6.1

What's Changed

  • fix(hfb.containers): Add width axis and amplitude dataset to HFBSearchResult by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/249
  • fix(hfb.io): make selections in file loader more robust by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/252
  • fix(hfb.analysis): change distributed axis to el by @arashcosmology in https://github.com/chime-experiment/ch_pipeline/pull/254
  • Include slurm files in failed job check by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/255
  • Correctly include older days in --retrieve list by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/259
  • Reduce range of data kept permanently online by daily pipeline by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/263

Full Changelog: https://github.com/chime-experiment/ch_pipeline/compare/v24.6.0.1...v24.6.1

- Python
Published by ljgray over 1 year ago

ch_pipeline - v24.6.0.1

What's Changed

  • fix(base): improve re match on db connection error by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/253

Full Changelog: https://github.com/chime-experiment/ch_pipeline/compare/v24.6.0...v24.6.0.1

- Python
Published by ljgray over 1 year ago

ch_pipeline - v24.6.0

What's Changed

  • feat(hfb): tools for deconvolving the subfrequency bandshape by @jrs65 in https://github.com/chime-experiment/ch_pipeline/pull/183
  • HFB flatten subfrequency bandshape using DeconvolvePFB by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/188
  • feat(hfb): make MakeHighFreqRes more general by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/198
  • feat(hfb): add HFB differencing task by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/199
  • feat(hfb): allow HFBStackDays with all data cont by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/200
  • feat(hfb): add Doppler shift task by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/201
  • refactor(hfb): create base HFB container by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/202
  • feat(hfb): add HFB RingMap containers by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/205
  • fix(hfb.io): allow loading of a simple list of files by @jrs65 in https://github.com/chime-experiment/ch_pipeline/pull/209
  • Fixes for pipeline runner by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/212
  • fix: upgrade versioneer and change to non-vendored mode for Python 3.12 by @jrs65 in https://github.com/chime-experiment/ch_pipeline/pull/216
  • fix(hfb): remove redistribute in HFBStackDays by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/208
  • fix(hfb.pfb): use invertnozero by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/217
  • Change doc requirements to allow Sphinx version 5.0 by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/227
  • feat(hfb): stitch freqs together for HFB ringmaps by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/206
  • feat(hfb): task to flatten HFB ringmap using PFB by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/207
  • Add container for HFB blind search results by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/218
  • Allow selections when loading CHIME data by @jrs65 in https://github.com/chime-experiment/ch_pipeline/pull/214
  • HFB add beam container by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/222
  • refactor: run black 24.1.1 by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/232
  • fix(hfb.analysis): fix shape of pfbshape by @rikvl in https://github.com/chime-experiment/chpipeline/pull/219
  • HFB averaging high-res ringmaps over EW beams by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/224
  • HFB weighted median subtraction by @arashcosmology in https://github.com/chime-experiment/ch_pipeline/pull/225
  • fix(hfb): fix weight normalization by @arashcosmology in https://github.com/chime-experiment/ch_pipeline/pull/228
  • fix(hfb.analysis.HFBDividePFB): use isinstance by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/235
  • HFB regridding by @jrs65 in https://github.com/chime-experiment/ch_pipeline/pull/210
  • Quarterstack updates by @jrs65 in https://github.com/chime-experiment/ch_pipeline/pull/140
  • Add a task to establish a database connection by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/243
  • Exclude NaNs in weather data when interpolating by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/226
  • feat(flagging): add pipeline task for rainfall flagging by @sjforeman in https://github.com/chime-experiment/ch_pipeline/pull/244
  • fix: update instructions for installing virtualenv by @sjforeman in https://github.com/chime-experiment/ch_pipeline/pull/194
  • Include module load options and defaults by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/215
  • feat(hfb): Task for on-off differencing by @arashcosmology in https://github.com/chime-experiment/ch_pipeline/pull/247
  • Chime-specific version of new RFI mask by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/241
  • feat(flagging): add chime version of RFIMaskChisqHighDelay by @ssiegelx in https://github.com/chime-experiment/ch_pipeline/pull/246
  • Updates to daily pipeline infrastructure by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/239
  • ss/madtimes by @ssiegelx in https://github.com/chime-experiment/ch_pipeline/pull/248
  • feat(hfb.io): add selection of NS and EW beams by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/234
  • fix(hfb.analysis): use beamew and el properties by @rikvl in https://github.com/chime-experiment/chpipeline/pull/236
  • HFB align EW beams by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/223
  • HFB MPI fix hang on write-out by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/238
  • fix(hfb.analysis): make SelectBeam a pipeline task by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/250
  • Daily Pipeline rev08 Config by @ljgray in https://github.com/chime-experiment/chpipeline/pull/229

Full Changelog: https://github.com/chime-experiment/ch_pipeline/compare/v23.6.0.2...v24.6.0

- Python
Published by ljgray over 1 year ago

ch_pipeline - 23.6.0.2

What's Changed

  • fix(daily): add longer buffer to recent day list by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/204

Full Changelog: https://github.com/chime-experiment/ch_pipeline/compare/v23.6.0.1...v23.6.0.2

- Python
Published by ljgray over 2 years ago

ch_pipeline - 23.6.0.1

What's Changed

  • fix(daily): ignore the current day since some of the data won't exist… by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/203

Full Changelog: https://github.com/chime-experiment/ch_pipeline/compare/v23.6.0...v23.6.0.1

- Python
Published by ljgray over 2 years ago

ch_pipeline - 23.6.0

What's Changed

  • Create HFB subpackage by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/134
  • Merge solar beam code by @wulfda02 in https://github.com/chime-experiment/ch_pipeline/pull/135
  • feat(calibration): pipeline to flag narrowband gain errors by @ssiegelx in https://github.com/chime-experiment/ch_pipeline/pull/114
  • fix(containers): replace some deprecated numpy types with built-ins by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/143
  • fix: change deprecated numpy types by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/145
  • feat(containers): add time property to RawContainer by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/142
  • Ch/timingerrors by @cahofer in https://github.com/chime-experiment/ch_pipeline/pull/72
  • HFB data loader with selections by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/139
  • HFB RFI flagging by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/133
  • HFB Time averaging by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/151
  • HFB Flattening by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/148
  • HFB High frequency resolution by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/149
  • HFB Stack days by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/150
  • HFB data loading frequency selection fix by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/152
  • HFB average over beams by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/153
  • fix(hfb): Uniform weighting using binary weights by @arashcosmology in https://github.com/chime-experiment/ch_pipeline/pull/154
  • Reading a time stamp by @hgan0 in https://github.com/chime-experiment/ch_pipeline/pull/141
  • style: update for black 23.1 by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/160
  • Update daily config to account for refactored ThresholdVisWeight by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/165
  • fix(daily): fix ThresholdVixWeight requires in daily config by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/166
  • fix(processing): properly handle tvwb output mask by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/170
  • Bump minimum python version to 3.8 by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/171
  • Add config option to prioritize processing recent CSDs by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/144
  • HFB move nsamples dataset by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/155
  • HFB handle empty filelists in LoadFiles by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/159
  • HFB docs sdata type by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/158
  • HFB fix divide by zero in RFI flagging by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/162
  • HFB template local array by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/157
  • HFB fix containers.emptylike by @rikvl in https://github.com/chime-experiment/chpipeline/pull/156
  • fix(build): add pytz to requirements.txt by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/174
  • CHP method to list failed jobs by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/138
  • fix(daily): update config to use new draco ApplyBaselineMask task. by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/172
  • Frequency Map (1/2): Query database for frequency slot map by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/163
  • HFB use catalog by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/177
  • perf(telescope): cache slow properties by @nritsche in https://github.com/chime-experiment/ch_pipeline/pull/71
  • HFB select on-source and off-source data by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/179
  • HFB add tag and LSD to attributes by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/180
  • HFB use catalog to get source coordinates by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/181
  • fix(telescope): include correct complex check for HEALPixBeams by @sareda26 in https://github.com/chime-experiment/ch_pipeline/pull/178
  • fix(telescope): remove deprecated np.str type by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/186
  • Datasetid (2/2): Ensure CHIMETimeStream datasets are accurate and handle distributed `datasetid` by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/175
  • Timestamp Alignment(4/4): Remove CHIMETimeStream.time property by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/168
  • feat(pyproject): add pyproject file by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/190
  • fix(dataquery): handle case where no fmap is found for a given datasetid by @ljgray in https://github.com/chime-experiment/chpipeline/pull/187
  • HFB general averaging by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/184
  • fix: remove deprecated numpy types by @jrs65 in https://github.com/chime-experiment/ch_pipeline/pull/195
  • Pull HFB staging into master by @jrs65 in https://github.com/chime-experiment/ch_pipeline/pull/196
  • feat(daily): save beamformed visibilities versus hour angle by @ssiegelx in https://github.com/chime-experiment/ch_pipeline/pull/189
  • rev07 config updates by @ljgray in https://github.com/chime-experiment/chpipeline/pull/176

New Contributors

  • @wulfda02 made their first contribution in https://github.com/chime-experiment/ch_pipeline/pull/135
  • @arashcosmology made their first contribution in https://github.com/chime-experiment/ch_pipeline/pull/154
  • @hgan0 made their first contribution in https://github.com/chime-experiment/ch_pipeline/pull/141
  • @sareda26 made their first contribution in https://github.com/chime-experiment/ch_pipeline/pull/178

Full Changelog: https://github.com/chime-experiment/ch_pipeline/compare/v22.10.0...v23.6.0

- Python
Published by ljgray over 2 years ago

ch_pipeline - 22.10.0

What's Changed

  • feat(client): option to select user when getting slurm jobs by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/127
  • fix(base): correctly check running and queued files against crashed by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/128
  • feat(io): Load HFB data with selections by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/123
  • fix(containers): access to flags data via property by @rikvl in https://github.com/chime-experiment/ch_pipeline/pull/131
  • feat(base): method to get all job tag status items. by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/129
  • rev06 updates by @jrs65 in https://github.com/chime-experiment/ch_pipeline/pull/136
  • feat(client): improve clarity of status metric naming by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/137

New Contributors

  • @rikvl made their first contribution in https://github.com/chime-experiment/ch_pipeline/pull/123

Full Changelog: https://github.com/chime-experiment/ch_pipeline/compare/v22.9.0...v22.10.0

- Python
Published by jrs65 over 3 years ago

ch_pipeline - 22.9.0

What's Changed

  • Chp fairshare support by @jrs65 in https://github.com/chime-experiment/ch_pipeline/pull/57
  • feat(timing): accommodate updates in chutil.timing by @ssiegelx in https://github.com/chime-experiment/chpipeline/pull/50
  • fix: port to new skyfield base ephemeris code by @jrs65 in https://github.com/chime-experiment/ch_pipeline/pull/59
  • Consolidate github installation urls by @anjakefala in https://github.com/chime-experiment/ch_pipeline/pull/68
  • chore: add MIT license by @nritsche in https://github.com/chime-experiment/ch_pipeline/pull/65
  • fix(beam): replace deprecated caput.pipeline.PipelineConfigError by @nritsche in https://github.com/chime-experiment/ch_pipeline/pull/67
  • Fix sphinx build and put it on readthedocs by @nritsche in https://github.com/chime-experiment/ch_pipeline/pull/61
  • docs(examples): fix some errors in the example configs by @nritsche in https://github.com/chime-experiment/ch_pipeline/pull/60
  • fix(analysis.beam,analysis.sidereal): Fix chimeobserver. by @tristpinsm in https://github.com/chime-experiment/chpipeline/pull/73
  • feat(daily): new revision by @jrs65 in https://github.com/chime-experiment/ch_pipeline/pull/74
  • Quarterstack by @jrs65 in https://github.com/chime-experiment/ch_pipeline/pull/63
  • feat(telescope): update beam evaluation for use in beamformer code by @ssiegelx in https://github.com/chime-experiment/ch_pipeline/pull/78
  • refactor(core.telescope.CHIMEExternalBeam): Adapt to use new beam fil… by @tristpinsm in https://github.com/chime-experiment/ch_pipeline/pull/76
  • Dataquery and weather changes by @jrs65 in https://github.com/chime-experiment/ch_pipeline/pull/79
  • feat(io): add capabilities to file loading tasks by @ssiegelx in https://github.com/chime-experiment/ch_pipeline/pull/81
  • fix(beam): update dataset names for TrackBeam container by @ssiegelx in https://github.com/chime-experiment/ch_pipeline/pull/51
  • Frequency dependent FWHMs by @saurabh-astro in https://github.com/chime-experiment/ch_pipeline/pull/84
  • fix: chimearchive does not exist anymore; now reading from chimeonline by @anjakefala in https://github.com/chime-experiment/ch_pipeline/pull/88
  • [WIP] feat(core.telescope.CHIMEExternalBeam): Interpolate GridBeam. by @tristpinsm in https://github.com/chime-experiment/ch_pipeline/pull/83
  • feat(telescope): option to skip omit transfers for specified pol pairs by @jrs65 in https://github.com/chime-experiment/ch_pipeline/pull/90
  • feat(sourceremoval): reduce memory usage and other improvements by @ssiegelx in https://github.com/chime-experiment/chpipeline/pull/86
  • feat(timing): ApplyTimingCorrection only to data flagged by needstimingcorrection by @anjakefala in https://github.com/chime-experiment/ch_pipeline/pull/91
  • Changes for rev04 by @anjakefala in https://github.com/chime-experiment/chpipeline/pull/93
  • fix(chp): use new allocation id by @jrs65 in https://github.com/chime-experiment/ch_pipeline/pull/94
  • fix(timing): TimingCorrection bugfixes by @anjakefala in https://github.com/chime-experiment/ch_pipeline/pull/95
  • fix(CHIMEExternalBeam): fix typo in frequency interpolation by @sjforeman in https://github.com/chime-experiment/ch_pipeline/pull/96
  • Add decorrelation correction to holography fringestop pipeline by @tristpinsm in https://github.com/chime-experiment/ch_pipeline/pull/49
  • doc: change Sphinx requirement to a working version. by @tristpinsm in https://github.com/chime-experiment/ch_pipeline/pull/100
  • feat(containers): support HFB archive data by @jrs65 in https://github.com/chime-experiment/ch_pipeline/pull/99
  • feat(client): Add "metrics" command to display pipeline info by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/101
  • fix(dataquery): forcing a list should actually force a list by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/107
  • fix: check ephemeris sources are present in chutil.fluxcat by @Arnab-half-blood-prince in https://github.com/chime-experiment/chpipeline/pull/110
  • refactor(daily): avoid hidden in-place modifications in pipeline config. by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/112
  • convert chpipeline ringmap to draco ringmap container by @Arnab-half-blood-prince in https://github.com/chime-experiment/chpipeline/pull/113
  • Update RFIFilter to use draco container and ApplyRFIMask task by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/115
  • fix(daily): Update pipeline config for ThresholdVisWeight changes. by @ljgray in https://github.com/chime-experiment/ch_pipeline/pull/108
  • fix(sidereal): accommodate changes to MPIArray and containers by @ssiegelx in https://github.com/chime-experiment/ch_pipeline/pull/117
  • feat: add CITATION.cff file for Zenodo/Github by @jrs65 in https://github.com/chime-experiment/ch_pipeline/pull/118
  • Update configs for rev05 run by @jrs65 in https://github.com/chime-experiment/ch_pipeline/pull/116
  • feat(flagging): create task for masking decorrelated cylinders by @ssiegelx in https://github.com/chime-experiment/ch_pipeline/pull/124
  • Fixes for MaskDecorrelatedCylinder by @jrs65 in https://github.com/chime-experiment/ch_pipeline/pull/125
  • config(daily): add precision truncation to pipeline output by @jrs65 in https://github.com/chime-experiment/ch_pipeline/pull/119

New Contributors

  • @anjakefala made their first contribution in https://github.com/chime-experiment/ch_pipeline/pull/68
  • @saurabh-astro made their first contribution in https://github.com/chime-experiment/ch_pipeline/pull/84
  • @ljgray made their first contribution in https://github.com/chime-experiment/ch_pipeline/pull/101
  • @Arnab-half-blood-prince made their first contribution in https://github.com/chime-experiment/ch_pipeline/pull/110

Full Changelog: https://github.com/chime-experiment/ch_pipeline/compare/v20.10.0...v22.9.0

- Python
Published by jrs65 over 3 years ago

ch_pipeline - 20.10.0

Bug Fixes

  • processing.base: Write revconfig directly via stream. (2874b64)
  • SiderealRegridder: throw an exception if down_mix is set (83b588b)

Features

  • analysis.beam.FilterHolographyProcessed: Allow list of directories. (296e5f0)
  • analysis.fringestop: Add wterm option. (27070a3)
  • processing.beam: Add holography fringestopping. (fe65cef)
  • ThermalCalibration: a task to correct temperature related gains (79988ba)

- Python
Published by jrs65 over 5 years ago

ch_pipeline - 20.5.0

Bug Fixes

  • change versioneer config to give correct version strings (33859ea)
  • analysis.beam: Resolve conflicting tools import. (#34) (3b01f1a)
  • analysis.beam: Save a 26m input that can be used to directly index the input axis (d47dc9b)
  • base: changed incorrect mode for jobscript generation (08083bc)
  • DataFlagger: correct location of DataFlag classes (15ae96a)
  • dataquery: correct the default node_spoof (0ce7636)
  • dataquery: make QueryAcquisitions work as a task.MPILoggedTask. (65e125a)
  • flagging: convert altitude from Angle to radians (fd4b4dc)
  • LoadSetup: file reading bug (23ba828)
  • MaskCHIMEData: global slicing outside loop (#24) (7259c8f)
  • processing: preserve order of pending items (59bc24c)
  • ProcessingType: string type issue wehn writing out config (cad0df6)
  • RFISensitivityMask: incorrect time range used for bright sources (888fd42)
  • RingMapMaker: calculate grid properly after feed pos rotation (e24c6c7)
  • change deprecated import location (1ee39d5)
  • move from deprecated chutil module to chimedb.dataindex (1faf9d8)
  • Replace calls to dataindex.connectdatabase. (fba93aa)
  • requirements.txt: change ch_util installation from https to ssh (c396fc6)
  • requirements.txt: update ch_util repository address (3fdda52)
  • sidereal,io: fixes string problems that arise in python 2. (d794c59)
  • use prodstack where appropriate (1ab071f)
  • RingMapMaker: Fixed calculation of nfeed (cc263fe)
  • RingMapMaker: Fixed ringmap calculation when single_beam=True (94f51e5)
  • source_removal: handle csd of sidereal stacks properly (#26) (4d38d4e)
  • timing: modify condition that determines appropriate timing correction. (856b475)
  • remove unicode_literals for better setuptools support (a9697f3)
  • removed debugging clause that disabled fast read. (05da0d8)

Features

  • analysis.timing: Add option to pass if no correction found. (a56bf92)
  • calibration: pipeline for generating gains from chimecal acquisitions (#22) (44f6e6b)
  • daily: allow intervals to be given as CSD ranges (89685ca)
  • daily: updated config for the daily processing (ab92f66)
  • flagging: refactor DayMask. add tasks for flagging sources, sun, moon. (5ddc30a)
  • processing.base: open a description file when user creates a revision. (2ea4e2e)
  • QueryInputs: add an option to cache and reuse an inputs query (b3b3e4c)
  • add versioneer for better version naming (c5e77ba)
  • processing.client: Add option to list all types including those with no data. (6bcc201)
  • added ability to filter out specified CSDs (1d12572)
  • added option to only generate the central beam. (e5231fc)
  • python 3 support (33c07bd)
  • store virtualenv in revision directory. (1bf909f)
  • RFISensitivityMask: added CHIME specific version of RFI masking task (a6f471c)
  • support for fast reading of andata files. (a05a129)
  • use a nonzero rotation of the CHIME telescope (4995318)
  • processing: tools for managing the regular processing of data (309f8f4)
  • QueryDatabase: query for a range of CSDs (4890838)
  • RingMapMaker: improve handling of cross-pol to keep Stokes V (3e7c194)
  • sidereal: capability to specify ranges of RA for mean subtraction. (ea2d6a0)
  • sidereal: working versions of SiderealMean and ChangeSiderealMean (1ffe86a), closes #39
  • source_removal: initial version of tasks that subtract sources from visibilities (d004807)
  • telescope: add option to mask baselines accodring to total length, (de3b53d)
  • telescope: add polarisation property (#23) (e35b58c)
  • telescope: fix some bugs and style errors (ef9926a)
  • timing: pipeline tasks for constructing timing correction and applying to data. (fe13007), closes #33
  • timingerrors.py: simulate timing distribution errors (f8437e4), closes #24
  • a task that scans for existing CSDs to stop repeat processing (0285c9c)

Performance Improvements

  • RingMap: change order of axes for faster IO (0aada0c)
  • RingMapMaker: speed up by resolving datasets once (364cab3)

BREAKING CHANGES

  • RingMap: the ring map container axis order has changed

- Python
Published by jrs65 almost 6 years ago