karabo-pipeline

The Karabo Pipeline can be used as Digital Twin for SKA

https://github.com/i4ds/karabo-pipeline

Science Score: 46.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
  • Academic publication links
    Links to: arxiv.org
  • Committers with academic emails
    2 of 22 committers (9.1%) from academic institutions
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (17.3%) to scientific vocabulary

Keywords

ska
Last synced: 7 months ago · JSON representation

Repository

The Karabo Pipeline can be used as Digital Twin for SKA

Basic Info
Statistics
  • Stars: 16
  • Watchers: 6
  • Forks: 7
  • Open Issues: 75
  • Releases: 45
Topics
ska
Created over 4 years ago · Last pushed 8 months ago
Metadata Files
Readme License Citation

README.md

Alt text

| | | | --- | --- | | Testing | CI - Test codecov | | Package | Conda Latest Release Conda Downloads | | Meta | License - BSD 3-Clause |

Documentation | Examples | Contributors

Karabo is a radio astronomy software distribution for validation and benchmarking of radio telescopes and algorithms. It can be used to simulate the behavior of the Square Kilometer Array or other supported telescopes. Our goal is to make installation and ramp-up easier for researchers and developers.

Karabo includes and relies on OSKAR, RASCIL, WSClean, PyBDSF, MIGHTEE, GLEAM, Aratmospy, Bluebild, Eidos, Dask, Tools21cm, katbeam plus configuration of 20 well-known telescopes. Karabo can simulate instrument behavior and atmospheric effects, run imaging algorithms, and evaluate results.

You can use Karabo to build your own data processing pipelines by combining existing libraries and your own code. Karabo is written in Python, composed of modules that can be set up in an interactive Jupyter Notebook environment.

Installation

The software can be installed & used on Linux or Windows WSL.

Please see our documentation for the full installation instructions.

We also offer Docker images.

Quick Look with no Installation

If you are curious to see whether Karabo is for you or if you want to try it out before you install something, then this is for you: we offer a demo installation on Renkulab. This demo was created for a workshop at Swiss SKA Days in September 2024. It has been kept up to date ever since.

The demo installation can be found as SwissSKADays-Karabo-Workshop. You can start a server (free of cost) and start using the Karabo pipeline without an account. However, if you want to save your work, you need to log in using your GitHub account, your ORCID id, or your edu-ID. You then fork the project. Changes you make will be saved to your GitLab repository linked to your Renkulab accout.

A good starting point may be the slide deck of the workshop. You can find it in the folder documents. The code in the slides is available as Jupyter notebooks in the folder notebooks. Those help you get started.

Contribute to Karabo

We are very happy to accept contributions, either as code or even just bug reports! When writing code, please make sure you have a quick look at our Developer Documentation. Also, feel free to file bug reports or suggestions.

License

Contributors, 2024. Licensed under an MIT License license.

Owner

  • Name: Institute for Data Science
  • Login: i4Ds
  • Kind: organization
  • Location: Windisch, Switzerland

Institute for Data Science of FHNW.

GitHub Events

Total
  • Fork event: 2
  • Create event: 27
  • Issues event: 15
  • Release event: 11
  • Watch event: 7
  • Delete event: 20
  • Member event: 2
  • Issue comment event: 50
  • Push event: 178
  • Pull request review event: 60
  • Pull request review comment event: 61
  • Pull request event: 30
  • Gollum event: 40
Last Year
  • Fork event: 2
  • Create event: 27
  • Issues event: 15
  • Release event: 11
  • Watch event: 7
  • Delete event: 20
  • Member event: 2
  • Issue comment event: 50
  • Push event: 178
  • Pull request review event: 60
  • Pull request review comment event: 61
  • Pull request event: 30
  • Gollum event: 40

Committers

Last synced: 11 months ago

All Time
  • Total Commits: 1,538
  • Total Committers: 22
  • Avg Commits per committer: 69.909
  • Development Distribution Score (DDS): 0.725
Past Year
  • Commits: 51
  • Committers: 6
  • Avg Commits per committer: 8.5
  • Development Distribution Score (DDS): 0.569
Top Committers
Name Email Commits
lukas.gehrig l****g@s****h 423
Christoph Vögele c****e@f****h 242
Vincenzo Timmel v****l@g****m 231
Vincenzo Timmel v****l@g****m 224
Rohit Sharma r****t@g****m 77
vtimmel v****l@f****h 73
Jennifer Studer s****e@p****h 65
Lukas113 3****3 40
Luis Fernando Machado Poletti Valle l****i@g****m 33
Filip Schramka f****a@f****h 26
Andreas Wassmer a****r@f****h 22
jejestern j****r@b****h 22
Christoph Vögele c****8@p****h 21
Simon Felix s****x@f****h 15
Michel Pluess m****s@f****h 9
Simon Felix de@i****h 6
Michel Pluess s****1@g****h 2
ACsillaghy a****y@f****h 2
Dev Null d****l@g****m 2
Christopher Finlay c****y@u****h 1
PHerzogFHNW p****g@f****h 1
Sean B****e@g****m 1
Committer Domains (Top 20 + Academic)

Issues and Pull Requests

Last synced: 7 months ago

All Time
  • Total issues: 138
  • Total pull requests: 76
  • Average time to close issues: 8 months
  • Average time to close pull requests: 7 days
  • Total issue authors: 10
  • Total pull request authors: 11
  • Average comments per issue: 2.22
  • Average comments per pull request: 1.26
  • Merged pull requests: 70
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 18
  • Pull requests: 26
  • Average time to close issues: 3 months
  • Average time to close pull requests: 8 days
  • Issue authors: 6
  • Pull request authors: 5
  • Average comments per issue: 0.89
  • Average comments per pull request: 1.69
  • Merged pull requests: 22
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
  • sfiruch (57)
  • Lukas113 (24)
  • cvoegele (21)
  • kenfus (16)
  • mpluess (14)
  • anawas (12)
  • rohitcbscient (11)
  • fschramka (2)
  • d3v-null (2)
  • ACsillaghy (1)
  • tmartinezML (1)
  • lmachadopolettivalle (1)
  • deiruch (1)
Pull Request Authors
  • Lukas113 (37)
  • anawas (30)
  • cvoegele (22)
  • mpluess (18)
  • d3v-null (4)
  • lmachadopolettivalle (4)
  • rohitcbscient (3)
  • PHerzogFHNW (2)
  • deiruch (1)
  • trailfog (1)
  • fschramka (1)
  • sfiruch (1)
  • jejestern (1)
Top Labels
Issue Labels
enhancement (95) prio-med (41) prio-high (36) bug (22) prio-low (19) question (15) documentation (15) cscs (9) testing (8) proj-source-detection (7) data-set (7) user-request (4) proj-bluebild (2) proj-sdc3 (1) parallelisation (1)
Pull Request Labels
enhancement (1)

Dependencies

.github/workflows/build-dev-image.yml actions
  • actions/checkout v3 composite
  • docker/build-push-action v4 composite
  • docker/login-action v2 composite
  • docker/metadata-action v4 composite
  • docker/setup-qemu-action v2 composite
.github/workflows/build-docs.yml actions
  • actions/checkout v3 composite
  • actions/upload-artifact v3 composite
  • conda-incubator/setup-miniconda v2 composite
  • peaceiris/actions-gh-pages v3 composite
.github/workflows/build-user-image.yml actions
  • actions-ecosystem/action-get-latest-tag v1 composite
  • actions/checkout v3 composite
  • docker/build-push-action v4 composite
  • docker/login-action v2 composite
  • docker/metadata-action v4 composite
  • docker/setup-qemu-action v2 composite
.github/workflows/conda-build.yml actions
  • actions-ecosystem/action-get-latest-tag v1 composite
  • actions/checkout v3 composite
.github/workflows/dev-workflow.yml actions
  • actions/checkout v3 composite
.github/workflows/purge-image.yml actions
  • bots-house/ghcr-delete-image-action v1.1.0 composite
.github/workflows/test-user-package.yml actions
  • conda-incubator/setup-miniconda v2 composite
.github/workflows/test.yml actions
  • actions/checkout v3 composite
  • codecov/codecov-action v3 composite
  • conda-incubator/setup-miniconda v2 composite
docker/dev/Dockerfile docker
  • continuumio/miniconda3 4.12.0 build
docker/user/Dockerfile docker
  • nvidia/cuda 11.7.1-cudnn8-devel-ubuntu22.04 build
environment.yaml conda
  • aratmospy 1.0.0.*
  • astropy
  • bdsf
  • bluebild
  • cuda-cudart
  • dask 2022.12.1.*
  • dask-mpi
  • distributed
  • eidos 1.1.0.*
  • h5py
  • healpy
  • ipython
  • katbeam 0.1.0.*
  • libcufft
  • matplotlib
  • montagepy 6.0.0.*
  • mpi4py
  • nbconvert
  • nbformat
  • numpy 1.22.*
  • oskarpy 2.8.3.*
  • pandas
  • pinocchio 5.0.0.*
  • psutil
  • python 3.9.*
  • rascil 1.0.0.*
  • reproject
  • requests
  • scipy 1.10.1.*
  • ska-gridder-nifty-cuda 0.3.0.*
  • ska-sdp-datamodels 0.1.3.*
  • ska-sdp-func-python 0.1.4.*
  • tools21cm 2.0.2.*
  • xarray