Data

Tools

Indexes

Applications

Experiments

Open Source Science

https://github.com/ornladios/adios2

Next generation of ADIOS developed in the Exascale Computing Program

https://github.com/ornladios/adios2

Science Score: 49.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ✓
    DOI references
    Found 2 DOI reference(s) in README
  • ○
    Academic publication links
  • ✓
    Committers with academic emails
    43 of 112 committers (38.4%) from academic institutions
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (17.0%) to scientific vocabulary

Keywords

adios cmake ecp exascale exascale-computing hdf5 high-performance-computing hpc io

Keywords from Contributors

hpsf radiuss build-tools spack parallel-computing kokkos programming-model abstraction amr parallelism
Last synced: 5 months ago · JSON representation

Repository

Next generation of ADIOS developed in the Exascale Computing Program

Basic Info
Statistics
  • Stars: 299
  • Watchers: 22
  • Forks: 134
  • Open Issues: 67
  • Releases: 25
Topics
adios cmake ecp exascale exascale-computing hdf5 high-performance-computing hpc io
Created about 9 years ago · Last pushed 6 months ago
Metadata Files
Readme Contributing License Codeowners Copyright

ReadMe.md

License Documentation Circle CI GitHub release latest packaged version(s)

ADIOS2 : The Adaptable Input Output System version 2

This is ADIOS2: The Adaptable Input/Output (I/O) System.

ADIOS2 is developed as part of the United States Department of Energy's Exascale Computing Project. It is a framework for scientific data I/O to publish and subscribe to data when and where required.

ADIOS2 transports data as groups of self-describing variables and attributes across different media types (such as files, wide-area-networks, and remote direct memory access) using a common application programming interface for all transport modes. ADIOS2 can be used on supercomputers, cloud systems, and personal computers.

ADIOS2 focuses on:

  1. Performance I/O scalability in high performance computing (HPC) applications.
  2. Adaptability unified interfaces to allow for several modes of transport (files, memory-to-memory)
  3. Ease of Use two-level application programming interface (APIs)
  4. Full APIs for HPC applications: C++11, Fortran 90, C 99, Python 2 and 3
  5. Simplified High-Level APIs for data analysis: Python 2 and 3, C++11, Matlab

In addition, ADIOS2 APIs are based on:

  • MPI Although ADIOS2 is MPI-based, it can also be used in non-MPI serial code.

  • Data Groups ADIOS2 favors a deferred/prefetch/grouped variables transport mode by default to maximize data-per-request ratios. Sync mode, one variable at a time, is treated as the special case.

  • Data Steps ADIOS2 follows the actual production/consumption of data using an I/O “steps” abstraction removing the need to manage extra indexing information.

  • Data Engines ADIOS2 Engine abstraction allows for reusing the APIs for different transport modes removing the need for drastic code changes.

Documentation

Documentation is hosted at readthedocs.

Citing

If you find ADIOS2 useful, please cite our SoftwareX paper, which also gives a high-level overview to the motivation and goals of ADIOS; complementing the documentation.

Getting ADIOS2

Releases

Packages

| Platform | Package | |---------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------| | Summary | latest packaged version(s) | | Conda | Conda Version | | Spack | Spack package | | Homebrew | Homebrew package | | Ubuntu 24.04 | Ubuntu 24.04 package | | Debian 13 | Debian 13 package | | Debian Unstable | Debian Unstable package | | OpenSUSE TumbleWeed | openSUSE Tumbleweed package | | OpenSUSE Leap 15.6 | openSUSE Leap 15.6 package | | vcpkg | Vcpkg package | | Dockerhub | Docker Image Version |

Community

ADIOS2 is an open source project: Questions, discussion, and contributions are welcome. Join us at:

  • Mailing list: adios-ecp@kitware.com
  • Github Discussions: https://github.com/ornladios/ADIOS2/discussions

Reporting Bugs

If you find a bug, please open an issue on ADIOS2 github repository

Contributing

See the Contributor's Guide to ADIOS 2 for instructions on how to contribute.

License

ADIOS2 is licensed under the Apache License v2.0. See the accompanying Copyright.txt for more details.

Directory layout

  • bindings - public application programming interface, API, language bindings (C++11, C, Fortran, Python and Matlab)

  • cmake - Project specific CMake modules

  • examples - Simple set of examples in different languages

  • scripts - Project maintenance and development scripts

  • source - Internal source code for private components

  • adios2 - source directory for the ADIOS2 library to be installed under install-dir/lib/libadios2.

  • utils - source directory for the binary utilities, to be installed under install-dir/bin

  • testing - Tests using gtest

Owner

  • Name: ADIOS
  • Login: ornladios
  • Kind: organization

GitHub Events

Total
  • Create event: 6
  • Release event: 1
  • Issues event: 274
  • Watch event: 31
  • Delete event: 5
  • Member event: 1
  • Issue comment event: 759
  • Push event: 124
  • Pull request event: 302
  • Pull request review event: 247
  • Pull request review comment event: 73
  • Fork event: 10
Last Year
  • Create event: 6
  • Release event: 1
  • Issues event: 274
  • Watch event: 31
  • Delete event: 5
  • Member event: 1
  • Issue comment event: 759
  • Push event: 124
  • Pull request event: 302
  • Pull request review event: 247
  • Pull request review comment event: 73
  • Fork event: 10

Committers

Last synced: 7 months ago

All Time
  • Total Commits: 7,276
  • Total Committers: 112
  • Avg Commits per committer: 64.964
  • Development Distribution Score (DDS): 0.849
Past Year
  • Commits: 283
  • Committers: 21
  • Avg Commits per committer: 13.476
  • Development Distribution Score (DDS): 0.739
Top Committers
Name Email Commits
Greg Eisenhauer e****n@c****u 1,100
Jason Wang j****g@g****m 1,098
Norbert Podhorszki p****t@o****v 986
Chuck Atkins c****s@k****m 782
William F Godoy w****c@y****m 733
Vicente Adolfo Bolea Sanchez v****a@k****m 304
guj j****u@l****v 286
anagainaru a****u@g****m 231
Brad King b****g@k****m 210
Kai Germaschewski k****i@u****u 206
EVPath Upstream r****t@a****2 182
Philip Davis p****s@r****u 130
wfg w****g@p****v 119
Wan, Lipeng w****l@o****v 104
Dmitry Ganyushin g****n@g****m 97
Kyle Edwards k****s@k****m 70
Scott Wittenburg s****g@k****m 56
Nick n****7@p****m 51
Caitlin Ross c****s@k****m 49
Keichi Takahashi k****t@m****m 44
Godoy, William F g****f@o****v 43
Spiros Tsalikis s****s@k****m 41
Axel Huebl a****l@p****a 31
dependabot[bot] 4****] 21
Shawn Yang s****0@g****m 18
Erik Schnetter s****r@g****m 16
Kevin Huck k****k@c****u 16
wgodoy w****y@w****p 14
Haocheng Liu h****u@k****m 14
Aron Helser a****r@k****m 14
and 82 more...
Committer Domains (Top 20 + Academic)
kitware.com: 11 ornl.gov: 7 hdfgroup.org: 3 jlselogin5.ftm.alcf.anl.gov: 2 jlselogin6.ftm.alcf.anl.gov: 2 epcc.ed.ac.uk: 2 skylake15.ftm.alcf.anl.gov: 2 lbl.gov: 2 rutgers.edu: 2 cc.gatech.edu: 1 jlselogin4.ftm.alcf.anl.gov: 1 login4.summit.olcf.ornl.gov: 1 utk.edu: 1 asu.edu: 1 vols.utk.edu: 1 mbpwfg.ornl.gov: 1 login3.summit.olcf.ornl.gov: 1 pc0098504.ornl.gov: 1 hlrs.de: 1 njit.edu: 1 unh.edu: 1 cs.uoregon.edu: 1 rpi.edu: 1 mac118209.ornl.gov: 1 skylake16.ftm.alcf.anl.gov: 1 skylake14.ftm.alcf.anl.gov: 1 login2.summit.olcf.ornl.gov: 1 illinois.edu: 1 mcs.anl.gov: 1 umn.edu: 1 anl.gov: 1 bigubuntubase.rutgers.edu: 1 jlselogin7.ftm.alcf.anl.gov: 1

Issues and Pull Requests

Last synced: 6 months ago

All Time
  • Total issues: 491
  • Total pull requests: 972
  • Average time to close issues: over 2 years
  • Average time to close pull requests: 13 days
  • Total issue authors: 102
  • Total pull request authors: 35
  • Average comments per issue: 4.28
  • Average comments per pull request: 1.54
  • Merged pull requests: 680
  • Bot issues: 0
  • Bot pull requests: 6
Past Year
  • Issues: 54
  • Pull requests: 234
  • Average time to close issues: 11 days
  • Average time to close pull requests: 5 days
  • Issue authors: 22
  • Pull request authors: 21
  • Average comments per issue: 1.41
  • Average comments per pull request: 0.85
  • Merged pull requests: 150
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
  • vicentebolea (83)
  • pnorbert (62)
  • ax3l (47)
  • eisenhauer (21)
  • anagainaru (17)
  • eschnett (17)
  • franzpoeschel (16)
  • germasch (15)
  • dmitry-ganyushin (8)
  • NAThompson (8)
  • guj (8)
  • williamfgc (8)
  • kshitij-v-mehta (7)
  • liangwang0734 (7)
  • dqwu (7)
Pull Request Authors
  • eisenhauer (341)
  • vicentebolea (231)
  • pnorbert (143)
  • anagainaru (95)
  • dmitry-ganyushin (34)
  • lizdulac (17)
  • scottwittenburg (16)
  • guj (15)
  • spyridon97 (9)
  • Change72 (8)
  • franzpoeschel (8)
  • ax3l (7)
  • dependabot[bot] (6)
  • caitlinross (5)
  • adrianjhpc (4)
Top Labels
Issue Labels
Stale (193) enhancement (40) area: ci (32) area: build (29) bug (21) discussion (10) question (10) api: Python (9) api: C++ (8) triage: low (7) area: documentation (6) help wanted (5) api: Fortran (5) not-a-bug (4) api: C (4) sustainability (4) triage: high (3) triage: medium (3) area: external (2) external-sync (2) duplicate (1) status: work-in-progress (1) backport:master (1)
Pull Request Labels
never merge (95) backport:release (51) backport:master (9) don't merge yet (8) sustainability (7) dependencies (6) discussion (3) Stale (3) area: build (2) area: ci (2) help wanted (1)

Packages

  • Total packages: 5
  • Total downloads:
    • pypi 5,695 last-month
  • Total dependent packages: 5
    (may contain duplicates)
  • Total dependent repositories: 0
    (may contain duplicates)
  • Total versions: 69
  • Total maintainers: 2
proxy.golang.org: github.com/ornladios/adios2
  • Versions: 25
  • Dependent Packages: 0
  • Dependent Repositories: 0
Rankings
Dependent packages count: 6.5%
Average: 6.7%
Dependent repos count: 6.9%
Last synced: 6 months ago
proxy.golang.org: github.com/ornladios/ADIOS2
  • Versions: 25
  • Dependent Packages: 0
  • Dependent Repositories: 0
Rankings
Dependent packages count: 6.5%
Average: 6.7%
Dependent repos count: 6.9%
Last synced: 6 months ago
conda-forge.org: adios2

ADIOS2 is the latest implementation of the ADaptable Input Output System, ADIOS. This brand new architecture was designed to continue supporting the performance legacy of ADIOS, and extend its current capabilities to address current and future input/output (IO) challenges in the scientific data lifecycle through effective research and development (R&D) activities.

  • Versions: 9
  • Dependent Packages: 3
  • Dependent Repositories: 0
Rankings
Dependent packages count: 15.6%
Forks count: 16.1%
Average: 22.6%
Stargazers count: 24.7%
Dependent repos count: 34.0%
Last synced: 6 months ago
conda-forge.org: libadios2

ADIOS2 is the latest implementation of the ADaptable Input Output System, ADIOS. This brand new architecture was designed to continue supporting the performance legacy of ADIOS, and extend its current capabilities to address current and future input/output (IO) challenges in the scientific data lifecycle through effective research and development (R&D) activities.

  • Versions: 1
  • Dependent Packages: 2
  • Dependent Repositories: 0
Rankings
Forks count: 16.1%
Dependent packages count: 19.5%
Average: 23.6%
Stargazers count: 24.7%
Dependent repos count: 34.0%
Last synced: 6 months ago
pypi.org: adios2

The Adaptable Input Output System version 2

  • Versions: 9
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 5,695 Last month
Rankings
Dependent packages count: 7.4%
Average: 38.1%
Dependent repos count: 68.9%
Maintainers (2)
scottwittenburg vbolea
Last synced: 6 months ago

Dependencies

.github/actions/save-context-artifacts/action.yml actions
  • actions/upload-artifact v3 composite
.github/workflows/everything.yml actions
  • actions/cache/restore v3 composite
  • actions/cache/save v3 composite
  • actions/checkout v4 composite
  • actions/download-artifact v2 composite
  • actions/upload-artifact v2 composite
  • github/codeql-action/analyze v2 composite
  • github/codeql-action/init v2 composite
scripts/ci/images/fedora-asan/Dockerfile docker
  • ornladios/adios2 ci-fedora-sanitizers-base build
scripts/ci/images/fedora-full-stack-onbuild/Dockerfile docker
  • ornladios/adios2 ci-fedora-sanitizers-base build
scripts/ci/images/fedora-msan/Dockerfile docker
  • ornladios/adios2 ci-fedora-full-stack-onbuild build
  • ornladios/adios2 ci-fedora-sanitizers-base build
scripts/ci/images/fedora-sanitizers-base/Dockerfile docker
  • fedora latest build
scripts/ci/images/fedora-tsan/Dockerfile docker
  • ornladios/adios2 ci-fedora-full-stack-onbuild build
  • ornladios/adios2 ci-fedora-sanitizers-base build
scripts/ci/images/fedora-ubsan/Dockerfile docker
  • ornladios/adios2 ci-fedora-sanitizers-base build
scripts/ci/images/formatting/Dockerfile docker
  • fedora 38 build
scripts/ci/images/spack/Dockerfile docker
  • ornladios/adios2 spack-dependencies-${baseos} build
thirdparty/EVPath/EVPath/zpl-enet/package.json npm
requirements.txt pypi
  • mpi4py >=3.0.3
  • numpy >=1.19
docs/environment.yml pypi
  • blockdiag ==3.0.0
  • sphinx_rtd_theme ==1.1.1
  • sphinxcontrib-blockdiag ==3.0.0
.github/workflows/pypackaging.yml actions
  • actions/checkout v4 composite
  • actions/download-artifact v3 composite
  • actions/upload-artifact v3 composite
  • pypa/cibuildwheel v2.16 composite
  • pypa/gh-action-pypi-publish release/v1 composite
pyproject.toml pypi
  • numpy *