Data

Tools

Indexes

Applications

Experiments

Open Source Science

hdf5stuff

Temporary place to collect various HDF5 test clients

https://github.com/markcmiller86/hdf5stuff

Science Score: 64.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ✓
    CITATION.cff file
    Found CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ✓
    Academic publication links
    Links to: arxiv.org
  • ✓
    Committers with academic emails
    2 of 2 committers (100.0%) from academic institutions
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (9.3%) to scientific vocabulary
Last synced: 7 months ago · JSON representation ·

Repository

Temporary place to collect various HDF5 test clients

Basic Info
Statistics
  • Stars: 1
  • Watchers: 3
  • Forks: 0
  • Open Issues: 1
  • Releases: 0
Created over 7 years ago · Last pushed over 2 years ago
Metadata Files
Readme Citation

README.md

hdf5stuff

Temporary place to collect various HDF5 example/test clients

  • Graph of User Defined Types

    • Evolution from naive to optimized use of HDF5 for writing an amorphous graph/tree of user defined types

  • testhdf5_serialize.c

    • Creates a random JSON object using JSON-CWX library and writes it, naively, to HDF5
    • Has a few command line arguments size of object and amounts of meta data vs raw data within it.

  • testhdf5.c

    • Extensive test of HDF5 meta data which can generate 1,2,3 or 4 levels of groups with tiny datasets within it
    • Tests time to write, amount of object overhead

  • testhdf5complicatedudtsgroups.c

    • Example of writing a pointer-linked data structure to HDF5 in a way that is really simple from the software engineering standpoint but does not use HDF5 in an optimal way.

  • testhdf5complicatedudtscompounds.c

    • Example of writing a pointer-linked data structure to HDF5 in a way that minimizes HDF5 object overheads
    • This should be last step in evolution of this use case from the naive approach of realizing each node in the data structure as an HDF5 group.

  • testhdf5complicatedudtscompounds.F90

    • Same as above except as a fortran 90 example.

  • Comparing gzip to HDF5 deflate filter

  • Benchmark data sources to consider

    • Paper: Knorr, Fabian, Peter Thoman, and Thomas Fahringer. “Datasets for Benchmarking Floating-Point Compressors.” arXiv.org (2020): n. pag. Print.
    • Website: https://sdrbench.github.io

To add new examples, create a top-level directory and start developing the example, including any markdown files associated with it in that directory

Owner

  • Name: Mark (he/his) C. Miller
  • Login: markcmiller86
  • Kind: user
  • Location: Livermore, CA.
  • Company: @LLNL

Inclusive practices in sw, scientific data models, data & sw interoperability, sw quality engineering, Scalable I/O, Viz. (@visit-dav, @LLNL, @HDFGroup)

Citation (CITATION.cff) 

# This CITATION.cff file was generated with cffinit.
# Visit https://bit.ly/cffinit to generate yours today!

cff-version: 1.2.0
title: VisIt
message: >-
  If you use this software, please cite it using the
  metadata from this file.
type: software
authors:
  - given-names: Mark C. Miller
    family-names: Miller

GitHub Events

Total
Last Year

Committers

Last synced: 9 months ago

All Time
  • Total Commits: 51
  • Total Committers: 2
  • Avg Commits per committer: 25.5
  • Development Distribution Score (DDS): 0.392
Past Year
  • Commits: 0
  • Committers: 0
  • Avg Commits per committer: 0.0
  • Development Distribution Score (DDS): 0.0
Top Committers
Name Email Commits
miller86 m****6@l****v 31
Neil Hodge h****3@l****v 20
Committer Domains (Top 20 + Academic)
llnl.gov: 2

Issues and Pull Requests

Last synced: 9 months ago

All Time
  • Total issues: 1
  • Total pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Total issue authors: 1
  • Total pull request authors: 0
  • Average comments per issue: 0.0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
  • markcmiller86 (1)
Pull Request Authors
Top Labels
Issue Labels
Pull Request Labels