https://github.com/craylabs/smartredis

SmartSim Infrastructure Library Clients.

Science Score: 59.0%

This score indicates how likely this project is to be science-related based on various indicators:

○
CITATION.cff file
✓
codemeta.json file
Found codemeta.json file
✓
.zenodo.json file
Found .zenodo.json file
✓
DOI references
Found 4 DOI reference(s) in README
✓
Academic publication links
Links to: sciencedirect.com
✓
Committers with academic emails
1 of 21 committers (4.8%) from academic institutions
○
Institutional organization owner
○
JOSS paper metadata
○
Scientific vocabulary similarity
Low similarity (14.9%) to scientific vocabulary

Keywords

hpc machine-learning redis redis-client redisai

Keywords from Contributors

climate-model mom6 parameterization earth-system-model

Last synced: 5 months ago · JSON representation

Repository

SmartSim Infrastructure Library Clients.

Basic Info

Host: GitHub
Owner: CrayLabs
License: bsd-2-clause
Language: C++
Default Branch: develop
Homepage:
Size: 7.75 MB

Statistics

Stars: 56
Watchers: 7
Forks: 24
Open Issues: 42
Releases: 14

Topics

hpc machine-learning redis redis-client redisai

Created over 5 years ago · Last pushed 8 months ago

Metadata Files

Readme Contributing License

README.md

Home Install Documentation Slack Cray Labs

GitHub last commit PyPI - Wheel GitHub tag (latest by date) PyPI - Python Version Language

SmartRedis

SmartRedis is a collection of Redis clients that support RedisAI capabilities and include additional features for high performance computing (HPC) applications. SmartRedis provides clients in the following languages:

| Language | Version/Standard | |------------|:----------------------------------------------:| | Python | 3.10, 3.11, 3.12 | | C++ | C++17 | | C | C99 | | Fortran | Fortran 2018 (GNU/Intel), 2003 (PGI/Nvidia) |

SmartRedis is used in the SmartSim library. SmartSim makes it easier to use common Machine Learning (ML) libraries like PyTorch and TensorFlow in numerical simulations at scale. SmartRedis connects these simulations to a Redis database or Redis database cluster for data storage, script execution, and model evaluation. While SmartRedis contains features for simulation workflows on supercomputers, SmartRedis is fully functional as a RedisAI client library and can be used without SmartSim in any Python, C++, C, or Fortran project.

Using SmartRedis

SmartRedis installation instructions are currently hosted as part of the SmartSim library installation instructions Additionally, detailed API documents are also available as part of the SmartSim documentation.

Dependencies

SmartRedis utilizes the following libraries:

Publications

The following are public presentations or publications using SmartRedis

Cite

Please use the following citation when referencing SmartSim, SmartRedis, or any SmartSim related work:

Partee et al., "Using Machine Learning at scale in numerical simulations with SmartSim:
An application to ocean climate modeling",
Journal of Computational Science, Volume 62, 2022, 101707, ISSN 1877-7503.
Open Access: https://doi.org/10.1016/j.jocs.2022.101707.

bibtex

@article{PARTEE2022101707,
    title = {Using Machine Learning at scale in numerical simulations with SmartSim:
    An application to ocean climate modeling},
    journal = {Journal of Computational Science},
    volume = {62},
    pages = {101707},
    year = {2022},
    issn = {1877-7503},
    doi = {https://doi.org/10.1016/j.jocs.2022.101707},
    url = {https://www.sciencedirect.com/science/article/pii/S1877750322001065},
    author = {Sam Partee and Matthew Ellis and Alessandro Rigazzi and Andrew E. Shao
    and Scott Bachman and Gustavo Marques and Benjamin Robbins},
    keywords = {Deep learning, Numerical simulation, Climate modeling, High performance computing, SmartSim},
    }

Owner

Name: Cray Labs
Login: CrayLabs
Kind: organization

Website: https://www.craylabs.org/docs/overview.html
Repositories: 14
Profile: https://github.com/CrayLabs

GitHub Events

Total

Issues event: 6
Watch event: 2
Issue comment event: 10
Push event: 5
Pull request review event: 16
Pull request review comment event: 7
Pull request event: 12
Fork event: 1

Last Year

Issues event: 6
Watch event: 2
Issue comment event: 10
Push event: 5
Pull request review event: 16
Pull request review comment event: 7
Pull request event: 12
Fork event: 1

Committers

Last synced: almost 3 years ago

All Time

Total Commits: 672
Total Committers: 21
Avg Commits per committer: 32.0
Development Distribution Score (DDS): 0.71

Top Committers

Name	Email	Commits
Matthew Ellis	m**s@h**m	195
billschereriii	b**r@h**m	94
Sam Partee	s**e@h**m	74
Bill Scherer	3**i@u**m	69
EricGustin	e**4@g**m	51
Alessandro Rigazzi	a**i@c**m	40
Andrew Shao	a**o@g**m	39
ctandon11	4**1@u**m	38
Matthew Ellis	m**s@c**m	24
Al Rigazzi	a**i@h**m	19
Matt Ellis	m**3@u**m	12
Eric Gustin	3**n@u**m	3
Jim Edwards	j**s@u**u	3
Matt Drozt	d**t@h**m	2
Ben Albrecht	b**t@u**m	2
Julia Putko	8**o@u**m	2
Andrew Shao	a**o@h**m	1
Matthew Drozt	m**t@g**m	1
Eric Gustin	e**n@h**m	1
Gustavo Coelho	g**o@g**m	1
Sam Partee	p**1@g**m	1

Committer Domains (Top 20 + Academic)

hpe.com: 7 cray.com: 2 gcoelho.com: 1 ucar.edu: 1

Issues and Pull Requests

Last synced: 6 months ago

All Time

Total issues: 85
Total pull requests: 207
Average time to close issues: 5 months
Average time to close pull requests: 9 days
Total issue authors: 19
Total pull request authors: 12
Average comments per issue: 1.01
Average comments per pull request: 0.81
Merged pull requests: 187
Bot issues: 0
Bot pull requests: 4

Past Year

Issues: 7
Pull requests: 22
Average time to close issues: 3 months
Average time to close pull requests: 4 days
Issue authors: 5
Pull request authors: 5
Average comments per issue: 1.43
Average comments per pull request: 0.77
Merged pull requests: 20
Bot issues: 0
Bot pull requests: 3

View more stats

Top Authors

Issue Authors

billschereriii (40)
mellis13 (13)
ashao (5)
juliaputko (3)
MattToast (3)
rickybalin (2)
b-fg (2)
jrwrigh (2)
EricGustin (2)
Spartee (2)
SachinBM-CE (2)
al-rigazzi (2)
ankona (1)
ben-albrecht (1)
m-kurz (1)

Pull Request Authors

billschereriii (83)
ashao (53)
mellis13 (31)
MattToast (26)
amandarichardsonn (21)
al-rigazzi (17)
ankona (14)
github-actions[bot] (8)
AlyssaCote (6)
juliaputko (1)
jrwrigh (1)
gcoelho (1)

Top Labels

Issue Labels

type: feature (38) area: C++ (22) area: build (20) area: python (17) area: test (17) area: fortran (13) type: usability (10) bug: minor (10) type: refactor (10) area: C (8) Short task (8) area: third-party (7) area: CI/CD (6) bug: major (6) User Issue (6) type: bug (6) area: docs (5) type: performance (3) Epic (2) area: examples (2) API break (2) type: spike (1) user issue (1)

Pull Request Labels

area: C++ (37) area: python (30) area: docs (27) area: build (19) area: CI/CD (19) area: test (18) type: refactor (15) ignore-for-release (15) area: fortran (14) area: C (14) bug: minor (12) type: feature (9) area: third-party (7) area: release (6) Short task (4) API break (4) type: performance (4) User Issue (3) type: usability (3) short task (2) non-user-facing (2) type: design (1) area: examples (1) bug: major (1)

Packages

Total packages: 1
Total downloads:
- pypi 474 last-month
Total docker downloads: 101,707

Total dependent packages: 1
Total dependent repositories: 5
Total versions: 13
Total maintainers: 2

pypi.org: smartredis

RedisAI clients for SmartSim

Homepage: https://github.com/CrayLabs/SmartRedis
Documentation: https://www.craylabs.org
License: BSD 2-Clause License
Latest release: 0.6.1
published over 1 year ago

Versions: 13
Dependent Packages: 1
Dependent Repositories: 5
Downloads: 474 Last month
Docker Downloads: 101,707

Rankings

Docker downloads count: 4.1%

Dependent packages count: 4.8%

Dependent repos count: 6.6%

Average: 6.7%

Downloads: 6.8%

Forks count: 8.1%

Stargazers count: 9.5%

Maintainers (2)

CrayLabs spartee

Last synced: 6 months ago

Dependencies

requirements-dev.txt pypi

black ==20.8b1
breathe ==4.26.0
isort ==5.6.4
numpy >=1.18.2
pylint ==2.6.0
pytest >=6.0.0
pytest-cov ==2.10.1
sphinx ==3.1.1
sphinx-fortran ==1.1.1
sphinx_rtd_theme >=0.5.0
torch ==1.7.1

requirements.txt pypi

numpy >=1.18.2

.github/workflows/build_wheels.yml actions

actions/checkout v2 composite
actions/setup-python v2 composite
actions/upload-artifact v2 composite

.github/workflows/docker.yml actions

actions/checkout v2 composite
redislabs/redisai ${{ matrix.rai_v }}-cpu-xenial docker

.github/workflows/release.yml actions

actions/checkout v2 composite
actions/download-artifact v2 composite
actions/setup-python v2 composite
actions/upload-artifact v2 composite
pypa/gh-action-pypi-publish master composite

.github/workflows/run_tests.yml actions

actions/checkout v2 composite
actions/setup-python v2 composite
codecov/codecov-action v2 composite
redislabs/redisai ${{ matrix.rai_v }}-cpu-bionic docker

images/Dockerfile docker

ubuntu 20.04 build

tests/docker/c/Dockerfile docker

smartredis latest build

tests/docker/cpp/Dockerfile docker

smartredis latest build

tests/docker/fortran/Dockerfile docker

smartredis latest build

tests/docker/python/Dockerfile docker

smartredis latest build

pyproject.toml pypi

setup.py pypi

.github/workflows/run_static_and_examples.yml actions

actions/checkout v3 composite
actions/setup-python v4 composite