hyfi

HyFI: Hydra Fast Interface (Hydra and Pydantic based interface framework)

https://github.com/entelecheia/hyfi

Science Score: 67.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
    Found CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
    Found 6 DOI reference(s) in README
  • Academic publication links
    Links to: zenodo.org
  • Committers with academic emails
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (15.7%) to scientific vocabulary

Keywords

hydra hyfi pydantic pydantic-v2

Keywords from Contributors

transformation profiles cryptocurrencies data-profiling cameratrap energy-system-model tokenizer energy-system led sentiment-analysis
Last synced: 6 months ago · JSON representation ·

Repository

HyFI: Hydra Fast Interface (Hydra and Pydantic based interface framework)

Basic Info
Statistics
  • Stars: 3
  • Watchers: 1
  • Forks: 1
  • Open Issues: 9
  • Releases: 0
Topics
hydra hyfi pydantic pydantic-v2
Created about 3 years ago · Last pushed 6 months ago
Metadata Files
Readme Changelog Contributing License Code of conduct Citation

README.md

HyFI: Hydra Fast Interface

pypi-image version-image release-date-image license-image DOI codecov codefactor codacy

HyFI, short for Hydra Fast Interface, is a powerful Python framework built atop the foundations of Hydra and Pydantic. Its main objective is to provide a streamlined interface for configuring, structuring, executing, and scaling Python applications and workflows.

Overview

In the modern world of software and data science, creating scalable, reproducible, and modular Python workflows is vital. HyFI is here to make that process not just feasible but also efficient and straightforward. It has been meticulously crafted to help developers and researchers build pipeline-oriented projects and promote shareable and reproducible workflows.

Core Features

1. Dynamic Configuration Management

  • Modular Configuration: Harness the power of Hydra and Pydantic to manage your application configurations dynamically and modularity.
  • Seamless Command Line Overrides: Experiment swiftly without the clutter of multiple similar configuration files.
  • Jupyter Notebook Integration: The HyFI class allows for easy composition of configurations even in a jupyter notebook setting.

2. Zero Boilerplate

Stay focused on your core problems. HyFI takes care of the usual overheads such as command line flags, loading configuration files, and logging.

3. Structured Workflows

  • Configurable Automated Processes: Divide your research into unit jobs or tasks, and then bundle them into workflows.

  • Versatility: Have the liberty to create multiple workflows, with each performing varied sets of tasks.

4. Reproducibility and Sharing

  • Sharing Capability: Share your datasets, models, and configurations effortlessly.

  • Reproducibility: Sharing configurations alongside datasets and models ensures that every piece of research can be replicated.

  • Granular or Holistic: Choose to share individual unit jobs or an entire workflow, as per your need.

5. Support for Plugins

  • Integration of HyFI-based Applications: Enhance your project by plugging in several HyFI-based applications. This allows you to leverage the functionalities of plugins along with their specific configuration files.
  • Modular Design Enablement: The plugin support fosters a truly modular design approach, enabling seamless integration of various components and features, thereby promoting greater flexibility and extensibility in your projects.

Other Noteworthy Features:

  • Workspace Management: Automatic workspace creation and environment variable management.
  • Task Pipelining: Chain and parallelize jobs and steps seamlessly.
  • Optimized Parallelism: Efficient job batching with the help of Joblib.
  • Dotenv Integration: Manage configurations via .env files with ease.
  • Built-in Commands: Simplify processes like initializing projects, running pipelines, and copying files.
  • Extensibility: Easily extend HyFI's capabilities by crafting new Config classes and utilizing the building blocks it offers.
  • Command Line Interface (CLI): Access a suite of commands and workflows directly from the command line.
  • Advanced Logging: Make use of the integrated logging configurations, complemented by Hydra logging.
  • Robust Caching: Cache both files and data efficiently.

Citation

tex @software{lee_2023_8247719, author = {Young Joon Lee}, title = {HyFI: Hydra Fast Interface}, month = aug, year = 2023, publisher = {Zenodo}, doi = {10.5281/zenodo.8247719}, url = {https://doi.org/10.5281/zenodo.8247719} }

tex @software{lee_2023_hyfi, author = {Young Joon Lee}, title = {HyFI: Hydra Fast Interface}, year = 2023, publisher = {GitHub}, url = {https://github.com/entelecheia/hyfi} }

Changelog

See the CHANGELOG for more information.

Contributing

Contributions are welcome! Please see the contributing guidelines for more information.

License

This project is released under the MIT License.

Owner

  • Name: Young Joon Lee
  • Login: entelecheia
  • Kind: user
  • Location: Jeju, South Korea
  • Company: Cheju Halla University

Professor at Cheju Halla University

Citation (CITATION.cff)

cff-version: 1.1.0
message: "If you use this software, please cite it as below."
authors:
  - family-names: Lee
    given-names: Young Joon
    orcid: https://orcid.org/0000-0002-4349-5926
title: "HyFI: Hydra Fast Interface"
version: v1.29.6
date-released: 2023-08-14

GitHub Events

Total
  • Release event: 1
  • Watch event: 1
  • Delete event: 43
  • Issue comment event: 87
  • Push event: 57
  • Pull request event: 82
  • Pull request review event: 24
  • Create event: 41
Last Year
  • Release event: 1
  • Watch event: 1
  • Delete event: 43
  • Issue comment event: 87
  • Push event: 57
  • Pull request event: 82
  • Pull request review event: 24
  • Create event: 41

Committers

Last synced: over 1 year ago

All Time
  • Total Commits: 2,256
  • Total Committers: 5
  • Avg Commits per committer: 451.2
  • Development Distribution Score (DDS): 0.134
Past Year
  • Commits: 150
  • Committers: 3
  • Avg Commits per committer: 50.0
  • Development Distribution Score (DDS): 0.42
Top Committers
Name Email Commits
Young Joon Lee e****a@h****m 1,953
semantic-release s****e 173
dependabot[bot] 4****] 119
github-actions g****s@g****m 10
Sourcery AI 1
Committer Domains (Top 20 + Academic)

Issues and Pull Requests

Last synced: 6 months ago

All Time
  • Total issues: 18
  • Total pull requests: 421
  • Average time to close issues: 5 days
  • Average time to close pull requests: 3 days
  • Total issue authors: 1
  • Total pull request authors: 3
  • Average comments per issue: 0.06
  • Average comments per pull request: 1.49
  • Merged pull requests: 350
  • Bot issues: 0
  • Bot pull requests: 311
Past Year
  • Issues: 0
  • Pull requests: 88
  • Average time to close issues: N/A
  • Average time to close pull requests: 3 days
  • Issue authors: 0
  • Pull request authors: 2
  • Average comments per issue: 0
  • Average comments per pull request: 1.83
  • Merged pull requests: 71
  • Bot issues: 0
  • Bot pull requests: 84
Top Authors
Issue Authors
  • entelecheia (18)
Pull Request Authors
  • dependabot[bot] (303)
  • entelecheia (110)
  • sourcery-ai[bot] (8)
Top Labels
Issue Labels
enhancement (9) bug (5) [zube]: Inbox (3) documentation (2) security (1)
Pull Request Labels
Extra Small (148) [zube]: Inbox (112) [zube]: Done (33) Small (10) Extra Large (8) Medium (5) Large (3) enhancement (1) No Changes (1)

Packages

  • Total packages: 1
  • Total downloads:
    • pypi 400 last-month
  • Total dependent packages: 27
  • Total dependent repositories: 3
  • Total versions: 177
  • Total maintainers: 1
pypi.org: hyfi

Hydra Fast Interface (Hydra and Pydantic based interface framework)

  • Versions: 177
  • Dependent Packages: 27
  • Dependent Repositories: 3
  • Downloads: 400 Last month
Rankings
Dependent packages count: 0.6%
Downloads: 7.7%
Dependent repos count: 8.9%
Average: 15.0%
Stargazers count: 27.8%
Forks count: 29.8%
Maintainers (1)
Last synced: 6 months ago

Dependencies

.github/workflows/deploy-docs.yaml actions
  • actions/checkout v3 composite
  • actions/setup-python v4 composite
  • peaceiris/actions-gh-pages v3 composite
.github/workflows/lint_and_test.yaml actions
  • MishaKav/pytest-coverage-comment main composite
  • actions/checkout v3 composite
  • actions/setup-python v4 composite
.github/workflows/prerelease-to-test-pypi.yaml actions
  • actions/checkout v3 composite
  • relekang/python-semantic-release master composite
.github/workflows/prerelease.yaml actions
  • actions/checkout v3 composite
  • relekang/python-semantic-release master composite
.github/workflows/release-patch.yaml actions
  • actions/checkout v3 composite
  • relekang/python-semantic-release master composite
.github/workflows/release-test.yaml actions
  • actions/checkout v3 composite
  • relekang/python-semantic-release master composite
.github/workflows/release.yaml actions
  • actions/checkout v3 composite
  • relekang/python-semantic-release master composite
poetry.lock pypi
  • 122 dependencies
pyproject.toml pypi
  • cached-path ^1.3.3
  • chardet <=4.0.0
  • gdown <=4.4.0
  • hydra-colorlog ^1.2.0
  • hydra-core ^1.3.2
  • ipython <=7.9.0
  • ipython-autotime ^0.3.1
  • matplotlib <=3.5.3
  • numpy <1.24
  • pandas <1.4.0
  • pydantic <=1.10.5
  • pygments <=2.6.1
  • python ^3.8.1, <3.12
  • python-dotenv ^1.0.0
  • requests <=2.25.1
  • scipy <=1.8
  • tqdm ^4.64.1
.github/workflows/issue_metrics.yaml actions
  • github/issue-metrics v2 composite
  • peter-evans/create-issue-from-file v4 composite
docs/requirements.txt pypi
  • markdown-include *
  • mkdocs *
  • mkdocs-click *
  • mkdocs-include-dir-to-nav *
  • mkdocs-include-markdown-plugin *
  • mkdocs-material *
  • mkdocs-material-extensions >=1.1
  • mkdocstrings *
  • pymdown-extensions >=9.9.1