Data

Tools

Indexes

Applications

Experiments

Open Source Science

pnp

Pull 'n' Push - Pulls data from sources and pushes it to sinks

https://github.com/hazarddede/pnp

Science Score: 13.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ○
    .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Committers with academic emails
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (12.2%) to scientific vocabulary

Keywords

asyncio data home-automation mqtt pipeline python3 workflow
Last synced: 6 months ago · JSON representation

Repository

Pull 'n' Push - Pulls data from sources and pushes it to sinks

Basic Info
  • Host: GitHub
  • Owner: HazardDede
  • License: mit
  • Language: Python
  • Default Branch: develop
  • Size: 1.96 MB
Statistics
  • Stars: 4
  • Watchers: 1
  • Forks: 1
  • Open Issues: 5
  • Releases: 0
Topics
asyncio data home-automation mqtt pipeline python3 workflow
Created almost 8 years ago · Last pushed about 3 years ago
Metadata Files
Readme License

README.md

Pull 'n' Push

Python PyPI version Docs GitHub Activity Build Status Coverage Status Docker: hub License: MIT Project Maintenance

Pulls data from sources and pushes it to sinks with optional transformations in between.

Installation

pip install pnp

Installation with extras:

pip install pnp[fswatcher,faceR]

Please consult the component documentation to see if a component requires an extra or not.

Getting started

Define pulls to fetch / pull data from source systems. Define one push or multiple pushes per pull to transfer the pulled data anywhere else (you only need a plugin that knows how to handle the target). You configure your pipeline in yaml:

yaml tasks: - name: hello-world pull: plugin: pnp.plugins.pull.simple.Repeat args: interval: 1s repeat: "Hello World" push: - plugin: pnp.plugins.push.simple.Echo

Copy this configuration and create the file helloworld.yaml. Run it:

pnp helloworld.yaml

This example yields the string Hello World every second.

Hint: You can validate your config without actually executing it with

bash pnp --check helloworld.yaml

If you want to learn more please see the documentation at Read the Docs.

Owner

  • Name: Dennis
  • Login: HazardDede
  • Kind: user
  • Location: Hamburg

Coffee and python enthusiast

GitHub Events

Total
Last Year

Committers

Last synced: over 1 year ago

All Time
  • Total Commits: 484
  • Total Committers: 2
  • Avg Commits per committer: 242.0
  • Development Distribution Score (DDS): 0.198
Past Year
  • Commits: 0
  • Committers: 0
  • Avg Commits per committer: 0.0
  • Development Distribution Score (DDS): 0.0
Top Committers
Name Email Commits
Dennis Muth d****h@g****t 388
Dennis Muth d****h@m****e 96
Committer Domains (Top 20 + Academic)
magicline.de: 1 gmx.net: 1

Issues and Pull Requests

Last synced: 6 months ago

All Time
  • Total issues: 0
  • Total pull requests: 50
  • Average time to close issues: N/A
  • Average time to close pull requests: 10 days
  • Total issue authors: 0
  • Total pull request authors: 2
  • Average comments per issue: 0
  • Average comments per pull request: 0.04
  • Merged pull requests: 43
  • Bot issues: 0
  • Bot pull requests: 5
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
Pull Request Authors
  • HazardDede (45)
  • dependabot[bot] (5)
Top Labels
Issue Labels
Pull Request Labels
enhancement (30) bug (6) dependencies (5) documentation (4)

Packages

  • Total packages: 1
  • Total downloads:
    • pypi 99 last-month
  • Total dependent packages: 0
  • Total dependent repositories: 1
  • Total versions: 32
  • Total maintainers: 1
pypi.org: pnp

Pull 'n' Push

  • Versions: 32
  • Dependent Packages: 0
  • Dependent Repositories: 1
  • Downloads: 99 Last month
  • Docker Downloads: 0
Rankings
Docker downloads count: 4.0%
Dependent packages count: 10.0%
Average: 17.4%
Dependent repos count: 21.7%
Forks count: 22.6%
Stargazers count: 23.1%
Downloads: 23.1%
Maintainers (1)
HazardDede
Last synced: 6 months ago

Dependencies

poetry.lock pypi
  • 139 dependencies
pyproject.toml pypi
  • argresolver ^0.3.3 develop
  • astroid ^2.4.0 develop
  • bumpversion ^0.5.3 develop
  • coveralls ^2.0.0 develop
  • flake8 ^3.7.9 develop
  • httpx ^0.16.1 develop
  • invoke ^1.4.1 develop
  • mock <=3.0.5 develop
  • mypy ^0.770 develop
  • pylint ^2.5.0 develop
  • pytest ^5.4.1 develop
  • pytest-asyncio ^0.11.0 develop
  • pytest-cov ^2.8.1 develop
  • sphinx ^3.1.1 develop
  • sphinx-rtd-theme ^0.5.1 develop
  • websockets >=6.0,<7.0 develop
  • yamllint ^1.23.0 develop
  • Adafruit_DHT ^1.3.2
  • Jinja2 ^2.11.2
  • PyAudio ^0.2.11
  • RPi.GPIO ^0.6.5
  • aiohttp ^3.6.2
  • async_generator ^1.10
  • asyncio ^3.4.3
  • asyncws ^0.1
  • binaryornot ^0.4.4
  • cachetools ^4.1.0
  • click ^7.1.2
  • coloredlogs ^14.0
  • cronex ^0.1.3
  • dictmentor ^0.2.2
  • dropbox ^9.0.0
  • face-recognition ^1.2.2
  • fastapi ^0.61.2
  • fastcore ^1.3.13
  • fitbit ^0.3.0
  • fritzconnection ^1.2.0
  • glom ^19.10.0
  • image ^1.5.24
  • influxdb ^5.3.0
  • miflora ^0.4.0
  • numpy ^1.16.0
  • paho-mqtt ^1.5.0
  • pathspec ^0.8.0
  • psutil ^5.7.0
  • pyftpdlib ^1.5.0
  • pytest-mock ^3.3.1
  • python ^3.6
  • python-box <=3.4.6
  • pytz ^2020.1
  • pyyaml-include ^1.2.post2
  • requests ^2.23.0
  • schedule ^0.6.0
  • schema ^0.7.2
  • scipy ^1.2.0
  • slacker ^0.14.0
  • speedtest-cli ^2.1.3
  • starlette_exporter ^0.6.0
  • sty ^1.0.0-beta.12
  • syncasync ^20180812
  • typeguard ^2.7.1
  • typing-extensions ^3.7.4
  • tzlocal ^2.0.0
  • urllib3 ^1.20
  • uvicorn ^0.12.2
  • watchdog ^0.8.3
Dockerfile docker
  • python 3.7-slim-buster build