Data

Tools

Indexes

Applications

Experiments

Open Source Science

hydra

A Python Bloomfilter

https://github.com/crankycoder/hydra

Science Score: 13.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ○
    .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Committers with academic emails
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (8.5%) to scientific vocabulary
Last synced: 11 months ago · JSON representation

Repository

A Python Bloomfilter

Basic Info
  • Host: GitHub
  • Owner: crankycoder
  • License: mit
  • Language: Python
  • Default Branch: master
  • Size: 448 KB
Statistics
  • Stars: 21
  • Watchers: 2
  • Forks: 6
  • Open Issues: 6
  • Releases: 0
Created over 11 years ago · Last pushed over 2 years ago
Metadata Files
Readme Changelog License

README.md

Build Status

Hydra: The Python Bloom Filter.

Compile with Cython 0.24 or higher.

Hydra is a high performance bloom filter. It's basically a port of the Cassandra bloom filter with some fun Cython hackery.

1) It's persistent using memory mapped io. On Linux, the mmap uses the MAP_POPULATE flag so the entire file is loaded into kernel space virtual memory. In other words - fast.

2) The hash function uses the MurmurHash3 algorithm, so it should be fast and have excellent key distribution and avalanche properties.

3) The filter exports a set-like interface. Use .add(..), .contains() or use the "in" operator.

4) Tests. OMG what is wrong with people with no tests?

The filter supports periodic forced synchronization to disk using fdatasync(), or you can just let the deallocator flush everything to disk when your filter goes out of scope, or your process terminates.

Hydras are snakes with multiple heads. They're also bad dudes with snake logos on their chest who regularly try to beat on Nick Fury. Now it's a bloom filter.

Mostly, I couldn't bear to make this yet another PySomeLibraryName library.

Build, install a dev build and test:

$ pip install -r requirements.txt
$ cythonize src/_hydra.pyx
$ python setup.py develop
$ python setup.py test

Owner

  • Name: Victor Ng
  • Login: crankycoder
  • Kind: user
  • Location: Newmarket, Ontario, Canada
  • Company: @wealthsimple

I make software things.

GitHub Events

Total
  • Watch event: 1
Last Year
  • Watch event: 1

Committers

Last synced: almost 3 years ago

All Time
  • Total Commits: 55
  • Total Committers: 4
  • Avg Commits per committer: 13.75
  • Development Distribution Score (DDS): 0.382
Past Year
  • Commits: 0
  • Committers: 0
  • Avg Commits per committer: 0.0
  • Development Distribution Score (DDS): 0.0
Top Committers
Name Email Commits
Henry Stern s****n@f****o 34
Hanno Schlichting h****o@h****u 12
Victor Ng v****r@c****m 8
André Laszlo a****o@m****m 1
Committer Domains (Top 20 + Academic)
meltwater.com: 1 crankycoder.com: 1 hannosch.eu: 1 fsi.io: 1

Issues and Pull Requests

Last synced: 11 months ago

All Time
  • Total issues: 6
  • Total pull requests: 17
  • Average time to close issues: 6 months
  • Average time to close pull requests: 5 days
  • Total issue authors: 6
  • Total pull request authors: 5
  • Average comments per issue: 1.5
  • Average comments per pull request: 0.29
  • Merged pull requests: 15
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
  • AlanKK (1)
  • mlaferrera (1)
  • jonathf (1)
  • ewestern (1)
  • elenavolkova93 (1)
  • xloem (1)
Pull Request Authors
  • hstern (11)
  • hannosch (3)
  • andrelaszlo (1)
  • xloem (1)
  • arzeth (1)
Top Labels
Issue Labels
Pull Request Labels

Packages

  • Total packages: 2
  • Total downloads:
    • pypi 9,433 last-month
  • Total dependent packages: 4
    (may contain duplicates)
  • Total dependent repositories: 77
    (may contain duplicates)
  • Total versions: 9
  • Total maintainers: 3
pypi.org: hydra

A high performance persistent bloom filter

  • Versions: 8
  • Dependent Packages: 4
  • Dependent Repositories: 75
  • Downloads: 9,433 Last month
Rankings
Dependent repos count: 1.7%
Dependent packages count: 1.8%
Downloads: 2.9%
Average: 6.9%
Stargazers count: 13.6%
Forks count: 14.2%
Maintainers (3)
hannosch victorng hstern
Last synced: 11 months ago
conda-forge.org: hydra
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 2
Rankings
Dependent repos count: 20.1%
Average: 43.5%
Stargazers count: 50.1%
Dependent packages count: 51.6%
Forks count: 52.1%
Last synced: 12 months ago

Dependencies

requirements.txt pypi
  • Cython *
  • flake8 *
  • nose *
setup.py pypi