Data

Tools

Indexes

Applications

Experiments

Open Source Science

mmappickle

mmappickle: Python 3 module to store memory-mapped numpy array in pickle format - Published in JOSS (2018)

https://github.com/unine-chyn/mmappickle

Science Score: 93.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ✓
    DOI references
    Found 3 DOI reference(s) in README and JOSS metadata
  • ○
    Academic publication links
  • ○
    Committers with academic emails
  • ○
    Institutional organization owner
  • ✓
    JOSS paper metadata
    Published in Journal of Open Source Software

Keywords

dictionary memory mmap python python-3 python-library python3
Last synced: 4 months ago · JSON representation

Repository

Python 3 library to store memory mappable objects into pickle-compatible files

Basic Info
Statistics
  • Stars: 38
  • Watchers: 3
  • Forks: 4
  • Open Issues: 3
  • Releases: 1
Topics
dictionary memory mmap python python-3 python-library python3
Created almost 9 years ago · Last pushed over 7 years ago
Metadata Files
Readme License

README.md

Memmap pickle

This Python 3 module enables to store large structure in a python pickle, in such a way that the array can be memory-mapped instead of being copied in memory. This module is licensed under the LGPL3 license.

Currently, the container has to be a dictionnary (mmappickle.dict), which keys are strings of less than 256 bytes.

It supports any values, but it is only possible to memory-map numpy arrays and numpy masked arrays.

It also supports concurrent access (i.e. you can pass a mmappickle.dict as an argument which is called using the multiprocessing Python module).

Documentation

Documentation is available at http://mmappickle.readthedocs.io/

Citation

Fasnacht, (2018). mmappickle: Python 3 module to store memory-mapped numpy array in pickle format . Journal of Open Source Software, 3(26), 651, https://doi.org/10.21105/joss.00651

Contributing

Please post issues and pull requests on github. Alternatively, you can also send your patches by email.

The following tools are used to ensure good code quality:

Tool | Status ------------ | ------------- travis-ci | Build Status AppVeyor | Build status Coveralls | Coverage Status

Owner

  • Name: University of Neuchâtel (CHYN)
  • Login: UniNE-CHYN
  • Kind: organization
  • Location: Neuchâtel, Switzerland

Centre for Hydrogeology and Geothermics of University of Neuchâtel

JOSS Publication

mmappickle: Python 3 module to store memory-mapped numpy array in pickle format
Published
June 18, 2018
DOI
Volume 3, Issue 26, Page 651
Authors
Laurent Fasnacht ORCID
University of Neuchâtel
Editor
Arfon Smith ORCID
Tags
memory-mapped mmap memmap numpy array pickle
View PDF Review Thread Software Archive

GitHub Events

Total
  • Watch event: 1
Last Year
  • Watch event: 1

Committers

Last synced: 5 months ago

All Time
  • Total Commits: 64
  • Total Committers: 3
  • Avg Commits per committer: 21.333
  • Development Distribution Score (DDS): 0.031
Past Year
  • Commits: 0
  • Committers: 0
  • Avg Commits per committer: 0.0
  • Development Distribution Score (DDS): 0.0
Top Committers
Name Email Commits
Laurent Fasnacht l@l****h 62
Solange Oesch s****h@g****m 1
Arfon Smith a****n 1
Committer Domains (Top 20 + Academic)
libres.ch: 1

Issues and Pull Requests

Last synced: 4 months ago

All Time
  • Total issues: 15
  • Total pull requests: 2
  • Average time to close issues: 8 days
  • Average time to close pull requests: about 7 hours
  • Total issue authors: 5
  • Total pull request authors: 2
  • Average comments per issue: 2.6
  • Average comments per pull request: 0.5
  • Merged pull requests: 1
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
  • glemaitre (11)
  • tinducvo (1)
  • BorisMansencal (1)
  • NekosPlease (1)
  • clemaitre58 (1)
Pull Request Authors
  • arfon (1)
  • soesch (1)
Top Labels
Issue Labels
Pull Request Labels

Packages

  • Total packages: 1
  • Total downloads:
    • pypi 23 last-month
  • Total docker downloads: 121
  • Total dependent packages: 0
  • Total dependent repositories: 1
  • Total versions: 1
  • Total maintainers: 1
pypi.org: mmappickle

This module enables to store large structures in a python pickle, in such a way that the data can be mmap'ed instead of being copied in memory.

  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 1
  • Downloads: 23 Last month
  • Docker Downloads: 121
Rankings
Docker downloads count: 3.7%
Dependent packages count: 10.0%
Stargazers count: 10.7%
Average: 13.8%
Forks count: 15.3%
Downloads: 21.5%
Dependent repos count: 21.7%
Maintainers (1)
lfasnacht
Last synced: 4 months ago