Science Score: 13.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
✓codemeta.json file
Found codemeta.json file -
○.zenodo.json file
-
○DOI references
-
○Academic publication links
-
○Academic email domains
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (16.0%) to scientific vocabulary
Repository
Distributed Data Set for PyCOMPSs
Basic Info
- Host: GitHub
- Owner: bsc-wdc
- License: apache-2.0
- Language: Python
- Default Branch: main
- Size: 791 KB
Statistics
- Stars: 0
- Watchers: 3
- Forks: 0
- Open Issues: 0
- Releases: 0
Metadata Files
README.md
PyCOMPSs Distributed Data Set (DDS)
Website • Documentation • Releases • Slack
Table of content:
- Description
- Requirements
- Installation
- The Most Useful Methods
- Examples
- Availability
- Acknowledgements
- License
Description
DDS is a lightweight library for PyCOMPSs developers which contains some basic and widely used data processing methods such as map, filter, reduce, etc. The main purpose of this library is to avoid implementations of simple 'task' functions by developers. DDS is trustful and it processes the data in the most adequate way in terms of parallelism.
Requirements
Python>= 3.6pycompss>= 3.3
Installation
This package can be installed:
- From source:
./install.sh - From Pypi:
python3 -m pip install dds
The Most Useful Methods
text
map
filter
reduce
count
max
min
sum
foreach
map_values
combine_by_key
reduce_by_key
collect
collect_as_dict
Please feel free to suggest more methods!
Examples
Please see examples or notebooks folders.
Availability
Currently, the following supercomputers have already PyCOMPSs and DDS installed and ready to use. If you need help configuring your own cluster or supercomputer, drop us an email and we will be pleased to help.
- Marenostrum 5 - Barcelona Supercomputing Center (BSC)
Acknowledgements
This work has received funding from the European Commission's through the Horizon Europe CyclOps project (Contract 101135513)
License
Apache License Version 2.0, see LICENSE
Owner
- Name: Workflows and Distributed Computing
- Login: bsc-wdc
- Kind: organization
- Email: distributed_computing@bsc.es
- Location: Barcelona
- Website: https://www.bsc.es/discover-bsc/organisation/scientific-structure/workflows-and-distributed-computing
- Repositories: 13
- Profile: https://github.com/bsc-wdc
GitHub Events
Total
- Public event: 1
- Push event: 1
Last Year
- Public event: 1
- Push event: 1
Issues and Pull Requests
Last synced: about 1 year ago
All Time
- Total issues: 0
- Total pull requests: 0
- Average time to close issues: N/A
- Average time to close pull requests: N/A
- Total issue authors: 0
- Total pull request authors: 0
- Average comments per issue: 0
- Average comments per pull request: 0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0
Past Year
- Issues: 0
- Pull requests: 0
- Average time to close issues: N/A
- Average time to close pull requests: N/A
- Issue authors: 0
- Pull request authors: 0
- Average comments per issue: 0
- Average comments per pull request: 0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0
Top Authors
Issue Authors
Pull Request Authors
Top Labels
Issue Labels
Pull Request Labels
Dependencies
- compss/compss-tutorial 3.3 build
- Sphinx >=8.0.2,<9.0.0
- ipython >=8.27.0
- ipywidgets >=8.1.5
- nbsphinx >=0.9.5
- nbsphinx-link >=1.3.0
- sphinx-copybutton ==0.5.2
- sphinx-prompt ==1.9.0
- sphinx-rtd-theme >=3.0.0rc1
- sphinx-tabs ==3.4.5
- sphinx-toolbox ==3.8.0
- sphinx_design ==0.6.1
- sphinx_mdinclude >=0.6.2
- sphinxcontrib-svg2pdfconverter ==1.2.3
- sphinxcontrib.contentui ==0.2.5