mephisto
A suite of tools for managing crowdsourcing tasks from the inception through to data packaging for research use.
Science Score: 46.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
✓codemeta.json file
Found codemeta.json file -
○.zenodo.json file
-
✓DOI references
Found 1 DOI reference(s) in README -
✓Academic publication links
Links to: arxiv.org -
✓Committers with academic emails
2 of 38 committers (5.3%) from academic institutions -
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (16.4%) to scientific vocabulary
Keywords from Contributors
Repository
A suite of tools for managing crowdsourcing tasks from the inception through to data packaging for research use.
Basic Info
- Host: GitHub
- Owner: facebookresearch
- License: mit
- Language: Python
- Default Branch: main
- Homepage: https://mephisto.ai/
- Size: 75.4 MB
Statistics
- Stars: 311
- Watchers: 13
- Forks: 76
- Open Issues: 74
- Releases: 27
Metadata Files
README.md
Mephisto makes crowdsourcing easier.
We provide a platform for launching, monitoring, and reviewing your crowdsourcing tasks. Tasks made on Mephisto can easily be open sourced as part of other projects. Like the chess-playing automaton we've adopted the name from, Mephisto hides the complexity of projects that need human interaction or input.
You can find complete details about the project on our docs website.
Quickstart
Want to help?
Check out our guidelines for contributing and then take a look at some of our tagged issues: good first issue, help wanted.
For library authors, you may also find the how to contribute documentation helpful.
License
Mephisto is MIT licensed. See the LICENSE file for details.
Citation
If you use Mephisto in your work, please consider citing the project. It helps us prioritize features based on our users, and helps others discover implementations that may be relevant to their projects.
bibtex
@misc{mephisto,
doi = {10.48550/ARXIV.2301.05154},
url = {https://arxiv.org/abs/2301.05154},
author = {Urbanek, Jack and Ringshia, Pratik},
keywords = {Artificial Intelligence (cs.AI), Human-Computer Interaction (cs.HC), FOS: Computer and information sciences, FOS: Computer and information sciences},
title = {Mephisto: A Framework for Portable, Reproducible, and Iterative Crowdsourcing},
publisher = {arXiv},
year = {2024},
copyright = {arXiv.org perpetual, non-exclusive license}
}
Owner
- Name: Meta Research
- Login: facebookresearch
- Kind: organization
- Location: Menlo Park, California
- Website: https://opensource.fb.com
- Repositories: 1,060
- Profile: https://github.com/facebookresearch
GitHub Events
Total
- Watch event: 7
- Issue comment event: 1
- Push event: 7
- Fork event: 1
Last Year
- Watch event: 7
- Issue comment event: 1
- Push event: 7
- Fork event: 1
Committers
Last synced: about 1 year ago
Top Committers
| Name | Commits | |
|---|---|---|
| Jack Urbanek | j****u@f****m | 918 |
| Etesam Ansari | e****1@f****m | 389 |
| dependabot[bot] | 4****] | 239 |
| Paul Abumov | p****v@m****m | 211 |
| Pratik | t****r@f****m | 143 |
| Sara Ebrahim | s****y@g****m | 51 |
| EricMichaelSmith | e****s@f****m | 25 |
| Sathira Katugaha | s****2 | 15 |
| Mojtaba | k****i@f****m | 13 |
| Martin Corredor | m****r@d****r | 7 |
| Jing | j****3@f****m | 6 |
| Jeremy Reizenstein | 6****r | 6 |
| mojtaba-komeili | k****i@d****r | 5 |
| George Wei | g****i@m****m | 5 |
| Vaibhav Adlakha | 3****d | 5 |
| Sath Katugaha | s****a@f****m | 4 |
| Mary Williamson | m****n@f****m | 4 |
| edwadguo61 | e****o@b****u | 3 |
| Thamme Gowda | t****n@g****m | 3 |
| Steven Basart | x****n@g****m | 2 |
| Yash Goel | 5****1 | 2 |
| Peter Reithofer | p****r@p****e | 2 |
| Facebook Community Bot | f****t | 2 |
| Sasha Sheng | s****h@f****m | 2 |
| Arjunan K | a****0@g****m | 1 |
| Ben Selby | b****y@g****m | 1 |
| Ikko Eltociear Ashimine | e****r@g****m | 1 |
| Jacob Kahn | j****1@g****m | 1 |
| liushh | h****1@g****m | 1 |
| Jimmy Wei | j****i@f****m | 1 |
| and 8 more... | ||
Committer Domains (Top 20 + Academic)
Issues and Pull Requests
Last synced: 8 months ago
All Time
- Total issues: 69
- Total pull requests: 311
- Average time to close issues: 11 months
- Average time to close pull requests: 26 days
- Total issue authors: 24
- Total pull request authors: 17
- Average comments per issue: 2.07
- Average comments per pull request: 0.84
- Merged pull requests: 213
- Bot issues: 0
- Bot pull requests: 206
Past Year
- Issues: 1
- Pull requests: 78
- Average time to close issues: 17 days
- Average time to close pull requests: 10 days
- Issue authors: 1
- Pull request authors: 2
- Average comments per issue: 2.0
- Average comments per pull request: 0.23
- Merged pull requests: 34
- Bot issues: 0
- Bot pull requests: 50
Top Authors
Issue Authors
- JackUrb (19)
- pringshia (14)
- mjkanji (4)
- jayhuynh (4)
- meta-paul (3)
- Stefan1220 (2)
- PReithofer (2)
- spxneo (2)
- jadermcs (1)
- SYSU-lulc (1)
- lidiyam (1)
- wise-east (1)
- hideaki-j (1)
- gpucce (1)
- dependabot[bot] (1)
Pull Request Authors
- dependabot[bot] (304)
- meta-paul (50)
- JackUrb (23)
- pringshia (6)
- Etesam913 (4)
- benmatselby (3)
- gzhihongwei (3)
- PReithofer (3)
- macota (2)
- arjunan-k (1)
- eltociear (1)
- Guest400123064 (1)
- edwardguo61 (1)
- 0x00b1 (1)
- jayhuynh (1)
Top Labels
Issue Labels
Pull Request Labels
Packages
- Total packages: 1
-
Total downloads:
- pypi 108 last-month
- Total dependent packages: 0
- Total dependent repositories: 1
- Total versions: 12
- Total maintainers: 1
pypi.org: mephisto
Crowdsourcing made simpler.
- Homepage: https://mephisto.ai/
- Documentation: https://mephisto.ai/docs/reference/overview/
- License: MIT
-
Latest release: 1.1.1
published over 3 years ago