The Experiment Factory
The Experiment Factory: Reproducible Experiment Containers - Published in JOSS (2018)
Science Score: 77.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
✓CITATION.cff file
Found CITATION.cff file -
✓codemeta.json file
Found codemeta.json file -
✓.zenodo.json file
Found .zenodo.json file -
✓DOI references
Found 7 DOI reference(s) in README -
✓Academic publication links
Links to: joss.theoj.org, zenodo.org -
✓Committers with academic emails
1 of 4 committers (25.0%) from academic institutions -
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (16.2%) to scientific vocabulary
Keywords
Repository
software to generate a reproducible container with a battery of experiments
Basic Info
- Host: GitHub
- Owner: expfactory
- License: bsd-3-clause
- Language: Python
- Default Branch: master
- Homepage: https://expfactory.github.io/
- Size: 2.53 MB
Statistics
- Stars: 38
- Watchers: 8
- Forks: 14
- Open Issues: 28
- Releases: 3
Topics
Metadata Files
README.md
The Experiment Factory

See our documentation for getting started. If you are new to containers, read our background or paper first. If you want a more guided entry, see the detailed start
The Experiment Factory is software to create a reproducible container that you can easily customize to deploy a set of web-based experiments.
Citation
If the Experiment Factory is useful to you, please cite the paper to support the software and open source development.
Sochat, (2018). The Experiment Factory: Reproducible Experiment Containers. Journal of Open Source Software, 3(22), 521, https://doi.org/10.21105/joss.00521
Contributing
We have many ways to contribute, and will briefly provide resources here to get you started.
How to Contribute
If you are a developer interested in working on the Experiment Factory software you should read out contributing guidelines for details. For contributing containers and experiments, see our user documentation. If you have any questions, please don't hesitate to ask a question. You'll need to lint your code using black:
bash
$ pip install black
$ black expfactory --exclude template.py
Code of Conduct
It's important to treat one another with respect, and maintain a fun and respectful environment for the open source community. Toward this aim, we ask that you review our code of conduct
Background
It's predecessor at Expfactory.org was never able to open up to the public, and this went against the original goal of the software. Further, the badly needed functionality to serve a local battery was poorly met with expfactory-python as time progressed and dependencies changes.
This version is agnostic to the underlying driver of the experiments, and provides reproducible, instantly deployable "container" experiments. What does that mean?
- You obtain (or build) one container, a battery of experiments.
- You (optionally) customize it
- custom variables (e.g., a study identifier) and configurations go into the build recipe
- you can choose to use your own database (default output is flat files)
- other options are available at runtime
- The container can be easily shared.
- You run the container, optionally specifying a subset and ordering, and collect your results
If you build on Docker Hub anyone else can then pull and use your exact container to collect their own results. It is exact down to the file hash. Note that bases for expfactory were initially provided on Docker Hub and have moved to Quay.io. Dockerfiles in the repository that use the expfactory-builder are also updated. If you need a previous version, please see the tags on the original Docker Hub.
Experiment Library
The experiments themselves are now maintained under expfactory-experiments, official submissions to be found by expfactory can be added to the library (under development) to be tested that they meet minimum requirements.
Owner
- Name: The Experiment Factory
- Login: expfactory
- Kind: organization
- Location: Stanford University
- Website: http://expfactory.github.io
- Repositories: 26
- Profile: https://github.com/expfactory
Citation (CITATION.cff)
cff-version: 1.1.0
message: "If you use this software, please cite it as below."
authors:
- family-names: Sochat
given-names: Vanessa
orcid: https://orcid.org/0000-0002-4387-3819
title: "The Experiment Factory: Reproducible Experiment Containers"
version: 3.19
doi: 10.21105/joss.00521
date-released: 2018-02-04
GitHub Events
Total
- Issues event: 1
- Watch event: 2
- Issue comment event: 8
- Pull request event: 2
Last Year
- Issues event: 1
- Watch event: 2
- Issue comment event: 8
- Pull request event: 2
Committers
Last synced: 7 months ago
Top Committers
| Name | Commits | |
|---|---|---|
| vsoch | v****t@s****u | 490 |
| earcanal | p****l@m****m | 25 |
| Thomas J. Leeper | t****r@g****m | 1 |
| tylerburleigh | t****g@u****a | 1 |
Committer Domains (Top 20 + Academic)
Issues and Pull Requests
Last synced: 6 months ago
All Time
- Total issues: 59
- Total pull requests: 48
- Average time to close issues: 10 months
- Average time to close pull requests: 4 months
- Total issue authors: 20
- Total pull request authors: 6
- Average comments per issue: 6.15
- Average comments per pull request: 2.17
- Merged pull requests: 33
- Bot issues: 0
- Bot pull requests: 0
Past Year
- Issues: 1
- Pull requests: 1
- Average time to close issues: N/A
- Average time to close pull requests: N/A
- Issue authors: 1
- Pull request authors: 1
- Average comments per issue: 9.0
- Average comments per pull request: 0.0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0
Top Authors
Issue Authors
- vsoch (13)
- AlvaroAguilera (11)
- danieljwilson (8)
- earcanal (6)
- tylerburleigh (4)
- tfeige91 (2)
- SaschaFroelich (2)
- SSchwoebel (1)
- OscarKjell (1)
- mz973 (1)
- SIHranova (1)
- yarikoptic (1)
- emmjayya (1)
- davidjohnbaker1 (1)
- jlhanson5 (1)
Pull Request Authors
- vsoch (28)
- earcanal (12)
- AlvaroAguilera (4)
- tylerburleigh (3)
- YanivD (1)
- yarikoptic (1)
Top Labels
Issue Labels
Pull Request Labels
Packages
- Total packages: 1
-
Total downloads:
- pypi 77 last-month
- Total docker downloads: 1,622
- Total dependent packages: 0
- Total dependent repositories: 3
- Total versions: 204
- Total maintainers: 1
pypi.org: expfactory
software to generate a reproducible container battery of experiments.
- Homepage: http://www.github.com/expfactory/expfactory
- Documentation: https://expfactory.readthedocs.io/
- License: LICENSE
-
Latest release: 3.2.15
published over 3 years ago
