https://github.com/axiom-data-science/docker-luigi
🐍 🐳 Luigi in Docker - alpine and ubuntu images available
Science Score: 13.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
✓codemeta.json file
Found codemeta.json file -
○.zenodo.json file
-
○DOI references
-
○Academic publication links
-
○Academic email domains
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (8.3%) to scientific vocabulary
Keywords
Repository
🐍 🐳 Luigi in Docker - alpine and ubuntu images available
Basic Info
Statistics
- Stars: 51
- Watchers: 5
- Forks: 20
- Open Issues: 1
- Releases: 0
Topics
Metadata Files
README.md
Luigi on Docker
In addition to supporting the sqlite task history backend, this container includes all of the dependencies to use the mysql and postgresql backends.
Versions
alpine
Uses pip to install luigi and dependencies
axiom/docker-luigi:latest-alpine(2.8.13)axiom/docker-luigi:{version}-alpine
baseimage (ubuntu xenial)
Uses conda to install luigi and dependencies
axiom/docker-luigi:latest(2.8.13)axiom/docker-luigi:{version}
Exposed Volumes
/etc/luigi/
Both luigi and luigid load their configuration from /etc/luigi/.
- Configuration:
/etc/luigi/luigi.conf - Logging:
/etc/luigi/logging.conf
Mount a directory containing a luigi.conf and logging.conf file(s) to
/etc/luigi to provide your own configuration(s).
docker run \
-v /your/directory:/etc/luigi \
axiom/docker-luigi
Or mount a single configuration file:
docker run \
-v /your/directory/logging.conf:/etc/luigi/logging.conf \
axiom/docker-luigi
The default can be found in the luigi.conf and logging.conf files in this
repository. Be aware that these specify the paths to the logging configration
and the state persistence database. If you change these values in luigi.conf
the examples in this document will not work!
/luigi/state
Mount a volume at /luigi/state for the luigid state to be persisted
between restarts. Example below uses a named docker volume to persist the state:
docker run \
-v luigistate:/luigi/state \
axiom/docker-luigi
Testing
```bash docker-compose -f tests/docker-compose.yml up -d maria pgsql
Wait ~10s for databases to start
docker-compose -f tests/docker-compose.yml build docker-compose -f tests/docker-compose.yml up docker-compose down ```
Owner
- Name: Axiom Data Science
- Login: axiom-data-science
- Kind: organization
- Location: United States
- Website: https://www.axiomdatascience.com/
- Repositories: 64
- Profile: https://github.com/axiom-data-science