Science Score: 44.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
✓CITATION.cff file
Found CITATION.cff file -
✓codemeta.json file
Found codemeta.json file -
✓.zenodo.json file
Found .zenodo.json file -
○DOI references
-
○Academic publication links
-
○Academic email domains
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (5.3%) to scientific vocabulary
Repository
Mitwelten ML Backend
Basic Info
- Host: GitHub
- Owner: mitwelten
- License: mit
- Language: Python
- Default Branch: main
- Size: 1.07 MB
Statistics
- Stars: 1
- Watchers: 2
- Forks: 0
- Open Issues: 0
- Releases: 0
Metadata Files
README.md
Mitwelten ML Backend
Pipeline Overview
mermaid
graph TD
ingest(ingest: file upload)-->db(db: metadata, datasets, results)
ingest-->storage(storage: files)
storage --> inference(inference: TensorFlow)
db --> inference
inference --> db
ingest
Import of assets, metadata to db (PostgreSQL), files to storage (minIO S3).
- extract metadata from files
- check for naming collisions with existing files
- upload metadata to db
- upload files to storage
The import of existing audio data is documented in the import-existing-audio report. The accompanying code is found in ingest/import_existing/. Further development will be based on this code.
audio uploader app
To upload audiofiles recorded by Audiomoths, you can use the mitwelten-audio-uploader app.
database
Retired database schema, for current setup check mitwelten-db-backend.
- files (metadata)
- datasets (collections of files)
- paramsets (inference configuration)
- results (inference)
For details check initialize_db.sql.
Set credentials in credentials.py (db)
storage
Bucket on minIO S3 backend, publicly accessible.
Set credentials in credentials.py (storage)
Owner
- Name: Mitwelten
- Login: mitwelten
- Kind: organization
- Website: https://mitwelten.org/
- Twitter: mitwelten
- Repositories: 32
- Profile: https://github.com/mitwelten
Citation (CITATION.cff)
# This CITATION.cff file was generated with cffinit.
# Visit https://bit.ly/cffinit to generate yours today!
cff-version: 1.2.0
title: Mitwelten Machine Learning Backend
message: >-
If you use this software, please cite it using the
metadata from this file.
type: software
authors:
- given-names: Cedric
family-names: Spindler
email: cedric.spindler@fhnw.ch
affiliation: FHNW
orcid: 'https://orcid.org/0000-0001-5080-0848'
- given-names: Timeo
family-names: Wullschleger
email: timeo.wullschleger@fhnw.ch
affiliation: FHNW
- given-names: Thomas
family-names: Amberg
email: thomas.amberg@fhnw.ch
affiliation: FHNW
repository-code: 'https://github.com/mitwelten/mitwelten-ml-backend'
url: 'https://mitwelten.org'
abstract: >-
Mitwelten Machine Learning: Collection, Processing,
Exploration and Validation of data as part of the research
project.
license: MIT
commit: 16e1cf5d63bccf754bb68a7365a183298814597e
GitHub Events
Total
- Issues event: 3
- Watch event: 1
- Push event: 6
Last Year
- Issues event: 3
- Watch event: 1
- Push event: 6
Dependencies
- Pillow ==9.1.1
- certifi ==2022.6.15
- charset-normalizer ==2.1.0
- idna ==3.3
- minio ==7.1.9
- pkg_resources ==0.0.0
- psycopg2-binary ==2.9.3
- requests ==2.28.1
- tqdm ==4.64.0
- urllib3 ==1.26.9
- Pillow ==9.1.1
- PyQt5 ==5.15.6
- audio-metadata ==0.11.1
- minio ==7.1.7
- psycopg2-binary ==2.8.6
- pyinstaller ==5.0.1
- pyparsing ==2.4.7
- tqdm ==4.64.0
- click ==8.1.7
- librosa ==0.9.2
- matplotlib ==3.6.2
- minio ==7.2.0
- numpy ==1.23.4
- pandas ==1.5.2
- psycopg2-binary ==2.9.9
- scikit_learn ==1.2.0
- scipy ==1.9.3
- torch ==1.13.1
- torchaudio ==0.13.1
- torchvision ==0.14.1
- librosa ==0.9.2
- minio ==7.2.0
- psycopg2-binary ==2.9.9
- tensorflow ==2.9.1