Science Score: 44.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
✓CITATION.cff file
Found CITATION.cff file -
✓codemeta.json file
Found codemeta.json file -
✓.zenodo.json file
Found .zenodo.json file -
○DOI references
-
○Academic publication links
-
○Academic email domains
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (7.4%) to scientific vocabulary
Keywords
Repository
Basic Info
Statistics
- Stars: 5
- Watchers: 2
- Forks: 1
- Open Issues: 1
- Releases: 0
Topics
Metadata Files
README.md
Etikedi
Open-source active-learning backend multipurpose labeling tool. Inspired by prodigy and Labelbox.
Battle mode
Compare two active learning strategies (implemented by alipy) and visualize (altair) the learning process with numerous charts. The strategies are highly configurable and can be combined with multiple sklearn al-model. More information can be found here and here.
Installation
After cloning this repo you first need to initialize the git submodules, which you can in laymen terms think of as including the active learning code from a different git repository.
```bash
Git
git submodule init git submodule update
Frontend
cd frontend npm i ```
Developing
We use docker for the backend. Both backend and frontend have hot reloading out of the box.
- Backend:
docker-compose up --build. - Frontend:
cd frontendthennpm run dev
For further information check the related README.md in the ./frontend and ./backend directory.
Citation (CITATION.cff)
# This CITATION.cff file was generated with cffinit.
# Visit https://bit.ly/cffinit to generate yours today!
cff-version: 1.2.0
title: >-
ALWars: Combat-Based Evaluation of Active Learning
Strategies
message: >-
If you use this software, please cite it using the
metadata from this file.
type: software
authors:
- given-names: Julius
family-names: Gonsior
email: julius.gonsior@tu-dresden.de
affiliation: Technische Universität Dresden
orcid: 'https://orcid.org/0000-0002-5985-4348'
- given-names: Jakob
family-names: Krude
email: jakob.krude@tu-dresden.de
affiliation: Technische Universität Dresden
- given-names: Janik
family-names: Schönfelder
email: janik.schonfelder@tu-dresden.de
affiliation: Technische Universität Dresden
- given-names: Nick
family-names: Lehmann
email: nick.lehmann.@tu-dresden.de
affiliation: Technische Universität Dresden
- given-names: Niccolo
family-names: Borgioli
email: niccolo.Borgioli@tu-dresden.de
affiliation: Technische Universität Dresden
- given-names: Paul
family-names: Sikorski
email: paul.sikorski@tu-dresden.de
affiliation: Technische Universität Dresden
- given-names: Jessica
family-names: Schulze
email: jessica.schulze@tu-dresden.de
affiliation: Technische Universität Dresden
- given-names: Juan Andreas
family-names: Osorio Escobar
email: juan_andres.osorio_escobar@tu-dresden.de
affiliation: Technische Universität Dresden
- given-names: Alexander
family-names: Krause
email: alexander.krause@tu-dresden.de
affiliation: Technische Universität Dresden
- given-names: Andreas
family-names: Geyer
email: andreas.geyer@tu-dresden.de
affiliation: Technische Universität Dresden
- given-names: Franziskus
family-names: Borrmann
email: Franziskus.borrmann@tu-dresden.de
affiliation: Technische Universität Dresden
- given-names: Vinzenz
family-names: Fuhrmann
email: vinzenz.fuhrmann@tu-dresden.de
affiliation: Technische Universität Dresden
- given-names: Moritz
family-names: Blei
email: moritz.blei@tu-dresden.de
affiliation: Technische Universität Dresden
- given-names: Maik
family-names: Thiele
email: maik.thiele@htw-dresden.de
affiliation: Hochschule für Technik und Wirtschaft Dresden
orcid: 'https://orcid.org/0000-0002-1665-977X'
- given-names: Wolfgang
family-names: Lehner
email: wolfgang.lehner@tu-dresden.de
affiliation: Technische Universität Dresden
orcid: 'https://orcid.org/0000-0001-8107-2775'
identifiers:
- type: doi
value: 10.1007/978-3-030-99739-7\_36
- type: url
value: >-
https://link.springer.com/chapter/10.1007/978-3-030-99739-7_36
repository-code: 'https://github.com/etikedi/etikedi'
repository-artifact: 'https://wwwdb.inf.tu-dresden.de/'
abstract: >-
The demand for annotated datasets for supervised
machine learning (ML) projects is growing rapidly.
Annotating a dataset often requires domain experts
and is a timely and costly process. A premier
method to reduce this overhead drastically is
Active Learning (AL). Despite a tremendous
potential for annotation cost savings, AL is still
not used universally in ML projects. The large
number of available AL strategies has significantly
risen during the past years leading to an increased
demand for thorough evaluations of AL strategies.
Existing evaluations show in many cases
contradicting results, without clear superior
strategies. To help researchers in taming the AL
zoo we present ALWars: an interactive system with a
rich set of features to compare AL strategies in a
novel replay view mode of all AL episodes with many
available visualization and metrics. Under the hood
we support a rich variety of AL strategies by
supporting the API of the powerful AL framework
ALiPy [21], amounting to over 25 AL strategies
out-of-the-box.
keywords:
- Active Learning
- Python
- GUI
- Machine Learning
- Demo
license: AGPL-3.0
date-released: '2022-04-05'
GitHub Events
Total
Last Year
Dependencies
- 277 dependencies
- @rollup/plugin-commonjs ^16.0.0 development
- @rollup/plugin-json ^4.1.0 development
- @rollup/plugin-node-resolve ^10.0.0 development
- @rollup/plugin-replace ^2.3.4 development
- @rollup/plugin-typescript ^6.0.0 development
- @smui/slider ^6.0.0-beta.13 development
- @tsconfig/svelte ^1.0.0 development
- @types/node ^17.0.31 development
- @types/sanitize-html ^1.27.0 development
- rollup ^2.3.4 development
- rollup-plugin-css-only ^3.0.0 development
- rollup-plugin-livereload ^2.0.0 development
- rollup-plugin-svelte ^7.1.0 development
- rollup-plugin-terser ^7.0.0 development
- sirv-cli ^1.0.0 development
- svelte ^3.0.0 development
- svelte-check ^1.0.0 development
- svelte-loading-spinners ^0.1.7 development
- svelte-preprocess ^4.10.5 development
- svelte-select ^4.4.7 development
- svelte-simple-modal ^1.3.1 development
- tslib ^2.0.0 development
- typescript ^3.9.3 development
- @beyonk/svelte-notifications ^3.1.0
- axios ^0.21.0
- change-case ^4.1.2
- chart.js ^2.9.4
- chartkick ^3.2.1
- copy-to-clipboard ^3.3.1
- dompurify ^2.2.3
- jwt-decode ^3.1.2
- svelte-ace 1.0.10
- tinro ^0.4.3
- vega ^5.22.1
- vega-embed ^6.20.8
- vega-lite ^5.2.0
- 275 dependencies
- black ==19.10b0 develop
- jedi * develop
- jupyter * develop
- jupyterlab * develop
- nb-black * develop
- pydocstyle * develop
- pylint * develop
- pytest * develop
- rope * develop
- alipy *
- altair *
- altair-saver *
- bcrypt *
- cvxpy *
- dataclasses *
- dill *
- fastapi *
- json-tricks *
- numba *
- numpy *
- pandas *
- passlib *
- peewee *
- pillow *
- psycopg2-binary *
- python-jose *
- requests *
- seaborn *
- sklearn *
- sqlalchemy *
- statsmodels *
- tabulate *
- uvicorn *
- 199 dependencies