moabb

Mother of All BCI Benchmarks

Science Score: 77.0%

This score indicates how likely this project is to be science-related based on various indicators:

✓
CITATION.cff file
Found CITATION.cff file
✓
codemeta.json file
Found codemeta.json file
✓
.zenodo.json file
Found .zenodo.json file
✓
DOI references
Found 9 DOI reference(s) in README
✓
Academic publication links
Links to: arxiv.org, iop.org, zenodo.org
✓
Committers with academic emails
5 of 50 committers (10.0%) from academic institutions
○
Institutional organization owner
○
JOSS paper metadata
○
Scientific vocabulary similarity
Low similarity (17.0%) to scientific vocabulary

Keywords

bci bci-benchmarks brain-computer-interface eeg machine-learning neuroscience

Keywords from Contributors

meg magnetoencephalography neuroimaging electroencephalography electrocorticography ecog data-profilers pipeline-testing datacleaner mesh

Last synced: 6 months ago · JSON representation ·

Repository

Mother of All BCI Benchmarks

Basic Info

Host: GitHub
Owner: NeuroTechX
License: bsd-3-clause
Language: Python
Default Branch: develop
Homepage: https://moabb.neurotechx.com/docs/index.html
Size: 141 MB

Statistics

Stars: 835
Watchers: 31
Forks: 211
Open Issues: 113
Releases: 10

Topics

bci bci-benchmarks brain-computer-interface eeg machine-learning neuroscience

Created almost 9 years ago · Last pushed 6 months ago

Metadata Files

Readme Contributing License Code of conduct Citation Roadmap

README.md

Mother of all BCI Benchmarks Build a comprehensive benchmark of popular Brain-Computer Interface (BCI) algorithms applied on an extensive list of freely available EEG datasets.

Disclaimer

This is an open science project that may evolve depending on the need of the community.

The problem

Brain-Computer Interfaces allow to interact with a computer using brain signals. In this project, we focus mostly on electroencephalographic signals (EEG), that is a very active research domain, with worldwide scientific contributions. Still:

Reproducible Research in BCI has a long way to go.
While many BCI datasets are made freely available, researchers do not publish code, and reproducing results required to benchmark new algorithms turns out to be trickier than it should be.
Performances can be significantly impacted by parameters of the preprocessing steps, toolboxes used and implementation “tricks” that are almost never reported in the literature.

As a result, there is no comprehensive benchmark of BCI algorithms, and newcomers are spending a tremendous amount of time browsing literature to find out what algorithm works best and on which dataset.

The solution

The Mother of all BCI Benchmarks allows to:

Build a comprehensive benchmark of popular BCI algorithms applied on an extensive list of freely available EEG datasets.
The code is available on GitHub, serving as a reference point for the future algorithmic developments.
Algorithms can be ranked and promoted on a website, providing a clear picture of the different solutions available in the field.

This project will be successful when we read in an abstract “ … the proposed method obtained a score of 89% on the MOABB (Mother of All BCI Benchmarks), outperforming the state of the art by 5% ...”.

Core Team

This project is under the umbrella of NeuroTechX, the international community for NeuroTech enthusiasts.

The project is currently maintained by:

Sylvain Chevallier	Bruno Aristimunha	Igor Carrara	Pierre Guetschel

The Mother of all BCI Benchmarks was founded by Alexander Barachant and Vinay Jayaram, who are experts in the field of Brain-Computer Interfaces (BCI). At the moment, both work as Research Scientists at Meta.

Alexander Barachant	Vinay Jayaram

Contributors

The MOABB is a community project, and we are always thankful to all the contributors!

Special acknowledge for the extra MOABB contributors:

Pedro Rodrigues

What do we need?

You! In whatever way you can help.

We need expertise in programming, user experience, software sustainability, documentation and technical writing and project management.

We'd love your feedback along the way.

Our primary goal is to build a comprehensive benchmark of popular BCI algorithms applied on an extensive list of freely available EEG datasets, and we're excited to support the professional development of any and all of our contributors. If you're looking to learn to code, try out working collaboratively, or translate your skills to the digital domain, we're here to help.

Citing MOABB and related publications

If you use MOABB in your experiments, please cite this library when publishing a paper to increase the visibility of open science initiatives:

Here is the APA version: Aristimunha, B., Carrara, I., Guetschel, P., Sedlar, S., Rodrigues, P., Sosulski, J., Narayanan, D., Bjareholt, E., Barthelemy, Q., Schirrmeister, R. T., Kobler, R., Kalunga, E., Darmet, L., Gregoire, C., Abdul Hussain, A., Gatti, R., Goncharenko, V., Thielen, J., Moreau, T., Roy, Y., Jayaram, V., Barachant, A., & Chevallier, S. (2025). Mother of all BCI Benchmarks (MOABB), 2025. DOI: 10.5281/zenodo.10034223.

and the Bibtex version:

```bibtex

@software{Aristimunha_Mother_of_all,
  author       = {Aristimunha, Bruno and
                  Carrara, Igor and
                  Guetschel, Pierre and
                  Sedlar, Sara and
                  Rodrigues, Pedro and
                  Sosulski, Jan and
                  Narayanan, Divyesh and
                  Bjareholt, Erik and
                  Barthelemy, Quentin and
                  Schirrmeister, Robin Tibor and
                  Kobler, Reinmar and
                  Kalunga, Emmanuel and
                  Darmet, Ludovic and
                  Gregoire, Cattan and
                  Abdul Hussain, Ali and
                  Gatti, Ramiro and
                  Goncharenko, Vladislav and
                  Thielen, Jordy and
                  Moreau, Thomas and
                  Roy, Yannick and
                  Jayaram, Vinay and
                  Barachant, Alexandre and
                  Chevallier, Sylvain},
        title        = {Mother of all BCI Benchmarks},
        year         = 2025,
        publisher    = {Zenodo},
        version      = {v1.2.0},
        url = {https://github.com/NeuroTechX/moabb},
        doi = {10.5281/zenodo.10034223},
}

```

If you want to cite the scientific contributions of MOABB, you could use the following paper:

Sylvain Chevallier, Igor Carrara, Bruno Aristimunha, Pierre Guetschel, Sara Sedlar, Bruna Junqueira Lopes, Sébastien Velut, Salim Khazem, Thomas Moreau "The largest EEG-based BCI reproducibility study for open science: the MOABB benchmark" HAL: hal-04537061.

Vinay Jayaram and Alexandre Barachant. "MOABB: trustworthy algorithm benchmarking for BCIs." Journal of neural engineering 15.6 (2018): 066011. DOI

If you publish a paper using MOABB, please contact us on gitter or open an issue! We would love to hear about your work and help you promote it.

Contact us

If you want to report a problem or suggest an enhancement, we'd love for you to open an issue at this GitHub repository because then we can get right on it.

For a less formal discussion or exchanging ideas, you can also reach us on the Github or join our weekly office hours! This an open video meeting happening on a regular basis, please ask the link on the gitter channel. We are also on NeuroTechX Slack channel #moabb.

Owner

Name: NeuroTechX
Login: NeuroTechX
Kind: organization

Website: neurotechx.com
Repositories: 34
Profile: https://github.com/NeuroTechX

Citation (CITATION.cff)

cff-version: 1.3.0
message: "If you use this software, please cite it as below."
authors:
- family-names: "Aristimunha"
  given-names: "Bruno"
  orcid: "https://orcid.org/0000-0001-5258-2995"
- family-names: "Carrara"
  given-names: "Igor"
  orcid: "https://orcid.org/0000-0002-2580-094X"
- family-names: "Guetschel"
  given-names: "Pierre"
  orcid: "https://orcid.org/0000-0002-8933-7640"
- family-names: "Sedlar"
  given-names: "Sara"
  orcid: "https://orcid.org/0000-0002-1492-0014"
- family-names: "Rodrigues"
  given-names: "Pedro"
  orcid: "https://orcid.org/0000-0003-3534-317X"
- family-names: "Sosulski"
  given-names: "Jan"
  orcid: "https://orcid.org/0000-0002-8105-3395"
- family-names: "Narayanan"
  given-names: "Divyesh"
- family-names: "Bjareholt"
  given-names: "Erik"
  orcid: "https://orcid.org/0000-0003-1350-9677"
- family-names: "Barthelemy"
  given-names: "Quentin"
  orcid: "https://orcid.org/0000-0002-7059-6028"
- family-names: "Schirrmeister"
  given-names: "Robin Tibor"
  orcid: "https://orcid.org/0000-0002-5518-7445"
- family-names: "Kobler"
  given-names: "Reinmar"
  orcid: "https://orcid.org/0000-0003-4007-279X"
- family-names: "Kalunga"
  given-names: "Emmanuel"
  orcid: "https://orcid.org/0000-0001-7522-5253"
- family-names: "Darmet"
  given-names: "Ludovic"
  orcid: "https://orcid.org/0000-0001-5445-9763"
- family-names: "Gregoire"
  given-names: "Cattan"
  orcid: "https://orcid.org/0000-0002-7515-0690"
- family-names: "Abdul Hussain"
  given-names: "Ali"
  orcid: "https://orcid.org/0000-0002-9814-9107"
- family-names: "Gatti"
  given-names: "Ramiro"
  orcid: "https://orcid.org/0000-0001-7367-0791"
- family-names: "Goncharenko"
  given-names: "Vladislav"
  orcid: "https://orcid.org/0000-0002-9243-6914"
- family-names: "Thielen"
  given-names: "Jordy"
  orcid: "https://orcid.org/0000-0002-6264-0367"
- family-names: "Moreau"
  given-names: "Thomas"
  orcid: "https://orcid.org/0000-0002-1523-3419"
- family-names: "Roy"
  given-names: "Yannick"
  orcid: "https://orcid.org/0000-0003-4408-5221"
- family-names: "Jayaram"
  given-names: "Vinay"
  orcid: "https://orcid.org/0000-0002-8581-4921"
- family-names: "Barachant"
  given-names: "Alexandre"
  orcid: "https://orcid.org/0000-0001-8202-6287"
- family-names: "Chevallier"
  given-names: "Sylvain"
  orcid: "https://orcid.org/0000-0003-3027-8241"
title: "Mother of all BCI Benchmarks"
version: 1.3.0
doi: 10.5281/zenodo.10034223
date-released: 2025-08-28
url: "https://github.com/NeuroTechX/moabb"

Committers

Last synced: 9 months ago

All Time

Total Commits: 689
Total Committers: 50
Avg Commits per committer: 13.78
Development Distribution Score (DDS): 0.835

Past Year

Commits: 111
Committers: 23
Avg Commits per committer: 4.826
Development Distribution Score (DDS): 0.523

Top Committers

Name	Email	Commits
Bru	a**o@a**r	114
Vinay Jayaram	v**m@d**t	102
Sylvain Chevallier	s**r@u**r	90
Alexandre Barachant	a**t@g**m	80
PierreGtch	2****h	64
Vladislav Goncharenko	v**o@p**u	45
Jan Sosulski	m**l@j**e	27
Sylvain Chevallier	s**r@u**r	17
Divyesh Narayanan	4****5	16
Igor Carrara	9****g	15
gcattan	g**n@h**r	13
Erik Bjäreholt	e**k@b**t	12
Ramiro Gatti	r**i@i**r	11
pre-commit-ci[bot]	6****]	11
AliAbdulHussain	k**0@g**m	9
Sara Sedlar	s**r@g**m	8
dependabot[bot]	4****]	4
Quentin Barthélemy	q**y@g**m	4
AJ Keller	p**c@g**m	3
Vinay	v**3@g**m	3
robintibor	r**r@g**m	3
Bruna Junqueira Lopes	9****l	2
Emmanuel Kalunga	e**k@g**m	2
Jordy Thielen	j**n@g**m	2
Samuel-Boehm	7****m	2
Sébastien VELUT	1****t	2
Taha Habib	9****3	2
Thomas Moreau	t**0@g**m	2
toncho11	t****1	2
yosider	y**h@g**m	2
and 20 more...

Committer Domains (Top 20 + Academic)

live.it: 1 maluuba.com: 1 inria.fr: 1 foxmail.com: 1 ingenieria.uner.edu.ar: 1 bjareho.lt: 1 universite-paris-saclay.fr: 1 jan-sosulski.de: 1 phystech.edu: 1 uvsq.fr: 1 danube.is.localnet: 1 aluno.ufabc.edu.br: 1

Issues and Pull Requests

Last synced: 6 months ago

All Time

Total issues: 225
Total pull requests: 389
Average time to close issues: 6 months
Average time to close pull requests: 23 days
Total issue authors: 59
Total pull request authors: 42
Average comments per issue: 2.18
Average comments per pull request: 1.76
Merged pull requests: 325
Bot issues: 0
Bot pull requests: 18

Past Year

Issues: 64
Pull requests: 169
Average time to close issues: 29 days
Average time to close pull requests: 9 days
Issue authors: 24
Pull request authors: 30
Average comments per issue: 1.27
Average comments per pull request: 1.63
Merged pull requests: 138
Bot issues: 0
Bot pull requests: 6

View more stats

Top Authors

Issue Authors

bruAristimunha (57)
PierreGtch (42)
toncho11 (18)
sylvchev (16)
jsosulski (9)
thijor (5)
Div12345 (5)
dawin2015 (4)
AlexandreBleuze (3)
v-goncharenko (3)
srinathakuthota (3)
lionelkusch (2)
t170815518 (2)
alexandrebarachant (2)
allwaysFindFood (2)

Pull Request Authors

bruAristimunha (167)
PierreGtch (93)
sylvchev (39)
gcattan (20)
carraraig (20)
pre-commit-ci[bot] (17)
Sara04 (13)
brunaafl (6)
dependabot[bot] (5)
toncho11 (5)
lucas-heck (5)
qbarthelemy (4)
Samuel-Boehm (4)
tahatt13 (4)
sebVelut (4)

Top Labels

Issue Labels

enhancement (44) moabb (44) help wanted (20) bug (19) easy (13) dataset (13) documentation (9) question (9) medium (5) braindecode (3) hard (2) dependencies (1)

Pull Request Labels

no changelog (35) dependencies (8) enhancement (6) bug (5) dataset (4) documentation (4) help wanted (2) hard (1) medium (1)

Packages

Total packages: 3
Total downloads:
- pypi 5,358 last-month

Total dependent packages: 2
(may contain duplicates)
Total dependent repositories: 24
(may contain duplicates)
Total versions: 29
Total maintainers: 3

pypi.org: moabb

Mother of All BCI Benchmarks

Documentation: https://neurotechx.github.io/moabb
License: BSD-3-Clause
Latest release: 1.2.0
published 12 months ago

Versions: 13
Dependent Packages: 2
Dependent Repositories: 24
Downloads: 5,358 Last month

Rankings

Stargazers count: 2.8%

Dependent repos count: 3.0%

Dependent packages count: 3.2%

Average: 3.5%

Forks count: 4.0%

Downloads: 4.4%

Maintainers (3)

sylvain.chevallier v-goncharenko bruAristimunha

Last synced: 6 months ago

proxy.golang.org: github.com/neurotechx/moabb

Documentation: https://pkg.go.dev/github.com/neurotechx/moabb#section-documentation
License: bsd-3-clause
Latest release: v1.2.0
published 12 months ago

Versions: 8
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Dependent packages count: 5.4%

Average: 5.6%

Dependent repos count: 5.8%

Last synced: 6 months ago

proxy.golang.org: github.com/NeuroTechX/moabb

Documentation: https://pkg.go.dev/github.com/NeuroTechX/moabb#section-documentation
License: bsd-3-clause
Latest release: v1.2.0
published 12 months ago

Versions: 8
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Dependent packages count: 5.4%

Average: 5.6%

Dependent repos count: 5.8%

Last synced: 6 months ago

Dependencies

poetry.lock pypi

alabaster 0.7.12 develop
babel 2.9.1 develop
cfgv 3.3.1 develop
distlib 0.3.4 develop
docutils 0.16 develop
filelock 3.6.0 develop
identify 2.4.10 develop
imagesize 1.3.0 develop
importlib-metadata 4.11.1 develop
jinja2 3.0.3 develop
m2r2 0.2.8 develop
markupsafe 2.1.0 develop
mistune 0.8.4 develop
nodeenv 1.6.0 develop
numpydoc 1.2 develop
platformdirs 2.5.1 develop
pre-commit 2.17.0 develop
pygments 2.11.2 develop
snowballstemmer 2.2.0 develop
sphinx 3.5.4 develop
sphinx-bootstrap-theme 0.8.1 develop
sphinx-gallery 0.8.2 develop
sphinxcontrib-applehelp 1.0.2 develop
sphinxcontrib-devhelp 1.0.2 develop
sphinxcontrib-htmlhelp 2.0.0 develop
sphinxcontrib-jsmath 1.0.1 develop
sphinxcontrib-qthelp 1.0.3 develop
sphinxcontrib-serializinghtml 1.1.5 develop
tdlda 0.1.0 develop
toml 0.10.2 develop
typing-extensions 4.1.1 develop
virtualenv 20.13.1 develop
zipp 3.7.0 develop
appdirs 1.4.4
cached-property 1.5.2
certifi 2021.10.8
charset-normalizer 2.0.12
colorama 0.4.4
coverage 5.5
cycler 0.11.0
fonttools 4.29.1
h5py 3.6.0
idna 3.3
joblib 1.1.0
kiwisolver 1.3.2
matplotlib 3.5.1
mne 0.24.1
numpy 1.21.1
packaging 21.3
pandas 1.1.5
pillow 9.0.1
pooch 1.6.0
pyparsing 3.0.7
pyriemann 0.2.7
python-dateutil 2.8.2
pytz 2021.3
pyyaml 5.4.1
requests 2.27.1
scikit-learn 1.0.2
scipy 1.6.1
seaborn 0.11.2
setuptools-scm 6.4.2
six 1.16.0
threadpoolctl 3.1.0
tomli 2.0.1
tqdm 4.62.3
urllib3 1.26.8

.github/workflows/docs.yml actions

actions/cache v3 composite
actions/checkout v3 composite
actions/setup-python v4 composite
actions/upload-artifact v2 composite
snok/install-poetry v1 composite

.github/workflows/test-devel.yml actions

actions/cache v3 composite
actions/checkout v3 composite
actions/setup-python v4 composite
codecov/codecov-action v3 composite
snok/install-poetry v1 composite

.github/workflows/test.yml actions

actions/cache v3 composite
actions/checkout v3 composite
actions/setup-python v4 composite
codecov/codecov-action v3 composite
snok/install-poetry v1 composite

.github/workflows/test-braindecode.yml actions

actions/cache v3 composite
actions/checkout v4 composite
actions/setup-python v4 composite
snok/install-poetry v1 composite

Dockerfile docker

nvcr.io/nvidia/pytorch 22.11-py3 build

bash/meta_requirements.txt pypi

gdown *
mne *
moabb *

pyproject.toml pypi

PyYAML ^6.0
coverage ^7.0.1
edflib-python ^1.0.6
h5py ^3.7.0
matplotlib ^3.6.2
memory-profiler ^0.61.0
mne ^1.4
mne-bids ^0.13
numpy ^1.22
pandas ^1.5.2
pooch ^1.6.0
pyriemann ^0.3
pytest ^7.4.0
python >=3.8, <3.12
requests ^2.28.1
scikit-learn ^1.2.0
scipy ^1.9.3
seaborn ^0.12.1
tqdm ^4.64.1

.github/workflows/whats-new.yml actions