baseline_eeg_study

Replication package, analysis scripts, and additional plots and raw data for our study paper on baselines in neuroimaging experiments of program comprehension.

https://github.com/brains-on-code/baseline_eeg_study

Science Score: 44.0%

This score indicates how likely this project is to be science-related based on various indicators:

✓
CITATION.cff file
Found CITATION.cff file
✓
codemeta.json file
Found codemeta.json file
✓
.zenodo.json file
Found .zenodo.json file
○
DOI references
○
Academic publication links
○
Academic email domains
○
Institutional organization owner
○
JOSS paper metadata
○
Scientific vocabulary similarity
Low similarity (9.3%) to scientific vocabulary

Keywords

eeg-study eye-tracking-study program-comprehension replication-package research

Last synced: 6 months ago · JSON representation ·

Repository

Replication package, analysis scripts, and additional plots and raw data for our study paper on baselines in neuroimaging experiments of program comprehension.

Basic Info

Host: GitHub
Owner: brains-on-code
License: cc-by-sa-4.0
Language: Jupyter Notebook
Default Branch: main
Homepage:
Size: 29.1 MB

Statistics

Stars: 0
Watchers: 2
Forks: 0
Open Issues: 0
Releases: 0

Topics

eeg-study eye-tracking-study program-comprehension replication-package research

Created over 3 years ago · Last pushed 6 months ago

Metadata Files

Readme License Citation

On the Influence of the Baseline in Neuroimaging Experiments on Program Comprehension

This repository contains the preregistration, replication package, analysis scripts, and additional plots and raw data for our paper.

Pregistration

We preregistered this study at osf. We also include this pregistration as a pdf here: Preregistration.pdf.

Replication Package

We aim to provide everything necessary to replicate our study in this repository.
The data is stored on OSF: Raw Data (https://osf.io/h892p/)
If you encounter any problems with this package, please contact the main author.

Experiment Setup

We provide the experiment setup for replicating the study in /PsychoPy/.

- open the file test.psyexp in Psychopy Version 2021.2.3
- choose the option to run the experiment without devices
- the study supports participant numbers 1

We also provide the questionnaire for demographic data and programming experience: Prequestionnaire.pdf

Data Analysis

We provide the analysis protocol for replicating the data analysis in /scripts/.

Here, you:

- install the requirements: requirements.txt
- download EEGLab and Matlab
- let the scripts run in their correct ordering: `Preprocessing01_fif_to_set.ipynb`, `Preprocessing02_ICA.m`, `Preprocessing03_data_format.ipynb`, `Preprocessing04_fixation_detection.ipynb` and `Baseline.ipynb`

Additional Figures and Data

Finally, we provide extended versions of the figures used in the paper in /plots/.

- averaged_programcomprehension_with_baseline: Figure 6 in the paper and Figures for every baseline individual with the raw and baselinecorrected graph
- averaged_total: Figure 8 in the paper and Figures for every task type individual
- heatmaps: The heatmaps based on the eyetracking data for all tasks, divided into ProgCompr and Baselinetasks (averaged over all participants)
- scanpaths: The scanpaths based on the eyetracking data for all tasks for all participants (not anonymized participant numbering)
- statistics: all statistic values presented in the paper    
- topoplots: Topoplots averaged over all participants for all task types and for ProgCompr with respect to all baselines

We also provide the raw data of the response times and correctness values of the pilot study in Pilot_Study.csv.

License

This repository is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Owner

Name: Brains-on-Code
Login: brains-on-code
Kind: organization

Website: https://brains-on-code.github.io/
Repositories: 2
Profile: https://github.com/brains-on-code

We are researchers interested in empirical software engineering from Chemnitz, Magdeburg, Saarbrücken, and Raleigh.

Citation (CITATION.cff)

cff-version: 1.2.0
message: "If you use our data or replication package, please cite it as below."
authors:
- family-names: "Bergum"
  given-names: "Annabelle"
  orcid: "https://orcid.org/0000-0002-9953-4904"
- family-names: "Peitek"
  given-names: "Norman"
  orcid: "https://orcid.org/0000-0001-7828-4558"
- family-names: "Rekrut"
  given-names: "Maurice"
  orcid: "https://orcid.org/0000-0002-5829-5409"
- family-names: "Siegmund"
  given-names: "Janet"
  orcid: "https://orcid.org/0000-0002-5815-266X"
- family-names: "Apel"
  given-names: "Sven"
  orcid: "https://orcid.org/0000-0003-3687-2233"
title: "On the Influence of the Baseline in Neuroimaging Experiments on Program Comprehension"
version: 1.0.0
url: "https://github.com/brains-on-code/baseline_eeg_study"
preferred-citation:
  authors:
  - family-names: "Bergum"
    given-names: "Annabelle"
    orcid: "https://orcid.org/0000-0002-9953-4904"
  - family-names: "Peitek"
    given-names: "Norman"
    orcid: "https://orcid.org/0000-0001-7828-4558"
  - family-names: "Rekrut"
    given-names: "Maurice"
    orcid: "https://orcid.org/0000-0002-5829-5409"
  - family-names: "Siegmund"
    given-names: "Janet"
    orcid: "https://orcid.org/0000-0002-5815-266X"
  - family-names: "Apel"
    given-names: "Sven"
    orcid: "https://orcid.org/0000-0003-3687-2233"
  title: "On the Influence of the Baseline in Neuroimaging Experiments on Program Comprehension"
  type: article
  journal: "Transactions on Software Engineering and Methodology"
  year: 2025
  doi: "https://www.doi.org/10.1145/3744739"

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Open Source Science