lemon-evaluation

https://github.com/iamdecode/lemon-evaluation

Science Score: 44.0%

This score indicates how likely this project is to be science-related based on various indicators:

✓
CITATION.cff file
Found CITATION.cff file
✓
codemeta.json file
Found codemeta.json file
✓
.zenodo.json file
Found .zenodo.json file
○
DOI references
○
Academic publication links
○
Academic email domains
○
Institutional organization owner
○
JOSS paper metadata
○
Scientific vocabulary similarity
Low similarity (10.3%) to scientific vocabulary

Last synced: 9 months ago · JSON representation ·

Repository

Basic Info

Host: GitHub
Owner: iamDecode
License: bsd-2-clause
Language: Jupyter Notebook
Default Branch: main
Homepage: https://explaining.ml/lemon
Size: 1.37 MB

Statistics

Stars: 0
Watchers: 2
Forks: 0
Open Issues: 0
Releases: 0

Created about 7 years ago · Last pushed over 2 years ago

Metadata Files

Readme License Citation

🍋 LEMON evaluation

This repository hosts the code to run the evaluation of the LEMON explainer technique.

Setup

This assumes you have got the python virtualenv package installed (pip install virtualenv).

Create a virtual environment:
```
$ virtualenv venv
```
Activate the virtual environment:
```
$ source venv/bin/activate
```

Or in the fish shell:

    $ source venv/bin/activate.fish

Install the dependencies:
```
$ pip install -r requirements.txt
```
Make sure jupyter uses the virtualenv:

$ python -m ipykernel install --user --name=venv

Running

To execute the notebook, run:

    $ jupyter lab

You may have to switch the kernel to the one we created in setup step 4.

Content

01-samples contains code to generate samples using arbitrary distance kernels (the basis of LEMON), and code to generate the figures used in the paper.
02-evaluation-synthetic contains the full code for LEMON and for the synthetic data evaluation in the paper, and
03-evaluation-uci the code for the UCI dataset evaluation in the paper (this may take a while to run).

Citation

If you want to refer to our explanation technique, please cite our paper using the following BibTeX entry:

bibtex @inproceedings{collaris2023lemon, title={{LEMON}: Alternative Sampling for More Faithful Explanation Through Local Surrogate Models}, author={Collaris, Dennis and Gajane, Pratik and Jorritsma, Joost and van Wijk, Jarke J and Pechenizkiy, Mykola}, booktitle={Advances in Intelligent Data Analysis XXI: 21st International Symposium on Intelligent Data Analysis (IDA 2023)}, pages={77--90}, year={2023}, organization={Springer} }

Owner

Name: Dennis Collaris
Login: iamDecode
Kind: user
Location: Brainport, The Netherlands
Company: Eindhoven University of Technology

Website: de.co.de
Repositories: 53
Profile: https://github.com/iamDecode

Citation (CITATION.cff)

cff-version: 1.2.0
message: "If you use this software, please cite it using these metadata."
title: "LEMON: Alternative Sampling for More Faithful Explanation Through Local Surrogate Models"
abstract: "Local surrogate learning is a popular and successful method for machine learning explanation. It uses synthetic transfer data to approximate a complex reference model. The sampling technique used for this transfer data has a significant impact on the provided explanation, but remains relatively unexplored in literature. In this work, we explore alternative sampling techniques in pursuit of more faithful and robust explanations, and present LEMON: a sampling technique that samples directly from the desired distribution instead of reweighting samples as done in other explanation techniques (e.g., LIME). Next, we evaluate our technique in a synthetic and UCI dataset-based experiment, and show that our sampling technique yields more faithful explanations compared to current state-of-the-art explainers."
authors:
  - family-names: Collaris
    given-names: Dennis
    orcid: "https://orcid.org/0000-0001-7612-9319"
  - family-names: Pratik
    given-names: Gajane
    orcid: "http://orcid.org/0000-0002-8087-5661"
  - family-names: Joost
    given-names: Jorritsma
    orcid: "http://orcid.org/0000-0002-1669-9253"
  - family-names: van Wijk
    given-names: Jarke J.
    orcid: "https://orcid.org/0000-0002-5128-976X"
  - family-names: Pechenizkiy
    given-names: Mykola
    orcid: "http://orcid.org/0000-0003-4955-0743"
doi: 10.1007/978-3-031-30047-9_7
date-released: 2023-04-14
license: BSD-2-Clause

GitHub Events

Total

Last Year

Issues and Pull Requests

Last synced: over 1 year ago

All Time

Total issues: 0
Total pull requests: 0
Average time to close issues: N/A
Average time to close pull requests: N/A
Total issue authors: 0
Total pull request authors: 0
Average comments per issue: 0
Average comments per pull request: 0
Merged pull requests: 0
Bot issues: 0
Bot pull requests: 0

Past Year

Issues: 0
Pull requests: 0
Average time to close issues: N/A
Average time to close pull requests: N/A
Issue authors: 0
Pull request authors: 0
Average comments per issue: 0
Average comments per pull request: 0
Merged pull requests: 0
Bot issues: 0
Bot pull requests: 0

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Open Source Science