Data

Tools

Indexes

Applications

Experiments

Open Source Science

pylids

Generalizable DNNs for pupil and eyelid tracking

https://github.com/piecesofmindlab/pylids

Science Score: 75.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ✓
    CITATION.cff file
    Found CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ✓
    DOI references
    Found 1 DOI reference(s) in README
  • ✓
    Academic publication links
    Links to: springer.com
  • ○
    Academic email domains
  • ✓
    Institutional organization owner
    Organization piecesofmindlab has institutional domain (piecesofmind.psyc.unr.edu)
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (11.0%) to scientific vocabulary
Last synced: 10 months ago · JSON representation ·

Repository

Generalizable DNNs for pupil and eyelid tracking

Basic Info
  • Host: GitHub
  • Owner: piecesofmindlab
  • License: gpl-3.0
  • Language: Python
  • Default Branch: main
  • Size: 16.9 MB
Statistics
  • Stars: 12
  • Watchers: 2
  • Forks: 1
  • Open Issues: 1
  • Releases: 1
Created about 3 years ago · Last pushed 10 months ago
Metadata Files
Readme License Citation

README.md

Pylids

A suite of tools for robust and generalizable estimation of eye shape from videos.

With pylids you can use a pretrained DNN model based on DLC to:

  • Estimate the pupil outline
  • Estimate the shape of the eylids

pylids also provides users with tools to finetune the default DNN model to ensure generalization on their dataset. Users can:

  • Automatically generate optimally selected domain specific data augmentations to improve pupil and eyelid estimation on new datasets
  • Select miniminum frames to relabel from the new dataset to ensure generalization

pylids has been built to be used with the pupil lab gaze estimation pipeline.

How to install pylids

We assume you have conda or mamba setup. For GPU usage make sure you have CUDA installed. Current version has been tested with CUDA 12.2

Use the included .yml file to create the pylids environment conda env create -f PYLIDS.yml

Demos

Check out the notebooks in the demo folder to see how to use pylids and train new models.

Funding

The creation of pylids was funded by NSF EPSCoR # 1920896 to Michelle R. Greene, Mark D. Lescorart, Paul MacNeilage, and Benjamin Balas.

Citation

If you use pylids in your research, please cite the following paper:

Biswas, A., & Lescroart, M. D. (2023). A framework for generalizable neural networks for robust estimation of eyelids and pupils. Behavior Research Methods, 1-23. https://link.springer.com/article/10.3758/s13428-023-02266-3

Owner

  • Name: Pieces of Mind Lab @ UN Reno
  • Login: piecesofmindlab
  • Kind: organization
  • Location: Reno, NV

Mark Lescroart's computational cognitive neuroscience lab. We study scene, object, & body perception.

Citation (CITATION.cff) 

cff-version: 1.2.0
message: "If you use this software, please cite it as below."
authors:
- family-names: "Biswas"
  given-names: "Arnab"
- family-names: "Lescroart"
  given-names: "Mark"
title: "A framework for generalizable neural networks for robust estimation of eyelids and pupils"
doi: 10.3758/s13428-023-02266-3 
date-released: 2023-07-23
url: "https://github.com/piecesofmindslab/pylids"

GitHub Events

Total
  • Delete event: 1
  • Issue comment event: 1
  • Push event: 12
  • Pull request review event: 1
  • Pull request event: 4
  • Create event: 1
Last Year
  • Delete event: 1
  • Issue comment event: 1
  • Push event: 12
  • Pull request review event: 1
  • Pull request event: 4
  • Create event: 1

Dependencies

setup.py pypi