Data

Tools

Indexes

Applications

Experiments

Open Source Science

https://github.com/ai4bharat/include

Code for INCLUDE paper with pre-trained models

https://github.com/ai4bharat/include

Science Score: 23.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ○
    codemeta.json file
  • ○
    .zenodo.json file
  • ✓
    DOI references
    Found 2 DOI reference(s) in README
  • ✓
    Academic publication links
    Links to: zenodo.org
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (7.4%) to scientific vocabulary

Keywords

indian-sign-language isolated-sign-language-recognition
Last synced: 9 months ago · JSON representation

Repository

Code for INCLUDE paper with pre-trained models

Basic Info
  • Host: GitHub
  • Owner: AI4Bharat
  • License: mit
  • Language: Python
  • Default Branch: master
  • Homepage:
  • Size: 117 KB
Statistics
  • Stars: 20
  • Watchers: 4
  • Forks: 27
  • Open Issues: 5
  • Releases: 0
Topics
indian-sign-language isolated-sign-language-recognition
Created over 5 years ago · Last pushed about 5 years ago

https://github.com/AI4Bharat/INCLUDE/blob/master/ 

# INLCUDE - Isolated Indian Sign Language Recognition

This repository contains code for training models on [INCLUDE](https://zenodo.org/record/4010759) dataset

# Dependencies

Install the dependencies through the following command

```bash
>> pip install -r requirements.txt
```



## Steps
- Download the INCLUDE dataset
- Run `generate_keypoints.py` to save keypoints from Mediapipe Hands and Blazepose for train, validation and test videos. 
```bash
>> python generate_keypoints.py --include_dir  --save_dir  --dataset 
```
- Run `runner.py` to train a machine learning model on the dataset
```bash
>> python runner.py --dataset  --use_augs --model transformer --data_dir 
```
- Use the `--use_pretrained` flag to either perform only inference using pretrained model or resume training with the pretrained model. 
```bash
>> python runner.py --dataset  --use_augs --model transformer --data_dir  --use_pretrained 
```
- To get predictions for videos from a pretrained model, run the following command.
```bash
>> python evaluate.py --data_dir 
```

## Citation

```
@inproceedings{10.1145/3394171.3413528,
author = {Sridhar, Advaith and Ganesan, Rohith Gandhi and Kumar, Pratyush and Khapra, Mitesh},
title = {INCLUDE: A Large Scale Dataset for Indian Sign Language Recognition},
year = {2020},
isbn = {9781450379885},
publisher = {Association for Computing Machinery},
doi = {10.1145/3394171.3413528},
numpages = {10},
series = {MM '20}
}
```

Owner

  • Name: AI4Bhārat
  • Login: AI4Bharat
  • Kind: organization
  • Email: opensource@ai4bharat.org
  • Location: India

Artificial-Intelligence-For-Bhārat : Building open-source AI solutions for India!

GitHub Events

Total
  • Watch event: 6
  • Issue comment event: 2
  • Fork event: 3
Last Year
  • Watch event: 6
  • Issue comment event: 2
  • Fork event: 3

Issues and Pull Requests

Last synced: 9 months ago

All Time
  • Total issues: 4
  • Total pull requests: 6
  • Average time to close issues: N/A
  • Average time to close pull requests: 10 days
  • Total issue authors: 3
  • Total pull request authors: 3
  • Average comments per issue: 1.0
  • Average comments per pull request: 0.17
  • Merged pull requests: 5
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
  • swaptr (2)
  • Parag0506 (1)
  • Vintern03 (1)
Pull Request Authors
  • roshni-poddar (3)
  • grohith327 (2)
  • sabdur (1)
Top Labels
Issue Labels
Pull Request Labels

Dependencies

requirements.txt pypi
  • mediapipe *
  • scikit-learn *
  • timm *
  • torch *
  • tqdm *
  • transformers *
  • xgboost *