Data

Tools

Indexes

Applications

Experiments

Open Source Science

https://github.com/causallearning/est

https://github.com/causallearning/est

Science Score: 26.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (7.8%) to scientific vocabulary
Last synced: 10 months ago · JSON representation

Repository

Basic Info
  • Host: GitHub
  • Owner: CausalLearning
  • Language: Python
  • Default Branch: main
  • Size: 49.8 KB
Statistics
  • Stars: 113
  • Watchers: 0
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Created almost 2 years ago · Last pushed almost 2 years ago
Metadata Files
Readme

readme.md

Expression Snippet Transformer for Robust Video-based Facial Expression Recognition

Pytorch implementation of paper:

Expression Snippet Transformer for Robust Video-based Facial Expression Recognition

Content

Dependencies

Python Version: 3.7.9

Required packages are listed in requirements.txt. You can install them by running:

pip install -r requirements.txt

Code and Data Preparation

  1. Download the code from this repository and download the pre-trained ResNet-18 from Baidu Drive (1req)

  2. Prepare the dataset.

You need to unified the input video length to 105 frames. Make sure the data structure is as below.

├── DFEW └── videos └── 14400 ├── 000.jpg ├── 001.jpg ├── 002.jpg ├── ... └── 14401 ├── 000.jpg ├── 001.jpg ├── 002.jpg ├── ... └── data_list ├── Train_DFEW_all_clip.txt ├── Train_DFEW_all_clip_set_2.txt ├── Train_DFEW_all_clip_set_3.txt ├── Train_DFEW_all_clip_set_4.txt ├── Train_DFEW_all_clip_set_5.txt

Training

You can use the following command to train:

python main.py --train_video_root /data/Your_Path/data_path/DFEW/videos --train_list_root /data/Your_Path/data_path/DFEW/data_list/Train_DFEW_all_clip_set_2.txt --test_video_root /data/Your_Path/data_path/DFEW/videos --test_list_root /data/Your_Path/data_path/DFEW/data_list/Test_DFEW_all_clip_set_2.txt --dataset_name DFEW --name dfew_transformer --gpu_ids 3 --batch 8 --epochs_count 160

Testing

You can evaluate a trained model by running:

python main.py --train_video_root /data/Your_Path/data_path/DFEW/videos --train_list_root /data/Your_Path/data_path/DFEW/data_list/Train_DFEW_all_clip_set_1.txt --test_video_root /data/Your_Path/data_path/DFEW/videos --test_list_root /data/Your_Path/data_path/DFEW/data_list/Test_DFEW_all_clip_set_1.txt --dataset_name DFEW --name dfew_transformer --gpu_ids 3 --batch 8 --phase test --eval_model_path MODEL_PATH

Here, MODEL_PATH denotes for the path of the trained model.

You can download our trained model on DFEW from Baidu Drive (owu2)

IF YOU HAVE ANY PROBLEM, PLEASE CONTACT wangwenbin@cug.edu.cn OR COMMIT ISSUES

Owner

  • Name: CausalLearning
  • Login: CausalLearning
  • Kind: organization

GitHub Events

Total
  • Watch event: 65
Last Year
  • Watch event: 65

Dependencies

requirements.txt pypi
  • Jinja2 ==3.0.2
  • Keras-Preprocessing ==1.1.2
  • Markdown ==3.3.3
  • MarkupSafe ==2.0.1
  • Pillow ==8.1.0
  • PyWavelets ==1.1.1
  • PyYAML ==5.4.1
  • Pygments ==2.10.0
  • Send2Trash ==1.8.0
  • Shapely ==1.7.1
  • SoundFile ==0.10.3.post1
  • Werkzeug ==1.0.1
  • absl-py ==0.11.0
  • albumentations ==1.1.0
  • appdirs ==1.4.4
  • argcomplete ==1.12.3
  • argon2-cffi ==21.1.0
  • astunparse ==1.6.3
  • attrs ==21.2.0
  • audioread ==2.1.9
  • av ==8.0.3
  • backcall ==0.2.0
  • bleach ==4.1.0
  • cached-property ==1.5.2
  • cachetools ==4.2.1
  • certifi ==2021.5.30
  • cffi ==1.14.5
  • chardet ==4.0.0
  • cycler ==0.10.0
  • debugpy ==1.5.1
  • decorator ==4.4.2
  • defusedxml ==0.7.1
  • docopt ==0.6.2
  • efficientnet-pytorch ==0.6.3
  • einops ==0.3.2
  • entrypoints ==0.3
  • et-xmlfile ==1.0.1
  • facenet-pytorch ==2.5.2
  • fastprogress ==1.0.0
  • flatbuffers ==1.12
  • ftfy ==6.0.3
  • fvcore ==0.1.5.post20210515
  • gast ==0.3.3
  • google-auth ==1.25.0
  • google-auth-oauthlib ==0.4.2
  • google-pasta ==0.2.0
  • graphviz ==0.16
  • grpcio ==1.32.0
  • h5py ==2.10.0
  • idna ==2.10
  • imageio ==2.9.0
  • imgaug ==0.4.0
  • importlib-metadata ==3.4.0
  • iopath ==0.1.8
  • ipykernel ==6.5.0
  • ipython ==7.29.0
  • ipython-genutils ==0.2.0
  • ipywidgets ==7.6.5
  • jdcal ==1.4.1
  • jedi ==0.18.0
  • joblib ==1.0.1
  • jsonpatch ==1.32
  • jsonpointer ==2.1
  • jsonschema ==4.1.2
  • jupyter-client ==7.0.6
  • jupyter-core ==4.9.1
  • jupyterlab-pygments ==0.1.2
  • jupyterlab-widgets ==1.0.2
  • keras ==2.8.0
  • kiwisolver ==1.3.1
  • librosa ==0.8.1
  • linformer ==0.2.1
  • llvmlite ==0.36.0
  • matplotlib ==3.3.4
  • matplotlib-inline ==0.1.3
  • mistune ==0.8.4
  • mkl-fft ==1.2.0
  • mkl-random ==1.2.0
  • mkl-service ==2.3.0
  • munch ==2.5.0
  • nbclient ==0.5.4
  • nbconvert ==6.2.0
  • nbformat ==5.1.3
  • nest-asyncio ==1.5.1
  • networkx ==2.5
  • notebook ==6.4.5
  • numba ==0.53.1
  • numpy ==1.19.5
  • oauthlib ==3.1.0
  • olefile ==0.46
  • opencv-python ==4.5.1.48
  • opencv-python-headless ==4.5.3.56
  • openpyxl ==3.0.6
  • opt-einsum ==3.3.0
  • packaging ==21.0
  • pandas ==1.2.2
  • pandocfilters ==1.5.0
  • parso ==0.8.2
  • pexpect ==4.8.0
  • pickleshare ==0.7.5
  • pipreqs ==0.4.10
  • pooch ==1.4.0
  • portalocker ==2.3.0
  • pretrainedmodels ==0.7.4
  • prometheus-client ==0.12.0
  • prompt-toolkit ==3.0.21
  • protobuf ==3.14.0
  • ptflops ==0.6.5
  • ptyprocess ==0.7.0
  • pyasn1 ==0.4.8
  • pyasn1-modules ==0.2.8
  • pycparser ==2.20
  • pyparsing ==2.4.7
  • pyrsistent ==0.18.0
  • python-dateutil ==2.8.1
  • pytorch-warmup ==0.0.4
  • pytz ==2021.1
  • pyzmq ==22.1.0
  • qudida ==0.0.4
  • regex ==2022.1.18
  • requests ==2.25.1
  • requests-oauthlib ==1.3.0
  • resampy ==0.2.2
  • rsa ==4.7
  • scikit-learn ==1.0.1
  • scipy ==1.6.0
  • seaborn ==0.11.1
  • segmentation-models-pytorch ==0.2.0
  • simplejson ==3.17.2
  • six ==1.15.0
  • tabulate ==0.8.9
  • tensorboard ==2.4.1
  • tensorboard-logger ==0.1.0
  • tensorboard-plugin-wit ==1.8.0
  • tensorboardX ==2.4.1
  • tensorflow ==2.4.1
  • tensorflow-estimator ==2.4.0
  • termcolor ==1.1.0
  • terminado ==0.12.1
  • testpath ==0.5.0
  • thop ==0.0.31.post2005241907
  • threadpoolctl ==2.1.0
  • tifffile ==2021.2.1
  • timer ==0.1.2
  • timm ==0.4.12
  • torch ==1.7.1
  • torchsummary ==1.5.1
  • torchvision ==0.8.2
  • tornado ==6.1
  • tqdm ==4.62.2
  • traitlets ==5.1.1
  • ttach ==0.0.3
  • typing-extensions *
  • urllib3 ==1.26.3
  • visdom ==0.1.8.9
  • vit-pytorch ==0.20.8
  • wcwidth ==0.2.5
  • webencodings ==0.5.1
  • websocket-client ==1.1.0
  • widgetsnbextension ==3.5.2
  • wrapt ==1.12.1
  • yacs ==0.1.8
  • yarg ==0.1.9
  • zipp ==3.4.0