https://github.com/adiehl96/facial
FACIAL: Synthesizing Dynamic Talking Face With Implicit Attribute Learning. ICCV, 2021.
Science Score: 10.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
○codemeta.json file
-
○.zenodo.json file
-
○DOI references
-
✓Academic publication links
Links to: arxiv.org -
○Academic email domains
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (7.5%) to scientific vocabulary
Last synced: 9 months ago
·
JSON representation
Repository
FACIAL: Synthesizing Dynamic Talking Face With Implicit Attribute Learning. ICCV, 2021.
Basic Info
Statistics
- Stars: 0
- Watchers: 0
- Forks: 1
- Open Issues: 0
- Releases: 0
Fork of zhangchenxu528/FACIAL
Created almost 4 years ago
· Last pushed almost 4 years ago
https://github.com/adiehl96/FACIAL/blob/main/
# FACIAL: Synthesizing Dynamic Talking Face with Implicit Attribute Learning
PyTorch implementation for the paper:
> **FACIAL: Synthesizing Dynamic Talking Face with Implicit Attribute Learning**
>
> Chenxu Zhang,
> Yifan Zhao,
> Yifei Huang,
> Ming Zeng,
> Saifeng Ni,
> Madhukar Budagavi,
> Xiaohu Guo
>
> ICCV 2021
>
> [[Paper]](https://arxiv.org/abs/2108.07938)
> [[Video]](https://www.youtube.com/watch?v=hl9ek3bUV1E)
> [[Website]](https://personal.utdallas.edu/~xguo/)
## Update: train a new person on Google Colab
[](https://colab.research.google.com/github/adiehl96/FACIAL/blob/main/facial_demo_train.ipynb)
## Run the test demo on Google Colab
[](https://colab.research.google.com/github/adiehl96/FACIAL/blob/main/facial_demo.ipynb)
## Requirements
- Python environment
```
conda create -n audio_face
conda activate audio_face
```
- ffmpeg
```
sudo apt-get install ffmpeg
```
- python packages
```
pip install -r requirements.txt
```
- you may add opencv by conda.
```
conda install opencv
```
## Citation
```
@inproceedings{zhang2021facial,
title={FACIAL: Synthesizing Dynamic Talking Face with Implicit Attribute Learning},
author={Zhang, Chenxu and Zhao, Yifan and Huang, Yifei and Zeng, Ming and Ni, Saifeng and Budagavi, Madhukar and Guo, Xiaohu},
booktitle={Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
pages={3867--3876},
year={2021}
}
```
## Acknowledgments
We use [Deep3DFaceReconstruction](https://github.com/microsoft/Deep3DFaceReconstructionh) for face reconstruction, [DeepSpeech](https://github.com/mozilla/DeepSpeech) and [VOCA](https://github.com/TimoBolkart/voca) for audio feature extraction, and [3dface](https://github.com/YadiraF/face3d) for face rendering. Rendering-to-video module borrows heavily from [everybody-dance-now](https://github.com/Lotayou/everybody_dance_now_pytorch).
Owner
- Name: Arne Diehl
- Login: adiehl96
- Kind: user
- Location: Nijmegen
- Repositories: 11
- Profile: https://github.com/adiehl96
Master student AI @ Radboud University, machine learning enthusiast, will hopefully automate my own job away
GitHub Events
Total
Last Year
Issues and Pull Requests
Last synced: 9 months ago
All Time
- Total issues: 0
- Total pull requests: 1
- Average time to close issues: N/A
- Average time to close pull requests: less than a minute
- Total issue authors: 0
- Total pull request authors: 1
- Average comments per issue: 0
- Average comments per pull request: 0.0
- Merged pull requests: 1
- Bot issues: 0
- Bot pull requests: 0
Past Year
- Issues: 0
- Pull requests: 0
- Average time to close issues: N/A
- Average time to close pull requests: N/A
- Issue authors: 0
- Pull request authors: 0
- Average comments per issue: 0
- Average comments per pull request: 0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0
Top Authors
Issue Authors
Pull Request Authors
- adiehl96 (1)