074-telme-teacher-leading-multimodal-fusion-network-for-emotion-recognition-in-conversation
Science Score: 13.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
✓codemeta.json file
Found codemeta.json file -
○.zenodo.json file
-
○DOI references
-
○Academic publication links
-
○Academic email domains
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (6.3%) to scientific vocabulary
Last synced: 10 months ago
·
JSON representation
Repository
Basic Info
- Host: GitHub
- Owner: SZU-AdvTech-2024
- Default Branch: main
- Size: 0 Bytes
Statistics
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 0
- Releases: 0
Created over 1 year ago
· Last pushed over 1 year ago
Metadata Files
Citation
https://github.com/SZU-AdvTech-2024/074-TelME-Teacher-leading-Multimodal-Fusion-Network-for-Emotion-Recognition-in-Conversation/blob/main/
# TelME: Teacher-leading Multimodal Fusion Network for Emotion Recognition in Conversation (NAACL 2024)
The overall flow of our model
## Requirements
Key Libraries
1. python 3.9
2. requirements.txt
## Datasets
Each data is split into train/dev/test in the [dataset folder](https://github.com/yuntaeyang/TelME/tree/main/dataset).(However, we do not provide video clip here.)
1. [MELD](https://github.com/declare-lab/MELD/)
2. [IEMOCAP](https://sail.usc.edu/iemocap/iemocap_publication.htm)
## Train
**for MELD**
```bash
python MELD/teacher.py
python MELD/student.py
python MELD/fusion.py
```
**for IEMOCAP**
```bash
python IEMOCAP/teacher.py
python IEMOCAP/student.py
python IEMOCAP/fusion.py
```
## Testing with pretrained TelME
- [Goole Drive](https://drive.google.com/file/d/1JIh77AqJ-mfME-nxv8r7hU3UZSrGukv0/view?usp=sharing)
- Unpack model.tar.gz and place each Save_model Folder within [MELD](https://github.com/yuntaeyang/TelME/tree/main/MELD) and [IEMOCAP](https://github.com/yuntaeyang/TelME/tree/main/IEMOCAP)
```
|- MELD/
| |- save_model/
|- ...
```
```
|- IEMOCAP/
| |- save_model/
|- ...
```
Running inference.py allows you to reproduce the results.
```bash
python MELD/inference.py
python IEMOCAP/inference.py
```
## Citation
```
@article{yun2024telme,
title={TelME: Teacher-leading Multimodal Fusion Network for Emotion Recognition in Conversation},
author={Yun, Taeyang and Lim, Hyunkuk and Lee, Jeonghwan and Song, Min},
journal={arXiv preprint arXiv:2401.12987},
year={2024}
}
```
Owner
- Name: SZU-AdvTech-2024
- Login: SZU-AdvTech-2024
- Kind: organization
- Repositories: 1
- Profile: https://github.com/SZU-AdvTech-2024
GitHub Events
Total
- Push event: 2
- Create event: 3
Last Year
- Push event: 2
- Create event: 3