Data

Tools

Indexes

Applications

Experiments

Open Source Science

clover

Offical PyTorch implementation of Clover: Towards A Unified Video-Language Alignment and Fusion Model (CVPR2023)

https://github.com/leeyn-43/clover

Science Score: 54.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ✓
    CITATION.cff file
    Found CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ✓
    Academic publication links
    Links to: arxiv.org
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (5.1%) to scientific vocabulary
Last synced: 6 months ago · JSON representation ·

Repository

Offical PyTorch implementation of Clover: Towards A Unified Video-Language Alignment and Fusion Model (CVPR2023)

Basic Info
  • Host: GitHub
  • Owner: LeeYN-43
  • License: apache-2.0
  • Language: Python
  • Default Branch: main
  • Homepage:
  • Size: 1.65 MB
Statistics
  • Stars: 41
  • Watchers: 3
  • Forks: 4
  • Open Issues: 3
  • Releases: 0
Created over 3 years ago · Last pushed about 3 years ago
Metadata Files
Readme License Citation

README.md

Clover

Offical PyTorch implementation of Clover: Towards A Unified Video-Language Alignment and Fusion Model [arXiv] Overview

Update

(2022-8-18) release pretrain / finetune code and configs

To Do

  • [x] Release pretrain code
  • [x] Release pretrain config
  • [ ] Release pretrain model
  • [x] Release finetune code
  • [x] Release finetune configs
  • [ ] Release finetune model
  • [ ] Release installation and usage command

Citation

If you find this work useful in your research, please consider cite:

@article{huang2022clover,
title={Clover: Towards A Unified Video-Language Alignment and Fusion Model},
author={Huang, Jingjia and Li, Yinan and Feng, Jiashi, Xinglong Wu, Sun, Xiaoshuai and Ji, Rongrong},
journal={arXiv preprint arXiv:2207.07885},
year={2022}
}

Acknowledgements

Thanks the contribution of mmaction2 and awesome PyTorch team.

Citation (CITATION.cff) 

cff-version: 1.2.0
message: "If you use this software, please cite it as below."
authors:
  - name: "MMAction2 Contributors"
title: "OpenMMLab's Next Generation Video Understanding Toolbox and Benchmark"
date-released: 2020-07-21
url: "https://github.com/open-mmlab/mmaction2"
license: Apache-2.0

GitHub Events

Total
  • Watch event: 1
Last Year
  • Watch event: 1

Dependencies

requirements/build.txt pypi
  • numpy *
  • torch >=1.3
requirements/docs.txt pypi
  • einops *
  • opencv-python *
  • recommonmark *
  • scipy *
  • sphinx ==4.0.2
  • sphinx_markdown_tables *
  • sphinx_rtd_theme ==0.5.2
requirements/mminstall.txt pypi
  • mmcv-full >=1.3.1
requirements/optional.txt pypi
  • PyTurboJPEG *
  • av *
  • decord >=0.4.1
  • einops *
  • imgaug *
  • librosa *
  • lmdb *
  • moviepy *
  • onnx *
  • onnxruntime *
  • pims *
  • timm *
requirements/readthedocs.txt pypi
  • mmcv *
  • titlecase *
  • torch *
  • torchvision *
requirements/runtime.txt pypi
  • Pillow *
  • matplotlib *
  • numpy *
  • opencv-contrib-python *
requirements/tests.txt pypi
  • coverage * test
  • flake8 * test
  • interrogate * test
  • isort ==4.3.21 test
  • pytest * test
  • pytest-runner * test
  • xdoctest >=0.10.0 test
  • yapf * test
requirements.txt pypi
setup.py pypi