https://github.com/amazon-science/prompt-pretraining
Official implementation for the paper "Prompt Pre-Training with Over Twenty-Thousand Classes for Open-Vocabulary Visual Recognition"
Science Score: 23.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
✓codemeta.json file
Found codemeta.json file -
○.zenodo.json file
-
○DOI references
-
✓Academic publication links
Links to: arxiv.org -
○Committers with academic emails
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (3.1%) to scientific vocabulary
Keywords from Contributors
Repository
Official implementation for the paper "Prompt Pre-Training with Over Twenty-Thousand Classes for Open-Vocabulary Visual Recognition"
Basic Info
Statistics
- Stars: 258
- Watchers: 5
- Forks: 9
- Open Issues: 7
- Releases: 0
Metadata Files
README.md
Prompt Pre-Training with Over Twenty-Thousand Classes for Open-Vocabulary Visual Recognition
"Scaling up prompt learning on ImageNet-21K achieves SOTA on 21 downstream datasets."
Prompt Pre-Training with Over Twenty-Thousand Classes for Open-Vocabulary Visual Recognition
Shuhuai Ren, Aston Zhang, Yi Zhu, Shuai Zhang, Shuai Zheng, Mu Li, Alex Smola, Xu Sun
:rocket: News
- (Jul 11, 2023)
- Inference demo for object detection in Jupyter.
- (May 31, 2023)
- Inference demo for image classification in Google Colab.
- (Mar 22, 2023)
- Codes for prompt pretraining (POMP) on ImageNet-21K, cross-dataset and cross-task evaluation.
- Checkpoints of pre-trained POMP prompts, segmentation backbones, and detection backbones.
Highlights
Main Contributions
1) We introduce a prompt pre-training method POMP, which fisrt enables prompt learning on large-scale datasets like ImageNet-21K with over twenty-thousand classes. 2) POMP is memory and computation efficient. Compared with previous methods like CoOp, it achieves comparable accuracy on ImageNet-1K with only 19\% GPU memory and 50\% training time. 3) POMP achieves new SOTAs on various open-vocabulary visual recognition datasets and tasks.
Installation
For installation and other package requirements, please follow the instructions detailed in INSTALL.md.
Data preparation
Please follow the instructions at DATASETS.md to prepare all datasets.
Pre-trained Models
Please follow the instructions at MODELS.md to prepare all pre-trained models.
Training and Evaluation
Please refer to the RUN.md for detailed instructions on training, evaluating and reproducing the results.
Contact
If you have any questions, please feel free to create an issue on this repository.
Citation
If you find this code useful for your research, please consider citing:
@article{ren2023pomp,
title={Prompt Pre-Training with Twenty-Thousand Classes for Open-Vocabulary Visual Recognition},
author={Ren, Shuhuai and Zhang, Aston and Zhu, Yi and Zhang, Shuai and Zheng, Shuai and Li, Mu and Smola, Alex and Sun, Xu},
journal={arXiv preprint arXiv:2304.04704},
year={2023}
}
Acknowledgements
Our code is based on CoOp, MaPLe, Dassl, Detic and ZSSeg repositories. We thank the authors for releasing their code.
Owner
- Name: Amazon Science
- Login: amazon-science
- Kind: organization
- Website: https://amazon.science
- Twitter: AmazonScience
- Repositories: 80
- Profile: https://github.com/amazon-science
GitHub Events
Total
- Watch event: 11
- Fork event: 1
Last Year
- Watch event: 11
- Fork event: 1
Committers
Last synced: about 1 year ago
Top Committers
| Name | Commits | |
|---|---|---|
| Shuhuai Ren | 7****9@q****m | 2 |
| Aston Zhang | 2****g | 2 |
| Amazon GitHub Automation | 5****o | 1 |
| Aston Zhang | a****z@a****m | 1 |
Committer Domains (Top 20 + Academic)
Issues and Pull Requests
Last synced: about 1 year ago
All Time
- Total issues: 16
- Total pull requests: 6
- Average time to close issues: 6 days
- Average time to close pull requests: 21 days
- Total issue authors: 8
- Total pull request authors: 3
- Average comments per issue: 2.31
- Average comments per pull request: 0.0
- Merged pull requests: 2
- Bot issues: 0
- Bot pull requests: 2
Past Year
- Issues: 0
- Pull requests: 0
- Average time to close issues: N/A
- Average time to close pull requests: N/A
- Issue authors: 0
- Pull request authors: 0
- Average comments per issue: 0
- Average comments per pull request: 0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0
Top Authors
Issue Authors
- zhszysrh (4)
- taoxinlily (2)
- 100rab-S (2)
- Jiaxzhao (1)
- nhussein (1)
- Xiloy (1)
- YaoShunyu19 (1)
Pull Request Authors
- RenShuhuai-Andy (3)
- dependabot[bot] (2)
- eltociear (1)