swarm-distillation-zero-shot
Science Score: 54.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
✓CITATION.cff file
Found CITATION.cff file -
✓codemeta.json file
Found codemeta.json file -
✓.zenodo.json file
Found .zenodo.json file -
○DOI references
-
✓Academic publication links
Links to: arxiv.org -
○Academic email domains
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (6.2%) to scientific vocabulary
Repository
Basic Info
- Host: GitHub
- Owner: violet-zct
- License: apache-2.0
- Language: Python
- Default Branch: master
- Size: 78 MB
Statistics
- Stars: 22
- Watchers: 2
- Forks: 2
- Open Issues: 0
- Releases: 0
Metadata Files
README.md
Prompt Consistency for Zero-Shot Task Generalization
This is the official implementation of the paper:
Prompt Consistency for Zero-Shot Task Generalization
Chunting Zhou*, Junxian He*, Xuezhe Ma, Taylor Berg-Kirkpatrick, Graham Neubig
Preprint 2022
Dependencies
This repo is a fork of the huggingface transformers repo (forked on Oct 29, 2021), and the code is tested on PyTorch 1.9.0. Please follow the instructions below to install dependencies after you set up PyTorch:
```bash git clone git@github.com:violet-zct/swarm-distillation-zero-shot.git cd swarm-distillation-zero-shot
install transformers from this repo
pip install -e .
install other requirements
pip install datasets ```
Usage
We are still working on cleaning the code, for early usage please refer to exps/ttt/final_3B.sh for an example training script that we used to tune the T0-3B model.
Citation
@article{zhou2022prompt,
title={Prompt Consistency for Zero-Shot Task Generalization},
author={Chunting Zhou and Junxian He and Xuezhe Ma and Taylor Berg-Kirkpatrick and Graham Neubig},
journal={ArXiv},
year={2022},
volume={abs/2205.00049}
}
Owner
- Name: Chunting Zhou
- Login: violet-zct
- Kind: user
- Website: https://violet-zct.github.io/
- Repositories: 7
- Profile: https://github.com/violet-zct
Graduate Student in LTI Carnegie Mellon University
Citation (CITATION.cff)
cff-version: "1.2.0"
date-released: 2020-10
message: "If you use this software, please cite it using these metadata."
title: "Transformers: State-of-the-Art Natural Language Processing"
url: "https://github.com/huggingface/transformers"
authors:
- family-names: Wolf
given-names: Thomas
- family-names: Debut
given-names: Lysandre
- family-names: Sanh
given-names: Victor
- family-names: Chaumond
given-names: Julien
- family-names: Delangue
given-names: Clement
- family-names: Moi
given-names: Anthony
- family-names: Cistac
given-names: Perric
- family-names: Ma
given-names: Clara
- family-names: Jernite
given-names: Yacine
- family-names: Plu
given-names: Julien
- family-names: Xu
given-names: Canwen
- family-names: "Le Scao"
given-names: Teven
- family-names: Gugger
given-names: Sylvain
- family-names: Drame
given-names: Mariama
- family-names: Lhoest
given-names: Quentin
- family-names: Rush
given-names: "Alexander M."
preferred-citation:
type: conference-paper
authors:
- family-names: Wolf
given-names: Thomas
- family-names: Debut
given-names: Lysandre
- family-names: Sanh
given-names: Victor
- family-names: Chaumond
given-names: Julien
- family-names: Delangue
given-names: Clement
- family-names: Moi
given-names: Anthony
- family-names: Cistac
given-names: Perric
- family-names: Ma
given-names: Clara
- family-names: Jernite
given-names: Yacine
- family-names: Plu
given-names: Julien
- family-names: Xu
given-names: Canwen
- family-names: "Le Scao"
given-names: Teven
- family-names: Gugger
given-names: Sylvain
- family-names: Drame
given-names: Mariama
- family-names: Lhoest
given-names: Quentin
- family-names: Rush
given-names: "Alexander M."
booktitle: "Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations"
month: 10
start: 38
end: 45
title: "Transformers: State-of-the-Art Natural Language Processing"
year: 2020
publisher: "Association for Computational Linguistics"
url: "https://www.aclweb.org/anthology/2020.emnlp-demos.6"
address: "Online"
GitHub Events
Total
- Fork event: 1
Last Year
- Fork event: 1
Packages
- Total packages: 1
- Total downloads: unknown
- Total dependent packages: 0
- Total dependent repositories: 0
- Total versions: 72
proxy.golang.org: github.com/violet-zct/swarm-distillation-zero-shot
- Documentation: https://pkg.go.dev/github.com/violet-zct/swarm-distillation-zero-shot#section-documentation
- License: apache-2.0
-
Latest release: v4.11.3+incompatible
published over 4 years ago