https://github.com/amazon-science/auto-cot
Official implementation for "Automatic Chain of Thought Prompting in Large Language Models" (stay tuned & more will be updated)
Science Score: 23.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
✓codemeta.json file
Found codemeta.json file -
○.zenodo.json file
-
○DOI references
-
✓Academic publication links
Links to: arxiv.org -
○Committers with academic emails
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (9.9%) to scientific vocabulary
Keywords
Repository
Official implementation for "Automatic Chain of Thought Prompting in Large Language Models" (stay tuned & more will be updated)
Basic Info
- Host: GitHub
- Owner: amazon-science
- License: apache-2.0
- Language: Jupyter Notebook
- Default Branch: main
- Homepage: https://arxiv.org/abs/2210.03493
- Size: 56.6 KB
Statistics
- Stars: 1,830
- Watchers: 18
- Forks: 167
- Open Issues: 10
- Releases: 0
Topics
Metadata Files
README.md
Auto-CoT: Automatic Chain of Thought Prompting in Large Language Models (ICLR 2023)
Cheer AI up with the "let's think step by step" prompt? More plz. Let’s think not just step by step, but also one by one.
Auto-CoT uses more cheers & diversity to SAVE huge manual efforts in chain of thought prompt design, matching or even exceeding performance of manual design on GPT-3.
Check out our 25-page paper for more information.
Requirements
Python>=3.8
pip install torch==1.8.2+cu111 torchtext==0.9.2 -f https://download.pytorch.org/whl/lts/1.8/torch_lts.html
pip install -r requirements.txt
Datasets
Download the datasets from the following:
https://github.com/kojima-takeshi188/zero_shot_cot/tree/main/dataset
https://github.com/kojima-takeshi188/zero_shot_cot/tree/main/log
Quick Start
See try_cot.ipynb
Instructions
Construct Demos:
python run_demo.py \
--task multiarith \
--pred_file log/multiarith_zero_shot_cot.log \
--demo_save_dir demos/multiarith
Run inference:
python run_inference.py \
--dataset multiarith \
--demo_path demos/multiarith \
--output_dir experiment/multiarith
Citing Auto-CoT
@inproceedings{zhang2023automatic,
title={Automatic Chain of Thought Prompting in Large Language Models},
author={Zhang, Zhuosheng and Zhang, Aston and Li, Mu and Smola, Alex},
booktitle={The Eleventh International Conference on Learning Representations (ICLR 2023)},
year={2023}
}
Security
See CONTRIBUTING for more information.
License
This project is licensed under the Apache-2.0 License.
Owner
- Name: Amazon Science
- Login: amazon-science
- Kind: organization
- Website: https://amazon.science
- Twitter: AmazonScience
- Repositories: 80
- Profile: https://github.com/amazon-science
GitHub Events
Total
- Issues event: 2
- Watch event: 384
- Issue comment event: 1
- Fork event: 41
Last Year
- Issues event: 2
- Watch event: 384
- Issue comment event: 1
- Fork event: 41
Committers
Last synced: 9 months ago
Top Committers
| Name | Commits | |
|---|---|---|
| Zhuosheng Zhang | 7****1@q****m | 8 |
| Philip Dhingra | 1****d | 6 |
| Aston Zhang | a****5@g****m | 2 |
| Amazon GitHub Automation | 5****o | 1 |
| Aston Zhang | a****z@a****m | 1 |
Committer Domains (Top 20 + Academic)
Issues and Pull Requests
Last synced: 9 months ago
All Time
- Total issues: 9
- Total pull requests: 6
- Average time to close issues: about 1 month
- Average time to close pull requests: 15 days
- Total issue authors: 8
- Total pull request authors: 4
- Average comments per issue: 0.78
- Average comments per pull request: 0.0
- Merged pull requests: 3
- Bot issues: 0
- Bot pull requests: 0
Past Year
- Issues: 3
- Pull requests: 0
- Average time to close issues: N/A
- Average time to close pull requests: N/A
- Issue authors: 3
- Pull request authors: 0
- Average comments per issue: 0.33
- Average comments per pull request: 0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0
Top Authors
Issue Authors
- aramhamidi (1)
- adventurexw (1)
- Dhaizei (1)
- WEXIJUE (1)
- isspek (1)
- 15380400416 (1)
- GasolSun36 (1)
Pull Request Authors
- gyanendrarawat (3)
- cooelf (2)
- philipkd (1)
- Seongbuming (1)
Top Labels
Issue Labels
Pull Request Labels
Dependencies
- matplotlib *
- sentence-transformers *
- sklearn *