https://github.com/carperai/instructgpt
For experiments involving instruct gpt. Currently used for documenting open research questions.
Science Score: 13.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
✓codemeta.json file
Found codemeta.json file -
○.zenodo.json file
-
○DOI references
-
○Academic publication links
-
○Academic email domains
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (1.9%) to scientific vocabulary
Last synced: 10 months ago
·
JSON representation
Repository
For experiments involving instruct gpt. Currently used for documenting open research questions.
Basic Info
- Host: GitHub
- Owner: CarperAI
- License: mit
- Default Branch: main
- Size: 5.86 KB
Statistics
- Stars: 71
- Watchers: 9
- Forks: 4
- Open Issues: 25
- Releases: 0
Created over 3 years ago
· Last pushed over 3 years ago
Metadata Files
Readme
License
README.md
BigModelName
This repository is for open-questions relating to RLHF and InstructGPT as pertaining to BigModelName.
Open Questions
- What is the preference rate of PPO vs PPO-Ptx? Why was 27.8 chosen as the mixing factor between the pre-training gradients and the PPO gradients?
- What do the gradient norms and gradient noise scales look like for PPO grads vs pre-training grads?
- How important is SFT pretraining on human-written completions?
Owner
- Name: CarperAI
- Login: CarperAI
- Kind: organization
- Repositories: 15
- Profile: https://github.com/CarperAI
GitHub Events
Total
- Fork event: 1
Last Year
- Fork event: 1
Issues and Pull Requests
Last synced: over 1 year ago
All Time
- Total issues: 27
- Total pull requests: 2
- Average time to close issues: N/A
- Average time to close pull requests: 6 minutes
- Total issue authors: 5
- Total pull request authors: 2
- Average comments per issue: 0.3
- Average comments per pull request: 0.0
- Merged pull requests: 2
- Bot issues: 0
- Bot pull requests: 0
Past Year
- Issues: 0
- Pull requests: 0
- Average time to close issues: N/A
- Average time to close pull requests: N/A
- Issue authors: 0
- Pull request authors: 0
- Average comments per issue: 0
- Average comments per pull request: 0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0
Top Authors
Issue Authors
- jon-tow (19)
- Makyab (2)
- LouisCastricato (2)
- jmerullo (1)
- taisazero (1)
Pull Request Authors
- jon-tow (1)
- cat-state (1)
Top Labels
Issue Labels
task (25)