https://github.com/andstor/reinforced-code-generation
Science Score: 13.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
✓codemeta.json file
Found codemeta.json file -
○.zenodo.json file
-
○DOI references
-
○Academic publication links
-
○Academic email domains
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (2.3%) to scientific vocabulary
Repository
Basic Info
- Host: GitHub
- Owner: andstor
- Language: Python
- Default Branch: main
- Homepage: https://wandb.ai/andstor/trlx/runs/jnwpv7tm?workspace=user-andstor
- Size: 68.4 KB
Statistics
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
- Releases: 0
Metadata Files
README.md
reinforced-code-generation
Setup accelerate:
bash
accelerate config
Train with TRL:
bash
accelerate launch run_trl.py \
--do_train \
--dataset_name openai_humaneval \
--dataset_config_name openai_humaneval \
--text_column_name prompt \
--model_name_or_path gpt2-xl \
--num_train_epochs 2 \
--per_device_train_batch_size 64 \
--forward_batch_size 16 \
--output_dir output \
--seed 42 \
--preprocessing_num_workers 8 \
--max_new_tokens 512 \
--report_to wandb
Train with TRL for code:
bash
accelerate launch run_trl.py \
--do_train \
--dataset_name code_x_glue_tc_text_to_code \
--dataset_config_name default \
--text_column_name code \
--split_examples \
--model_name_or_path gpt2-xl \
--num_train_epochs 2 \
--per_device_train_batch_size 64 \
--forward_batch_size 1 \
--output_dir output \
--seed 42 \
--preprocessing_num_workers 8 \
--max_new_tokens 512 \
--report_to wandb
Train with TRL-X:
bash
accelerate launch run_trlx.py \
--do_train \
--max_train_samples 100 \
--do_eval \
--max_eval_samples 100 \
--dataset_name code_search_net \
--text_column_name python \
--output_dir output \
--seed 42
Add Antlr4 to Java classpath:
bash
export CLASSPATH=".:/opt/homebrew/Cellar/antlr/4.11.1/antlr-4.11.1-complete.jar:$CLASSPATH"
Generate Python3 and Java parser and lexer for the Python3 grammar:
bash
make -f python3.mk all
`
Show parse tree in a GUI:
bash
make -f python3.mk grun < test.py
Owner
- Name: André Storhaug
- Login: andstor
- Kind: user
- Location: Trondheim 🇳🇴
- Company: NTNU
- Website: https://andre.storhaug.no
- Repositories: 87
- Profile: https://github.com/andstor
🎓 CS PhD student @ Norwegian University of Science and Technology (NTNU)
GitHub Events
Total
Last Year
Issues and Pull Requests
Last synced: over 1 year ago
All Time
- Total issues: 0
- Total pull requests: 0
- Average time to close issues: N/A
- Average time to close pull requests: N/A
- Total issue authors: 0
- Total pull request authors: 0
- Average comments per issue: 0
- Average comments per pull request: 0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0
Past Year
- Issues: 0
- Pull requests: 0
- Average time to close issues: N/A
- Average time to close pull requests: N/A
- Issue authors: 0
- Pull request authors: 0
- Average comments per issue: 0
- Average comments per pull request: 0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0
Top Authors
Issue Authors
Pull Request Authors
Top Labels
Issue Labels
Pull Request Labels
Dependencies
- transformers main