https://github.com/amazon-science/street-reasoning
STREET: a multi-task and multi-step reasoning dataset
Science Score: 26.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
✓codemeta.json file
Found codemeta.json file -
✓.zenodo.json file
Found .zenodo.json file -
○DOI references
-
○Academic publication links
-
○Academic email domains
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (6.2%) to scientific vocabulary
Repository
STREET: a multi-task and multi-step reasoning dataset
Basic Info
Statistics
- Stars: 22
- Watchers: 3
- Forks: 4
- Open Issues: 3
- Releases: 0
Metadata Files
README.md
STREET: a Multi-Task Structured Reasoning and Explanation Benchmark
Running Geneartion Script
This repository contains the annotations and script to generate the data for the STREET dataset.
Requirements:
- Python 3
Execute the following python script:
python run_street_data_generation.py
The script will download some of the original datasets in which STREET is built and merge them with our reasoning and explanation annotations.
The final data will be contained within the ./data/$STREET_TASK$/reasoning_annotated_$SPLIT$.jsonl files in JSONL format.
Citation
@inproceedings{
ribeiro2023street,
title={{STREET}: A {MULTI}-{TASK} {STRUCTURED} {REASONING} {AND} {EXPLANATION} {BENCHMARK}},
author={Danilo Neves Ribeiro and Shen Wang and Xiaofei Ma and Henghui Zhu and Rui Dong and Deguang Kong and Juliette Burger and Anjelica Ramos and zhiheng huang and William Yang Wang and George Karypis and Bing Xiang and Dan Roth},
booktitle={International Conference on Learning Representations},
year={2023},
url={https://openreview.net/forum?id=1C_kSW1-k0}
}
Owner
- Name: Amazon Science
- Login: amazon-science
- Kind: organization
- Website: https://amazon.science
- Twitter: AmazonScience
- Repositories: 80
- Profile: https://github.com/amazon-science
GitHub Events
Total
- Issues event: 1
- Watch event: 4
- Issue comment event: 1
Last Year
- Issues event: 1
- Watch event: 4
- Issue comment event: 1
Issues and Pull Requests
Last synced: over 1 year ago
All Time
- Total issues: 4
- Total pull requests: 0
- Average time to close issues: 2 days
- Average time to close pull requests: N/A
- Total issue authors: 4
- Total pull request authors: 0
- Average comments per issue: 1.0
- Average comments per pull request: 0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0
Past Year
- Issues: 2
- Pull requests: 0
- Average time to close issues: N/A
- Average time to close pull requests: N/A
- Issue authors: 2
- Pull request authors: 0
- Average comments per issue: 0.0
- Average comments per pull request: 0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0
Top Authors
Issue Authors
- tom68-ll (1)
- ufo526ufo (1)
- yifan-h (1)
- davidfan1224 (1)