statcan-dialogue-dataset
The StatCan Dialogue Dataset: Retrieving Data Tables through Conversations with Genuine Intents
Science Score: 54.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
✓CITATION.cff file
Found CITATION.cff file -
✓codemeta.json file
Found codemeta.json file -
✓.zenodo.json file
Found .zenodo.json file -
○DOI references
-
✓Academic publication links
Links to: arxiv.org -
○Academic email domains
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (14.3%) to scientific vocabulary
Repository
The StatCan Dialogue Dataset: Retrieving Data Tables through Conversations with Genuine Intents
Basic Info
- Host: GitHub
- Owner: McGill-NLP
- Language: Python
- Default Branch: main
- Homepage: https://mcgill-nlp.github.io/statcan-dialogue-dataset
- Size: 22 MB
Statistics
- Stars: 9
- Watchers: 4
- Forks: 2
- Open Issues: 0
- Releases: 5
Metadata Files
README.md
This repository contains the code for our project. For more detailed information, instructions on requesting access, API user guide and documentation, please visit the website. You can find useful links above. A quickstart is provided below.
Quickstart
First, you need to request access (please go to the main webpage for more information).
Then, you can install our Python library to load the dataset:
python
pip install statcan-dialogue-dataset
Now, inside Python, you can use various functions to work with the data:
```python import statcandialoguedataset as sdd
Download the dataset (from dataverse)
sdd.downloaddataverse("yourapi_token")
Alternatively, Download from huggingface
sdd.downloadhuggingface("yourapi_token")
Extract ZIP into ~/.statcandialoguedataset/
sdd.extracttaskdatazip(removezip=True)
Load task specific split for a specific language
trainret = sdd.loadtask_data(task="retrieval", split="train", lang="en")
Load all task conversations
taskconversations = sdd.loadtask_conversations()
Load table metadata
table = sdd.metadata.Table.from_code(10100002)
Get subjects or surveys
subjects = table.getsubjects() surveys = table.getsurveys() ```
For more information, head to the Core API Reference page.
Reproduce paper results
The full eacl_code directory contains the code used to produce the results in the paper. To reproduce the results, start by reading the README.md file in the eacl_code directory.
StatCan resources
You may find the following external resources useful: * Web Data Service User Guide * Web Data Service API * Developer homepage
Citation
If you use our dataset, please cite our conference paper:
bibtex
@inproceedings{lu-etal-2023-statcan,
title = "The {S}tat{C}an Dialogue Dataset: Retrieving Data Tables through Conversations with Genuine Intents",
author = "Lu, Xing Han and
Reddy, Siva and
de Vries, Harm",
booktitle = "Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics",
month = may,
year = "2023",
address = "Dubrovnik, Croatia",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/2304.01412",
pages = "2799--2829",
}
Owner
- Name: McGill NLP
- Login: McGill-NLP
- Kind: organization
- Location: Canada
- Website: https://mcgill-nlp.github.io/
- Twitter: McGill_NLP
- Repositories: 28
- Profile: https://github.com/McGill-NLP
Research group within McGill University and Mila focusing on various topics in natural language processing.
Citation (CITATION.cff)
cff-version: "1.2.0"
date-released: 2023-05-02
message: "If you use our dataset, models or other aspects of our work, please cite the paper."
authors:
- family-names: "Lu"
given-names: "Xing Han"
- family-names: "Reddy"
given-names: "Siva"
- family-names: "de Vries"
given-names: "Harm"
title: Statcan Dialogue Dataset
doi: "10.48550/arXiv.2304.01412"
url: "https://arxiv.org/abs/2304.01412"
preferred-citation:
type: conference-paper
authors:
- family-names: "Lu"
given-names: "Xing Han"
- family-names: "Reddy"
given-names: "Siva"
- family-names: "de Vries"
given-names: "Harm"
title: "The StatCan Dialogue Dataset: Retrieving Data Tables through Conversations with Genuine Intents"
year: 2023
month: 05
booktitle: "Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics"
start: 2799
end: 2829
doi: "10.48550/arXiv.2304.01412"
url: "https://arxiv.org/abs/2304.01412"
GitHub Events
Total
- Push event: 2
- Pull request review comment event: 1
- Pull request event: 4
- Fork event: 1
Last Year
- Push event: 2
- Pull request review comment event: 1
- Pull request event: 4
- Fork event: 1
Issues and Pull Requests
Last synced: about 1 year ago
All Time
- Total issues: 0
- Total pull requests: 6
- Average time to close issues: N/A
- Average time to close pull requests: 4 days
- Total issue authors: 0
- Total pull request authors: 2
- Average comments per issue: 0
- Average comments per pull request: 0.0
- Merged pull requests: 6
- Bot issues: 0
- Bot pull requests: 0
Past Year
- Issues: 0
- Pull requests: 2
- Average time to close issues: N/A
- Average time to close pull requests: 1 minute
- Issue authors: 0
- Pull request authors: 1
- Average comments per issue: 0
- Average comments per pull request: 0.0
- Merged pull requests: 2
- Bot issues: 0
- Bot pull requests: 0
Top Authors
Issue Authors
Pull Request Authors
- xhluca (5)
- HadiaSamil (4)
Top Labels
Issue Labels
Pull Request Labels
Packages
- Total packages: 1
-
Total downloads:
- pypi 20 last-month
- Total dependent packages: 0
- Total dependent repositories: 0
- Total versions: 4
- Total maintainers: 1
pypi.org: statcan-dialogue-dataset
The Statcan Dialogue Dataset
- Homepage: https://github.com/McGill-NLP/statcan-dialogue-dataset
- Documentation: https://statcan-dialogue-dataset.readthedocs.io/
- License: MIT License
-
Latest release: 0.2.0
published about 3 years ago