sdg-queries-evaluation-report

In this study we evaluate the accuracy of our Aurora SDG classification model version 5, to match research papers to the Sustainable Development Goals (SDG's) of the United Nations. The aim of this investigation is to be transparent about the accuracy of the model, because this model might get used in reporting and strategy analysis by University leadership. The measurements are based on a baseline, 'golden set', where researchers of the Aurora universities handpicked publications that relate to an SDG. We measured the Precision and Recall of the Aurora model, and relating it to our previous version of the model, and to the Elsevier SDG model.

https://github.com/aurora-network-global/sdg-queries-evaluation-report

Science Score: 75.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
    Found CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
    Found 4 DOI reference(s) in README
  • Academic publication links
    Links to: zenodo.org
  • Committers with academic emails
  • Institutional organization owner
    Organization aurora-network-global has institutional domain (aurora-universities.eu)
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (3.9%) to scientific vocabulary

Keywords

accuracy bibliometrics precision recall sdg sdgs
Last synced: 6 months ago · JSON representation ·

Repository

In this study we evaluate the accuracy of our Aurora SDG classification model version 5, to match research papers to the Sustainable Development Goals (SDG's) of the United Nations. The aim of this investigation is to be transparent about the accuracy of the model, because this model might get used in reporting and strategy analysis by University leadership. The measurements are based on a baseline, 'golden set', where researchers of the Aurora universities handpicked publications that relate to an SDG. We measured the Precision and Recall of the Aurora model, and relating it to our previous version of the model, and to the Elsevier SDG model.

Basic Info
  • Host: GitHub
  • Owner: Aurora-Network-Global
  • License: cc-by-4.0
  • Language: TeX
  • Default Branch: main
  • Homepage:
  • Size: 7.29 MB
Statistics
  • Stars: 1
  • Watchers: 2
  • Forks: 1
  • Open Issues: 1
  • Releases: 2
Topics
accuracy bibliometrics precision recall sdg sdgs
Created over 4 years ago · Last pushed over 4 years ago
Metadata Files
Readme License Citation

README.md

Evaluation on accuracy of mapping science to the United Nations' Sustainable Development Goals (SDGs) of the Aurora SDG queries

10.5281/zenodo.4917107

In this study we evaluate the accuracy of our Aurora SDG classification model version 5, to match research papers to the Sustainable Development Goals (SDG's) of the United Nations. The aim of this investigation is to be transparent about the accuracy of the model, because this model might get used in reporting and strategy analysis by University leadership. The measurements are based on a baseline, 'golden set', where researchers of the Aurora universities handpicked publications that relate to an SDG. We measured the Precision and Recall of the Aurora model, and relating it to our previous version of the model, and to the Elsevier SDG model.

bubble plots: improving precision and recall v4 vs v5

Owner

  • Name: Aurora Universities
  • Login: Aurora-Network-Global
  • Kind: organization

Citation (CITATION.cff)

# YAML 1.2
---
authors: 
  -
    affiliation: "University of Duisburg-Essen"
    family-names: Schmidt
    given-names: Felix
	orcid: "https://orcid.org/0000-0002-9277-7954"
  -
    affiliation: "Vrije Universiteit Amsterdam"
    family-names: Vanderfeesten
    given-names: Maurice
    orcid: "https://orcid.org/0000-0002-5119-3514"
cff-version: "1.1.0"
date-released: 2021-06-08
doi: "10.5281/zenodo.4917108"
license: "CC-BY-4.0"
message: "If you use this software, please cite it using these metadata."
repository-code: "https://github.com/Aurora-Network-Global/sdg-queries-evaluation-report"
title: "Evaluation on accuracy of mapping science to the United Nations' Sustainable Development Goals (SDGs) of the Aurora SDG queries"
version: "1.0"
...

GitHub Events

Total
  • Watch event: 1
  • Fork event: 1
Last Year
  • Watch event: 1
  • Fork event: 1

Committers

Last synced: about 2 years ago

All Time
  • Total Commits: 15
  • Total Committers: 1
  • Avg Commits per committer: 15.0
  • Development Distribution Score (DDS): 0.0
Past Year
  • Commits: 0
  • Committers: 0
  • Avg Commits per committer: 0.0
  • Development Distribution Score (DDS): 0.0
Top Committers
Name Email Commits
Maurice Vanderfeesten m****n@g****m 15

Issues and Pull Requests

Last synced: about 2 years ago

All Time
  • Total issues: 1
  • Total pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Total issue authors: 1
  • Total pull request authors: 0
  • Average comments per issue: 0.0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
  • 6wom9 (1)
Pull Request Authors
Top Labels
Issue Labels
Pull Request Labels