https://github.com/classifier-calibration/classifier-calibration.github.io

Website for the Classifier calibration tutorial, ECML-PKDD 2020

https://github.com/classifier-calibration/classifier-calibration.github.io

Science Score: 13.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
  • DOI references
  • Academic publication links
  • Academic email domains
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (4.4%) to scientific vocabulary
Last synced: 9 months ago · JSON representation

Repository

Website for the Classifier calibration tutorial, ECML-PKDD 2020

Basic Info
Statistics
  • Stars: 2
  • Watchers: 3
  • Forks: 2
  • Open Issues: 0
  • Releases: 0
Created about 6 years ago · Last pushed almost 2 years ago
Metadata Files
Readme

README.md

Classifier Calibration

How to asses and improve classifier confidence and uncertainty

A tutorial for the ECML-PKDD 2020 conference in Ghent, Belgium, from the 14th to the 18th of September 2020. Full information will be provided at classifier-calibration.github.io

Abstract

This tutorial introduces fundamental concepts in classifier calibration and gives an overview of recent progress in the enhancement and evaluation of calibration methods. Participants will learn why some training algorithms produce calibrated probability estimates and others don't, and how to apply post-hoc calibration techniques in order to improve the probability estimates in theory and in practice, the latter in a Section dedicated to Hands-On explanations. Participants will furthermore learn how to test if a classifier’s outputs are calibrated and how to assess and evaluate probabilistic classifiers using a range of evaluation metrics and exploratory graphical tools. Additionally, participants will obtain a basic appreciation of the more abstract perspective provided by proper scoring rules, and learn about related topics and some open problems in the field.

Contact

Peter Flach, University of Bristol, UK, Peter.Flach@bristol.ac.uk , www.cs.bris.ac.uk/~flach/

Miquel Perello-Nieto, University of Bristol, UK, miquel.perellonieto@bristol.ac.uk, https://www.perellonieto.com/

Hao Song, University of Bristol, UK, hao.song@bristol.ac.uk

Meelis Kull, University of Tartu, Estonia, meelis.kull@ut.ee

Telmo Silva Filho, Federal University of Paraiba, Brazil, telmo@de.ufpb.br

Owner

  • Name: classifier-calibration
  • Login: classifier-calibration
  • Kind: organization

GitHub Events

Total
Last Year

Dependencies

.github/workflows/quarto-publish.yml actions
  • actions/checkout v4 composite
  • actions/setup-python v5 composite
  • quarto-dev/quarto-actions/publish v2 composite
  • quarto-dev/quarto-actions/setup v2 composite