Metrics

An R package for common supervised machine learning metrics.

https://github.com/mfrasco/metrics

Science Score: 10.0%

This score indicates how likely this project is to be science-related based on various indicators:

○
CITATION.cff file
○
codemeta.json file
○
.zenodo.json file
○
DOI references
○
Academic publication links
✓
Committers with academic emails
1 of 16 committers (6.3%) from academic institutions
○
Institutional organization owner
○
JOSS paper metadata
○
Scientific vocabulary similarity
Low similarity (11.9%) to scientific vocabulary

Last synced: 11 months ago · JSON representation

Repository

An R package for common supervised machine learning metrics.

Basic Info

Host: GitHub
Owner: mfrasco
License: other
Language: R
Default Branch: master
Homepage:
Size: 354 KB

Statistics

Stars: 102
Watchers: 6
Forks: 26
Open Issues: 20
Releases: 0

Created almost 9 years ago · Last pushed almost 7 years ago

Metadata Files

Readme Contributing License Code of conduct

Metrics

Build Status

How to Install this Package

This package is distributed from CRAN. From the R prompt, run install.packages("Metrics").

Metrics Repo

This repository contains code for the Metrics package in R. Metrics was created by Ben Hamner and came from this github repo. Hamner's repo contains packages for common machine learning metrics in several programming languages, not just R. On 2017-04-21, CRAN orphaned the R package. To revive the status of the R package, I cloned the original and created this repo. I have added new metrics, improved documentation, and fixed bugs. This repository will be the home of active development on the Metrics R package moving forward.

Community Feedback

If you notice anything wrong with the Metrics package or have any ideas on how to improve it, please create an issue in this github repository that describes your issue. I also welcome improvements to this package via a pull request. This is a simple R package, which makes it perfect for first time open source contributors. Here is a guide that walks you through how to make an open source contribution.

What Metrics are Included in this Package?

All functions in the Metrics package take at least two arguments: actual and predicted. In the table below, I abbreviate actual as x and predicted as y for the sake of mathematical brevity.

| Metric Type | Metric Name | Function Name | Formula | | ---- | ------------------------ | ---- | ------------------------------- | | regression | Squared Error | se | $(x_i-y_i)^2$ | | regression | Mean Squared Error | mse | $\frac{1}{n} \sum_{i=1}^n (x_i - y_i) ^ 2$ | | regression | Root Mean Squared Error | rmse | $\sqrt{\frac{1}{n} \sum_{i=1}^n (x_i - y_i)^ 2}$ | | regression | Absolute Error | ae | $\lvert x_i - y_i \rvert$ | | regression | Mean Absolute Error | mae | $\frac{1}{n} \sum_{i=1}^n \lvert x_i - y_i \rvert$ | | regression | Absolute Percent Error | ape | $\frac{\lvert x_i - y_i \rvert}{x_i}$ | | regression | Mean Absolute Percent Error | mape | $\frac{1}{n} \sum_{i=1}^n \frac{\lvert x_i - y_i \rvert}{x_i}$ | | regression | Symmetric Mean Absolute Percent Error | smape | $\frac{2}{n} \sum_{i=1}^n \frac{\lvert x_i - y_i \rvert}{\lvert x_i \rvert + \lvert y_i \rvert}$ | | regression | Squared Log Error | sle | $\big(\ln(1 + x_i) - \ln(1 + y_i)\big) ^ 2$ | | regression | Mean Squared Log Error | msle | $\frac{1}{n} \sum_{i=1}^n \big(\ln(1 + x_i) - \ln(1 + y_i)\big) ^ 2$ | | regression | Root Mean Squared Log Error | rmsle | $\sqrt{\frac{1}{n} \sum_{i=1}^n \big(\ln(1 + x_i) - \ln(1 + y_i)\big) ^ 2}$ | | regression | Relative Squared Error | rse | $\Big[\sum_{i=1}^n (x_i - y_i) ^ 2\Big] / \Big[\sum_{i=1}^n (x_i - \bar{x}) ^ 2\Big]$ | | regression | Root Relative Squared Error | rrse | $\sqrt{\Big[\sum_{i=1}^n (x_i - y_i) ^ 2\Big] / \Big[\sum_{i=1}^n (x_i - \bar{x}) ^ 2\Big]}$ | | regression | Relative Absolute Error | rae | $\Big[\sum_{i=1}^n \lvert x_i - y_i \rvert\Big] / \Big[\sum_{i=1}^n \lvert x_i - \bar{x} \rvert\Big]$ | | time series | Mean Absolute Scaled Error | mase | $\Big[\sum_{i=1}^n \lvert x_i - y_i \rvert\Big] / \Big[\frac{n}{n - m} \sum_{i=1+m}^n \lvert x_i - x_{i-m} \rvert \Big]$ | | classification | Classification Error | ce | $\frac{1}{n} \sum_{i=1}^n I(x_i \neq y_i)$ | | classification | Accuracy | accuracy | $\frac{1}{n} \sum_{i=1}^n I(x_i = y_i)$ | | classification | F1 Score | f1 | $\frac{2 * \text{precision} * \text{recall}}{\text{precision} + \text{recall}}$ | | binary classification | Area Under ROC Curve | auc | $\int_0^1 [1 - G_1(G^{-1}_0(1 - v))] dv$ . help(auc) for details. | | binary classification | Log Loss | ll | $x_i * \ln(y_i) + (1 - x_i) * \ln(1 - y_i)$ | | binary classification | Mean Log Loss | logloss | $\frac{1}{n} \sum_{i=1}^n x_i * \ln(y_i) + (1 - x_i) * \ln(1 - y_i)$ | | binary classification | Precision | precision | $\frac{1}{\sum I(y_i = 1)}\sum_{i=1} ^{n} I(y_i = 1)x_i$ | | binary classification | Recall | recall | $\frac{1}{\sum I(x_i = 1)}\sum_{i=1} ^{n} I(x_i = 1)y_i$ | | binary classification | F-beta Score | fbeta_score | $(1 + \beta^2) \frac{\text{precision} * \text{recall}}{ (\beta^2 * \text{precision}) + \text{recall}}$ |

Owner

Name: mfrasco
Login: mfrasco
Kind: user
Location: Seattle, Washington, USA

Repositories: 2
Profile: https://github.com/mfrasco

Data Scientist

GitHub Events

Total

Issues event: 2
Watch event: 2
Issue comment event: 2

Last Year

Issues event: 2
Watch event: 2
Issue comment event: 2

Committers

Last synced: almost 3 years ago

All Time

Total Commits: 275
Total Committers: 16
Avg Commits per committer: 17.188
Development Distribution Score (DDS): 0.247

Past Year

Commits: 0
Committers: 0
Avg Commits per committer: 0.0
Development Distribution Score (DDS): 0.0

Top Committers

Name	Email	Commits
Ben Hamner	b**n@b**m	207
Michael Frasco	m**6@g**m	23
Dan Blanchard	d**d@g**m	11
Michael Horrell	m**l@u**m	8
Ujjwal Karn	u**n@g**m	5
Fabian Hirschmann	f**n@h**t	4
Marco De Nadai	d**2@M**l	3
ashreekumar	a**r@u**u	3
Michael Horrell	m**l@m**t	3
AdvikS	A****S	2
Eduardo Flores	e**v@g**m	1
Wendy Kan	w**n@g**m	1
ledell	e**n@h**i	1
Dan Blanchard	d**d@e**g	1
heidiw8	4****8	1
Simon Roth	s****s	1

Committer Domains (Top 20 + Academic)

ets.org: 1 h2o.ai: 1 michaels-mbp.attlocal.net: 1 uchicago.edu: 1 hirschm.net: 1 uptake.com: 1 benhamner.com: 1

Issues and Pull Requests

Last synced: 12 months ago

All Time

Total issues: 21
Total pull requests: 28
Average time to close issues: 4 months
Average time to close pull requests: 6 days
Total issue authors: 18
Total pull request authors: 8
Average comments per issue: 1.19
Average comments per pull request: 1.61
Merged pull requests: 24
Bot issues: 0
Bot pull requests: 0

Past Year

Issues: 1
Pull requests: 0
Average time to close issues: N/A
Average time to close pull requests: N/A
Issue authors: 1
Pull request authors: 0
Average comments per issue: 1.0
Average comments per pull request: 0
Merged pull requests: 0
Bot issues: 0
Bot pull requests: 0

View more stats

Top Authors

Issue Authors

adam-m-mcelhinney (3)
mfrasco (2)
Pentaonia (1)
muskuloes (1)
chansigit (1)
ghost (1)
plpxsk (1)
jiyunson (1)
timbook (1)
burakaydin (1)
newtiff (1)
bgreenwell (1)
iblasi (1)
kiganev (1)
jayqi (1)

Pull Request Authors

mfrasco (19)
mthorrell (2)
mllg (2)
systats (1)
timbook (1)
adviksh (1)
jmcastagnetto (1)
heidiw8 (1)

Top Labels

Issue Labels

good first issue (1) documentation (1)

Pull Request Labels

Packages

Total packages: 2
Total downloads:
- cran 19,535 last-month
Total docker downloads: 44,528

Total dependent packages: 39
(may contain duplicates)
Total dependent repositories: 68
(may contain duplicates)
Total versions: 5
Total maintainers: 1

cran.r-project.org: Metrics

Evaluation Metrics for Machine Learning

Homepage: https://github.com/mfrasco/Metrics
Documentation: http://cran.r-project.org/web/packages/Metrics/Metrics.pdf
License: BSD_3_clause + file LICENSE
Latest release: 0.1.4
published about 8 years ago

Versions: 4
Dependent Packages: 38
Dependent Repositories: 67
Downloads: 19,535 Last month
Docker Downloads: 44,528

Rankings

Dependent packages count: 2.2%

Downloads: 2.9%

Dependent repos count: 2.9%

Forks count: 3.1%

Stargazers count: 3.9%

Average: 6.3%

Docker downloads count: 22.5%

Maintainers (1)

mfrasco6@gmail.com

Last synced: 12 months ago

conda-forge.org: r-metrics

Homepage: https://github.com/mfrasco/Metrics
License: BSD_3_clause
Latest release: 0.1.4
published over 7 years ago

Versions: 1
Dependent Packages: 1
Dependent Repositories: 1

Rankings

Dependent repos count: 24.3%

Dependent packages count: 29.0%

Average: 30.3%

Stargazers count: 33.8%

Forks count: 34.1%

Last synced: 11 months ago

Dependencies

DESCRIPTION cran

testthat * suggests

Metrics

Science Score: 10.0%

Repository

Basic Info

Statistics

Metadata Files

README.md

Metrics

How to Install this Package

Metrics Repo

Community Feedback

What Metrics are Included in this Package?

Owner

GitHub Events

Total

Last Year

Committers

All Time

Past Year

Top Committers

Committer Domains (Top 20 + Academic)

Issues and Pull Requests

All Time

Past Year

Top Authors

Issue Authors

Pull Request Authors

Top Labels

Issue Labels

Pull Request Labels

Packages

cran.r-project.org: Metrics

Rankings

Maintainers (1)

conda-forge.org: r-metrics

Rankings

Dependencies