sacrebleu

NLG Evaluation Metrics for R

https://github.com/lazerlambda/sacrebleu

Science Score: 13.0%

This score indicates how likely this project is to be science-related based on various indicators:

○
CITATION.cff file
✓
codemeta.json file
Found codemeta.json file
○
.zenodo.json file
○
DOI references
○
Academic publication links
○
Academic email domains
○
Institutional organization owner
○
JOSS paper metadata
○
Scientific vocabulary similarity
Low similarity (11.1%) to scientific vocabulary

Last synced: 10 months ago · JSON representation

Repository

NLG Evaluation Metrics for R

Basic Info

Host: GitHub
Owner: LazerLambda
Language: R
Default Branch: main
Size: 236 KB

Statistics

Stars: 5
Watchers: 1
Forks: 0
Open Issues: 0
Releases: 0

Created about 2 years ago · Last pushed about 2 years ago

Metadata Files

Readme Changelog

README.Rmd

---
output: github_document
---



```{r, include = FALSE}
knitr::opts_chunk$set(
  collapse = TRUE,
  comment = "#>",
  fig.path = "man/figures/README-",
  out.width = "100%"
)
```

# sacRebleu




The goal of sacRebleu is to provide a simple interface to the BLEU score, a metric for evaluating the quality of generated text.
This package is inspired by the NLTK and sacrebleu implementations of the BLEU score, and is implemented in C++ for the R programming language.

## Installation

You can install the development version of sacRebleu from [GitHub](https://github.com/) with:

### Linux and MacOS
``` r
# install.packages("devtools")
devtools::install_github("LazerLambda/sacRebleu")
```

### Windows
This package builds upon the [tok](https://github.com/mlverse/tok) package, which requires the Rust toolchain to be installed.
To install the rustup, follow the instructions at [https://www.rust-lang.org/tools/install](https://rustup.rs/) and at [tok](https://github.com/mlverse/tok).
After installing the Rust toolchain, you can install the development version of sacRebleu as described above.

## Example

```{r example}
library(sacRebleu)
cand_corpus <- list("This is good", "This is not good")
ref_corpus <- list(list("Perfect outcome!", "Excellent!"), list("Not sufficient.", "Horrible."))
bleu_corpus <- bleu_corpus(ref_corpus, cand_corpus)
```

Owner

Name: Philipp Koch
Login: LazerLambda
Kind: user
Location: Munich

Twitter: PhilippKoch15
Repositories: 20
Profile: https://github.com/LazerLambda

Studying Statistics and Data Science @LMU | @Munich-NLP

GitHub Events

Total

Last Year

Issues and Pull Requests

Last synced: 10 months ago

All Time

Total issues: 0
Total pull requests: 2
Average time to close issues: N/A
Average time to close pull requests: 18 minutes
Total issue authors: 0
Total pull request authors: 1
Average comments per issue: 0
Average comments per pull request: 0.0
Merged pull requests: 2
Bot issues: 0
Bot pull requests: 0

Past Year

Issues: 0
Pull requests: 0
Average time to close issues: N/A
Average time to close pull requests: N/A
Issue authors: 0
Pull request authors: 0
Average comments per issue: 0
Average comments per pull request: 0
Merged pull requests: 0
Bot issues: 0
Bot pull requests: 0

View more stats

Top Authors

Issue Authors

Pull Request Authors

LazerLambda (4)

Top Labels

Issue Labels

Pull Request Labels

Packages

Total packages: 1
Total downloads:
- cran 175 last-month

Total dependent packages: 0
Total dependent repositories: 0
Total versions: 2
Total maintainers: 1

cran.r-project.org: sacRebleu

Metrics for Assessing the Quality of Generated Text

Homepage: https://github.com/LazerLambda/sacRebleu
Documentation: http://cran.r-project.org/web/packages/sacRebleu/sacRebleu.pdf
License: GPL-2 | GPL-3 [expanded from: GPL (≥ 2)]
Latest release: 0.2.0
published over 1 year ago

Versions: 2
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 175 Last month

Rankings

Dependent packages count: 27.8%

Dependent repos count: 35.7%

Average: 49.5%

Downloads: 84.9%

Maintainers (1)

PhillKoch@protonmail.com