Recent Releases of mbrs

mbrs - v0.1.6

What's Changed

  • Fix a bug of BERTScore encoding by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/33
  • Use dataclass for generation arguments by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/34
  • Fix a bug of xCOMET-lite loader by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/35

Full Changelog: https://github.com/naist-nlp/mbrs/compare/v0.1.5...v0.1.6

- Python
Published by de9uch1 11 months ago

mbrs - v0.1.5

What's Changed

  • Refactor cacheable metrics and speed up BERTScore by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/31
  • Implement an option for deduplication in mbrs-generate by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/32

Full Changelog: https://github.com/naist-nlp/mbrs/compare/v0.1.4...v0.1.5

- Python
Published by de9uch1 about 1 year ago

mbrs - v0.1.4

What's Changed

  • Implement xCOMET-lite (Larionov et al., 2024) by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/25
  • Implement MetricX by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/26
  • Migrate the package manager to uv by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/27
  • Support fastchrf by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/28
  • Implement BERTScore by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/29
  • Implement plug-in module loader by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/30

Full Changelog: https://github.com/naist-nlp/mbrs/compare/v0.1.3...v0.1.4

- Python
Published by de9uch1 about 1 year ago

mbrs - v0.1.3

What's Changed

  • Implement Diverse MBR (Jinnai et al., 2024) by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/24

Full Changelog: https://github.com/naist-nlp/mbrs/compare/v0.1.2...v0.1.3

- Python
Published by de9uch1 over 1 year ago

mbrs - v0.1.2

What's Changed

  • Implement reference aggregation (DeNero et al., 2009; Vamvas and Sennrich, 2024) by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/8
  • Rename modules and classes by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/9
  • Install CI/CD by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/10
  • Add documents by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/11
  • Calculate log-probabilities in mbrs-generate by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/12
  • Speed up pairwise_scores of BLEURT by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/13
  • Use multiprocessing for pairwise_scores of BLEU and chrF by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/14
  • Fix a bug of multiprocessing in mecab-python3 tokenizer used in BLEU by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/15
  • Treat empty inputs in MetricBLEURT.pairwise_scores() by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/16
  • Fix the model-based estimation by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/17
  • Add documents of implementation lists by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/18
  • Ignore unnecessary arguments in corpus_score() of BLEURT by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/19
  • Add icon by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/20
  • Use multiprocessing for all scores() methods in BLEU, chrF, and TER by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/21
  • Implement YAML-based configuration by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/22
  • Add documents of YAML configuration by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/23

Full Changelog: https://github.com/naist-nlp/mbrs/compare/v0.1.1...v0.1.2

- Python
Published by de9uch1 over 1 year ago

mbrs - v0.1.1

What's Changed

  • Add supports for XCOMET metrics by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/1
  • Add the citation of this software by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/2
  • Implement Probabilistic MBR (Trabelsi et al., 2024) by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/3
  • Support multiple scoring methods of UnifiedMetric by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/4
  • Implement MetricBLEURT by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/5
  • Add a scoring script by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/6
  • Implement model-based estimation (Jinnai et al., 2024) by @de9uch1 in https://github.com/naist-nlp/mbrs/pull/7

Full Changelog: https://github.com/naist-nlp/mbrs/compare/v0.1.0...v0.1.1

- Python
Published by de9uch1 over 1 year ago

mbrs - v0.1.0

First release

- Python
Published by de9uch1 almost 2 years ago