lang-myv

Finite state and Constraint Grammar based analysers and proofing tools, and language resources for the Erzya language

https://github.com/giellalt/lang-myv

Science Score: 57.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
    Found CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
    Found 1 DOI reference(s) in README
  • Academic publication links
  • Academic email domains
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (13.3%) to scientific vocabulary

Keywords

constraint-grammar finite-state-transducers geo-russia giellalt-langs langfam-uralic language-resources maturity-beta minority-language nlp proofing-tools
Last synced: 6 months ago · JSON representation ·

Repository

Finite state and Constraint Grammar based analysers and proofing tools, and language resources for the Erzya language

Basic Info
  • Host: GitHub
  • Owner: giellalt
  • License: lgpl-3.0
  • Language: Text
  • Default Branch: main
  • Homepage: https://giellalt.uit.no
  • Size: 115 MB
Statistics
  • Stars: 2
  • Watchers: 24
  • Forks: 0
  • Open Issues: 2
  • Releases: 0
Topics
constraint-grammar finite-state-transducers geo-russia giellalt-langs langfam-uralic language-resources maturity-beta minority-language nlp proofing-tools
Created almost 6 years ago · Last pushed 6 months ago
Metadata Files
Readme License Citation Authors

README.md

The Erzya morphology and tools

Maturity Lemma count GitHub issues License Doc Build Status CI/CD Build Status

Download nightly / CI/CD installation packages for testing (contains the core zhfst file(s)):

Windows MacOS Mobile

NB!! Note that the nightly / CI/CD installation packages are not tested for language quality, and might contain regressions and errors.

This repository contains finite state source files for the Erzya language, for building morphological analysers, proofing tools and dictionaries. The data and implementation are licenced under GNU GPL licence, also detailed in the LICENSE. The authors named in the AUTHORS file are available to grant other licencing choices.

Install proofing tools and keyboards for the Erzya language by using the Divvun Installer (some languages are only available via the nightly channel).

Download and test speller files

The speller files downloadable at the top of this page (the *.bhfst files) can be used with divvunspell, to test their performance. These files are the exact same ones as installed on users' computers and mobile phones. Desktop and mobile speller files differ from each other in the error model and should be tested separately — thus also two different downloads.

Documentation

Documentation can be found at:

Core dependencies

In order to compile and use Erzya language morphology and dictionaries, you need:

To install VislCG3 and HFST, just copy/paste this into your Terminal on macOS:

curl https://apertium.projectjj.com/osx/install-nightly.sh | sudo bash

or terminal on Ubuntu, Debian or Windows Subsystem for Linux:

wget https://apertium.projectjj.com/apt/install-nightly.sh -O - | sudo bash sudo apt-get install cg3 hfst

or terminal on RedHat, Fedora, CentOS or Windows Subsystem for Linux:

wget https://apertium.projectjj.com/rpm/install-nightly.sh -O - | sudo bash sudo dnf install cg3 hfst

Alternatively, the Apertium wiki has good instructions on how to install the dependencies for Mac OS X and how to install the dependencies on linux

Further details and dependencies are described on the GiellaLT Getting Started pages.

Downloading

Using Git: git clone https://github.com/giellalt/lang-myv

Using Subversion: svn checkout https://github.com/giellalt/lang-myv.git/trunk lang-myv

Building and installation

INSTALL describes the GNU build system in detail, but for most users it is the usual:

sh ./autogen.sh # This will automatically clone or check out other GiellaLT dependencies ./configure make (as root) make install

Citing

Rueter, J., Hämäläinen, M., & Partanen, N. (2020). Open-Source Morphology for Endangered Mordvinic Languages. In Proceedings of Second Workshop for NLP Open Source Software (NLP-OSS) (pp. 94–100). The Association for Computational Linguistics.

bibtex @inproceedings{rueter-etal-2020-open, title = "Open-Source Morphology for Endangered Mordvinic Languages", author = {Rueter, Jack and H{\"a}m{\"a}l{\"a}inen, Mika and Partanen, Niko}, booktitle = "Proceedings of Second Workshop for NLP Open Source Software (NLP-OSS)", month = nov, year = "2020", address = "Online", publisher = "Association for Computational Linguistics", url = "https://aclanthology.org/2020.nlposs-1.13", doi = "10.18653/v1/2020.nlposs-1.13", pages = "94--100" }

If you use language data from more than one GiellaLT language, consider citing our LREC 2022 article on whole infra:

Linda Wiechetek, Katri Hiovain-Asikainen, Inga Lill Sigga Mikkelsen, Sjur Moshagen, Flammie Pirinen, Trond Trosterud, and Børre Gaup. 2022. Unmasking the Myth of Effortless Big Data - Making an Open Source Multi-lingual Infrastructure and Building Language Resources from Scratch. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 1167–1177, Marseille, France. European Language Resources Association.

If you use bibtex, following is as it is on ACL anthology:

bibtex @inproceedings{wiechetek-etal-2022-unmasking, title = "Unmasking the Myth of Effortless Big Data - Making an Open Source Multi-lingual Infrastructure and Building Language Resources from Scratch", author = "Wiechetek, Linda and Hiovain-Asikainen, Katri and Mikkelsen, Inga Lill Sigga and Moshagen, Sjur and Pirinen, Flammie and Trosterud, Trond and Gaup, B{\o}rre", booktitle = "Proceedings of the Thirteenth Language Resources and Evaluation Conference", month = jun, year = "2022", address = "Marseille, France", publisher = "European Language Resources Association", url = "https://aclanthology.org/2022.lrec-1.125", pages = "1167--1177" }

Owner

  • Name: GiellaLT
  • Login: giellalt
  • Kind: organization
  • Email: giellalt@uit.no
  • Location: Tromsø

GiellaLT hosts resources for keyboards, proofing tools & text analysis for indigenous & minority languages. See also @divvun & @giellatekno.

Citation (CITATION.cff)

authors: # for whole infra, add / replace
  - family-names: Rueter
    given-names: Jack
    orcid: "https://orcid.org/0000-0002-3076-7929"
  - family-names: Hämäläinen
    given-names: Mika
    orcid: "https://orcid.org/0000-0001-9315-1278"
  - family-names: Partanen
    given-names: Niko
    orcid: "https://orcid.org/0000-0001-8584-3880"
cff-version: 1.2.0
date-released: "2022-06-19"
identifiers:
  - description: ACL anthology
    type: url
    value: https://aclanthology.org/2020.nlposs-1.13/
keywords:
  - Erzya
  - Moksha
  - morphology
  - finite-state description
  - morpholexical unity and diversity
message: If you use this software, please cite it using these metadata.
repository-code: "https://github.com/giellalt/lang-myv"
title: Open-Source Morphology for Endangered Mordvinic Languages
version: 0.0.0
preferred-citation: # whole repo, replace with specific if one exists!
  authors:
      - family-names: Rueter
        given-names: Jack
      - family-names: Hämäläinen
        given-names: Mika
      - family-names: Partanen
        given-names: Niko
  title: "Open-Source Morphology for Endangered Mordvinic Languages"
  type: article

Rueter, J., Hämäläinen, M., & Partanen, N. (2020). [Open-Source Morphology for Endangered Mordvinic Languages](https://www.aclweb.org/anthology/2020.nlposs-1.13/). In Proceedings of Second Workshop for NLP Open Source Software (NLP-OSS) (pp. 94–100). The Association for Computational Linguistics.

```bibtex
    @inproceedings{rueter-etal-2020-open,
        title = "Open-Source Morphology for Endangered Mordvinic Languages",
        author = {Rueter, Jack  and
          H{\"a}m{\"a}l{\"a}inen, Mika  and
          Partanen, Niko},
        booktitle = "Proceedings of Second Workshop for NLP Open Source Software (NLP-OSS)",
        month = nov,
        year = "2020",
        address = "Online",
        publisher = "Association for Computational Linguistics",
        url = "https://aclanthology.org/2020.nlposs-1.13",
        doi = "10.18653/v1/2020.nlposs-1.13",
        pages = "94--100"
    }
```

license: __CC-BY-SA__
url: https://github.com/giellalt/lang-myv/

GitHub Events

Total
  • Push event: 107
Last Year
  • Push event: 107

Dependencies

.github/workflows/docsygen.yml actions
  • actions/checkout v2 composite
  • divvun/actions/lang/build master composite
  • divvun/actions/lang/install-deps master composite
  • divvun/compile-mermaid-markdown-action main composite
  • peaceiris/actions-gh-pages v3 composite