Data

Tools

Indexes

Applications

Experiments

Open Source Science

detransliterator

detransliteration library and tools

https://github.com/mdoumbouya/detransliterator

Science Score: 26.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Committers with academic emails
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (9.7%) to scientific vocabulary

Keywords

detransliteration machine-learning mande manding niger-congo nlp nmt-model transliteration
Last synced: 10 months ago · JSON representation

Repository

detransliteration library and tools

Basic Info
  • Host: GitHub
  • Owner: mdoumbouya
  • License: mit
  • Language: Python
  • Default Branch: main
  • Homepage:
  • Size: 95.1 MB
Statistics
  • Stars: 0
  • Watchers: 2
  • Forks: 1
  • Open Issues: 2
  • Releases: 2
Topics
detransliteration machine-learning mande manding niger-congo nlp nmt-model transliteration
Created almost 4 years ago · Last pushed almost 3 years ago
Metadata Files
Readme License Citation

README.md

detransliterator

Build PyPI - Version PyPI - Python Version

Table of Contents

Installation

console pip install detransliterator

Usage

as a software library

```python from detransliterator import Detransliterator

detransliterator = Detransliterator('latin2nqo001.38') for latin in ["maari", "mri", "magari", "mgri", "makari", "mkri"]: nqo = detransliterator.detransliterate(latin, beamsize=5) assert nqo == "" ```

as a console tool

```console

detransliteration tool

python -m detransliterator.tool --help

csv/tsv extraction tool

python -m detransliterator.csv_tool --help ```

example: detransliterate a stream console echo "musa dunbuya" | python -m detransliterator.tool --model-name latin2nqo_001.35

example: extract a column from a csv file ```console cat testcsvnoheader.csv \ | python -m detransliterator.csvtool \ extract-column --column-ix 1 \

tmpcol11.txt ```

example: extract a column from a tsv file ```console cat testtsvwithheader.tsv \ | python -m detransliterator.csvtool \ extract-column --column-ix 1 --skip-lines 1 --csv-formatting-params delimiter tab \

tmpcol12.txt ```

example: detransliterate a column from a csv file ```console cat testcsvwithheader.csv \ | python -m detransliterator.csvtool extract-column --column-ix 1 --skip-lines 1 \ | python -m detransliterator.tool --model-name latin2nqo_001.35 \

tmpcol1detransliterated1.nqo ```

example: detransliterate a column from a tsv file ```console cat testtsvnoheader.tsv \ | python -m detransliterator.csvtool extract-column --column-ix 1 \ --csv-formatting-params delimiter tab \ | python -m detransliterator.tool --model-name latin2nqo_001.35 \

tmpcol1detransliterated2.nqo ```

example: use a particular GPU console CUDA_VISIBLE_DEVICES="1" echo "musa dunbuya" | python -m detransliterator.tool

latin2nqo Detransliteration Models

|Model|Source Script|Target Script|#Parameters|Validation BLEU|Test BLEU| |:--:|:--:|:--:|--:|--:|--:| |latin2nqo001.35|latin|nqo|2 520 576|75.56|74.14| |latin2nqo001.38|latin|nqo|3 909 120|78.51|77.06|

Supported variants of latin transliterations

|variant|example latin|detransliterated nqo| |:--|:--:|:--:| |maninka | maari | | |maninka tonal | mri| | |bambara-ga | magari| | |bambara-ga tonal | mgri| | |bambara-ka | makari| | |bambara-ka tonal | mkri| |

License

detransliterator is distributed under the terms of the MIT license.

If you use this software in your work, please cite it using the following metadata: @software{Doumbouya_Detransliterator_2022, author = {Doumbouya, Moussa}, month = {7}, title = {{Detransliterator}}, url = {https://github.com/mdoumbouya/detransliterator}, version = {0.0.2}, year = {2022} }

Owner

  • Name: Moussa Doumbouya
  • Login: mdoumbouya
  • Kind: user

GitHub Events

Total
Last Year

Committers

Last synced: over 3 years ago

All Time
  • Total Commits: 22
  • Total Committers: 2
  • Avg Commits per committer: 11.0
  • Development Distribution Score (DDS): 0.136
Top Committers
Name Email Commits
Moussa Doumbouya d****a@g****m 19
mdoumbouya m****a@u****m 3

Issues and Pull Requests

Last synced: 11 months ago

All Time
  • Total issues: 10
  • Total pull requests: 1
  • Average time to close issues: about 14 hours
  • Average time to close pull requests: 2 minutes
  • Total issue authors: 1
  • Total pull request authors: 1
  • Average comments per issue: 0.0
  • Average comments per pull request: 0.0
  • Merged pull requests: 1
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
  • mdoumbouya (10)
Pull Request Authors
Top Labels
Issue Labels
Pull Request Labels

Packages

  • Total packages: 1
  • Total downloads:
    • pypi 11 last-month
  • Total dependent packages: 0
  • Total dependent repositories: 0
  • Total versions: 2
  • Total maintainers: 1
pypi.org: detransliterator
  • Versions: 2
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 11 Last month
Rankings
Dependent packages count: 6.6%
Forks count: 23.2%
Average: 28.6%
Dependent repos count: 30.6%
Stargazers count: 39.1%
Downloads: 43.6%
Maintainers (1)
mdoumbouya
Last synced: 11 months ago

Dependencies

.github/workflows/ci.yaml actions
  • actions/checkout v3 composite
  • actions/setup-python v4 composite
.github/workflows/release.yaml actions
  • actions/checkout v3 composite
  • actions/setup-python v4 composite
  • pypa/gh-action-pypi-publish 27b31702a0e7fc50959f5ad993c78deac1bdfc29 composite
pyproject.toml pypi
  • fairseq *
  • sacremoses ==0.0.49
  • subword-nmt ==0.3.8