goodness-of-pronunciation-pipelines-for-oov-problem

Goodness of Pronunciation Pipelines for OOV Removal

https://github.com/agrover112/goodness-of-pronunciation-pipelines-for-oov-problem

Science Score: 67.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
    Found CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
    Found 7 DOI reference(s) in README
  • Academic publication links
    Links to: arxiv.org, zenodo.org
  • Committers with academic emails
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (12.5%) to scientific vocabulary

Keywords

asr hidden-markov-model kaldi kaldi-asr lexicon-based oov speech speech-recognition
Last synced: 6 months ago · JSON representation ·

Repository

Goodness of Pronunciation Pipelines for OOV Removal

Basic Info
  • Host: GitHub
  • Owner: Agrover112
  • Language: Perl
  • Default Branch: main
  • Homepage:
  • Size: 1.61 MB
Statistics
  • Stars: 10
  • Watchers: 2
  • Forks: 3
  • Open Issues: 0
  • Releases: 4
Topics
asr hidden-markov-model kaldi kaldi-asr lexicon-based oov speech speech-recognition
Created over 3 years ago · Last pushed about 3 years ago
Metadata Files
Readme Citation

README.md

Goodness of Pronunciation Pipelines for OOV Problem

DOI

A proposed pipeline for GoP computation solving OOV problem at Testing time using Vocab/Lexicon expansion techniques. We also provide utilities for extracting the Phoneme posteriors , Word boundaries(alignments), using GoP scores as vectors. The detailed explanation of the pipelines and methods are described in this report.

Main Files

  • run1File.sh : Computes Forced Alignments.
  • run1File_posterior.sh : Computation of Acoustic model Posterior Probabilities.
  • runAllFiles.sh :Calls necessary files for computation of posteriors and alignment ,GoP computation.
  • online_computation.sh: Responsible for the Online/Hybrid pipelne of GoP computation.
  • conf/: Configuration files for MFCC, i-vector extractors,etc.
  • get_failed_entries.sh : File generates a Lexicon from a text file or dir of text files, along with list of failed entries if any.
  • Goodness-of-pronounciation/prop_gop_eqn.py : Contains Python code which calculates GoP scores using posterior and alignment inputs. (Refer to comments in my fork for detailed understanding).

The entire data and exp and lab folders can be found here.

Utils:

  • get_ctm.sh : Get the phone level conversation time mapping files
  • get_word_ctm.sh: Get the word level conversation time mapping files.
  • get_time.sh : Get the times for ctm files.
  • collect_transcripts.sh : Collect and place transcripts from sub-dirs to one file.
  • find_oov.sh: A file to find the OOV occurences from 2 databases.
  • append_vocab.sh : Append OOV lexicon entries to original Lexicon
  • temp_q.sh : File for pre-processing text.
  • dict.sh: A modified utils/prepare_dict.sh for Lexicon generation

Entry-point for running the entire pipeline bash ./get_acoustic_metrics.sh wav_file_dir_path transcript_file_dir_path output_folder path

Outputs:

  • gop/: Contains GoP scored outputs and phone level posteriors (IDgopphone_posteriors.txt).
  • lab/posteriors/: Contains IDposteriorinfile.ark from nnet-compute and IDphoneposteriors.ark are posteriors in different format than gop posteriors.
  • lab/: Contains Forced Alignments outputs(phone level and word level .ctm files) IDword.ctm and IDalignmentinfile.txt

image

Citation

Please cite the both the sources (Arxiv + Zenodo) if any/all of the code is used in your respective research work. @software{Ankit_Goodness-of-Pronunciation-Pipelines-for-OOV-Problem_2022, author = {Ankit, Ankit}, doi = {10.5281/zenodo.7078826.}, month = {9}, title = {{Goodness-of-Pronunciation-Pipelines-for-OOV-Problem}}, version = {new}, year = {2022} } @misc{https://doi.org/10.48550/arxiv.2209.03787, doi = {10.48550/ARXIV.2209.03787} url = {https://arxiv.org/abs/2209.03787}, author = {Grover, Ankit}, keywords = {Computation and Language (cs.CL), Sound (cs.SD), Audio and Speech Processing (eess.AS), FOS: Computer and information sciences, FOS: Computer and information sciences, FOS: Electrical engineering, electronic engineering, information engineering, FOS: Electrical engineering, electronic engineering, information engineering}, title = {Goodness of Pronunciation Pipelines for OOV Problem}, publisher = {arXiv}, year = {2022}, copyright = {Creative Commons Attribution Non Commercial Share Alike 4.0 International} }

Owner

  • Login: Agrover112
  • Kind: user

Humans trying to understand machines and people.

Citation (CITATION.cff)

cff-version: 1.1.0
message: "If you use this software, please cite it as below."
authors:
  - family-names: Ankit
    given-names: Ankit 
    orcid: https://orcid.org/0000-0003-3724-6605
title: Goodness-of-Pronunciation-Pipelines-for-OOV-Problem
version: new
date-released: 2022-09-14
doi: 10.5281/zenodo.7078826.

GitHub Events

Total
Last Year

Committers

Last synced: 8 months ago

All Time
  • Total Commits: 86
  • Total Committers: 2
  • Avg Commits per committer: 43.0
  • Development Distribution Score (DDS): 0.116
Past Year
  • Commits: 0
  • Committers: 0
  • Avg Commits per committer: 0.0
  • Development Distribution Score (DDS): 0.0
Top Committers
Name Email Commits
Agrover112 4****2 76
agrover112 a****2@g****m 10

Issues and Pull Requests

Last synced: 8 months ago

All Time
  • Total issues: 0
  • Total pull requests: 3
  • Average time to close issues: N/A
  • Average time to close pull requests: less than a minute
  • Total issue authors: 0
  • Total pull request authors: 1
  • Average comments per issue: 0
  • Average comments per pull request: 0.0
  • Merged pull requests: 3
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
Pull Request Authors
  • Agrover112 (3)
Top Labels
Issue Labels
Pull Request Labels