Data

Tools

Indexes

Applications

Experiments

Open Source Science

https://github.com/crcdng/meshing-with-voice

A quick voice-face-mesh-up in the browser

https://github.com/crcdng/meshing-with-voice

Science Score: 10.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ○
    codemeta.json file
  • ○
    .zenodo.json file
  • ○
    DOI references
  • ✓
    Academic publication links
    Links to: arxiv.org
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (5.0%) to scientific vocabulary

Keywords

augmented-reality machine-learning three-js
Last synced: 6 months ago · JSON representation

Repository

A quick voice-face-mesh-up in the browser

Basic Info
  • Host: GitHub
  • Owner: crcdng
  • Language: JavaScript
  • Default Branch: master
  • Homepage:
  • Size: 4.36 MB
Statistics
  • Stars: 0
  • Watchers: 2
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Topics
augmented-reality machine-learning three-js
Created over 5 years ago · Last pushed 9 months ago

https://github.com/crcdng/meshing-with-voice/blob/master/ 

### Meshing With Voice

NOTE (2025) still works :)

**WORK IN PROGRESS**

A quick voice and face-me(a)sh-up in the browser, inspired by https://www.youtube.com/watch?v=ac7MSo9nMiI
Uses [tensorflow.js](https://www.tensorflow.org/), the pretrained [Facemesh model](https://github.com/tensorflow/tfjs-models/tree/master/facemesh) and voice recognition via the [Web Speech API](https://caniuse.com/#search=Web%20Speech%20API)

Wait until it has loaded and then say something.

Demo: **TBD**

* Webcam and Microphone permissions required
* Must run in a secure context (https)
* *Chrome only* as of [Web Speech API](https://caniuse.com/#search=Web%20Speech%20API)

#### Thanks to:
* Samarth Gulati: original face painting code and face model data (https://samarthgulati.com/)
* Praveen Sinha: original face painting code and face model data
* Facemesh authors [paper](https://arxiv.org/pdf/1907.06724.pdf)
* Hendry Sadrak: original particle code (https://codepen.io/hendrysadrak/pen/BNvrMm)
* Darrell Flood (font)
* Mr.doob: (https://threejs.org/)

Also... inspired by Golan Levin: Re:MARK http://www.flong.com/projects/remark/

Owner

  • Name: crcdng
  • Login: crcdng
  • Kind: user

may the farce be with you

GitHub Events

Total
  • Push event: 1
Last Year
  • Push event: 1