Data

Tools

Indexes

Applications

Experiments

Open Source Science

multimodalhandsegmentation

:hand: Hand detection and segmentation using multimodal information from Kinect

https://github.com/pvti/multimodalhandsegmentation

Science Score: 26.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (9.9%) to scientific vocabulary

Keywords

hand-detection hand-segmentation kinect morphological-operators
Last synced: 6 months ago · JSON representation

Repository

:hand: Hand detection and segmentation using multimodal information from Kinect

Basic Info
Statistics
  • Stars: 2
  • Watchers: 1
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Topics
hand-detection hand-segmentation kinect morphological-operators
Created about 6 years ago · Last pushed about 2 years ago
Metadata Files
Readme Citation

README.md

:hand: Hand detection and segmentation using multimodal information from Kinect

1Modelling and Simulation Centre, Viettel High Technology Industries Corporation, Vietnam  2School of Electronics and Telecommunications, Hanoi University of Science and Technology, Vietnam  3International Research Institute MICA, Hanoi University of Science and Technology, Vietnam  4Université de Toulon, Aix Marseille Université, CNRS, LIS, UMR 7020, France  ✉Corresponding Author
Nowadays, hand gestures are becoming one of the most natural and intuitive ways of communication between human and computer. To this end, a complex process including hand gesture acquisition, hand detection, gesture representation and recognition must be carried out. This paper presents a method that detects hand and segments hand regions from images captured by a Kinect sensor. As Kinect sensor provides not only RGB images as conventional camera, but also depth and skeleton, in our work, we incorporate multi-modal data from Kinect to deal with hand detection and segmentation. Specifically, we use skeleton to approximately determine hand palm. Then a skin based detector will be applied to discard non-skin pixels from the region of interest. Using depth data helps to limit the human body regions and remove false positive regions from the previous steps. Finally, morphological operations will be applied to fill holes in the hand region. The main advantage of this method is very easy to implement and it performs in real-time on an ordinary computer. We evaluate the proposed method on a dataset of hand gestures captured from different viewpoints. Experiment shows that it provides reasonable accuracy at very high frame rate. It also produces comparable performance in comparison with deep learning based methods.

:+1: Citation

If you use this work in your research or wish to refer to the results, please use the following BibTeX entry.

BibTeX @inproceedings{pham2021detection, title={Detection and tracking hand from FPV: benchmarks and challenges on rehabilitation exercises dataset}, author={Pham, Van-Tien and Tran, Thanh-Hai and Vu, Hai}, booktitle={2021 RIVF International Conference on Computing and Communication Technologies (RIVF)}, pages={1--6}, year={2021}, organization={IEEE} }

Owner

  • Name: _
  • Login: pvti
  • Kind: user

GitHub Events

Total
Last Year