The Design of Low-cost Data Glove and Research on Medium Vocabulary Continuous Sign Language Recognition

Haoyu Ma No.2 Secondary School Attached to East China Normal University

S.-T. Yau High School Science Awarded Papers mathscidoc:1801.35005

Yau Science Award ( Computer Science), 2017.12
Sign language bridges the communication between the deaf-mute and the rest of the world. With the development of computer technology, the research on sign language recognition is prospering. Currently, there are two kinds of research methods. One is based on machine vision, the other is based on wearable input devices. Comparing with machine vision, wearable devices have the advantage of being able to get real-time information of the bend of the fingers and the movement of the hand. The essay applies recent technology in the field of voice recognition, and aims at finding out the best algorithm for medium vocabulary continuous sign language recognition. By building a hybrid Deep Neural Network-Hidden Markov Model, and designing and making a low-cost digital glove, the essay successfully compares the features between Dynamic Time Warping (DTW), Gaussian Mixture Model-Hidden Markov Model (GMM-HMM) and Deep Neural Network-Hidden Markov Model (DNN-HMM) as of solving the problem of sign language recognition. Tests show that in terms of calculating the observation probability, DNN has a much better performance than HMM, especially when syntax is not provided, meaning that DNN better suits the developing trend of sign language recognition. Real-time recognition is achieved on the intelligent terminal with an accuracy of over 97%, using the trained model and a decoding program.
No keywords uploaded!
[ Download ] [ 2018-01-13 19:47:21 uploaded by yauawardadmin ] [ 87 downloads ] [ 0 comments ]
@inproceedings{haoyu2017the,
  title={The Design of Low-cost Data Glove and Research on Medium Vocabulary Continuous Sign Language Recognition},
  author={Haoyu Ma},
  url={http://archive.ymsc.tsinghua.edu.cn/pacm_paperurl/20180113194721414755878},
  booktitle={Yau Science Award ( Computer Science)},
  year={2017},
}
Haoyu Ma. The Design of Low-cost Data Glove and Research on Medium Vocabulary Continuous Sign Language Recognition. 2017. In Yau Science Award ( Computer Science). http://archive.ymsc.tsinghua.edu.cn/pacm_paperurl/20180113194721414755878.
Please log in for comment!
 
 
Contact us: office-iccm@tsinghua.edu.cn | Copyright Reserved