HAND GESTURE RECOGNITION MENGGUNAKAN METODE SEGMENTASI WARNA KULIT DAN CENTER OF GRAVITY UNTUK TRANSLASI BAHASA ISYARAT SECARA REAL-TIME

Main Authors: , Wawan Kurniawan, S.Si, , Drs. Agus Harjoko, M.Sc, Ph.d
Format: Thesis NonPeerReviewed
Terbitan: [Yogyakarta] : Universitas Gadjah Mada , 2012
Subjects:
ETD
Online Access: https://repository.ugm.ac.id/97868/
http://etd.ugm.ac.id/index.php?mod=penelitian_detail&sub=PenelitianDetail&act=view&typ=html&buku_id=54454
Daftar Isi:
  • Sign language is a language that uses hand gestures and lip movements to explain the meaning. For that there needs to be created a system that can connect the disabled with normal human hearing impairment. The study of sign language recognition applications in real-time experience any problems, the factors that affect, among others, high level of similarity of training image data, the process of tracking, especially on the segmentation of objects with the background so the results do not capture the maximum interpretation. This research uses the tracking method the skin color segmentation and center of gravity (COG) managed to track the hand movements of each frame, as well as edge detection method and the PCA as feature extraction, and familiarity with using artificial neural network approach to Learning Vector Quantification (LVQ) and back propagation. The results of testing this system can recognize 26 letters of recognition cues with recognition accuracy the right hand and the left hand gesture was 83.43% and 82.40%. In a variety of lighting conditions and object distance to the camera, the system is experiencing changes in the level of recognition so that the required distance of an ideal and a good level of lighting. This application is the need for further development especially in the process of tracking and identification.