One-Way Communication System with CNN Between Deaf and Blind People

Abstract

Communication is very important, including for deaf and blind people. People with disabilities must be equal to the general public. Having a one-way communication system between deaf people and people with disabilities is very necessary. The input from the system is in the form of spoken language, and the output is in the form of braille. The input from this system is SIBI (Indonesian Sign Language System), SIBI is recorded with a camera and then processed with CNN. CNN is divided into 3 parts, namely (Training Process with a tecnable machine, SIBI DataSet model, and Detection Process), the output of this process is text. Meanwhile, how to change text to braille uses an image index. The results of the braille can be read by the blind. System analysis using Confusion Matrix. The system analysis results are as follows: accuracy value is 85%, precision is 90%, and recall is 82%