Generally deaf-dumb people use sign language for
communication, but they find difficulty in communicating with
others who don’t understand sign language. Due to which
communications between deaf-mute and a normal person have
always been a challenging task. We propose to develop a device
which can convert the hand gestures of a deaf-mute person into
speech. This methodology provides a map for developing a
Digital wireless glove which is fitted with Flex sensors and
accelerometer. These sensors sense the gestures of a person in the
form of bend of fingers and tilt of the hand fist. This system
includes a voice playback IC to give the real time speech output
in regional language as well as a LCD module to display the text.
The text display being in English, the voice output of this device
will be in regional language (here Marathi). So this device acts as
a communicator as well as a translator providing more flexibility
in communication.
B.D.Jadhav : Assistant professor, Department of Electronics & Telecommunication,
JSPM’s Rajarshi Shahu College of Engineering, Pune, India
Nipun Munot : UG Student, Department of Electronics & Telecommunication,
JSPM’s Rajarshi Shahu College of Engineering, Pune, India
Madhura Hambarde : UG Student, Department of Electronics & Telecommunication,
JSPM’s Rajarshi Shahu College of Engineering, Pune, India
Jueli Ashtikar : UG Student, Department of Electronics & Telecommunication,
JSPM’s Rajarshi Shahu College of Engineering, Pune, India
Gesture Recognition
Sign Language
Flex
Sensors
Regional Language
Accelerometer
This system aims to lower the communication gap
between the deaf or community and the normal world. The
project proposes a translational device for deaf-mute
people using glove technology. The proposed technique
has enabled the placement of five flex sensor and an
accelerometer on to a glove to detect the gestures of a
person. As this system is having its voice output in
regional language, it can be used as a translator to
communicate with people of different regions with ease.
To expand the systems capability, two or more
accelerometers can be attached. Camera for facial
detection can also be installed for better communication.
[1] Hernandez-Rebollar, J. L. Kyriakopoulos, N.Lindeman
R.W, “A new instrumented approach for translating
American Sign Language into sound and text” ,
Proceedings of the Sixth IEEE International Conference,
2004. [2] Mehdi S.A., Khan Y. N., “Sign language recognition
using sensor gloves”, Proceedings of the 9th
International Conference, Volume:5, IEEE Conference
Publications, 2002.
[3] Kunal Kadam, Rucha Ganu, Ankita Bhosekar, Prof. S. D.
Joshi, “American Sign Language Interpreter”,
Proceedings of the IEEE Fourth International Conference
on Technology for Education, 2012.
[4] Satjakarn Vutinuntakasame, “An Assistive Body Sensor
Network Glove for Speech- and Hearing- Impaired
Disabilities”, Proceedings of the IEEE Computer Society
International Conference on Body Sensor Networks,
2011.
[5] Anbarasi Rajamohan, Hemavathy R., Dhanalakshmi M. ,
“Deaf-Mute Communication Interpreter”, International
Journal of Scientific Engineering and Technology (ISSN :
2277-1581) Volume 2 Issue 5, pp : 336-341, 1 May 2013
[6] K.C. Shriharipriya and K. Arthy, “Flex sensor based hand
gesture recognition system”, Proceedings of International
Journal Of Innovative Research And Studies (IJIRS),
Vellore, India, May 2013.
[7] Bhavina Patel, Vandana Shah, Ravindra Kshirsagar,
“MICROCONTROLLER BASED GESTURE
RECOGNITION SYSTEM FOR THE HANDICAP
PEOPLE”, in Proceedings of Journal of Engineering
Research and Studies, December 2011.
