Development of Sign Language Interpreter Glove for Speech-Impaired Deaf Individuals with Levenshtein Algorithm as an Autotext Correction System.

Dea Muthia Febry, Ananda Putra Kanieza, Gilang Fajar Ramadhan, Velisa Nur Aini, Faisal Rahutomo

Abstract

Assistive technology is technology developed in the form of aids, adaptive tools, and rehabilitation for individuals with disabilities to compensate for their lacking abilities. With assistive technology available to people with special needs, it can help them enhance their independent living skills and reduce their dependence on others, including in communication activities. This research aims to assess the feasibility of developing assistive technology for the speech-impaired, specifically a glove that can translate the SIBI letter sequence into words displayed on a 6 x 12 LCD screen and also produce sound output from the sign language hand movements of speech-impaired individuals when using the glove. The research method used in this study is Research and Development (R&D). The calibration test phase indicated that the prototype was in good condition, as evidenced by an accuracy rate above 90% for voltage at 0◦ and 90◦ angles produced by each finger. Consequently, the next calibration phase, which involves translating sensor readings into SIBI letters through digital data values, can be carried out by taking the ADC values of each finger. Subsequently, the glove was tested to read 7 out of 20 alphabets and achieved a success rate of ≥ 90% for 5 alphabets. The lowest success rate was 70% for the letter E. The average success rate for the 7 alphabet experiments was 91.4%. In the field test phase, the glove was tested on a deaf-mute student to form several words, and the output text displayed on the LCD and audio output matched the readings corrected by the auto-text correction system.

Full Text:

PDF

References

R. Aldabas, “Special education teachers’ perceptions of their preparedness to teach students with severe disabilities in inclusive classrooms: A Saudi Arabian perspective,” Sage Open, vol. 10, no. 3, p. 2158244020950657, 2020.

S. Molina Roldán, J. Marauri, A. Aubert, and R. Flecha, “How inclusive interactive learning environments benefit students without special needs,” Front. Psychol., vol. 12, p. 661427, 2021.

S. Humane and P. Khaire, “Nursing management of deaf-and-dumb psychiatric patients,” Indian J. Psychiatr. Nurs., vol. 20, no. 1, p. 85, 2023, doi: 10.4103/iopn.iopn_73_22.

I. W. Leigh, J. F. Andrews, C. A. Miller, and J.-L. A. Wolsey, Deaf people and society: Psychological, sociological, and educational perspectives. Routledge, 2022.

Z. S. B. Taguibulos, “DEAFying Silence: Analyzing Inclusive Non-Verbal Communication Strategies Between Students with Deafness and Their Non-PWD Peers,” 2020.

S. A. Khan, “Causes, prevention and effects of deafness,” IJSA, vol. 3, no. 2, pp. 6–11, 2022.

F. S. ZAHAF, T. B. KRACHAI, and A. KERKEB, “Difficulties of Deaf and Hard of Hearing Pupils in Learning Foreign Languages. The Case of: Boussaid Aicha and Fatima Rahmania middle schools in Ain Temouchent.” UNIVERSITY OF AIN TEMOUCHENT, 2023.

J. E. C. Lieu, M. Kenna, S. Anne, and L. Davidson, “Hearing loss in children: a review,” Jama, vol. 324, no. 21, pp. 2195–2205, 2020.

V. Mehra, D. Pandey, A. Rastogi, A. Singh, and H. P. Singh, “Technological aids for deaf and mute in the modern world,” Recent Patents Eng., vol. 15, no. 6, pp. 43–52, 2021.

A. Sharma, S. Pingale, U. Sabale, N. Patil, and S. Dongre, “Sign Language Recognition System for Deaf People,” in Innovations in Information and Communication Technologies: Proceedings of ICIICT 2022, Springer, 2022, pp. 13–23.

A. M. Ridha and W. Shehieb, “Assistive technology for hearing-impaired and deaf students utilizing augmented reality,” in 2021 IEEE Canadian Conference on Electrical and Computer Engineering (CCECE), 2021, pp. 1–5.

T. Pousada Garcia, J. Garabal-Barbeira, P. Porto Trillo, O. Vilar Figueira, C. Novo Díaz, and J. Pereira Loureiro, “A framework for a new approach to empower users through low-cost and do-it-yourself assistive technology,” Int. J. Environ. Res. Public Health, vol. 18, no. 6, p. 3039, 2021.

S. S. Senjam and S. Manna, “Assistive Technology and Disabilities in the Context of Sustainable Developmental Goals,” in The Palgrave Encyclopedia of Disability, Springer, 2024, pp. 1–12.

A. S. Saraswat, “Designing Inclusive Spaces: Investigating the Role of Design in Creating Accessible Environments for People with Disabilities in the Context of Sustainable Development Goals,” J. Reatt. Ther. Dev. Divers., vol. 6, no. 1, pp. 1320–1333, 2023.

T. M. Annaswamy, M. Verduzco-Gutierrez, and L. Frieden, “Telemedicine barriers and challenges for persons with disabilities: COVID-19 and beyond,” Disabil. Health J., vol. 13, no. 4, p. 100973, 2020.

A. McNicholl, H. Casey, D. Desmond, and P. Gallagher, “The impact of assistive technology use for students with disabilities in higher education: a systematic review,” Disabil. Rehabil. Assist. Technol., vol. 16, no. 2, pp. 130–143, 2021.

V. Suresh and L. Dyaram, “Workplace disability inclusion in India: review and directions,” Manag. Res. Rev., vol. 43, no. 12, 2020.

E. Surya and F. A. Putri, “Improving mathematical problem-solving ability and self-confidence of high school students through contextual learning model.,” J. Math. Educ., vol. 8, no. 1, pp. 85–94, 2017.

K. A. Aka, “Integration Borg & Gall (1983) and Lee & Owen (2004) models as an alternative model of design-based research of interactive multimedia in elementary school,” J. Phys. Conf. Ser., vol. 1318, no. 1, 2019, doi: 10.1088/1742-6596/1318/1/012022.

8th Borg, W. R. Borg, M. D. Gall, and J. P. Gall, Educational Research: An Introduction, Fifth Edition. Instructor’s manual. Longman, 1989. [Online]. Available: https://books.google.com.ph/books?id=8DIIDUxxtc8C

G. Sowmya, “A Review On Applications of Flex Sensor,” 5th IEEE Int. Conf. Cybern. Cogn. Mach. Learn. Appl. ICCCMLA 2023, no. July, pp. 113–120, 2023, doi: 10.1109/ICCCMLA58983.2023.10346789.

D. Zappi, G. Varani, E. Cozzoni, I. Iatsunskyi, S. Laschi, and M. T. Giardi, “Innovative eco-friendly conductive ink based on carbonized lignin for the production of flexible and stretchable bio-sensors,” Nanomaterials, vol. 11, no. 12, p. 3428, 2021.

J. Qin et al., “Flexible and stretchable capacitive sensors with different microstructures,” Adv. Mater., vol. 33, no. 34, p. 2008267, 2021.

M. C. Fenta, D. K. Potter, and J. Szanyi, “Fibre optic methods of prospecting: A comprehensive and modern branch of geophysics,” Surv. Geophys., vol. 42, no. 3, pp. 551–584, 2021.

M. A. Landa-Jimenez, P. Gonzalez-Gaspar, F. M. Montes-Gonzalez, C. Morgado-Valle, and L. Beltran-Parrazal, “An open-source low-cost wireless sensor system for acquisition of human movement data,” An. Acad. Bras. Cienc., vol. 94, p. e20191419, 2022.

A. Albaghdadi and A. Ali, “An Optimized Complementary Filter For An Inertial Measurement Unit Contain MPU6050 Sensor,” Iraqi J. Electr. Electron. Eng., vol. 15, no. 2, pp. 71–77, 2019, doi: 10.37917/ijeee.15.2.8.

Z. M. Naing, S. Anatolii, and H. S. Paing, “Evaluation of microelectromechanical system gyroscope and accelerometer in the object orientation system using complementary filter,” in 2021 IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering (ElConRus), 2021, pp. 2777–2781.

K. Singh and D. Bura, “Internet-of-Things (IoT): distinct algorithms for sensor connectivity with comparative study between node MCU and arduino UNO,” NVEO-NATURAL VOLATILES Essent. OILS Journal| NVEO, pp. 4313–4324, 2021.

R. Singh, A. Gehlot, L. R. Gupta, M. N. Rathour, M. Swain, and B. Singh, IoT based Projects: Realization with Raspberry Pi, NodeMCU and Arduino. BPB Publications, 2020.

R. Morris, A.S., Langari, “Measurement and Instrumentation: Theory and Application,” Acad. Press. United State, 2012.

L. Klyatis, “Negative Trends in the Development of Simulation, Testing, and Prediction in Engineering,” 2023, pp. 145–191. doi: 10.1007/978-3-031-16655-6_5.

A. H. Zaidan, M. K. Wail, and A. A. Yaseen, “Design and Implementation of Upper Prosthetic Controlled remotely by Flexible Sensor Glove,” IOP Conf. Ser. Mater. Sci. Eng., vol. 1105, no. 1, p. 012080, 2021, doi: 10.1088/1757-899x/1105/1/012080.

H. Tus Sadiah, Muhamad Saad Nurul Ishlah, and Nisa Najwa Rokhmah, “Autocorrect on Drugs e-Dictionary Search Module Using Levenshtein Distance Algorithm,” J. RESTI (Rekayasa Sist. dan Teknol. Informasi), vol. 4, no. 1, pp. 64–69, 2020, doi: 10.29207/resti.v4i1.1401.

DOI: https://doi.org/10.20961/jeeict.6.1.79652

Refbacks

  • There are currently no refbacks.