LinkedIn

 آمار

تعداد نشریات21
تعداد شماره‌ها1,292
تعداد مقالات11,793
تعداد مشاهده مقاله83,088,119
تعداد دریافت فایل اصل مقاله121,853,822
Awwad, Sari, El-Salhi, Subhieh M., Igried, Bashar. (1405). Dimensionality Reduction for Offline Alphabet Arabic Sign Language Recognition using Deep Learning. سامانه مدیریت نشریات علمی, 16(4), 353-360. doi: 10.31661/jbpe.v0i0.2503-1904
Sari Awwad; Subhieh M. El-Salhi; Bashar Igried. "Dimensionality Reduction for Offline Alphabet Arabic Sign Language Recognition using Deep Learning". سامانه مدیریت نشریات علمی, 16, 4, 1405, 353-360. doi: 10.31661/jbpe.v0i0.2503-1904
Awwad, Sari, El-Salhi, Subhieh M., Igried, Bashar. (1405). 'Dimensionality Reduction for Offline Alphabet Arabic Sign Language Recognition using Deep Learning', سامانه مدیریت نشریات علمی, 16(4), pp. 353-360. doi: 10.31661/jbpe.v0i0.2503-1904
Awwad, Sari, El-Salhi, Subhieh M., Igried, Bashar. Dimensionality Reduction for Offline Alphabet Arabic Sign Language Recognition using Deep Learning. سامانه مدیریت نشریات علمی, 1405; 16(4): 353-360. doi: 10.31661/jbpe.v0i0.2503-1904

Dimensionality Reduction for Offline Alphabet Arabic Sign Language Recognition using Deep Learning

Journal of Biomedical Physics and Engineering
مقاله 8، دوره 16، شماره 4 - شماره پیاپی 1، آبان 2026، صفحه 353-360    اصل مقاله (1.35 M)
نوع مقاله: Original Research
شناسه دیجیتال (DOI): 10.31661/jbpe.v0i0.2503-1904
نویسندگان
Sari Awwad* 1؛ Subhieh M. El-Salhi2؛ Bashar Igried1
1Department of Computer Science and Applications, Faculty of Prince Al-Hussein Bin Abdullah II for Information Technology, The Hashemite University, Zarqa, Jordan
2Department of Computer Information Systems, Faculty of Prince Al-Hussein Bin Abdullah II for Information Technology, The Hashemite University, Zarqa, Jordan
چکیده
Background: Arabic Sign Language (ArSL) recognition remains limited in terms of technological development, compared to American Sign Language (ASL). This disparity restricts communication accessibility for individuals with hearing impairments in Arabic-speaking regions, in offline environments with limited computational resources.
Objective: This study aimed to develop a robust offline recognition system for ArSL by integrating Principal Component Analysis (PCA) for dimensionality reduction, Scale-Invariant Feature Transform (SIFT) for feature extraction, and Convolutional Neural Networks (CNNs) for gesture classification.
Material and Methods: This experimental, quantitative research used a curated dataset of ArSL gestures, obtained from Kaggle. Preprocessing involved normalization, contrast enhancement, and noise reduction. SIFT was used to extract invariant features, while PCA reduced computational complexity. CNN architectures were trained to recognize gestures, assessed using accuracy, precision, recall, F1-score, loss, confusion matrix, and Receiver Operating Characteristic (ROC) curve.
Results: The system achieved an accuracy of 86.64%, surpassing conventional models, such as SIFT combined with Support Vector Machines (SIFT+SVM) (84.45%). The integration of PCA and SIFT enhanced recognition efficiency and reduced model complexity. Deep learning methods showed superior adaptability and precision across gesture types. 
Conclusion: This study presents a robust offline ArSL recognition system that enhances communication, education, and social participation for individuals with hearing impairments in Arabic-speaking regions.

تازه های تحقیق

Sari Awwad (Google Scholar)

کلیدواژه‌ها
Sign Language؛ Deep Learning؛ Image Processing؛ Computer-Assisted؛ Gesture؛ Principal Component Analysis
مراجع
  1. Abdullah A, Abdul-Kadir NA, Harun FC. Research and development of IMU sensors-based approach for sign language gesture recognition. J Telecommun Electron Comput Eng. 2017;9(3-9):33-9.
  2. Wadhawan A, Kumar P. Sign language recognition systems: A decade systematic literature review. Arch Comput Methods Eng. 2021;28:785-813. doi: 10.1007/s11831-019-09384-2.
  3. Alghazo JM, Latif G, Elhassan A, Alzubaidi L, Al-Hmouz A, Al-Hmouz R. An online numeral recognition system using improved structural features–a unified method for handwritten Arabic and Persian numerals. J Telecommun Electron Comput Eng. 2017;9(2-10):33-40.
  4. Tharwat A, Gaber T, Hassanien AE, Shahin MK, Refaat B. Sift-based arabic sign language recognition system. In: Afro-European Conference for Industrial Advancement: Proceedings of the First International Afro-European Conference for Industrial Advancement AECIA 2014; Springer; 2015. p. 359-70.
  5. Elleuch M, Maalej R, Kherallah M. A new design based-SVM of the CNN classifier architecture with dropout for offline Arabic handwritten recognition. Procedia Comput Sci. 2016;80:1712-23. doi: 10.1016/j.procs.2016.05.512.
  6. Fayyaz S, Ayaz Y. CNN and traditional classifiers performance for sign language recognition. In: Proceedings of the 3rd international conference on machine learning and soft computing; New York, NY, USA: Association for Computing Machinery; 2019. p. 192-6.
  7. Ghanim TM, Khalil MI, Abbas HM. Comparative study on deep convolution neural networks DCNN-based offline Arabic handwriting recognition. IEEE Access. 2020;8:95465-82. doi: 10.1109/ACCESS.2020.2994290.
  8. Kumar P, Gauba H, Roy PP, Dogra DP. A multimodal framework for sensor based sign language recognition. 2017;259:21-38. doi: 10.1016/j.neucom.2016.08.132.
  9. Hanecioğlu N. Gesture recognition for Turkish Sign Language with CNN and RNN [Master’s thesis]. Ankara: Ankara Yildirim Beyazit University; 2019.
  10. Ahmed R, Dashtipour K, Gogate M, Raza A, Zhang R, Huang K, et al. Offline arabic handwriting recognition using deep machine learning: A review of recent advances. In International conference on brain inspired cognitive systems; Guangzhou, China: Springer; 2019. p. 457-68.
  11. Zakariah M, Alotaibi YA, Koundal D, Guo Y, Mamun Elahi M. Sign language recognition for Arabic alphabets using transfer learning technique. Comput Intell Neurosci. 2022;2022(1):4567989. doi: 10.1155/2022/4567989.
  12. Rowel MMK, Gunasekara ADAI, Uwanthika GAI, Wijesinghe DB. E-Learning Platform for Hearing Impaired Children with Handwritten Character Recognition using CNN. IJRC. 2022;1(1):37-43. doi: 10.64701/ijrc/345/5297.
  13. Pisharady PK, Saerbeck M. Recent methods and databases in vision-based hand gesture recognition: A review. Comput Vis Image Underst. 2015;141:152-65. doi: 10.1016/j.cviu.2015.08.004.
  14. Nikam AS, Ambekar AG. Sign language recognition using image based hand gesture recognition techniques. In 2016 online international conference on green engineering and technologies (IC-GET); Coimbatore, India: IEEE; 2016. p. 1-5.
  15. Aly S, Aly W. DeepArSLR: A novel signer-independent deep learning framework for isolated arabic sign language gestures recognition. IEEE Access. 2020;8:83199-212. doi: 10.1109/ACCESS.2020.2990699.
  16. Ibrahim NB, Selim MM, Zayed HH. An automatic Arabic sign language recognition system (ArSLRS). J King Saud Univ Comput Inf Sci. 2018;30(4):470-7. doi: 10.1016/j.jksuci.2017.09.007.
  17. Cheok MJ, Omar Z, Jaward MH. A review of hand gesture and sign language recognition techniques. Int J Mach Learn Cybern. 2019;10(1):131-53. doi: 10.1007/s13042-017-0705-5.
  18. Anderson R, Wiryana F, Ariesta MC, Kusuma GP. Sign language recognition application systems for deaf-mute people: A review based on input-process-output. Procedia Comput Sci. 2017;116:441-8. doi: 10.1016/j.procs.2017.10.028.
  19. Goldin-Meadow S, Brentari D. Gesture, sign, and language: The coming of age of sign language and gesture studies. Behav Brain Sci. 2017;40:e46. doi: 10.1017/S0140525X15001247. PubMed PMID: 26434499. PubMed PMCID: PMC4821822.
  20. Wang F, Li C, Liu CW, Zeng Z, Xu K, Wu JX. An approach based on 1D fully convolutional network for continuous sign language recognition and labeling. Neural Comput Appl. 2022;34(20):17921-35. doi: 10.1007/s00521-022-07415-x.
  21. Oyedotun OK, Khashman A. Deep learning in vision-based static hand gesture recognition. Neural Comput Appl. 2017;28(12):3941-51. doi: 10.1007/s00521-016-2294-8.
  22. Alayed A. Machine Learning and Deep Learning Approaches for Arabic Sign Language Recognition: A Decade Systematic Literature Review. Sensors (Basel). 2024;24(23):7798. doi: 10.3390/s24237798. PubMed PMID: 39686335. PubMed PMCID: PMC11644898.
  23. Hu Y, Wong Y, Wei W, Du Y, Kankanhalli M, Geng W. A novel attention-based hybrid CNN-RNN architecture for sEMG-based gesture recognition. PLoS One. 2018;13(10):e0206049. doi: 10.1371/journal.pone.0206049. PubMed PMID: 30376567. PubMed PMCID: PMC6207326.
  24. Wu D, Pigou L, Kindermans PJ, Le ND, Shao L, Dambre J, Odobez JM. Deep Dynamic Neural Networks for Multimodal Gesture Segmentation and Recognition. IEEE Trans Pattern Anal Mach Intell. 2016;38(8):1583-97. doi: 10.1109/TPAMI.2016.2537340. PubMed PMID: 26955020.
  25. Joksimoski B, Zdravevski E, Lameski P, Pires IM, Melero FJ, Martinez TP, et al. Technological solutions for sign language recognition: a scoping review of research trends, challenges, and opportunities. IEEE Access. 2022;10:40979-98. doi: 10.1109/ACCESS.2022.3161440.
  26. Al-Hammadi M, Muhammad G, Abdul W, Alsulaiman M, Hossain MS. Hand gesture recognition using 3D-CNN model. IEEE Consumer Electronics Magazine. 2019;9(1):95-101. doi: 10.1109/MCE.2019.2941464.
  27. Latif G, Alghazo J, Mohammad N, Alghazo R. Communicating with the deaf and hard of hearing through automatic Arabic sign language translator. In J Phys Conf Ser. 2021;1962(1):012055. doi: 10.1088/1742-6596/1962/1/012055.
  28. Elshaer AM, Ambioh Y, Soliman Z, Ahmed O, Elnakib M, Safwat M, et al. Enhancing arabic alphabet sign language recognition with vgg16 deep learning investigation. In 14th International Conference on Electrical Engineering (ICEENG); Cairo, Egypt: IEEE; 2024. p. 184-6.
آمار
تعداد مشاهده مقاله: 307
تعداد دریافت فایل اصل مقاله: 563


سامانه مدیریت نشریات علمی. قدرت گرفته از سیناوب