Hamdi Altaheri

Postdoctoral Researcher

Spatial Attention-Based 3D Graph Convolutional Neural Network for Sign Language Recognition


Journal article


Muneer Al-hammadi, M. Bencherif, Mansour Alsulaiman, G. Muhammad, M. Mekhtiche, Wadood Abdul, Yousef A. Alohali, Tareq S. Alrayes, H. Mathkour, M. Faisal, Mohammed Algabri, Hamdi Altaheri, Taha M. Alfakih, Hamid Ghaleb
Italian National Conference on Sensors, 2022

Semantic Scholar DBLP DOI PubMedCentral PubMed
Cite

Cite

APA   Click to copy
Al-hammadi, M., Bencherif, M., Alsulaiman, M., Muhammad, G., Mekhtiche, M., Abdul, W., … Ghaleb, H. (2022). Spatial Attention-Based 3D Graph Convolutional Neural Network for Sign Language Recognition. Italian National Conference on Sensors.


Chicago/Turabian   Click to copy
Al-hammadi, Muneer, M. Bencherif, Mansour Alsulaiman, G. Muhammad, M. Mekhtiche, Wadood Abdul, Yousef A. Alohali, et al. “Spatial Attention-Based 3D Graph Convolutional Neural Network for Sign Language Recognition.” Italian National Conference on Sensors (2022).


MLA   Click to copy
Al-hammadi, Muneer, et al. “Spatial Attention-Based 3D Graph Convolutional Neural Network for Sign Language Recognition.” Italian National Conference on Sensors, 2022.


BibTeX   Click to copy

@article{muneer2022a,
  title = {Spatial Attention-Based 3D Graph Convolutional Neural Network for Sign Language Recognition},
  year = {2022},
  journal = {Italian National Conference on Sensors},
  author = {Al-hammadi, Muneer and Bencherif, M. and Alsulaiman, Mansour and Muhammad, G. and Mekhtiche, M. and Abdul, Wadood and Alohali, Yousef A. and Alrayes, Tareq S. and Mathkour, H. and Faisal, M. and Algabri, Mohammed and Altaheri, Hamdi and Alfakih, Taha M. and Ghaleb, Hamid}
}

Abstract

Sign language is the main channel for hearing-impaired people to communicate with others. It is a visual language that conveys highly structured components of manual and non-manual parameters such that it needs a lot of effort to master by hearing people. Sign language recognition aims to facilitate this mastering difficulty and bridge the communication gap between hearing-impaired people and others. This study presents an efficient architecture for sign language recognition based on a convolutional graph neural network (GCN). The presented architecture consists of a few separable 3DGCN layers, which are enhanced by a spatial attention mechanism. The limited number of layers in the proposed architecture enables it to avoid the common over-smoothing problem in deep graph neural networks. Furthermore, the attention mechanism enhances the spatial context representation of the gestures. The proposed architecture is evaluated on different datasets and shows outstanding results.