Sign Language Recognition Using Deep Learning: A Systematic Review of Models and Approaches

Sruthi SJ; Evaniya Anna Suvi; Rejeena J Jajin; Annfino Jagan; Shakhy PS

doi:10.55524/ijircst.2026.14.1.5

Abstract

SLR has evolved as one of the most important areas in human–computer interaction and assistive communication technologies. With the rapid development of deep learning, SLR systems have evolved from traditional handcrafted features to highly efficient data-driven models capable of grasping complex spatial and temporal patterns in sign sequences. A wide variety of recent works have investigated different approaches that range from CNNs and recurrent architectures to GCNs for skeletal modelling and state-of-the-art transformer frameworks for long-range sequence understanding. Besides, multimodal systems that incorporate RGB, depth, skeletal information, and radio-frequency signals demonstrate enhanced robustness under difficult real-world conditions. This survey provides an in-depth review of modern advances in SLR by underlining methodological novelties, commonly used datasets, architectural enhancements, and corresponding performance results. Shared challenges regarding signer variability, limited diversity in datasets, occlusions, and constraints on real-time processing are discussed in detail. The survey concludes by underlining emerging trends and future research directions oriented to the development of scalable, accurate, and context-aware SLR systems that can be effectively used in practical assistive applications.

Keywords

Sign Language Recognition, Deep Learning, CNN, GCN, Transformers, Pose Estimation, Multimodal Fusion, Continuous SLR, Word-Level SLR, Human–Computer Interaction.

References

M. Geetha, N. Aloysius, D. A. Somasundaran, A. Raghunath, and P. Nedungadi, “Toward real-time recognition of continuous Indian sign language: A multi-modal approach using RGB and pose,” IEEE Access, vol. 13, pp. 60270–60283, 2025. Available from: https://doi.org/10.1109/ACCESS.2025.3554618
M. Al-Qurishi et al., “Deep learning for sign language recognition: Current techniques, benchmarks, and open issues,” IEEE Access, vol. 9, pp. 156241–156255, 2021. Available from: https://doi.org/10.1109/ACCESS.2021.3110912
S. M. Miah et al., “Sign language recognition using graph and general deep neural network based on large-scale dataset,” IEEE Access, vol. 12, pp. 25001–25015, 2024. Available from: https://ieeexplore.ieee.org/document/10456765
Joksimoski et al., “Technological solutions for sign language recognition: A scoping review of research trends, challenges, and opportunities,” IEEE Access, vol. 10, pp. 101935–101960, 2022. Available from: https://ieeexplore.ieee.org/document/9739689
R. Kothadiya et al., “SIGNFORMER: DeepVision transformer for sign language recognition,” IEEE Access, vol. 11, pp. 17356–17369, 2023. Available from: https://ieeexplore.ieee.org/document/10011551
Y. Zhang et al., “Sign language recognition based on CNN-BiLSTM using RF signals,” IEEE Sensors Journal, vol. 24, no. 2, pp. 1456–1467, 2024. Available from: https://ieeexplore.ieee.org/document/10798415
M. Maruyama et al., “Word-level sign language recognition with multi-stream neural networks focusing on local regions and skeletal information,” IEEE Access, vol. 12, pp. 89012–89026, 2024. Available from: https://ieeexplore.ieee.org/document/10749796
N. Naz et al., “SIGNGRAPH: An efficient and accurate pose-based graph convolution approach toward sign language recognition,” IEEE Access, vol. 11, pp. 39211–39225, 2023. Available from: https://ieeexplore.ieee.org/document/10049842
Z. Zhou et al., “SignBERT: A BERT-based deep learning framework for continuous sign language recognition,” IEEE Access, vol. 9, pp. 104895–104907, 2021. Available from: https://ieeexplore.ieee.org/document/9635818
B. A. Al Abdullah et al., “Advancements in sign language recognition: A comprehensive review and future prospects,” IEEE Access, vol. 12, pp. 74122–74145, 2024. Available from: https://ieeexplore.ieee.org/document/10670380
Li et al., “Word-level deep sign language recognition from video: A new large-scale dataset and methods comparison,” in Proc. IEEE/CVF Winter Conf. Applications of Computer Vision (WACV), 2020. Available from: https://arxiv.org/abs/1910.11006
Li et al., “Transferring cross-domain knowledge for video sign language recognition,” in Proc. IEEE/CVF Conf. Computer Vision and Pattern Recognition (CVPR), 2020. Available from: https://arxiv.org/abs/2003.03703
N. C. Camgoz et al., “Sign language transformers: Joint end-to-end sign language recognition and translation,” in Proc. IEEE/CVF Conf. Computer Vision and Pattern Recognition (CVPR), 2020. Available from: https://arxiv.org/abs/2003.13830
M. De Coster et al., “Sign language recognition with transformer networks,” in Proc. International Conf. Language Resources and Evaluation (LREC), 2020. Available from: https://aclanthology.org/2020.lrec-1.737
M. Bohá?ek and M. Hrúz, “Sign pose-based transformer for word-level sign language recognition,” in Proc. IEEE/CVF WACV Workshops, 2022. Available from: https://ieeexplore.ieee.org/document/9707552
C. C. de Amorim et al., “Spatial-temporal graph convolutional networks for sign language recognition,” in Proc. Int. Conf. Artificial Neural Networks (ICANN), 2019. Available from: https://arxiv.org/abs/1901.11164
J. Huang et al., “Video-based sign language recognition without temporal segmentation,” in Proc. AAAI Conf. Artificial Intelligence, 2018. Available from: https://arxiv.org/abs/1801.10111
H. Zhou et al., “Spatial-temporal multi-cue network for continuous sign language recognition,” in Proc. AAAI Conf. Artificial Intelligence, 2020. Available from: https://arxiv.org/abs/2002.03187
L. Hu et al., “Continuous sign language recognition with correlation network,” in Proc. IEEE/CVF Conf. Computer Vision and Pattern Recognition (CVPR), 2023. Available from: https://arxiv.org/abs/2303.03202
L. Hu et al., “Temporal lift pooling for continuous sign language recognition,” in Proc. European Conf. Computer Vision (ECCV), 2022. Available from: https://arxiv.org/abs/2207.08734
L. Hu et al., “Self-emphasizing network for continuous sign language recognition,” in Proc. AAAI Conf. Artificial Intelligence, 2023. Available from: https://arxiv.org/abs/2211.17081
Hao et al., “Self-mutual distillation learning for continuous sign language recognition,” in Proc. IEEE/CVF Int. Conf. Computer Vision (ICCV), 2021. Available from: https://ieeexplore.ieee.org/document/9710140
Y. Min et al., “Visual alignment constraint for continuous sign language recognition,” in Proc. IEEE/CVF Int. Conf. Computer Vision (ICCV), 2021. Available from: https://arxiv.org/abs/2104.02330
K.-L. Cheng et al., “Fully convolutional networks for continuous sign language recognition,” in Proc. European Conf. Computer Vision (ECCV), 2020. Available from: https://arxiv.org/abs/2007.12402
R. Zuo and B. Mak, “C2SLR: Consistency-enhanced continuous sign language recognition,” in Proc. IEEE/CVF Conf. Computer Vision and Pattern Recognition (CVPR), 2022. Available from: https://ieeexplore.ieee.org/document/9880334
Xiao et al., “SLRFormer: Continuous sign language recognition using vision transformer,” in Proc. ACII Workshops, 2022. Available from: https://ieeexplore.ieee.org/document/10086026
R. Hinrichs et al., “Continuous sign-language recognition using neural ordinary differential equations,” in Proc. Int. Conf. Pattern Recognition Applications and Methods (ICPRAM), 2023.
R. Zuo et al., “Towards online continuous sign language recognition and translation,” in Proc. Conf. Empirical Methods in Natural Language Processing (EMNLP), 2024. Available from: https://arxiv.org/abs/2401.05336
N. S. Dinh et al., “Sign language recognition: A large-scale multi-view benchmark and comprehensive evaluation,” in Proc. IEEE/CVF WACV, 2025. Available from: https://ieeexplore.ieee.org/document/10943527
Tunga et al., “Pose-based sign language recognition using GCN and BERT,” in Proc. IEEE/CVF WACV Workshops, 2021. Available from: https://ieeexplore.ieee.org/document/9407595
K. M. Dafnis et al., “Bidirectional skeleton-based isolated sign recognition,” in Proc. LREC, 2022. Available from: https://aclanthology.org/2022.lrec-1.797
D. Li et al., “TSPNet: Hierarchical feature learning for sign language translation,” in Proc. Advances in Neural Information Processing Systems (NeurIPS), 2020. Available from: https://arxiv.org/abs/2010.05468
Sridhar et al., “INCLUDE: A large-scale dataset for Indian sign language,” in Proc. ACM Multimedia, 2020. Available from: https://dl.acm.org/doi/10.1145/3394171.3413528
S. Naeem et al., “Pakistani word-level sign language recognition based on deep spatiotemporal network,” AAAI Symposium Series, vol. 6, no. 1, pp. 123–130, 2025. Available from: https://doi.org/10.1609/aaaiss.v6i1.36042
R. Sreemathy et al., “Continuous word-level sign language recognition using an expert system,” International Journal of Cognitive Computing in Engineering, vol. 4, pp. 100–110, 2023. Available from: https://doi.org/10.1016/j.ijcce.2023.04.002
J. Bora et al., “Real-time Assamese sign language recognition using deep learning,” Procedia Computer Science, vol. 215, pp. 785–792, 2023, doi: 10.1016/j.procs.2023.01.117. Available from: https://doi.org/10.1016/j.procs.2023.01.117
B. Baidya et al., “Word-level Nepali sign language recognition using transformer networks,” in Proc. IOE Graduate Conf., 2022. Available from: https://conference.ioe.edu.np/publications/ioegc12/IOEGC-12-115-12166.pdf
El Zaar et al., “High performance deep learning applied to multiple sign languages,” E3S Web of Conferences, vol. 351, 2022. Available from: https://doi.org/10.1051/e3sconf/202235101065
S. Khanna et al., “Sign language interpretation using ensembled deep learning networks,” ITM Web of Conferences, vol. 53, 2023. Available from: https://doi.org/10.1051/itmconf/20235301003
R. A. Alawwad et al., “Indian regional sign language recognition using CNN models,” Array, vol. 16, 2022.
Lijiya et al., “SIGNET: A deep learning based Indian sign language recognition system,” in Proc. ICCSP, 2019. Available from: https://ieeexplore.ieee.org/document/8698006
T. Goswami and S. R. Javaji, “CNN model for American sign language recognition,” in Proc. ICCCE, 2020. Available from: https://link.springer.com/chapter/10.1007/978-981-15-7961-5_6
M. ElBadawy et al., “Arabic sign language recognition with 3D convolutional neural networks,” in Proc. ICICIS, 2017. Available from: https://ieeexplore.ieee.org/document/8260028
M. ElBadawy et al., “Deep convolutional neural networks for sign language recognition,” in Proc. SPACES, 2018. Available from: https://doi.org/10.1109/SPACES.2018.8316344
L. Pigou et al., “Sign language recognition using convolutional neural networks,” in Proc. ECCV Workshops, 2014. Available from: https://link.springer.com/chapter/10.1007/978-3-319-16178-5_40
L. Pigou et al., “Gesture and sign language recognition with temporal residual networks,” in Proc. ICCV Workshops, 2017. Available from: https://tinyurl.com/mu4ww2hy
Hu et al., “Hand-model-aware sign language recognition,” in Proc. AAAI Conf. Artificial Intelligence, 2021. Available from: https://doi.org/10.1609/aaai.v35i2.16247
Hu et al., “SignBERT: Pre-training hand-model-aware representation for sign language recognition,” in Proc. IEEE/CVF ICCV, 2021. Available from: https://tinyurl.com/45y2hvez
C. Lu et al., “Sign language recognition with multimodal sensors and deep learning methods,” Electronics, vol. 12, no. 23, 2023. Available from: https://doi.org/10.3390/electronics12234827
R. Rastgoo et al., “Sign language recognition: A deep survey,” Expert Systems with Applications, vol. 164, 2021. Available from: https://doi.org/10.1016/j.eswa.2020.113794

Cites this article as

S. SJ, E. A. Suvi, R. J. Jajin, A. Jagan, S. PS, "Sign Language Recognition Using Deep Learning: A Systematic Review of Models and Approaches", International Journal of Innovative Research in Computer Science and Technology (IJIRCST), Vol-14, Issue-1, Page No-34-42, 2026. Available from: https://doi.org/10.55524/ijircst.2026.14.1.5

Corresponding Author

Sruthi SJ

B.Tech Scholar, Department of Computer Science and Engineering, Marian Engineering College, Trivandrum, India

Download Full Paper

Download PDF

No. of Downloads: 19 | No. of Views: 639

Threat Defensive Intelligent Trust Framework for Secure FANET Clustering

Shikha Gupta, Deepak Gupta.

March 2026 - Vol 14, Issue 2
Design and Implementation of an Early Detection System for Chronical Kidney Disease Using Machine Learning Techniques

Mohd Shahbaz Khan, Richa Srivastava, Mohd Owais Khan, Faiyaz Ahamad.

March 2026 - Vol 14, Issue 2
Design and Implementation of a Quiz Platform Using AI to Increase Interactivity

Mohd Rafey, Najmus Sahar, Muskan Khatoon, Ajaz Husain Warsi.

March 2026 - Vol 14, Issue 2

Sign Language Recognition Using Deep Learning: A Systematic Review of Models and Approaches

Citations

Download Full Paper PDF

Total View 639

Total Download 19