Answers are grounded in this paper and cite their sources.
Arabic Sign Language (ArSL) is the main means of communication for many deaf people in the Arab world, and automatic alphabet recognition can support their access to technology and services. However, most existing studies classify static images and evaluate on signers already seen during training, which overestimates real-world performance. To address this, we propose a video-based recognition system that uses hand landmarks only, is evaluated on unseen signers, and is deployed as a live browser–server application. The method uses the 39 alphabet signs of the KArSL-502 dataset, MediaPipe hand landmarks normalized to wrist and palm size, and three models (Transformer, BiLSTM and temporal convolutional network), evaluated with leave-one-signer-out validation, five seeds and exact McNemar tests with Holm correction. Across 15 leave-one-signer-out runs on the three KArSL signers, the augmented Transformer with a 28-frame input achieved a mean accuracy of 79.42 ± 6.81% and a mean top-5 accuracy of 95.34 ± 3.20%. Averaging the five seed predictions within each held-out fold yielded a pooled accuracy of 81.67%. In a single-participant live feasibility test using a separately trained deployment checkpoint, 235 of 255 displayed predictions were correct (92.16%). The median time from the first frame with a detected hand to the displayed result was 1.43 s. These results describe recognition of isolated alphabet signs in the three-signer benchmark and the feasibility of the live prototype under the tested conditions.
No takes yet. Share an insight, caveat, or question.
Al-Jubouri et al. (2026) studied this question.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: