Please use this identifier to cite or link to this item:
http://hdl.handle.net/20.500.12188/27678
Title: | Real-time Macedonian Sign Language Recognition System by using Transfer Learning | Authors: | Kralevska, A Trajanov, R Gievska, Sonja |
Keywords: | Macedonian sign language recognition , real-time recognition system , transfer learning , Single Shot Detector (SSD), MobileNet | Issue Date: | 23-May-2022 | Publisher: | IEEE | Conference: | 2022 45th Jubilee International Convention on Information, Communication and Electronic Technology (MIPRO) | Abstract: | The objective for developing a real-time sign language recognition system is twofold: improving inter-personal communication and supporting inclusive human-computer interaction with hearing-impaired population using a particular sign language. This study describes the design and implementation of a system for real-time Macedonian Sign Language recognition in images and videos. A robust and lightweight model was proposed based on transfer learning of suitable pretrained architectures, namely, Single Shot Detector (SSD) MobileNetV2 and SSD MobileNetV2 FPNLite. The proposed models were fine-tuned and extensively evaluated in a number of diverse scenarios to account for the inherent difficulties in recognizing particular letters. In the absence of publicly available dataset, we have created a dataset consisting of two-handed images of 28 out of 31 letters of the Macedonian alphabet; the three letters expressed by dynamic gestures were excluded from the study. The results point out to a state-of-the-art prediction accuracy on the classification task of Macedonian sign language alphabet. | URI: | http://hdl.handle.net/20.500.12188/27678 |
Appears in Collections: | Faculty of Computer Science and Engineering: Conference papers |
Show full item record
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.