British Sign Language Detection Using Ultra-Wideband Radar Sensing and Residual Neural Network

  • Umer Saeed
  • , Syed Aziz Shah
  • , Yazeed Yasin Ghadi
  • , Hira Hameed
  • , Syed Ikram Shah
  • , Jawad Ahmad
  • , Qammer H. Abbas

    Research output: Contribution to journalArticlepeer-review

    6 Citations (Scopus)

    Abstract

    This study represents a significant advancement in Sign Language Detection (SLD), a crucial tool for enhancing communication and fostering inclusivity among the hearing-impaired community. It innovatively combines radar technology with deep learning techniques to develop a sophisticated, non-invasive SLD system. Traditional SLD methods often rely on cumbersome wearable devices or struggle with environmental inconsistencies. In contrast, this system utilizes the distinctive ability of radar to function effectively across various lighting conditions. The core of this research lies in its application to British Sign Language (BSL) detection, employing advanced neural network architectures for real-time interpretation. A key highlight is the impressive 92% accuracy rate achieved in BSL recognition, utilizing the Residual Neural Network (ResNet) model. This success is attributed to a comprehensive dataset and the strategic adaptation of ResNet for processing radar data. The fusion of radar technology with deep learning in this context not only marks a novel approach in the field but also establishes this research as a foundational contribution to the realm of SLD. Its implications extend beyond technical achievement, offering a more accessible and inclusive communication alternative for the hearing-impaired.
    Original languageEnglish
    Pages (from-to)11144-11151
    Number of pages8
    JournalIEEE Sensors Journal
    Volume24
    Issue number7
    Early online date15 Feb 2024
    DOIs
    Publication statusPublished - 1 Apr 2024

    Funder

    This work is supported in parts by Engineering and Physical Research Council (EPSRC) grant (EP/W037076/1).

    Funding

    This work is supported in parts by Engineering and Physical Research Council (EPSRC) grant (EP/W037076/1).

    FundersFunder number
    Engineering and Physical Sciences Research CouncilEP/X040518/1, EP/W037076/1

    Keywords

    • British Sign Language (BSL)
    • contactless detection
    • gesture-reading
    • radar sensing
    • residual neural network (ResNet)

    Fingerprint

    Dive into the research topics of 'British Sign Language Detection Using Ultra-Wideband Radar Sensing and Residual Neural Network'. Together they form a unique fingerprint.

    Cite this