Contactless Human Activity Recognition using Deep Learning with Flexible and Scalable Software Define Radio

  • Muhammad Zakir Khan
  • , Jawad Ahmad
  • , Wadii Boulila
  • , Matthew Broadbent
  • , Syed Aziz Shah
  • , Anis Koubaa
  • , Qammer H. Abbasi

    Research output: Chapter in Book/Report/Conference proceedingConference proceedingpeer-review

    Abstract

    Ambient computing is gaining popularity as a major technological advancement for the future. The modern era has witnessed a surge in the advancement in healthcare systems, with viable radio frequency solutions proposed for remote and unobtrusive human activity recognition (HAR). Specifically, this study investigates the use of Wi-Fi channel state information (CSI) as a novel method of ambient sensing that can be employed as a contactless means of recognizing human activity in indoor environments. These methods avoid additional costly hardware required for vision-based systems, which are privacy-intrusive, by (re)using Wi-Fi CSI for various safety and security applications. During an experiment utilizing universal software-defined radio (USRP) to collect CSI samples, it was observed that a subject engaged in six distinct activities, which included no activity, standing, sitting, and leaning forward, across different areas of the room. Additionally, more CSI samples were collected when the subject walked in two different directions. This study presents a Wi-Fi CSI-based HAR system that assesses and contrasts deep learning approaches, namely convolutional neural network (CNN), long short-term memory (LSTM), and hybrid (LSTM+CNN), employed for accurate activity recognition. The experimental results indicate that LSTM surpasses current models and achieves an average accuracy of 95.3% in multi-activity classification when compared to CNN and hybrid techniques. In the future, research needs to study the significance of resilience in diverse and dynamic environments to identify the activity of multiple users.
    Original languageEnglish
    Title of host publication2023 International Wireless Communications and Mobile Computing (IWCMC)
    PublisherIEEE
    Pages126-131
    Number of pages6
    ISBN (Electronic)979-8-3503-3339-8
    ISBN (Print)979-8-3503-3340-4
    DOIs
    Publication statusPublished - 21 Jul 2023
    EventInternational Wireless Communications & Mobile Computing Conference - Marrakesh, Morocco
    Duration: 19 Jun 202323 Jun 2023
    https://iwcmc.org/2023/

    Publication series

    Name
    PublisherIEEE
    ISSN (Print)2376-6492
    ISSN (Electronic)2376-6506

    Conference

    ConferenceInternational Wireless Communications & Mobile Computing Conference
    Abbreviated titleIWCMC 2023
    Country/TerritoryMorocco
    CityMarrakesh
    Period19/06/2323/06/23
    Internet address

    UN SDGs

    This output contributes to the following UN Sustainable Development Goals (SDGs)

    1. SDG 3 - Good Health and Well-being
      SDG 3 Good Health and Well-being

    Keywords

    • Deep learning
    • Radio frequency
    • Wireless communication
    • Feature extraction
    • Data models
    • Sensors
    • Human activity recognition

    Fingerprint

    Dive into the research topics of 'Contactless Human Activity Recognition using Deep Learning with Flexible and Scalable Software Define Radio'. Together they form a unique fingerprint.

    Cite this