Dual-Stream Contrastive Learning for Channel State Information Based Human Activity Recognition

Ke Xu, Jiangtao Wang, Le Zhang, Hongyuan Zhu, Dingchang Zheng

    Research output: Contribution to journalArticlepeer-review

    5 Citations (Scopus)
    215 Downloads (Pure)

    Abstract

    WiFi-based human activity recognition (HAR) has been extensively studied due to its far-reaching applications in health domains, including elderly monitoring, exercise supervision and rehabilitation monitoring, etc. Although existing supervised deep learning techniques have achieved remarkable performances for these tasks, they are however data-hungry and hence are notoriously difficult due to the privacy and incomprehensibility of WiFi-based HAR data. Existing contrastive learning models, mainly designed for computer vision, cannot guarantee their performance on channel state information (CSI) data. To this end, we propose a new dual-stream contrastive learning model that can process and learn the raw WiFi CSI data in a self-supervised manner. More specifically, our proposed method, coined as DualConFi , takes raw WiFI CSI data as input and incorporates channel and temporal streams to learn highly-discriminative spatiotemporal features under a mutual information constraint using unlabeled data. We exhibit the effectiveness of our model on three publicly available CSI data sets in various experiment settings, including linear evaluation, semi-supervised, and transfer learning. We show that DualConFi is able to perform favourably against challenging baselines in each setting. Moreover, by studying the effects of different transform functions on CSI data, we finally verify the effectiveness of highly-discriminative features.
    Original languageEnglish
    Pages (from-to)329-338
    Number of pages10
    JournalIEEE Journal of Biomedical and Health Informatics
    Volume27
    Issue number1
    Early online date4 Nov 2022
    DOIs
    Publication statusPublished - 1 Jan 2023

    Bibliographical note

    © 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

    Copyright © and Moral Rights are retained by the author(s) and/ or other copyright owners. A copy can be downloaded for personal non-commercial research or study, without prior permission or charge. This item cannot be reproduced or quoted extensively from without first obtaining permission in writing from the copyright holder(s). The content must not be changed in any way or sold commercially in any format or medium without the formal permission of the copyright holders.

    This document is the author’s post-print version, incorporating any revisions agreed during the peer-review process. Some differences between the published version and this version may remain and you are advised to consult the published version if you wish to cite from it.

    Keywords

    • Human Activity Recognition
    • Self-supervised Learning
    • Channel state information

    Fingerprint

    Dive into the research topics of 'Dual-Stream Contrastive Learning for Channel State Information Based Human Activity Recognition'. Together they form a unique fingerprint.

    Cite this