Participants Selection for From-Scratch Mobile Crowdsensing via Reinforcement Learning

Yunfan Hu, Jiangtao Wang, Bo Wu, Sumi Helal

Research output: Chapter in Book/Report/Conference proceedingConference proceeding

Abstract

Participant selection is a major research challenge in Mobile Crowdsensing (MCS). Previous approaches commonly assume that adequately long and fixed periods of candidate participants' historical mobility trajectories are available before the selection process. This enables the frameworks to accurately model mobility which enables the optimization of selection. However, this assumption may not be realistic for newly-released MCS applications or platforms because the candidates have just boarded without previous mobility profiles. The sparsity or even absence of mobility traces will incur inaccurate location prediction of the individual participant, thus imposing negative effects on the participant selection process and hindering the practical deployment of new MCS applications. To this end, this paper investigates a novel problem called "From-Scratch MCS" (FS-MCS for short), in which we study how to intelligently select participants to minimize such "cold-start" effect. Specifically, we propose a novel framework based on reinforcement learning, which we name RL-Recruiter. With the gradual accumulation of mobility trajectories over time, RL-Recruiter can make a good sequence of participant selection decisions for each sensing slot by incrementally extracting and utilizing the collective mobility patterns of all candidate participants, thus avoiding the prediction of individual participant's location that is very inaccurate when the training data is sparse. We test our approach experimentally based on two real-world mobility datasets. Our experiment results demonstrate that RL-Recruiter outperforms the baseline approaches under various settings.

Original languageEnglish
Title of host publication18th Annual IEEE International Conference on Pervasive Computing and Communications, PerCom 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
Number of pages10
ISBN (Electronic)978-1-7281-4657-7
ISBN (Print)978-1-7281-4658-4
DOIs
Publication statusPublished - 29 Jun 2020
Externally publishedYes
Event18th Annual IEEE International Conference on Pervasive Computing and Communications, PerCom 2020 - Austin, United States
Duration: 23 Mar 202027 Mar 2020

Publication series

Name18th Annual IEEE International Conference on Pervasive Computing and Communications, PerCom 2020

Conference

Conference18th Annual IEEE International Conference on Pervasive Computing and Communications, PerCom 2020
CountryUnited States
CityAustin
Period23/03/2027/03/20

Keywords

  • mobile crowdsensing
  • participant selection
  • reinforcement learning

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Networks and Communications
  • Computer Science Applications
  • Decision Sciences (miscellaneous)
  • Information Systems and Management
  • Media Technology

Fingerprint Dive into the research topics of 'Participants Selection for From-Scratch Mobile Crowdsensing via Reinforcement Learning'. Together they form a unique fingerprint.

Cite this