A Situation-Aware and Interactive System for Assisting People Fill out Paper Forms

Jiangtao Wang, Yasha Wang, YaFei Wang, Junfeng Zhao

Research output: Chapter in Book/Report/Conference proceedingConference proceeding

Abstract

People often need help when filling out paper forms, because they do not fully understand the meaning of form fields. Commonly adopted solutions are referring to the form filling instructions or consulting other people. However, they are either inefficient or inconvenient. In this paper, we propose a situation-aware and interactive system, named Interact Form, to help people fill out paper forms. First, it provides an easy-to-use tool to build the knowledge offline about any given form. The knowledge includes the instruction and examples of each form field, and the constraints between fields. Then, when people are filling out a paper form, with the equipped video camera, the system can determine the field-grained position of the pen and provide text or audio instructions based on the user's form filling situations. When a pre-defined constraint is possibly going to be violated, the provided pen will send out an alert by vibration, and an explanation of the alert will also be given at the same time. We evaluate Interact Form with 60 paper form filling activities on 10 real-world paper forms, and the results show the usability of the system.
Original languageEnglish
Title of host publication2015 IEEE 39th Annual Computer Software and Applications Conference
PublisherIEEE
Pages 595 - 600
Number of pages6
ISBN (Electronic)9781467365642
DOIs
Publication statusPublished - 1 Jul 2015
Externally publishedYes
Event2015 IEEE 39th Annual Computer Software and Applications Conference - Taichung, Taiwan, Province of China
Duration: 1 Jul 20155 Jul 2015
Conference number: 39th

Conference

Conference2015 IEEE 39th Annual Computer Software and Applications Conference
Abbreviated titleCOMPSAC
CountryTaiwan, Province of China
CityTaichung
Period1/07/155/07/15

Keywords

  • Situation Awareness
  • Interactive System
  • Paper Form Filling
  • Multi-Modal Interaction

Fingerprint Dive into the research topics of 'A Situation-Aware and Interactive System for Assisting People Fill out Paper Forms'. Together they form a unique fingerprint.

  • Cite this

    Wang, J., Wang, Y., Wang, Y., & Zhao, J. (2015). A Situation-Aware and Interactive System for Assisting People Fill out Paper Forms. In 2015 IEEE 39th Annual Computer Software and Applications Conference (pp. 595 - 600). IEEE. https://doi.org/10.1109/COMPSAC.2015.7