Exploring the potential of speech recognition to support problem solving and reflection: Wizards go to school in the elementary maths classroom

Manolis Mavrikis, Beate Grawemeyer, Alice Hansen, Sergio Gutierrez-Santos

Research output: Chapter in Book/Report/Conference proceedingConference proceeding

11 Citations (Scopus)

Abstract

The work described in this paper investigates the potential of Automatic Speech Recognition (ASR) to support young children's exploration and reflection as they are working with interactive learning environments. We describe a unique ecologically valid Wizard-of-Oz (WoZ) study in a classroom equipped with computers, two of which were set up to allow human facilitators (wizards) to listen to students thinking-aloud while having access to their interaction with the environment. The wizards provided support using a script and following an iterative methodology that limited on purpose their communication capacity in order to simulate the actual system. Our results indicate that the feedback received from the wizards did serve its function i.e. it helped modify students' behaviour in that they did think-aloud significantly more than in past interactions and rephrased their language to employ mathematical terminology. Additional results from student perception questionnaires show that overall students find the system suggestions helpful, not repetitive and understandable. Most also enjoy thinking aloud to the computer but, as expected, some find the feedback cognitively overloading, indicating that more work is needed on how to design the interaction tipping the balance towards facilitating post-task reflection.

Original languageEnglish
Title of host publicationOpen Learning and Teaching in Educational Communities - 9th European Conference on Technology Enhanced Learning, EC-TEL 2014, Proceedings
PublisherSpringer-Verlag Italia
Pages263-276
Number of pages14
ISBN (Electronic)9783319112008
ISBN (Print)9783319111995
DOIs
Publication statusPublished - 1 Jan 2014
Externally publishedYes
Event9th European Conference on Technology Enhanced Learning, EC-TEL 2014 - Graz, Austria
Duration: 16 Sep 201419 Sep 2014
Conference number: 9

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume8719 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference9th European Conference on Technology Enhanced Learning, EC-TEL 2014
Abbreviated titleEC-TEL
CountryAustria
CityGraz
Period16/09/1419/09/14

Keywords

  • Intelligent Support
  • Speech Recognition
  • Wizard-of-Oz

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Exploring the potential of speech recognition to support problem solving and reflection: Wizards go to school in the elementary maths classroom'. Together they form a unique fingerprint.

Cite this