Using Information Experience Design and Multimodality to make sense of experiences in physical and virtual curated spaces

Dylan Yamada-Rice, Kevin Walker

Research output: Contribution to journalConference articlepeer-review

Abstract

This paper shows how our use of multimodal theory in relation to the discipline of Information Experience Design (IED) that we teach and direct at the Royal College of Art contributes to the development of the multimodal paradigm.

Information Experience Design is a new, hybrid field unrelated to informatics or commercial ‘user experience’ where research is undertaken using theories of information and experience drawn from the social sciences, physics, computer science and communications research (including multimodal social semiotic theory). The discipline is forward thinking centring on multisensory forms of analysis and understanding, that have been made necessary by the proliferation of technologies and the growing capacity to gather data, which has raised questions about how people experience information, and how information is both communicated in and generated from embodied experiences. IED makes use of advances in digital technologies, combined with analogue making to produce a range of multimodal data that is then analysed in order to design means for people to experience data in innovative ways such as through physical-digital installations.

After outlining IED we draw on our interests in physical and virtual curated spaces to show how we have combined multimodality with hands-on methods of drawing, animation and making to inform changes in the museums and digital games industry. Specifically, Walker’s work focuses on visitor interactions with museum displays that incorporate both physical and digital exhibits. Yamada-Rice will draw examples from her commercially-funded study on children’s interaction and engagement with a wide range of virtual reality content and devices.
Original languageEnglish
Journal9ICOM International Conference on Multimodality
Publication statusPublished - 14 Aug 2018
Externally publishedYes
Event9th International Conference on Multimodality - University of Southern Denmark, Odense, Denmark
Duration: 15 Aug 201817 Aug 2018

Keywords

  • multimodality
  • information experience design
  • VR

ASJC Scopus subject areas

  • Arts and Humanities (miscellaneous)
  • Human-Computer Interaction
  • Communication

Fingerprint Dive into the research topics of 'Using Information Experience Design and Multimodality to make sense of experiences in physical and virtual curated spaces'. Together they form a unique fingerprint.

Cite this