InteractML:Making machine learning accessible for creative practitioners working with movement interaction in immersive media

Clarice Hilton; Nicola Plant; Carlos Gonzalez Diaz; Phoenix  Perry; Ruth Gibson; Bruno Martelli; Michael Zbyszynski; Rebecca Fiebrink; Marco Gillies

doi:10.1145/3489849

InteractML:Making machine learning accessible for creative practitioners working with movement interaction in immersive media

Clarice Hilton, Nicola Plant, Carlos Gonzalez Diaz, Phoenix Perry, Ruth Gibson, Bruno Martelli, Michael Zbyszynski, Rebecca Fiebrink, Marco Gillies

Research Centre for Dance Research

Research output: Chapter in Book/Report/Conference proceeding › Conference proceeding › peer-review

Abstract

Interactive Machine Learning offers a method for designing movement interaction that supports creators in implementing even complex movement designs in their immersive applications by simply performing them with their bodies. We introduce a new tool, InteractML, and an accompanying ideation method, which makes movement interaction design faster, adaptable and accessible to creators of varying experience and backgrounds, such as artists, dancers and independent game developers. The tool is specifically tailored to non-experts as creators configure and train machine learning models via a node-based graph and VR interface, requiring minimal programming. We aim to democratise machine learning for movement interaction to be used in the development of a range of creative and immersive applications.

Original language	English
Title of host publication	VRST'21: Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology
Editors	Yuichi Itoh, Kazuki Takashima, Parinya Punpongsanon, Misha Sra, Kazuyuki Fujita, Shigeo Yoshida, Shigeo Yoshida, Tham Piumsomboon
Publisher	ACM
Pages	1-10
Number of pages	10
Edition	Article No: 23
ISBN (Electronic)	9781450390927
DOIs	https://doi.org/10.1145/3489849
Publication status	Published - 8 Dec 2021
Event	27th ACM Symposium on Virtual Reality Software and Technology - Osaka, Japan Duration: 8 Oct 2021 → 10 Oct 2021

Conference

Conference	27th ACM Symposium on Virtual Reality Software and Technology
Abbreviated title	VRST 21
Country/Territory	Japan
City	Osaka
Period	8/10/21 → 10/10/21

Keywords

Machine Learning
Virtual Reality
Computer Science
Movement
Embodiment
Design
HCI
Immersive media
Interface

Access to Document

10.1145/3489849

Cite this

Hilton, C., Plant, N., Gonzalez Diaz, C., Perry, P., Gibson, R., Martelli, B., Zbyszynski, M., Fiebrink, R., & Gillies, M. (2021). InteractML:Making machine learning accessible for creative practitioners working with movement interaction in immersive media. In Y. Itoh, K. Takashima, P. Punpongsanon, M. Sra, K. Fujita, S. Yoshida, S. Yoshida, & T. Piumsomboon (Eds.), VRST'21: Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology (Article No: 23 ed., pp. 1-10). ACM. https://doi.org/10.1145/3489849

InteractML:Making machine learning accessible for creative practitioners working with movement interaction in immersive media. / Hilton, Clarice; Plant, Nicola; Gonzalez Diaz, Carlos et al.
VRST'21: Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology. ed. / Yuichi Itoh; Kazuki Takashima; Parinya Punpongsanon; Misha Sra; Kazuyuki Fujita; Shigeo Yoshida; Shigeo Yoshida; Tham Piumsomboon. Article No: 23. ed. ACM, 2021. p. 1-10.

Research output: Chapter in Book/Report/Conference proceeding › Conference proceeding › peer-review

Hilton, C, Plant, N, Gonzalez Diaz, C, Perry, P, Gibson, R, Martelli, B, Zbyszynski, M, Fiebrink, R & Gillies, M 2021, InteractML:Making machine learning accessible for creative practitioners working with movement interaction in immersive media. in Y Itoh, K Takashima, P Punpongsanon, M Sra, K Fujita, S Yoshida, S Yoshida & T Piumsomboon (eds), VRST'21: Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology. Article No: 23 edn, ACM, pp. 1-10, 27th ACM Symposium on Virtual Reality Software and Technology, Osaka, Japan, 8/10/21. https://doi.org/10.1145/3489849

Hilton C, Plant N, Gonzalez Diaz C, Perry P, Gibson R, Martelli B et al. InteractML:Making machine learning accessible for creative practitioners working with movement interaction in immersive media. In Itoh Y, Takashima K, Punpongsanon P, Sra M, Fujita K, Yoshida S, Yoshida S, Piumsomboon T, editors, VRST'21: Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology. Article No: 23 ed. ACM. 2021. p. 1-10 doi: 10.1145/3489849

Hilton, Clarice ; Plant, Nicola ; Gonzalez Diaz, Carlos et al. / InteractML:Making machine learning accessible for creative practitioners working with movement interaction in immersive media. VRST'21: Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology. editor / Yuichi Itoh ; Kazuki Takashima ; Parinya Punpongsanon ; Misha Sra ; Kazuyuki Fujita ; Shigeo Yoshida ; Shigeo Yoshida ; Tham Piumsomboon. Article No: 23. ed. ACM, 2021. pp. 1-10

@inproceedings{fefb531e2b124a05bd2864993eff2afd,

title = "InteractML:Making machine learning accessible for creative practitioners working with movement interaction in immersive media",

abstract = "Interactive Machine Learning offers a method for designing movement interaction that supports creators in implementing even complex movement designs in their immersive applications by simply performing them with their bodies. We introduce a new tool, InteractML, and an accompanying ideation method, which makes movement interaction design faster, adaptable and accessible to creators of varying experience and backgrounds, such as artists, dancers and independent game developers. The tool is specifically tailored to non-experts as creators configure and train machine learning models via a node-based graph and VR interface, requiring minimal programming. We aim to democratise machine learning for movement interaction to be used in the development of a range of creative and immersive applications.",

keywords = "Machine Learning, Virtual Reality, Computer Science, Movement, Embodiment, Design, HCI, Immersive media, Interface",

author = "Clarice Hilton and Nicola Plant and {Gonzalez Diaz}, Carlos and Phoenix Perry and Ruth Gibson and Bruno Martelli and Michael Zbyszynski and Rebecca Fiebrink and Marco Gillies",

year = "2021",

month = dec,

day = "8",

doi = "10.1145/3489849",

language = "English",

pages = "1--10",

editor = "Yuichi Itoh and Takashima, {Kazuki } and Punpongsanon, {Parinya } and Misha Sra and Fujita, {Kazuyuki } and Shigeo Yoshida and Yoshida, {Shigeo } and Tham Piumsomboon",

booktitle = "VRST'21: Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology",

publisher = "ACM",

address = "United States",

edition = "Article No: 23",

note = "27th ACM Symposium on Virtual Reality Software and Technology, VRST 21 ; Conference date: 08-10-2021 Through 10-10-2021",

}

TY - GEN

T1 - InteractML:Making machine learning accessible for creative practitioners working with movement interaction in immersive media

AU - Hilton, Clarice

AU - Plant, Nicola

AU - Gonzalez Diaz, Carlos

AU - Perry, Phoenix

AU - Gibson, Ruth

AU - Martelli, Bruno

AU - Zbyszynski, Michael

AU - Fiebrink, Rebecca

AU - Gillies, Marco

PY - 2021/12/8

Y1 - 2021/12/8

N2 - Interactive Machine Learning offers a method for designing movement interaction that supports creators in implementing even complex movement designs in their immersive applications by simply performing them with their bodies. We introduce a new tool, InteractML, and an accompanying ideation method, which makes movement interaction design faster, adaptable and accessible to creators of varying experience and backgrounds, such as artists, dancers and independent game developers. The tool is specifically tailored to non-experts as creators configure and train machine learning models via a node-based graph and VR interface, requiring minimal programming. We aim to democratise machine learning for movement interaction to be used in the development of a range of creative and immersive applications.

AB - Interactive Machine Learning offers a method for designing movement interaction that supports creators in implementing even complex movement designs in their immersive applications by simply performing them with their bodies. We introduce a new tool, InteractML, and an accompanying ideation method, which makes movement interaction design faster, adaptable and accessible to creators of varying experience and backgrounds, such as artists, dancers and independent game developers. The tool is specifically tailored to non-experts as creators configure and train machine learning models via a node-based graph and VR interface, requiring minimal programming. We aim to democratise machine learning for movement interaction to be used in the development of a range of creative and immersive applications.

KW - Machine Learning

KW - Virtual Reality

KW - Computer Science

KW - Movement

KW - Embodiment

KW - Design

KW - HCI

KW - Immersive media

KW - Interface

U2 - 10.1145/3489849

DO - 10.1145/3489849

M3 - Conference proceeding

SP - 1

EP - 10

BT - VRST'21: Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology

A2 - Itoh, Yuichi

A2 - Takashima, Kazuki

A2 - Punpongsanon, Parinya

A2 - Sra, Misha

A2 - Fujita, Kazuyuki

A2 - Yoshida, Shigeo

A2 - Piumsomboon, Tham

PB - ACM

T2 - 27th ACM Symposium on Virtual Reality Software and Technology

Y2 - 8 October 2021 through 10 October 2021

ER -

InteractML:Making machine learning accessible for creative practitioners working with movement interaction in immersive media

Abstract

Conference

Keywords

Access to Document

Fingerprint

Cite this