No Cover Image

Journal article 813 views 369 downloads

Pulling Back the Curtain on the Wizards of Oz

Martin Porcheron, Joel E. Fischer, Stuart Reeves

Proceedings of the ACM on Human-Computer Interaction, Volume: 4, Issue: CSCW3, Pages: 1 - 22

Swansea University Author: Martin Porcheron

Check full text

DOI (Published version): 10.1145/3432942

Abstract

The Wizard of Oz method is an increasingly common practice in HCI and CSCW studies as part of iterative design processes for interactive systems. Instead of designing a fully-fledged system, the ‘technical work’ of key system components is completed by human operators yet presented to study particip...

Full description

Published in: Proceedings of the ACM on Human-Computer Interaction
ISSN: 2573-0142 2573-0142
Published: New York, NY, USA Association for Computing Machinery (ACM) 2021
Online Access: Check full text

URI: https://cronfa.swan.ac.uk/Record/cronfa55249
first_indexed 2020-10-29T14:53:31Z
last_indexed 2021-12-02T04:11:15Z
id cronfa55249
recordtype SURis
fullrecord <?xml version="1.0"?><rfc1807><datestamp>2021-12-01T10:38:18.1903159</datestamp><bib-version>v2</bib-version><id>55249</id><entry>2020-09-23</entry><title>Pulling Back the Curtain on the Wizards of Oz</title><swanseaauthors><author><sid>d9de398c04c0b443d547d455782d5de5</sid><firstname>Martin</firstname><surname>Porcheron</surname><name>Martin Porcheron</name><active>true</active><ethesisStudent>false</ethesisStudent></author></swanseaauthors><date>2020-09-23</date><abstract>The Wizard of Oz method is an increasingly common practice in HCI and CSCW studies as part of iterative design processes for interactive systems. Instead of designing a fully-fledged system, the &#x2018;technical work&#x2019; of key system components is completed by human operators yet presented to study participants as if computed by a machine. However, little is known about how Wizard of Oz studies are interactionally and collaboratively achieved in situ by researchers and participants. By adopting an ethnomethodological perspective, we analyse our use of the method in studies with a voice-controlled vacuum robot and two researchers present. We present data that reveals how such studies are organised and presented to participants and unpack the coordinated orchestration work that unfolds &#x2018;behind the scenes&#x2019; to complete the study. We examine how the researchers attend to participant requests and technical breakdowns, and discuss the performative, collaborative, and methodological nature of their work. We conclude by offering insights from our application of the approach to others in the HCI and CSCW communities for using the method.</abstract><type>Journal Article</type><journal>Proceedings of the ACM on Human-Computer Interaction</journal><volume>4</volume><journalNumber>CSCW3</journalNumber><paginationStart>1</paginationStart><paginationEnd>22</paginationEnd><publisher>Association for Computing Machinery (ACM)</publisher><placeOfPublication>New York, NY, USA</placeOfPublication><isbnPrint/><isbnElectronic/><issnPrint>2573-0142</issnPrint><issnElectronic>2573-0142</issnElectronic><keywords>woz, natural language interfaces, voice interfaces, vuis, robots, collaboration, coordination, research practice, methodology, ethnography, ethnomethodology, cscw</keywords><publishedDay>5</publishedDay><publishedMonth>1</publishedMonth><publishedYear>2021</publishedYear><publishedDate>2021-01-05</publishedDate><doi>10.1145/3432942</doi><url/><notes/><college>COLLEGE NANME</college><CollegeCode>COLLEGE CODE</CollegeCode><institution>Swansea University</institution><apcterm/><lastEdited>2021-12-01T10:38:18.1903159</lastEdited><Created>2020-09-23T16:07:32.8932917</Created><path><level id="1">Faculty of Science and Engineering</level><level id="2">School of Mathematics and Computer Science - Computer Science</level></path><authors><author><firstname>Martin</firstname><surname>Porcheron</surname><order>1</order></author><author><firstname>Joel E.</firstname><surname>Fischer</surname><order>2</order></author><author><firstname>Stuart</firstname><surname>Reeves</surname><order>3</order></author></authors><documents><document><filename>55249__18719__b6a1685e4c2c4a76b752f9d13542d04e.pdf</filename><originalFilename>woz-authorversion.pdf</originalFilename><uploaded>2020-11-23T10:36:00.5080597</uploaded><type>Output</type><contentLength>4150859</contentLength><contentType>application/pdf</contentType><version>Accepted Manuscript</version><cronfaStatus>true</cronfaStatus><copyrightCorrect>true</copyrightCorrect><language>eng</language></document></documents><OutputDurs/></rfc1807>
spelling 2021-12-01T10:38:18.1903159 v2 55249 2020-09-23 Pulling Back the Curtain on the Wizards of Oz d9de398c04c0b443d547d455782d5de5 Martin Porcheron Martin Porcheron true false 2020-09-23 The Wizard of Oz method is an increasingly common practice in HCI and CSCW studies as part of iterative design processes for interactive systems. Instead of designing a fully-fledged system, the ‘technical work’ of key system components is completed by human operators yet presented to study participants as if computed by a machine. However, little is known about how Wizard of Oz studies are interactionally and collaboratively achieved in situ by researchers and participants. By adopting an ethnomethodological perspective, we analyse our use of the method in studies with a voice-controlled vacuum robot and two researchers present. We present data that reveals how such studies are organised and presented to participants and unpack the coordinated orchestration work that unfolds ‘behind the scenes’ to complete the study. We examine how the researchers attend to participant requests and technical breakdowns, and discuss the performative, collaborative, and methodological nature of their work. We conclude by offering insights from our application of the approach to others in the HCI and CSCW communities for using the method. Journal Article Proceedings of the ACM on Human-Computer Interaction 4 CSCW3 1 22 Association for Computing Machinery (ACM) New York, NY, USA 2573-0142 2573-0142 woz, natural language interfaces, voice interfaces, vuis, robots, collaboration, coordination, research practice, methodology, ethnography, ethnomethodology, cscw 5 1 2021 2021-01-05 10.1145/3432942 COLLEGE NANME COLLEGE CODE Swansea University 2021-12-01T10:38:18.1903159 2020-09-23T16:07:32.8932917 Faculty of Science and Engineering School of Mathematics and Computer Science - Computer Science Martin Porcheron 1 Joel E. Fischer 2 Stuart Reeves 3 55249__18719__b6a1685e4c2c4a76b752f9d13542d04e.pdf woz-authorversion.pdf 2020-11-23T10:36:00.5080597 Output 4150859 application/pdf Accepted Manuscript true true eng
title Pulling Back the Curtain on the Wizards of Oz
spellingShingle Pulling Back the Curtain on the Wizards of Oz
Martin Porcheron
title_short Pulling Back the Curtain on the Wizards of Oz
title_full Pulling Back the Curtain on the Wizards of Oz
title_fullStr Pulling Back the Curtain on the Wizards of Oz
title_full_unstemmed Pulling Back the Curtain on the Wizards of Oz
title_sort Pulling Back the Curtain on the Wizards of Oz
author_id_str_mv d9de398c04c0b443d547d455782d5de5
author_id_fullname_str_mv d9de398c04c0b443d547d455782d5de5_***_Martin Porcheron
author Martin Porcheron
author2 Martin Porcheron
Joel E. Fischer
Stuart Reeves
format Journal article
container_title Proceedings of the ACM on Human-Computer Interaction
container_volume 4
container_issue CSCW3
container_start_page 1
publishDate 2021
institution Swansea University
issn 2573-0142
2573-0142
doi_str_mv 10.1145/3432942
publisher Association for Computing Machinery (ACM)
college_str Faculty of Science and Engineering
hierarchytype
hierarchy_top_id facultyofscienceandengineering
hierarchy_top_title Faculty of Science and Engineering
hierarchy_parent_id facultyofscienceandengineering
hierarchy_parent_title Faculty of Science and Engineering
department_str School of Mathematics and Computer Science - Computer Science{{{_:::_}}}Faculty of Science and Engineering{{{_:::_}}}School of Mathematics and Computer Science - Computer Science
document_store_str 1
active_str 0
description The Wizard of Oz method is an increasingly common practice in HCI and CSCW studies as part of iterative design processes for interactive systems. Instead of designing a fully-fledged system, the ‘technical work’ of key system components is completed by human operators yet presented to study participants as if computed by a machine. However, little is known about how Wizard of Oz studies are interactionally and collaboratively achieved in situ by researchers and participants. By adopting an ethnomethodological perspective, we analyse our use of the method in studies with a voice-controlled vacuum robot and two researchers present. We present data that reveals how such studies are organised and presented to participants and unpack the coordinated orchestration work that unfolds ‘behind the scenes’ to complete the study. We examine how the researchers attend to participant requests and technical breakdowns, and discuss the performative, collaborative, and methodological nature of their work. We conclude by offering insights from our application of the approach to others in the HCI and CSCW communities for using the method.
published_date 2021-01-05T19:56:56Z
_version_ 1821346120376254464
score 11.04748

Similar Items