No Cover Image

Conference Paper/Proceeding/Abstract 432 views

Transparency of CHI Research Artifacts: Results of a Self-Reported Survey

Chat Wacharamanotham Orcid Logo, Lukas Eisenring, Steve Haroz, Florian Echtler

Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Pages: 1 - 14

Swansea University Author: Chat Wacharamanotham Orcid Logo

Full text not available from this repository: check for access using links below.

DOI (Published version): 10.1145/3313831.3376448

Abstract

Several fields of science are experiencing a “replication crisis” that has negatively impacted their credibility. Assessing the validity of a contribution via replicability of its experimental evidence and reproducibility of its analyses requires access to relevant study materials, data, and code. Fa...

Full description

Published in: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
ISBN: 978-1-4503-6708-0
Published: New York, NY, USA ACM 2020
URI: https://cronfa.swan.ac.uk/Record/cronfa60607
first_indexed 2022-08-15T13:55:06Z
last_indexed 2023-01-13T19:20:51Z
id cronfa60607
recordtype SURis
fullrecord <?xml version="1.0"?><rfc1807 xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><datestamp>2022-10-31T15:01:47.8089270</datestamp><bib-version>v2</bib-version><id>60607</id><entry>2022-07-22</entry><title>Transparency of CHI Research Artifacts: Results of a Self-Reported Survey</title><swanseaauthors><author><sid>5310be7eb485ebc96c9671f5a45d6f62</sid><ORCID>0000-0003-4831-2516</ORCID><firstname>Chat</firstname><surname>Wacharamanotham</surname><name>Chat Wacharamanotham</name><active>true</active><ethesisStudent>false</ethesisStudent></author></swanseaauthors><date>2022-07-22</date><deptcode>MACS</deptcode><abstract>Several &#xFB01;elds of science are experiencing a &#x201C;replication crisis&#x201D; that has negatively impacted their credibility. Assessing the validity of a contribution via replicability of its experimental evidence and reproducibility of its analyses requires access to relevant study materials, data, and code. Failing to share them limits the ability to scrutinize or build-upon the research, ultimately hindering scienti&#xFB01;c progress.Understanding how the diverse research artifacts in HCI impact sharing can help produce informed recommendations for individual researchers and policy-makers in HCI. Therefore, we surveyed authors of CHI 2018&#x2013;2019 papers, asking if they share their papers&#x2019; research materials and data, how they share them, and why they do not. The results (34% response rate) show that sharing is uncommon, partly due to misunderstandings about the purpose of sharing and reliable hosting. We conclude with recommendations for fostering open research practices.This paper and all data and materials are freely available at https://osf.io/3bu6t.</abstract><type>Conference Paper/Proceeding/Abstract</type><journal>Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems</journal><volume/><journalNumber/><paginationStart>1</paginationStart><paginationEnd>14</paginationEnd><publisher>ACM</publisher><placeOfPublication>New York, NY, USA</placeOfPublication><isbnPrint>978-1-4503-6708-0</isbnPrint><isbnElectronic/><issnPrint/><issnElectronic/><keywords>Open Science, public data sharing, open data, data availability</keywords><publishedDay>23</publishedDay><publishedMonth>4</publishedMonth><publishedYear>2020</publishedYear><publishedDate>2020-04-23</publishedDate><doi>10.1145/3313831.3376448</doi><url/><notes/><college>COLLEGE NANME</college><department>Mathematics and Computer Science School</department><CollegeCode>COLLEGE CODE</CollegeCode><DepartmentCode>MACS</DepartmentCode><institution>Swansea University</institution><apcterm/><funders/><projectreference/><lastEdited>2022-10-31T15:01:47.8089270</lastEdited><Created>2022-07-22T22:05:34.9594876</Created><path><level id="1">Faculty of Science and Engineering</level><level id="2">School of Mathematics and Computer Science - Computer Science</level></path><authors><author><firstname>Chat</firstname><surname>Wacharamanotham</surname><orcid>0000-0003-4831-2516</orcid><order>1</order></author><author><firstname>Lukas</firstname><surname>Eisenring</surname><order>2</order></author><author><firstname>Steve</firstname><surname>Haroz</surname><order>3</order></author><author><firstname>Florian</firstname><surname>Echtler</surname><order>4</order></author></authors><documents/><OutputDurs><OutputDur><Id>108</Id><IsDataAvailableOnline>true</IsDataAvailableOnline><DataNotAvailableOnlineReasonId xsi:nil="true"/><DurUrl>https://osf.io/3bu6t</DurUrl><IsDurRestrictions>false</IsDurRestrictions><DurRestrictionReasonId xsi:nil="true"/><DurEmbargoDate xsi:nil="true"/></OutputDur></OutputDurs></rfc1807>
spelling 2022-10-31T15:01:47.8089270 v2 60607 2022-07-22 Transparency of CHI Research Artifacts: Results of a Self-Reported Survey 5310be7eb485ebc96c9671f5a45d6f62 0000-0003-4831-2516 Chat Wacharamanotham Chat Wacharamanotham true false 2022-07-22 MACS Several fields of science are experiencing a “replication crisis” that has negatively impacted their credibility. Assessing the validity of a contribution via replicability of its experimental evidence and reproducibility of its analyses requires access to relevant study materials, data, and code. Failing to share them limits the ability to scrutinize or build-upon the research, ultimately hindering scientific progress.Understanding how the diverse research artifacts in HCI impact sharing can help produce informed recommendations for individual researchers and policy-makers in HCI. Therefore, we surveyed authors of CHI 2018–2019 papers, asking if they share their papers’ research materials and data, how they share them, and why they do not. The results (34% response rate) show that sharing is uncommon, partly due to misunderstandings about the purpose of sharing and reliable hosting. We conclude with recommendations for fostering open research practices.This paper and all data and materials are freely available at https://osf.io/3bu6t. Conference Paper/Proceeding/Abstract Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems 1 14 ACM New York, NY, USA 978-1-4503-6708-0 Open Science, public data sharing, open data, data availability 23 4 2020 2020-04-23 10.1145/3313831.3376448 COLLEGE NANME Mathematics and Computer Science School COLLEGE CODE MACS Swansea University 2022-10-31T15:01:47.8089270 2022-07-22T22:05:34.9594876 Faculty of Science and Engineering School of Mathematics and Computer Science - Computer Science Chat Wacharamanotham 0000-0003-4831-2516 1 Lukas Eisenring 2 Steve Haroz 3 Florian Echtler 4 108 true https://osf.io/3bu6t false
title Transparency of CHI Research Artifacts: Results of a Self-Reported Survey
spellingShingle Transparency of CHI Research Artifacts: Results of a Self-Reported Survey
Chat Wacharamanotham
title_short Transparency of CHI Research Artifacts: Results of a Self-Reported Survey
title_full Transparency of CHI Research Artifacts: Results of a Self-Reported Survey
title_fullStr Transparency of CHI Research Artifacts: Results of a Self-Reported Survey
title_full_unstemmed Transparency of CHI Research Artifacts: Results of a Self-Reported Survey
title_sort Transparency of CHI Research Artifacts: Results of a Self-Reported Survey
author_id_str_mv 5310be7eb485ebc96c9671f5a45d6f62
author_id_fullname_str_mv 5310be7eb485ebc96c9671f5a45d6f62_***_Chat Wacharamanotham
author Chat Wacharamanotham
author2 Chat Wacharamanotham
Lukas Eisenring
Steve Haroz
Florian Echtler
format Conference Paper/Proceeding/Abstract
container_title Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
container_start_page 1
publishDate 2020
institution Swansea University
isbn 978-1-4503-6708-0
doi_str_mv 10.1145/3313831.3376448
publisher ACM
college_str Faculty of Science and Engineering
hierarchytype
hierarchy_top_id facultyofscienceandengineering
hierarchy_top_title Faculty of Science and Engineering
hierarchy_parent_id facultyofscienceandengineering
hierarchy_parent_title Faculty of Science and Engineering
department_str School of Mathematics and Computer Science - Computer Science{{{_:::_}}}Faculty of Science and Engineering{{{_:::_}}}School of Mathematics and Computer Science - Computer Science
document_store_str 0
active_str 0
description Several fields of science are experiencing a “replication crisis” that has negatively impacted their credibility. Assessing the validity of a contribution via replicability of its experimental evidence and reproducibility of its analyses requires access to relevant study materials, data, and code. Failing to share them limits the ability to scrutinize or build-upon the research, ultimately hindering scientific progress.Understanding how the diverse research artifacts in HCI impact sharing can help produce informed recommendations for individual researchers and policy-makers in HCI. Therefore, we surveyed authors of CHI 2018–2019 papers, asking if they share their papers’ research materials and data, how they share them, and why they do not. The results (34% response rate) show that sharing is uncommon, partly due to misunderstandings about the purpose of sharing and reliable hosting. We conclude with recommendations for fostering open research practices.This paper and all data and materials are freely available at https://osf.io/3bu6t.
published_date 2020-04-23T16:54:42Z
_version_ 1832111919516876800
score 11.05923

Similar Items