Loading...
Evaluating the Effects of a Programming Error on a Virtual Environment Measure of Spatial Navigation Behavior
Weisberg, Steven Schinazi, Victor Ferrario, Andrea
Weisberg, Steven
Schinazi, Victor
Ferrario, Andrea
Citations
Altmetric:
Genre
Pre-print
Date
2022-01-24
Advisor
Committee member
Group
Department
Psychology and Neuroscience
Permanent link to this record
Collections
Research Projects
Organizational Units
Journal Issue
DOI
https://doi.org/10.31234/osf.io/c8a5z
Abstract
Relying on shared tasks and stimuli to conduct research can enhance the replicability of findings and allow a community of researchers to collect large data sets across multiple experiments. This approach is particularly relevant for experiments in spatial navigation, which often require the development of unfamiliar large-scale virtual environments to test participants. One challenge with shared platforms is that undetected technical errors, rather than being restricted to individual studies, become pervasive across many studies. Here, we discuss the discovery of a software bug in a virtual environment platform used to investigate individual differences in spatial navigation: Virtual Silcton. The bug, which was difficult to detect for several reasons, resulted in storing the absolute value of a direction in a pointing task rather than the signed direction and rendered the original sign of the direction unrecoverable. To assess the impact of the bug on published findings, we collected a new data set for comparison. Results revealed that although the bug caused suppression in pointing errors and had different effects across people (less accurate navigators had more suppression), the effect of the bug on published data is small, partially explaining the difficulty in detecting the bug. We also used the new data set to develop a tool that allows researchers who have previously used Virtual Silcton to evaluate the impact of the bug on their findings. We summarize the ways that shared open materials, shared data, and collaboration can pave the way for better science to prevent errors in the future.
Description
Citation
Weisberg, S. M., Schinazi, V. R., Ferrario, A., & Newcombe, N. (2021). Evaluating the Effects of a Programming Error on a Virtual Environment Measure of Spatial Navigation Behavior. https://doi.org/10.31234/osf.io/c8a5z
Citation to related work
PsyArXiv
Has part
ADA compliance
For Americans with Disabilities Act (ADA) accommodation, including help with reading this content, please contact scholarshare@temple.edu