Show simple item record

dc.creatorShen, Xinxu
dc.creatorHouser, Troy
dc.creatorSmith, David
dc.creatorMurty, Vishnu
dc.date.accessioned2022-07-27T14:59:52Z
dc.date.available2022-07-27T14:59:52Z
dc.date.issued2021-12-21
dc.identifier.citationShen, X., Houser, T., Smith, D. V., & Murty, V. P. (2021). Machine-learning as a validated tool to characterize individual differences in free recall of naturalistic events. https://doi.org/10.31234/osf.io/uygzv
dc.identifier.doihttp://dx.doi.org/10.34944/dspace/7928
dc.identifier.urihttp://hdl.handle.net/20.500.12613/7956
dc.description.abstractThe use of naturalistic stimuli, such as narrative movies, is gaining popularity in many fields, characterizing memory, affect, and decision-making. Narrative recall paradigms are often used to capture the complexity and richness of memory for naturalistic events. However, scoring narrative recalls is time-consuming and prone to human biases. Here, we show the validity and reliability of using a natural language processing tool, the Universal Sentence Encoder (USE), to automatically score narrative recall. We compared the reliability in scoring made between two independent raters (i.e., hand-scored) and between our automated algorithm and individual raters (i.e., automated) on trial-unique, video clips of magic tricks. Study 1 showed that our automated segmentation approaches yielded high reliability and reflected measures yielded by hand-scoring, and further that the results using USE outperformed another popular natural language processing tool, GloVe. In study two, we tested whether our automated approach remained valid when testing individual’s varying on clinically-relevant dimensions that influence episodic memory, age and anxiety. We found that our automated approach was equally reliable across both age groups and anxiety groups, which shows the efficacy of our approach to assess narrative recall in large-scale individual difference analysis. In sum, these findings suggested that machine learning approaches implementing USE are a promising tool for scoring large-scale narrative recalls and perform individual difference analysis for research using naturalistic stimuli.
dc.format.extent23 pages
dc.languageEnglish
dc.language.isoeng
dc.relation.ispartofFaculty/ Researcher Works
dc.relation.isreferencedbyPsyArXiv
dc.rightsAttribution CC BY
dc.rights.urihttp://creativecommons.org/licenses/by/4.0/
dc.subjectEpisodic memory
dc.subjectFree recall
dc.subjectMachine elarning
dc.titleMachine-learning as a validated tool to characterize individual differences in free recall of naturalistic events.
dc.typeText
dc.type.genrePre-print
dc.description.departmentPsychology and Neuroscience
dc.relation.doihttps://doi.org/10.31234/osf.io/uygzv
dc.ada.noteFor Americans with Disabilities Act (ADA) accommodation, including help with reading this content, please contact scholarshare@temple.edu
dc.description.schoolcollegeTemple University. College of Liberal Arts
dc.creator.orcidMurty|0000-0002-1360-3156
dc.creator.orcidSmith|0000-0001-5754-9633
dc.temple.creatorMurty, Vishnu P.
dc.temple.creatorSmith, David V.
refterms.dateFOA2022-07-27T14:59:52Z


Files in this item

Thumbnail
Name:
Murty-PrePrint-2021.docx
Size:
323.7Kb
Format:
Microsoft Word 2007

This item appears in the following Collection(s)

Show simple item record

Attribution CC BY
Except where otherwise noted, this item's license is described as Attribution CC BY