Decoding Behavior: Utilizing Virtual Reality Digital Marker and Machine Learning for Early Detection of Mild Cognitive Impairment

  • Yuwon Kim
  • , Jinseok Park
  • , Hojin Choi
  • , Martin Loeser
  • , Hokyoung Ryu
  • , Kyoungwon Seo

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Scopus citations

Abstract

The imperative for early mild cognitive impairment (MCI) detection is underscored by the limitations of traditional biomarkers, high cost and invasiveness, and they often fail to capture behavioral changes in MCI patients associated with impaired instrumental activities of daily living (IADL). This study introduces a cost-effective, non-invasive alternative using digital markers, "virtual kiosk test", which involves performing IADL tasks such as ordering food via a kiosk in virtual reality (VR) to detect MCI at an early stage. Involving 20 healthy controls and 31 MCI patients, four key behavioral features within VR digital markers effectively differentiate groups: hand movement speed, proportion of fixation duration, time to completion, and the number of errors. A machine learning model demonstrated high effectiveness with 93.3% accuracy, 100% sensitivity, 83.3% specificity, 90% precision, and a 94.7% F1-score in group differentiation. Findings suggest that observing behaviors via the virtual kiosk test within 5 minutes can be an efficient approach for early MCI detection, acting as reliable VR digital markers.

Original languageEnglish
Title of host publicationCHI 2024 - Extended Abstracts of the 2024 CHI Conference on Human Factors in Computing Sytems
PublisherAssociation for Computing Machinery
ISBN (Electronic)9798400703317
DOIs
StatePublished - 11 May 2024
Event2024 CHI Conference on Human Factors in Computing Sytems, CHI EA 2024 - Hybrid, Honolulu, United States
Duration: 11 May 202416 May 2024

Publication series

NameConference on Human Factors in Computing Systems - Proceedings

Conference

Conference2024 CHI Conference on Human Factors in Computing Sytems, CHI EA 2024
Country/TerritoryUnited States
CityHybrid, Honolulu
Period11/05/2416/05/24

Keywords

  • Behavior
  • Digital marker
  • Early detection
  • Machine learning
  • Mild cognitive impairment
  • Virtual reality

Fingerprint

Dive into the research topics of 'Decoding Behavior: Utilizing Virtual Reality Digital Marker and Machine Learning for Early Detection of Mild Cognitive Impairment'. Together they form a unique fingerprint.

Cite this