Skip to main navigation Skip to search Skip to main content

Silent Yet Expressive: Toward Seamless VR Communication through Emotion-aware Silent Speech Interfaces

  • Seoul National University of Science and Technology (SNUST)

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The increasing use of VR/MR in public spaces necessitates discreet and privacy-aware communication methods. While silent speech recognition offers an alternative to voice input, current systems cannot convey emotional nuance, limiting natural interaction. To bridge this gap, we present a novel emotion-aware silent-speech interface designed for immersive VR environments, which integrates facial expression recognition to enable the expression of affective cues. Our preliminary user study validates the feasibility of the proposed approach, showing promising results for enhanced, expressive communication within public VR contexts.

Original languageEnglish
Title of host publicationUIST Adjunct 2025 - Proceedings of the 38th Annual ACM Symposium on User Interface Software and Technology
EditorsAndrea Bianchi, Elena Glassman, Shengdong Zhao, Jeeeun Kim, Ian Oakley, Wendy E. Mackay
PublisherAssociation for Computing Machinery, Inc
ISBN (Electronic)9798400720369
DOIs
StatePublished - 27 Sep 2025
Event38th Annual ACM Symposium on User Interface Software and Technology, UIST 2025 - Busan, Korea, Republic of
Duration: 28 Sep 20251 Oct 2025

Publication series

NameUIST Adjunct 2025 - Proceedings of the 38th Annual ACM Symposium on User Interface Software and Technology

Conference

Conference38th Annual ACM Symposium on User Interface Software and Technology, UIST 2025
Country/TerritoryKorea, Republic of
CityBusan
Period28/09/251/10/25

Keywords

  • emotional expression
  • silent-speech
  • virtual reality

Fingerprint

Dive into the research topics of 'Silent Yet Expressive: Toward Seamless VR Communication through Emotion-aware Silent Speech Interfaces'. Together they form a unique fingerprint.

Cite this