Is this project an undergraduate, graduate, or faculty project?
Undergraduate
group
What campus are you from?
Daytona Beach
Authors' Class Standing
Weerachet Sinlapanuntakul, Senior Katlyn Skilton, Accelerated Senior Jose N. Mathew, Senior Aaron Collard, Senior Barbara S. Chaparro, Faculty
Lead Presenter's Name
Weerachet Sinlapanuntakul
Faculty Mentor Name
Barbara S. Chaparro
Abstract
Mixed reality devices, such as the Microsoft HoloLens 2, are growing in popularity and have been adopted in domains like education, aviation, and medicine. Text entry interaction is essential for daily activities: texting, using websites, and taking notes. However, typing long messages using the HoloLens’ virtual keyboard can be slow and cumbersome. The voice dictation provides a speech-to-text interaction that requires less physical effort and time by allowing users to verbalize messages and translate them into the text without manual input. Still, HoloLens 1’s dictation method was specifically problematic when the background noise exceeded 60 dB, which is common in many work environments. Consequently, less than half of the participants could dictate phrases in the high noise condition. However, the HoloLens 2 has improved the voice dictation to function in a higher background noise level with a maximum of 90 dB (Strange, 2019). This study will examine the user experience and the extent to which different background noise conditions impact voice dictation efficiency and effectiveness using the Microsoft HoloLens 2. The results will be compared to the past research on the HoloLens 1 (Derby et al., 2020). In addition, user perceptions and feedback will help create recommendations for future improvements.
Did this research project receive funding support from the Office of Undergraduate Research.
Yes, Student Internal Grant
Assessing Mixed Reality Voice Dictation with Background Noise
Mixed reality devices, such as the Microsoft HoloLens 2, are growing in popularity and have been adopted in domains like education, aviation, and medicine. Text entry interaction is essential for daily activities: texting, using websites, and taking notes. However, typing long messages using the HoloLens’ virtual keyboard can be slow and cumbersome. The voice dictation provides a speech-to-text interaction that requires less physical effort and time by allowing users to verbalize messages and translate them into the text without manual input. Still, HoloLens 1’s dictation method was specifically problematic when the background noise exceeded 60 dB, which is common in many work environments. Consequently, less than half of the participants could dictate phrases in the high noise condition. However, the HoloLens 2 has improved the voice dictation to function in a higher background noise level with a maximum of 90 dB (Strange, 2019). This study will examine the user experience and the extent to which different background noise conditions impact voice dictation efficiency and effectiveness using the Microsoft HoloLens 2. The results will be compared to the past research on the HoloLens 1 (Derby et al., 2020). In addition, user perceptions and feedback will help create recommendations for future improvements.