Is this project an undergraduate, graduate, or faculty project?

Undergraduate

group

What campus are you from?

Daytona Beach

Authors' Class Standing

Weerachet Sinlapanuntakul, Senior Katlyn Skilton, Accelerated Senior Jose N. Mathew, Senior Aaron Collard, Senior Barbara S. Chaparro, Faculty

Lead Presenter's Name

Weerachet Sinlapanuntakul

Faculty Mentor Name

Barbara S. Chaparro

Abstract

Mixed reality devices, such as the Microsoft HoloLens 2, are growing in popularity and have been adopted in domains like education, aviation, and medicine. Text entry interaction is essential for daily activities: texting, using websites, and taking notes. However, typing long messages using the HoloLens’ virtual keyboard can be slow and cumbersome. The voice dictation provides a speech-to-text interaction that requires less physical effort and time by allowing users to verbalize messages and translate them into the text without manual input. Still, HoloLens 1’s dictation method was specifically problematic when the background noise exceeded 60 dB, which is common in many work environments. Consequently, less than half of the participants could dictate phrases in the high noise condition. However, the HoloLens 2 has improved the voice dictation to function in a higher background noise level with a maximum of 90 dB (Strange, 2019). This study will examine the user experience and the extent to which different background noise conditions impact voice dictation efficiency and effectiveness using the Microsoft HoloLens 2. The results will be compared to the past research on the HoloLens 1 (Derby et al., 2020). In addition, user perceptions and feedback will help create recommendations for future improvements.

Did this research project receive funding support from the Office of Undergraduate Research.

Yes, Student Internal Grant

Share

COinS
 

Assessing Mixed Reality Voice Dictation with Background Noise

Mixed reality devices, such as the Microsoft HoloLens 2, are growing in popularity and have been adopted in domains like education, aviation, and medicine. Text entry interaction is essential for daily activities: texting, using websites, and taking notes. However, typing long messages using the HoloLens’ virtual keyboard can be slow and cumbersome. The voice dictation provides a speech-to-text interaction that requires less physical effort and time by allowing users to verbalize messages and translate them into the text without manual input. Still, HoloLens 1’s dictation method was specifically problematic when the background noise exceeded 60 dB, which is common in many work environments. Consequently, less than half of the participants could dictate phrases in the high noise condition. However, the HoloLens 2 has improved the voice dictation to function in a higher background noise level with a maximum of 90 dB (Strange, 2019). This study will examine the user experience and the extent to which different background noise conditions impact voice dictation efficiency and effectiveness using the Microsoft HoloLens 2. The results will be compared to the past research on the HoloLens 1 (Derby et al., 2020). In addition, user perceptions and feedback will help create recommendations for future improvements.

 

To view the content in your browser, please download Adobe Reader or, alternately,
you may Download the file to your hard drive.

NOTE: The latest versions of Adobe Reader do not support viewing PDF files within Firefox on Mac OS and if you are using a modern (Intel) Mac, there is no official plugin for viewing PDF files within the browser window.