Is this project an undergraduate, graduate, or faculty project?

Undergraduate

group

Poster Session

Authors' Class Standing

Courtney Thurston, Senior Daniel Silverio, Senior Albert DiCroce, Senior Jonathan Betancourt, Senior Jose Polo Melo, Senior

Lead Presenter's Name

Courtney Thurston

Faculty Mentor Name

Massood Towhidnejad

Abstract

The goal is to create a lightweight integrated device consisting of a small camera, binaural microphones, a head orientation tracker, and a GPS unit mounted onto a pair of glasses. The device will allow the user to capture and record audio and video in the same manner that it was experienced organically by the user. This is enabled by the glasses-mounted camera and the small profile binaural microphones, which sit inside the ear without blocking the eardrum. The head orientation tracker and GPS unit are attached to the glasses and record positioning and orientation of the user for realistic playback. A Raspberry Pi will be used as the microcontroller for data retrieval and processing. Connections are made between the components on the chassis, and data are compiled and synchronized. Further, an Android device, web server, and SQL database will be used for storage and playback of the captured data. There are many applications and uses for such a device. In military training situations, realistic audio and video captured from a first-person perspective can be used to create the best training simulations where the recorded data could be played back during training. This methodology would provide the most realistic scenarios, as each person would hear and see the video exactly as if they experienced it firsthand. In a combat scenario, the recorded audio could be transmitted between soldiers so that each soldier knows the relative position and environment of every other soldier. Further, the device can assist users that struggle with short-term memory loss, a common side-effect of a large swath of medical conditions. If the user is having difficulties remembering a situation that happened, they can use their Android device to easily playback the recorded environment to assist them in remembering the details.

Did this research project receive funding support (Spark or Ignite Grants) from the Office of Undergraduate Research?

No

Share

COinS
 

A Novel Binaural Audio Device for Cross-Platform Situational Awareness and Recall

The goal is to create a lightweight integrated device consisting of a small camera, binaural microphones, a head orientation tracker, and a GPS unit mounted onto a pair of glasses. The device will allow the user to capture and record audio and video in the same manner that it was experienced organically by the user. This is enabled by the glasses-mounted camera and the small profile binaural microphones, which sit inside the ear without blocking the eardrum. The head orientation tracker and GPS unit are attached to the glasses and record positioning and orientation of the user for realistic playback. A Raspberry Pi will be used as the microcontroller for data retrieval and processing. Connections are made between the components on the chassis, and data are compiled and synchronized. Further, an Android device, web server, and SQL database will be used for storage and playback of the captured data. There are many applications and uses for such a device. In military training situations, realistic audio and video captured from a first-person perspective can be used to create the best training simulations where the recorded data could be played back during training. This methodology would provide the most realistic scenarios, as each person would hear and see the video exactly as if they experienced it firsthand. In a combat scenario, the recorded audio could be transmitted between soldiers so that each soldier knows the relative position and environment of every other soldier. Further, the device can assist users that struggle with short-term memory loss, a common side-effect of a large swath of medical conditions. If the user is having difficulties remembering a situation that happened, they can use their Android device to easily playback the recorded environment to assist them in remembering the details.

 

To view the content in your browser, please download Adobe Reader or, alternately,
you may Download the file to your hard drive.

NOTE: The latest versions of Adobe Reader do not support viewing PDF files within Firefox on Mac OS and if you are using a modern (Intel) Mac, there is no official plugin for viewing PDF files within the browser window.