Is this project an undergraduate, graduate, or faculty project?
Undergraduate
Project Type
group
Authors' Class Standing
Courtney Thurston, Senior Daniel Silverio, Senior Albert DiCroce, Senior Jonathan Betancourt, Senior Jose Polo Melo, Senior
Lead Presenter's Name
Courtney Thurston
Faculty Mentor Name
Massood Towhidnejad
Abstract
The goal is to create a lightweight integrated device consisting of a small camera, binaural microphones, a head orientation tracker, and a GPS unit mounted onto a pair of glasses. The device will allow the user to capture and record audio and video in the same manner that it was experienced organically by the user. This is enabled by the glasses-mounted camera and the small profile binaural microphones, which sit inside the ear without blocking the eardrum. The head orientation tracker and GPS unit are attached to the glasses and record positioning and orientation of the user for realistic playback. A Raspberry Pi will be used as the microcontroller for data retrieval and processing. Connections are made between the components on the chassis, and data are compiled and synchronized. Further, an Android device, web server, and SQL database will be used for storage and playback of the captured data. There are many applications and uses for such a device. In military training situations, realistic audio and video captured from a first-person perspective can be used to create the best training simulations where the recorded data could be played back during training. This methodology would provide the most realistic scenarios, as each person would hear and see the video exactly as if they experienced it firsthand. In a combat scenario, the recorded audio could be transmitted between soldiers so that each soldier knows the relative position and environment of every other soldier. Further, the device can assist users that struggle with short-term memory loss, a common side-effect of a large swath of medical conditions. If the user is having difficulties remembering a situation that happened, they can use their Android device to easily playback the recorded environment to assist them in remembering the details.
Did this research project receive funding support (Spark, SURF, Research Abroad, Student Internal Grants, Collaborative, Climbing, or Ignite Grants) from the Office of Undergraduate Research?
No
A Novel Binaural Audio Device for Cross-Platform Situational Awareness and Recall
The goal is to create a lightweight integrated device consisting of a small camera, binaural microphones, a head orientation tracker, and a GPS unit mounted onto a pair of glasses. The device will allow the user to capture and record audio and video in the same manner that it was experienced organically by the user. This is enabled by the glasses-mounted camera and the small profile binaural microphones, which sit inside the ear without blocking the eardrum. The head orientation tracker and GPS unit are attached to the glasses and record positioning and orientation of the user for realistic playback. A Raspberry Pi will be used as the microcontroller for data retrieval and processing. Connections are made between the components on the chassis, and data are compiled and synchronized. Further, an Android device, web server, and SQL database will be used for storage and playback of the captured data. There are many applications and uses for such a device. In military training situations, realistic audio and video captured from a first-person perspective can be used to create the best training simulations where the recorded data could be played back during training. This methodology would provide the most realistic scenarios, as each person would hear and see the video exactly as if they experienced it firsthand. In a combat scenario, the recorded audio could be transmitted between soldiers so that each soldier knows the relative position and environment of every other soldier. Further, the device can assist users that struggle with short-term memory loss, a common side-effect of a large swath of medical conditions. If the user is having difficulties remembering a situation that happened, they can use their Android device to easily playback the recorded environment to assist them in remembering the details.