Beamforming with acoustic vector sensors for audio user interfaces. We aim to create new Audio User Interfaces (AUIs) for the automatic separation and annotation of audio from complex sound scenes using acoustic vector sensor beamforming technology. Specifically, we will develop: speech AUIs for noisy, multi-talker, reverberant environments; and sound transcription AUIs for the deaf. Ultimately, users will be able to walk into a room, hold conversations and leave with a searchable, automatically ....Beamforming with acoustic vector sensors for audio user interfaces. We aim to create new Audio User Interfaces (AUIs) for the automatic separation and annotation of audio from complex sound scenes using acoustic vector sensor beamforming technology. Specifically, we will develop: speech AUIs for noisy, multi-talker, reverberant environments; and sound transcription AUIs for the deaf. Ultimately, users will be able to walk into a room, hold conversations and leave with a searchable, automatically-generated transcript of the audio events, tagged with metadata. The application of these technologies will create new possibilities for recording audio in the music, radio, TV industries, and future home based audio communication systems.Read moreRead less
Mobile spatial-audio telecommunication systems. We will develop an inter-personal electronic spatial-audio telecommunication system that works outdoors in a mobile environment. Talkers using the system will be acoustically aware of other talkers? locations because the communication channel is rendered as 3D audio. The system provides situational awareness useful during activities such as fire fighting, search and rescue, surveillance, audio/video teleconferencing. The research investigates syste ....Mobile spatial-audio telecommunication systems. We will develop an inter-personal electronic spatial-audio telecommunication system that works outdoors in a mobile environment. Talkers using the system will be acoustically aware of other talkers? locations because the communication channel is rendered as 3D audio. The system provides situational awareness useful during activities such as fire fighting, search and rescue, surveillance, audio/video teleconferencing. The research investigates system implementations using wearable computing with personal location sensors (differential GPS) and personal orientation sensors (hybrid gyroscopic/magnetic system). The work will result in fundamental data relevant to the development, testing and validation of a mobile telecommunication system with individualised spatial audio.Read moreRead less