How, What and Who in Human Communication: Movement of Face and Voice. The aim of this project is to identify the essential characteristics of tone, affect, and identity from face and voice using a combination of signal processing, biological, and behavioural techniques in order to develop a comprehensive model of auditory-visual speech processing and communication. This research will significantly improve understanding of the basis of auditory-visual perception and production in tonal languages ....How, What and Who in Human Communication: Movement of Face and Voice. The aim of this project is to identify the essential characteristics of tone, affect, and identity from face and voice using a combination of signal processing, biological, and behavioural techniques in order to develop a comprehensive model of auditory-visual speech processing and communication. This research will significantly improve understanding of the basis of auditory-visual perception and production in tonal languages and in affective communication, facilitate links between neurophysiological processes and auditory-visual speech processing; and contribute to applications in automatic person recognition, automatic speech recognition, text-to-speech systems, and talking head aids for the hearing impaired.Read moreRead less
Special Research Initiatives - Grant ID: SR0354596
Funder
Australian Research Council
Funding Amount
$20,000.00
Summary
Perception and Action in Auditory Scenes (PAAS): Neural, Behavioural, Computational and Mechanical Systems. Auditory scenes are temporal and ephemeral yet pervasively influence human life. How humans negotiate such scenes has not been solved, a fact highlighted by attempts to build machines to respond to speech, warnings etc., in real-world situations with room reverberation, different talkers, and background noise. No one discipline can solve such problems. In this network outstanding researche ....Perception and Action in Auditory Scenes (PAAS): Neural, Behavioural, Computational and Mechanical Systems. Auditory scenes are temporal and ephemeral yet pervasively influence human life. How humans negotiate such scenes has not been solved, a fact highlighted by attempts to build machines to respond to speech, warnings etc., in real-world situations with room reverberation, different talkers, and background noise. No one discipline can solve such problems. In this network outstanding researchers from physical, medical, human, and social sciences with interests in speech, music and audition will provide insights into how humans and machines localize, recognize, interpret and produce auditory events, and advance frontier technologies, e.g., automatic speech recognition, hearing prostheses, auditory monitoring/warning systems.Read moreRead less
Filters reveal what flicker conceals: temporal processing in the human visual system. I have recently discovered a new form of camouflage using 10Hz luminance flicker. This project will quantify this effect and examine the extent to which it generalises across colour and spatial dimensions and to video sequences depicting natural scenes. This information is expected to provide foundational information to technologies relating to national security that rely on visual concealment. This research wi ....Filters reveal what flicker conceals: temporal processing in the human visual system. I have recently discovered a new form of camouflage using 10Hz luminance flicker. This project will quantify this effect and examine the extent to which it generalises across colour and spatial dimensions and to video sequences depicting natural scenes. This information is expected to provide foundational information to technologies relating to national security that rely on visual concealment. This research will examine the extent to which filtering out these camouflaging frequencies enhances our sensitivity to low temporal frequency information. This decamouflaging aspect of my research is expected to improve the clarity of digital video-based technologies including ultrasound, educational, info-tainment and defence applicationsRead moreRead less
Broadcasting 3D Audio: Recording, Transmission, and Playback. With the current state of the art, a performance at the Sydney Opera House cannot be recorded and broadcast such that you can listen to it as if you are in the best seat of the house. The goal of our project is to develop the ultimate form of multi-channel audio broadcasting to create this experience. We will develop and implement effective systems for recording, broadcasting and playback of 3D audio in three different scenarios: indi ....Broadcasting 3D Audio: Recording, Transmission, and Playback. With the current state of the art, a performance at the Sydney Opera House cannot be recorded and broadcast such that you can listen to it as if you are in the best seat of the house. The goal of our project is to develop the ultimate form of multi-channel audio broadcasting to create this experience. We will develop and implement effective systems for recording, broadcasting and playback of 3D audio in three different scenarios: individual headphone reproduction; small loudspeaker array reproduction; and large loudspeaker array reproduction. We will create optimal recording techniques and broadcasting software for each of these playback techniques.Read moreRead less
Predicting the diagnostic performance of individuals and organisations. Predicting the diagnostic performance of individuals and organisations. This project aims to address diagnostic error in advanced technology systems, by providing a mechanism to assess and improve individual diagnosticians’ performance. Organisations that rely on their employees’ diagnostic skills rarely assess them once the operators become qualified, so there is no basis for interventions that might prevent diagnostic erro ....Predicting the diagnostic performance of individuals and organisations. Predicting the diagnostic performance of individuals and organisations. This project aims to address diagnostic error in advanced technology systems, by providing a mechanism to assess and improve individual diagnosticians’ performance. Organisations that rely on their employees’ diagnostic skills rarely assess them once the operators become qualified, so there is no basis for interventions that might prevent diagnostic errors affecting thousands. This research tests a new method of assessing diagnostic skills based on how skilled operators respond to cues. This project will test how employees’ diagnostic skills change and whether this change corresponds to measures of organisational performance. This research is expected to provide organisations with a tool to pre-empt diagnostic errors that could minimise costs to the economy.Read moreRead less
Identification and Examination of Visual Cues for Aircraft Glideslope Control. While aviation safety has improved dramatically over the last 50 years, accidents are still more common during landing than any other stage of flight. This project aims to improve our understanding of the way pilots use visual information to land an aircraft. Once our findings have been incorporated into existing training programs, this much-needed information should result in: (i) reduced pilot training time and cost ....Identification and Examination of Visual Cues for Aircraft Glideslope Control. While aviation safety has improved dramatically over the last 50 years, accidents are still more common during landing than any other stage of flight. This project aims to improve our understanding of the way pilots use visual information to land an aircraft. Once our findings have been incorporated into existing training programs, this much-needed information should result in: (i) reduced pilot training time and cost; (ii) increased trainee pilot safety and confidence; and (iii) reduced aircraft maintenance costs. A PhD student, who will be trained in visual perception and aviation, should contribute significantly to future aviation research in this country.Read moreRead less
Discovery Early Career Researcher Award - Grant ID: DE230100469
Funder
Australian Research Council
Funding Amount
$442,327.00
Summary
Re-igniting 'artistic vibrancy' in the Australian opera ecosystem. This project aims to advance new methodologies for re-establishing 'artistic vibrancy' (a factor found to be lacking by the National Opera Review in 2014-16) within operatic practice in Australia. The project expects to generate new knowledge of vital, but hidden musical processes, using interdisciplinary approaches in order to rebalance and recalibrate the opera ecosystem. Expected outcomes include the revitalisation of operatic ....Re-igniting 'artistic vibrancy' in the Australian opera ecosystem. This project aims to advance new methodologies for re-establishing 'artistic vibrancy' (a factor found to be lacking by the National Opera Review in 2014-16) within operatic practice in Australia. The project expects to generate new knowledge of vital, but hidden musical processes, using interdisciplinary approaches in order to rebalance and recalibrate the opera ecosystem. Expected outcomes include the revitalisation of operatic practice and the establishment of clear parameters for responsible opera curation. Benefits include an enhanced awareness of artistic vibrancy within opera, and the creation of new practices, which will be of significant cultural and artistic benefit to the wider Australian community.Read moreRead less
Discovery Early Career Researcher Award - Grant ID: DE160100142
Funder
Australian Research Council
Funding Amount
$356,822.00
Summary
Sentient Testimony: digital media and memories of Parramatta Girls Home. The project aims to critically assess experimental artistic collaboration as a method for the production of marginalised stories and appropriate forms of national trauma commemoration. Innovative practices of art and digital media are emerging, for example to document life inside Australian child welfare institutions in the context of serious marginalisation and socio-economic disadvantages. The significance of these forms ....Sentient Testimony: digital media and memories of Parramatta Girls Home. The project aims to critically assess experimental artistic collaboration as a method for the production of marginalised stories and appropriate forms of national trauma commemoration. Innovative practices of art and digital media are emerging, for example to document life inside Australian child welfare institutions in the context of serious marginalisation and socio-economic disadvantages. The significance of these forms of testimony has not yet been studied.Read moreRead less
Human time perception: A crossmodal investigation. This research program investigates time perception in humans in the subsecond range. Time perception is a crucial aspect of cognitive functioning but one that is poorly understood. The subsecond scale is particularly relevant because it is the time-frame for crucial tasks such as motor coordination, speech perception and crossmodal integration. This project examines time in an audiovisual context, exploring the cognitive limits of our ability to ....Human time perception: A crossmodal investigation. This research program investigates time perception in humans in the subsecond range. Time perception is a crucial aspect of cognitive functioning but one that is poorly understood. The subsecond scale is particularly relevant because it is the time-frame for crucial tasks such as motor coordination, speech perception and crossmodal integration. This project examines time in an audiovisual context, exploring the cognitive limits of our ability to keep track of time and testing whether time is encoded as a basic feature. These experiments will further our knowledge of time perception and lead to improved models of how the brain encodes time.Read moreRead less
Audio-visual interactions in human perception. How the brain integrates information from different sensory modalities to form coherent perceptions of the external environment is a challenging question in sensory and cognitive neuroscience. Neurophysiologically, sensory interactions have become well documented over the last decade or so. Complementary perceptual research, however, is lacking. This project seeks to redress the imbalance, using audio-visual interactions as a paradigm. Psychophysica ....Audio-visual interactions in human perception. How the brain integrates information from different sensory modalities to form coherent perceptions of the external environment is a challenging question in sensory and cognitive neuroscience. Neurophysiologically, sensory interactions have become well documented over the last decade or so. Complementary perceptual research, however, is lacking. This project seeks to redress the imbalance, using audio-visual interactions as a paradigm. Psychophysical experiments will explore: (i) audio-visual interactions in perception (sound enhancing vision, vision enhancing hearing); (ii) audio-visual interactions in spatial attention. Neurophysiological evidence, plus very recent psychophysical findings of audio-visual interactions, suggest this will be a rich vein of research.Read moreRead less