Establishing how head and face movement properties contribute to the perception of speech and identity. The proposed studies provide an extensive research program into audio-visual speech processing and person identification: key components of face-to-face communication. The likely impact and benefits of the project concern its contribution to perceptual theory (linking signal, brain and behaviour) and its practical implications: For determining the viability of multimodal biometric identificati ....Establishing how head and face movement properties contribute to the perception of speech and identity. The proposed studies provide an extensive research program into audio-visual speech processing and person identification: key components of face-to-face communication. The likely impact and benefits of the project concern its contribution to perceptual theory (linking signal, brain and behaviour) and its practical implications: For determining the viability of multimodal biometric identification procedures by assessing the distinctiveness and permanence of AV speech characteristics. In the development of a visual dubbing technique that has potential for communication in noisy environments (and for the deaf) and for the development of a morphable model for AV presentation that has application for both first and second language learning.Read moreRead less
Special Research Initiatives - Grant ID: SR0354596
Funder
Australian Research Council
Funding Amount
$20,000.00
Summary
Perception and Action in Auditory Scenes (PAAS): Neural, Behavioural, Computational and Mechanical Systems. Auditory scenes are temporal and ephemeral yet pervasively influence human life. How humans negotiate such scenes has not been solved, a fact highlighted by attempts to build machines to respond to speech, warnings etc., in real-world situations with room reverberation, different talkers, and background noise. No one discipline can solve such problems. In this network outstanding researche ....Perception and Action in Auditory Scenes (PAAS): Neural, Behavioural, Computational and Mechanical Systems. Auditory scenes are temporal and ephemeral yet pervasively influence human life. How humans negotiate such scenes has not been solved, a fact highlighted by attempts to build machines to respond to speech, warnings etc., in real-world situations with room reverberation, different talkers, and background noise. No one discipline can solve such problems. In this network outstanding researchers from physical, medical, human, and social sciences with interests in speech, music and audition will provide insights into how humans and machines localize, recognize, interpret and produce auditory events, and advance frontier technologies, e.g., automatic speech recognition, hearing prostheses, auditory monitoring/warning systems.Read moreRead less
Learning from our mistakes: How and when complex decisions fail. The project aims to develop a novel mathematical framework, augmented by simulations and a set of experiments, to study when and how people commit errors. The modern environment bombards us with signals, such as radio and television advertisements as we sit at home or warning lights and car honks as we cross the road. Despite years of psychological research, it is not entirely clear how efficiently people cope with increasing amoun ....Learning from our mistakes: How and when complex decisions fail. The project aims to develop a novel mathematical framework, augmented by simulations and a set of experiments, to study when and how people commit errors. The modern environment bombards us with signals, such as radio and television advertisements as we sit at home or warning lights and car honks as we cross the road. Despite years of psychological research, it is not entirely clear how efficiently people cope with increasing amounts of information nor is it clear whether they process multiple signals simultaneously (in parallel) or one after the other (serial). The project offers new measures, based on the rate and pattern of error responses, to supplement the commonly used response times. The combination of a theoretical framework, based on mathematical and computational work, with empirical data to test the models, may deliver a better understanding of human performance and its limitations.Read moreRead less
Organization and Plasticity of Visual Processing in a Miniature Brain. To recognise objects a brain must have an internal representation of most likely object appearance. Two ways in which brains may posses this information include a hard wired template system, and/or the neuroplasticity to learn novel objects. Recent investigations on honeybee vision show that this animal can learn to recognise very difficult objects, although currently we do not know how the miniaturised bee brain manages thes ....Organization and Plasticity of Visual Processing in a Miniature Brain. To recognise objects a brain must have an internal representation of most likely object appearance. Two ways in which brains may posses this information include a hard wired template system, and/or the neuroplasticity to learn novel objects. Recent investigations on honeybee vision show that this animal can learn to recognise very difficult objects, although currently we do not know how the miniaturised bee brain manages these tasks. This project will reveal changes that occur in the processing of visual objects by the bee's brain with increasing experience, with potential applications including robotics or building interfaces between sensors and biological systems.Read moreRead less
The Role of Colour and Luminance in Spatial Location. How does the brain form our impression of the world? Black and white images appear normal to us. However, colour images without luminance variation have little depth, suggesting that the brain does not process colour in the same way as luminance. A series of fresh experiments examine how colour and luminance are utilised for seeing the depth and position of objects. The results will help us to understand how the first stages of visual process ....The Role of Colour and Luminance in Spatial Location. How does the brain form our impression of the world? Black and white images appear normal to us. However, colour images without luminance variation have little depth, suggesting that the brain does not process colour in the same way as luminance. A series of fresh experiments examine how colour and luminance are utilised for seeing the depth and position of objects. The results will help us to understand how the first stages of visual processing in the brain shape our sense of the world, and help develop theories of human vision, as well as animal and machine models of vision.Read moreRead less
Mechanisms underlying the perception of surface slant. How our brain encodes sensory information is of fundamental importance in neuroscience. Visual after-effects (how looking at various stimuli can affect the perception of subsequently presented stimuli) have provided valuable information about mechanisms of perceptual coding. We will use an adaptation paradigm to examine two-dimensional and three-dimensional after-effects, and their dependence on common mechanisms. Stimulus manipulations will ....Mechanisms underlying the perception of surface slant. How our brain encodes sensory information is of fundamental importance in neuroscience. Visual after-effects (how looking at various stimuli can affect the perception of subsequently presented stimuli) have provided valuable information about mechanisms of perceptual coding. We will use an adaptation paradigm to examine two-dimensional and three-dimensional after-effects, and their dependence on common mechanisms. Stimulus manipulations will allow us to probe the steps involved in recovering three-dimensional slant, and recording the full time-course of the after-effect will allow us to gauge the plasticity of these mechanisms. These effects will be modelled in terms of the response properties of cortical neurons.Read moreRead less
Determinants of Audio-Visual effects in degraded and non-degraded speech. Seeing a speaker's face can affect the perception of their speech in a number of ways. This project proposes a detailed comparison of factors that affect Audio-Visual (AV) facilitation of degraded speech detection and identification. Detection-based tasks should be more sensitive to signal based correlations whereas identification-based effects more sensitive to complementary information. The significance of the current pr ....Determinants of Audio-Visual effects in degraded and non-degraded speech. Seeing a speaker's face can affect the perception of their speech in a number of ways. This project proposes a detailed comparison of factors that affect Audio-Visual (AV) facilitation of degraded speech detection and identification. Detection-based tasks should be more sensitive to signal based correlations whereas identification-based effects more sensitive to complementary information. The significance of the current proposal is that it offers both a strategy and a connected series of experiments for determining key behavioural constraints on AV speech integration. Understanding AV interactions will build links between neurophysiological processes and coherent perception and have important implications for AV application.Read moreRead less
The neuronal bases of consciousness and attention. Why and how do some electrical activities in the brain make us see, hear and feel pain? Why other neural activities remain non-conscious? This project will utilise visual illusions combined with a range of state-of-the-art neuroimaging techniques to understand what kind of neuronal mechanisms underlie attention and consciousness.
A theory of attention and decision-making in multi-attribute and multi-object perceptual judgements. The human brain is an efficient biological computation device for rapidly translating perception into action. This project will develop and test a mathematical model of the processes of visual selective attention and perceptual decision-making. These processes are at the heart of the brain's ability to carry out this translation in a fast and accurate way.
Perception: From Genes to Behaviour. Understanding how genes affect behaviour is inherently difficult because the human brain is extraordinarily complex. This project aims to map fundamental relationships between genes, brain, and behaviour by studying visual perception, where brain mechanisms can be characterised with high fidelity. The project expects to generate new knowledge in behavioural genetics using innovative, interdisciplinary approaches to integrate precise genetic, neural and psycho ....Perception: From Genes to Behaviour. Understanding how genes affect behaviour is inherently difficult because the human brain is extraordinarily complex. This project aims to map fundamental relationships between genes, brain, and behaviour by studying visual perception, where brain mechanisms can be characterised with high fidelity. The project expects to generate new knowledge in behavioural genetics using innovative, interdisciplinary approaches to integrate precise genetic, neural and psychophysical measurements. Expected outcomes of this project include a deeper understanding of our perceptual experience, and rich new experimental paradigms. This should provide significant benefits for future research attempting to disentangle complex gene–behaviour relationships.Read moreRead less