Establishing how head and face movement properties contribute to the perception of speech and identity. The proposed studies provide an extensive research program into audio-visual speech processing and person identification: key components of face-to-face communication. The likely impact and benefits of the project concern its contribution to perceptual theory (linking signal, brain and behaviour) and its practical implications: For determining the viability of multimodal biometric identificati ....Establishing how head and face movement properties contribute to the perception of speech and identity. The proposed studies provide an extensive research program into audio-visual speech processing and person identification: key components of face-to-face communication. The likely impact and benefits of the project concern its contribution to perceptual theory (linking signal, brain and behaviour) and its practical implications: For determining the viability of multimodal biometric identification procedures by assessing the distinctiveness and permanence of AV speech characteristics. In the development of a visual dubbing technique that has potential for communication in noisy environments (and for the deaf) and for the development of a morphable model for AV presentation that has application for both first and second language learning.Read moreRead less
Special Research Initiatives - Grant ID: SR0354596
Funder
Australian Research Council
Funding Amount
$20,000.00
Summary
Perception and Action in Auditory Scenes (PAAS): Neural, Behavioural, Computational and Mechanical Systems. Auditory scenes are temporal and ephemeral yet pervasively influence human life. How humans negotiate such scenes has not been solved, a fact highlighted by attempts to build machines to respond to speech, warnings etc., in real-world situations with room reverberation, different talkers, and background noise. No one discipline can solve such problems. In this network outstanding researche ....Perception and Action in Auditory Scenes (PAAS): Neural, Behavioural, Computational and Mechanical Systems. Auditory scenes are temporal and ephemeral yet pervasively influence human life. How humans negotiate such scenes has not been solved, a fact highlighted by attempts to build machines to respond to speech, warnings etc., in real-world situations with room reverberation, different talkers, and background noise. No one discipline can solve such problems. In this network outstanding researchers from physical, medical, human, and social sciences with interests in speech, music and audition will provide insights into how humans and machines localize, recognize, interpret and produce auditory events, and advance frontier technologies, e.g., automatic speech recognition, hearing prostheses, auditory monitoring/warning systems.Read moreRead less
Learning from our mistakes: How and when complex decisions fail. The project aims to develop a novel mathematical framework, augmented by simulations and a set of experiments, to study when and how people commit errors. The modern environment bombards us with signals, such as radio and television advertisements as we sit at home or warning lights and car honks as we cross the road. Despite years of psychological research, it is not entirely clear how efficiently people cope with increasing amoun ....Learning from our mistakes: How and when complex decisions fail. The project aims to develop a novel mathematical framework, augmented by simulations and a set of experiments, to study when and how people commit errors. The modern environment bombards us with signals, such as radio and television advertisements as we sit at home or warning lights and car honks as we cross the road. Despite years of psychological research, it is not entirely clear how efficiently people cope with increasing amounts of information nor is it clear whether they process multiple signals simultaneously (in parallel) or one after the other (serial). The project offers new measures, based on the rate and pattern of error responses, to supplement the commonly used response times. The combination of a theoretical framework, based on mathematical and computational work, with empirical data to test the models, may deliver a better understanding of human performance and its limitations.Read moreRead less
Organization and Plasticity of Visual Processing in a Miniature Brain. To recognise objects a brain must have an internal representation of most likely object appearance. Two ways in which brains may posses this information include a hard wired template system, and/or the neuroplasticity to learn novel objects. Recent investigations on honeybee vision show that this animal can learn to recognise very difficult objects, although currently we do not know how the miniaturised bee brain manages thes ....Organization and Plasticity of Visual Processing in a Miniature Brain. To recognise objects a brain must have an internal representation of most likely object appearance. Two ways in which brains may posses this information include a hard wired template system, and/or the neuroplasticity to learn novel objects. Recent investigations on honeybee vision show that this animal can learn to recognise very difficult objects, although currently we do not know how the miniaturised bee brain manages these tasks. This project will reveal changes that occur in the processing of visual objects by the bee's brain with increasing experience, with potential applications including robotics or building interfaces between sensors and biological systems.Read moreRead less
The Role of Colour and Luminance in Spatial Location. How does the brain form our impression of the world? Black and white images appear normal to us. However, colour images without luminance variation have little depth, suggesting that the brain does not process colour in the same way as luminance. A series of fresh experiments examine how colour and luminance are utilised for seeing the depth and position of objects. The results will help us to understand how the first stages of visual process ....The Role of Colour and Luminance in Spatial Location. How does the brain form our impression of the world? Black and white images appear normal to us. However, colour images without luminance variation have little depth, suggesting that the brain does not process colour in the same way as luminance. A series of fresh experiments examine how colour and luminance are utilised for seeing the depth and position of objects. The results will help us to understand how the first stages of visual processing in the brain shape our sense of the world, and help develop theories of human vision, as well as animal and machine models of vision.Read moreRead less
Mechanisms underlying the perception of surface slant. How our brain encodes sensory information is of fundamental importance in neuroscience. Visual after-effects (how looking at various stimuli can affect the perception of subsequently presented stimuli) have provided valuable information about mechanisms of perceptual coding. We will use an adaptation paradigm to examine two-dimensional and three-dimensional after-effects, and their dependence on common mechanisms. Stimulus manipulations will ....Mechanisms underlying the perception of surface slant. How our brain encodes sensory information is of fundamental importance in neuroscience. Visual after-effects (how looking at various stimuli can affect the perception of subsequently presented stimuli) have provided valuable information about mechanisms of perceptual coding. We will use an adaptation paradigm to examine two-dimensional and three-dimensional after-effects, and their dependence on common mechanisms. Stimulus manipulations will allow us to probe the steps involved in recovering three-dimensional slant, and recording the full time-course of the after-effect will allow us to gauge the plasticity of these mechanisms. These effects will be modelled in terms of the response properties of cortical neurons.Read moreRead less
Determinants of Audio-Visual effects in degraded and non-degraded speech. Seeing a speaker's face can affect the perception of their speech in a number of ways. This project proposes a detailed comparison of factors that affect Audio-Visual (AV) facilitation of degraded speech detection and identification. Detection-based tasks should be more sensitive to signal based correlations whereas identification-based effects more sensitive to complementary information. The significance of the current pr ....Determinants of Audio-Visual effects in degraded and non-degraded speech. Seeing a speaker's face can affect the perception of their speech in a number of ways. This project proposes a detailed comparison of factors that affect Audio-Visual (AV) facilitation of degraded speech detection and identification. Detection-based tasks should be more sensitive to signal based correlations whereas identification-based effects more sensitive to complementary information. The significance of the current proposal is that it offers both a strategy and a connected series of experiments for determining key behavioural constraints on AV speech integration. Understanding AV interactions will build links between neurophysiological processes and coherent perception and have important implications for AV application.Read moreRead less
The neuronal bases of consciousness and attention. Why and how do some electrical activities in the brain make us see, hear and feel pain? Why other neural activities remain non-conscious? This project will utilise visual illusions combined with a range of state-of-the-art neuroimaging techniques to understand what kind of neuronal mechanisms underlie attention and consciousness.
A theory of attention and decision-making in multi-attribute and multi-object perceptual judgements. The human brain is an efficient biological computation device for rapidly translating perception into action. This project will develop and test a mathematical model of the processes of visual selective attention and perceptual decision-making. These processes are at the heart of the brain's ability to carry out this translation in a fast and accurate way.
Cognitive Foundations of Fast Decision Making. This project aims to develop a new theory of fast decision making. In all walks of life, from the sports field to the battlefield, fast and accurate decisions are central to human performance. This project will develop and test mathematical models of the processes involved in making decisions with continuous choice sets and decisions requiring integration of multiple sources of information and decisions in which information varies over time. It is e ....Cognitive Foundations of Fast Decision Making. This project aims to develop a new theory of fast decision making. In all walks of life, from the sports field to the battlefield, fast and accurate decisions are central to human performance. This project will develop and test mathematical models of the processes involved in making decisions with continuous choice sets and decisions requiring integration of multiple sources of information and decisions in which information varies over time. It is expected to contribute to our understanding of factors that characterise and limit human performance in settings in which fast and accurate decisions are required. It is expected to benefit the design of systems and environments in which safety and efficiency depend on human decision making.Read moreRead less