Establishing how head and face movement properties contribute to the perception of speech and identity. The proposed studies provide an extensive research program into audio-visual speech processing and person identification: key components of face-to-face communication. The likely impact and benefits of the project concern its contribution to perceptual theory (linking signal, brain and behaviour) and its practical implications: For determining the viability of multimodal biometric identificati ....Establishing how head and face movement properties contribute to the perception of speech and identity. The proposed studies provide an extensive research program into audio-visual speech processing and person identification: key components of face-to-face communication. The likely impact and benefits of the project concern its contribution to perceptual theory (linking signal, brain and behaviour) and its practical implications: For determining the viability of multimodal biometric identification procedures by assessing the distinctiveness and permanence of AV speech characteristics. In the development of a visual dubbing technique that has potential for communication in noisy environments (and for the deaf) and for the development of a morphable model for AV presentation that has application for both first and second language learning.Read moreRead less
Linkage Infrastructure, Equipment And Facilities - Grant ID: LE0210995
Funder
Australian Research Council
Funding Amount
$100,000.00
Summary
The Creation of an Eye Movement Recording Facility in Queensland. There are countless uses for technology that records visual behaviour; these include reading and cognitive psychology research, ergonomic design, web site usability testing, and evaluation of visual information (for example advertising or in ?virtual? environments). As such, recording eye movements has applications in pure and applied research, and in teaching demonstrations for students.
This application proposes to purchase ey ....The Creation of an Eye Movement Recording Facility in Queensland. There are countless uses for technology that records visual behaviour; these include reading and cognitive psychology research, ergonomic design, web site usability testing, and evaluation of visual information (for example advertising or in ?virtual? environments). As such, recording eye movements has applications in pure and applied research, and in teaching demonstrations for students.
This application proposes to purchase eye movement recording equipment to form a dedicated and truly collaborative facility to measure visual behaviour. The facility would be unique in Australia and would be invaluable to both further understand visual/cognitive processes and how individuals interact with their environments.Read moreRead less
Determinants of Audio-Visual effects in degraded and non-degraded speech. Seeing a speaker's face can affect the perception of their speech in a number of ways. This project proposes a detailed comparison of factors that affect Audio-Visual (AV) facilitation of degraded speech detection and identification. Detection-based tasks should be more sensitive to signal based correlations whereas identification-based effects more sensitive to complementary information. The significance of the current pr ....Determinants of Audio-Visual effects in degraded and non-degraded speech. Seeing a speaker's face can affect the perception of their speech in a number of ways. This project proposes a detailed comparison of factors that affect Audio-Visual (AV) facilitation of degraded speech detection and identification. Detection-based tasks should be more sensitive to signal based correlations whereas identification-based effects more sensitive to complementary information. The significance of the current proposal is that it offers both a strategy and a connected series of experiments for determining key behavioural constraints on AV speech integration. Understanding AV interactions will build links between neurophysiological processes and coherent perception and have important implications for AV application.Read moreRead less
Stochastic, Neurally-Plausible Models for Selective Attention and Decision Making. An understanding of the basic cognitive processes involved in attention and decision making is the goal of international research effort in a number of disciplines. The benefits expected from such understanding include improvements in the diagnosis and treatment of a variety of cognitive deficits and improved occupational safety and efficiency in settings involving interaction with complex systems, such air traffi ....Stochastic, Neurally-Plausible Models for Selective Attention and Decision Making. An understanding of the basic cognitive processes involved in attention and decision making is the goal of international research effort in a number of disciplines. The benefits expected from such understanding include improvements in the diagnosis and treatment of a variety of cognitive deficits and improved occupational safety and efficiency in settings involving interaction with complex systems, such air traffic control, airline cockpits, motor vehicles, and process management. By developing mathematical models of these processes and the neural mechanisms that underlie them, this project will contribute to this understanding. It will also provide international postdoctoral opportunties for Australian-trained Ph.D. graduates.Read moreRead less
The mind's nose: Evocation, representation and similarity of imaginary and real odours. The food industry is a key sector in the Australian economy, accounting for 26.6 Billion Dollars in exports in 2001/2. Every year substantial sums are spent advertising, developing and testing new products, with notoriously high failure rates. Arguably both advertising and development depend, to some degree, on the ability of people to imagine the flavour and smell of these products. This project should id ....The mind's nose: Evocation, representation and similarity of imaginary and real odours. The food industry is a key sector in the Australian economy, accounting for 26.6 Billion Dollars in exports in 2001/2. Every year substantial sums are spent advertising, developing and testing new products, with notoriously high failure rates. Arguably both advertising and development depend, to some degree, on the ability of people to imagine the flavour and smell of these products. This project should identify procedures which enhance peoples ability to do this. Such findings should enable advertisers to design advertisements that are better able to induce imaginary aromas in their audience and enhance the training of food product developers, so they too can better imagine and conceptualise new food products.Read moreRead less
Working Memory: The Binding of Spatial and Nonspatial Features in the Retention of Visual and Auditory Information. By advancing the understanding of how integrated representations are retained in memory for the features of visual objects and the features of sounds, the research will provide new theoretical insights as well as new methods for investigating several forms of psychopathology. Deficits in feature binding have been argued to be implicated in autism, in the auditory hallucinations exp ....Working Memory: The Binding of Spatial and Nonspatial Features in the Retention of Visual and Auditory Information. By advancing the understanding of how integrated representations are retained in memory for the features of visual objects and the features of sounds, the research will provide new theoretical insights as well as new methods for investigating several forms of psychopathology. Deficits in feature binding have been argued to be implicated in autism, in the auditory hallucinations experienced by individuals with schizophrenia, and in memory decline with advancing age. By investigating these deficits using insights from the proposed study, researchers may be able to develop ways to ameliorate the adverse effects of the deficits.Read moreRead less
Face recognition: Properties and origins of whole-face processing. Humans identify other individuals almost entirely by their faces. Correspondingly, research has demonstrated a "special" style of cognitive processing that is unique to faces (at least in ordinary adults). The present project will address two major theoretical issues: (1) the exact nature of the special processing for faces, and (2) the extent to which it is innate, or learned. New progress in understanding these issues will be m ....Face recognition: Properties and origins of whole-face processing. Humans identify other individuals almost entirely by their faces. Correspondingly, research has demonstrated a "special" style of cognitive processing that is unique to faces (at least in ordinary adults). The present project will address two major theoretical issues: (1) the exact nature of the special processing for faces, and (2) the extent to which it is innate, or learned. New progress in understanding these issues will be made using a series of novel experimental techniques. These techniques isolate the specific contribution of the face recognition system, independent of contributions from object recognition, and from early visual processing.Read moreRead less
Special cognitive processing for faces: Expertise effects, and links to neural mechanisms. Humans identify other individuals primarily by their faces. Evidence from cognitive psychology indicates a special 'whole-face' (as opposed to part-based) style of processing for upright faces. This project will provide new insights into two long-standing issues about the origin of special face processing: (1) whether it derives from generic expert recognition processes or has some face-specific innate co ....Special cognitive processing for faces: Expertise effects, and links to neural mechanisms. Humans identify other individuals primarily by their faces. Evidence from cognitive psychology indicates a special 'whole-face' (as opposed to part-based) style of processing for upright faces. This project will provide new insights into two long-standing issues about the origin of special face processing: (1) whether it derives from generic expert recognition processes or has some face-specific innate component; and (2) the extent to which it can be distinguished from part-based processing at the neural level using both functional brain imaging (fMRI) and adaptation to distorted faces.Read moreRead less
Absolute identification and beyond: A comprehensive, integrated architecture for speeded choice. Absolute identification (AI) is an important field of study for both theoretical and practical reasons. Theoretically, advances in AI study shed light on fundamental memory and attentional limitations of human cognition. Practically, AI models a task that is useful and necessary in everyday life and the extensions we propose are similarly useful (e.g., a model of the confidence with which judgments a ....Absolute identification and beyond: A comprehensive, integrated architecture for speeded choice. Absolute identification (AI) is an important field of study for both theoretical and practical reasons. Theoretically, advances in AI study shed light on fundamental memory and attentional limitations of human cognition. Practically, AI models a task that is useful and necessary in everyday life and the extensions we propose are similarly useful (e.g., a model of the confidence with which judgments are made). Apart from the epistemological benefits, the proposal will rebuild the role that Australian researchers have previously played in mathematical approaches to basic cognitive problems (including decision making and AI).
Read moreRead less
The How and Why of Auditory-Visual Speech Perception: Affective and Articulatory Factors in Japanese and English Language Infants and Children. When we talk to babies certain aspects of our face and voice change compared with when we talk to adults. In this project we investigate the nature of the changes mothers make to their face and voice when talking to infants, the emotional or language-based purpose of these changes, and how infants and schoolchildren perceive these changes. Our previous s ....The How and Why of Auditory-Visual Speech Perception: Affective and Articulatory Factors in Japanese and English Language Infants and Children. When we talk to babies certain aspects of our face and voice change compared with when we talk to adults. In this project we investigate the nature of the changes mothers make to their face and voice when talking to infants, the emotional or language-based purpose of these changes, and how infants and schoolchildren perceive these changes. Our previous studies show that visual information is used more by English than Japanese language speakers, so these studies are investigated with both these language groups. The results will inform us more about language learning, hearing aid use, and speech recognition by machines.Read moreRead less