Determinants of Audio-Visual effects in degraded and non-degraded speech. Seeing a speaker's face can affect the perception of their speech in a number of ways. This project proposes a detailed comparison of factors that affect Audio-Visual (AV) facilitation of degraded speech detection and identification. Detection-based tasks should be more sensitive to signal based correlations whereas identification-based effects more sensitive to complementary information. The significance of the current pr ....Determinants of Audio-Visual effects in degraded and non-degraded speech. Seeing a speaker's face can affect the perception of their speech in a number of ways. This project proposes a detailed comparison of factors that affect Audio-Visual (AV) facilitation of degraded speech detection and identification. Detection-based tasks should be more sensitive to signal based correlations whereas identification-based effects more sensitive to complementary information. The significance of the current proposal is that it offers both a strategy and a connected series of experiments for determining key behavioural constraints on AV speech integration. Understanding AV interactions will build links between neurophysiological processes and coherent perception and have important implications for AV application.Read moreRead less
Who may judge a book by its cover? This project aims to build a model of how and why people vary in their impressions of others and in the accuracy of these impressions. People readily form impressions of others from their faces and these impressions influence crucial decisions: election results, court case outcomes and partner choices. To build this model, the project will apply twin data and construct a psychometric test to measure variation in facial impressions. The research is expected to l ....Who may judge a book by its cover? This project aims to build a model of how and why people vary in their impressions of others and in the accuracy of these impressions. People readily form impressions of others from their faces and these impressions influence crucial decisions: election results, court case outcomes and partner choices. To build this model, the project will apply twin data and construct a psychometric test to measure variation in facial impressions. The research is expected to lead to insights into this aspect of social perception, and to identify the sources of atypical or inaccurate facial judgements. This has applications in health contexts (to identify social impairment) and in security contexts (for personnel selection).Read moreRead less
Filters reveal what flicker conceals: temporal processing in the human visual system. I have recently discovered a new form of camouflage using 10Hz luminance flicker. This project will quantify this effect and examine the extent to which it generalises across colour and spatial dimensions and to video sequences depicting natural scenes. This information is expected to provide foundational information to technologies relating to national security that rely on visual concealment. This research wi ....Filters reveal what flicker conceals: temporal processing in the human visual system. I have recently discovered a new form of camouflage using 10Hz luminance flicker. This project will quantify this effect and examine the extent to which it generalises across colour and spatial dimensions and to video sequences depicting natural scenes. This information is expected to provide foundational information to technologies relating to national security that rely on visual concealment. This research will examine the extent to which filtering out these camouflaging frequencies enhances our sensitivity to low temporal frequency information. This decamouflaging aspect of my research is expected to improve the clarity of digital video-based technologies including ultrasound, educational, info-tainment and defence applicationsRead moreRead less
Establishing how head and face movement properties contribute to the perception of speech and identity. The proposed studies provide an extensive research program into audio-visual speech processing and person identification: key components of face-to-face communication. The likely impact and benefits of the project concern its contribution to perceptual theory (linking signal, brain and behaviour) and its practical implications: For determining the viability of multimodal biometric identificati ....Establishing how head and face movement properties contribute to the perception of speech and identity. The proposed studies provide an extensive research program into audio-visual speech processing and person identification: key components of face-to-face communication. The likely impact and benefits of the project concern its contribution to perceptual theory (linking signal, brain and behaviour) and its practical implications: For determining the viability of multimodal biometric identification procedures by assessing the distinctiveness and permanence of AV speech characteristics. In the development of a visual dubbing technique that has potential for communication in noisy environments (and for the deaf) and for the development of a morphable model for AV presentation that has application for both first and second language learning.Read moreRead less