Filters reveal what flicker conceals: temporal processing in the human visual system. I have recently discovered a new form of camouflage using 10Hz luminance flicker. This project will quantify this effect and examine the extent to which it generalises across colour and spatial dimensions and to video sequences depicting natural scenes. This information is expected to provide foundational information to technologies relating to national security that rely on visual concealment. This research wi ....Filters reveal what flicker conceals: temporal processing in the human visual system. I have recently discovered a new form of camouflage using 10Hz luminance flicker. This project will quantify this effect and examine the extent to which it generalises across colour and spatial dimensions and to video sequences depicting natural scenes. This information is expected to provide foundational information to technologies relating to national security that rely on visual concealment. This research will examine the extent to which filtering out these camouflaging frequencies enhances our sensitivity to low temporal frequency information. This decamouflaging aspect of my research is expected to improve the clarity of digital video-based technologies including ultrasound, educational, info-tainment and defence applicationsRead moreRead less
Establishing how head and face movement properties contribute to the perception of speech and identity. The proposed studies provide an extensive research program into audio-visual speech processing and person identification: key components of face-to-face communication. The likely impact and benefits of the project concern its contribution to perceptual theory (linking signal, brain and behaviour) and its practical implications: For determining the viability of multimodal biometric identificati ....Establishing how head and face movement properties contribute to the perception of speech and identity. The proposed studies provide an extensive research program into audio-visual speech processing and person identification: key components of face-to-face communication. The likely impact and benefits of the project concern its contribution to perceptual theory (linking signal, brain and behaviour) and its practical implications: For determining the viability of multimodal biometric identification procedures by assessing the distinctiveness and permanence of AV speech characteristics. In the development of a visual dubbing technique that has potential for communication in noisy environments (and for the deaf) and for the development of a morphable model for AV presentation that has application for both first and second language learning.Read moreRead less
Linkage Infrastructure, Equipment And Facilities - Grant ID: LE0668448
Funder
Australian Research Council
Funding Amount
$150,000.00
Summary
See Hear! Multimodal Recording and Analysis Facility. High resolution recording and analysis will exploit the full potential of motion capture with progress towards automatic recognition of gesture and, eventually, real-time systems. Automatic tracking and recognition systems are in high demand and the interlacing of data from multiple modes is now computationally achievable. SeeHear! will be coded using techniques in multimodal fusion - tracking of bodies will be enhanced by locating and recogn ....See Hear! Multimodal Recording and Analysis Facility. High resolution recording and analysis will exploit the full potential of motion capture with progress towards automatic recognition of gesture and, eventually, real-time systems. Automatic tracking and recognition systems are in high demand and the interlacing of data from multiple modes is now computationally achievable. SeeHear! will be coded using techniques in multimodal fusion - tracking of bodies will be enhanced by locating and recognizing facial features, and a learning algorithm used to classify gesture from patterns of force and physiological response. In the future, full interactivity will be achieved by interconnecting visual and auditory data with a flow on to applications in the performing arts, rehabilitation and security.Read moreRead less
Image processing techniques for artificial human vision systems. Blindness affects millions of people worldwide and over 100,000 Australians. Our project supports quality of life improvements for them by developing image processing techniques necessary for artificial human vision systems: "bionic eyes". Our approach will extract the most visually informative content in a scene,allowing low resolution images to be generated which optimise usage of the limited number of eletrodes available in prot ....Image processing techniques for artificial human vision systems. Blindness affects millions of people worldwide and over 100,000 Australians. Our project supports quality of life improvements for them by developing image processing techniques necessary for artificial human vision systems: "bionic eyes". Our approach will extract the most visually informative content in a scene,allowing low resolution images to be generated which optimise usage of the limited number of eletrodes available in prototype bionic eye implants. Psychophysical tests presenting such modified images to normally sighted participants will verify the effectiveness of this approach. The techniques developed will provide a real-time image processing toolkit for visual protheses, with significant commercial and social benefits including enhancement of Australilia's neuroprostheses industry profile.Read moreRead less