Filters reveal what flicker conceals: temporal processing in the human visual system. I have recently discovered a new form of camouflage using 10Hz luminance flicker. This project will quantify this effect and examine the extent to which it generalises across colour and spatial dimensions and to video sequences depicting natural scenes. This information is expected to provide foundational information to technologies relating to national security that rely on visual concealment. This research wi ....Filters reveal what flicker conceals: temporal processing in the human visual system. I have recently discovered a new form of camouflage using 10Hz luminance flicker. This project will quantify this effect and examine the extent to which it generalises across colour and spatial dimensions and to video sequences depicting natural scenes. This information is expected to provide foundational information to technologies relating to national security that rely on visual concealment. This research will examine the extent to which filtering out these camouflaging frequencies enhances our sensitivity to low temporal frequency information. This decamouflaging aspect of my research is expected to improve the clarity of digital video-based technologies including ultrasound, educational, info-tainment and defence applicationsRead moreRead less
Establishing how head and face movement properties contribute to the perception of speech and identity. The proposed studies provide an extensive research program into audio-visual speech processing and person identification: key components of face-to-face communication. The likely impact and benefits of the project concern its contribution to perceptual theory (linking signal, brain and behaviour) and its practical implications: For determining the viability of multimodal biometric identificati ....Establishing how head and face movement properties contribute to the perception of speech and identity. The proposed studies provide an extensive research program into audio-visual speech processing and person identification: key components of face-to-face communication. The likely impact and benefits of the project concern its contribution to perceptual theory (linking signal, brain and behaviour) and its practical implications: For determining the viability of multimodal biometric identification procedures by assessing the distinctiveness and permanence of AV speech characteristics. In the development of a visual dubbing technique that has potential for communication in noisy environments (and for the deaf) and for the development of a morphable model for AV presentation that has application for both first and second language learning.Read moreRead less
Linkage Infrastructure, Equipment And Facilities - Grant ID: LE0668448
Funder
Australian Research Council
Funding Amount
$150,000.00
Summary
See Hear! Multimodal Recording and Analysis Facility. High resolution recording and analysis will exploit the full potential of motion capture with progress towards automatic recognition of gesture and, eventually, real-time systems. Automatic tracking and recognition systems are in high demand and the interlacing of data from multiple modes is now computationally achievable. SeeHear! will be coded using techniques in multimodal fusion - tracking of bodies will be enhanced by locating and recogn ....See Hear! Multimodal Recording and Analysis Facility. High resolution recording and analysis will exploit the full potential of motion capture with progress towards automatic recognition of gesture and, eventually, real-time systems. Automatic tracking and recognition systems are in high demand and the interlacing of data from multiple modes is now computationally achievable. SeeHear! will be coded using techniques in multimodal fusion - tracking of bodies will be enhanced by locating and recognizing facial features, and a learning algorithm used to classify gesture from patterns of force and physiological response. In the future, full interactivity will be achieved by interconnecting visual and auditory data with a flow on to applications in the performing arts, rehabilitation and security.Read moreRead less
Image processing techniques for artificial human vision systems. Blindness affects millions of people worldwide and over 100,000 Australians. Our project supports quality of life improvements for them by developing image processing techniques necessary for artificial human vision systems: "bionic eyes". Our approach will extract the most visually informative content in a scene,allowing low resolution images to be generated which optimise usage of the limited number of eletrodes available in prot ....Image processing techniques for artificial human vision systems. Blindness affects millions of people worldwide and over 100,000 Australians. Our project supports quality of life improvements for them by developing image processing techniques necessary for artificial human vision systems: "bionic eyes". Our approach will extract the most visually informative content in a scene,allowing low resolution images to be generated which optimise usage of the limited number of eletrodes available in prototype bionic eye implants. Psychophysical tests presenting such modified images to normally sighted participants will verify the effectiveness of this approach. The techniques developed will provide a real-time image processing toolkit for visual protheses, with significant commercial and social benefits including enhancement of Australilia's neuroprostheses industry profile.Read moreRead less
Development Of The Listening In Spatialized Noise - Tonal Test (or LiSN-T)
Funder
National Health and Medical Research Council
Funding Amount
$227,136.00
Summary
In this project a novel listening test software will be developed for diagnosing spatial processing disorder in children. These children often have difficulties in understanding teachers in classrooms, which can significantly impact their ability to learn. The developed software will be specifically designed for diagnosing 5-year old children, before they enter primary school, and in contrast to existing tests will be independent of their language background.
Real-time Porosity: Using computer gaming technology to map and analyse pedestrian movement in public and private space. This project will make a major, and ongoing, contribution to our understanding of urban space in a major Australian city. The Porosity Lenses will enable a more complete understanding of pedestrian movement that the Emergency Information Coordination Unit (EICU) believes will directly contribute to protecting Australia from terrorism and crime. In the case of terrorism the soc ....Real-time Porosity: Using computer gaming technology to map and analyse pedestrian movement in public and private space. This project will make a major, and ongoing, contribution to our understanding of urban space in a major Australian city. The Porosity Lenses will enable a more complete understanding of pedestrian movement that the Emergency Information Coordination Unit (EICU) believes will directly contribute to protecting Australia from terrorism and crime. In the case of terrorism the socio/economic benefits of even the smallest success can be immeasurable. The need to anticipate and mitigate the impact of catastrophic events on the city will be balanced, in this study, by a concern to maintain freedom of circulation and promote civic opportunities within previously under-utilised zones.Read moreRead less
Avatars and Identities. The avatar, a virtual representation of its user, is the key element of interface technology for everyday computer use in the twenty-first century. While specialist aspects of the avatar have received intensive attention from the technology industries and scholars, the focus of the work to date has been on the technical efficiency of the interface, rather than understanding the full social implications of its use. Through a historical, ethnographic and critical analysis o ....Avatars and Identities. The avatar, a virtual representation of its user, is the key element of interface technology for everyday computer use in the twenty-first century. While specialist aspects of the avatar have received intensive attention from the technology industries and scholars, the focus of the work to date has been on the technical efficiency of the interface, rather than understanding the full social implications of its use. Through a historical, ethnographic and critical analysis of the role of the avatar, in consultation with industry, this project offers a unique opportunity to develop a wider perspective that will contribute to an understanding of the uses and policies for the digital economy.Read moreRead less
Special Research Initiatives - Grant ID: SR0354596
Funder
Australian Research Council
Funding Amount
$20,000.00
Summary
Perception and Action in Auditory Scenes (PAAS): Neural, Behavioural, Computational and Mechanical Systems. Auditory scenes are temporal and ephemeral yet pervasively influence human life. How humans negotiate such scenes has not been solved, a fact highlighted by attempts to build machines to respond to speech, warnings etc., in real-world situations with room reverberation, different talkers, and background noise. No one discipline can solve such problems. In this network outstanding researche ....Perception and Action in Auditory Scenes (PAAS): Neural, Behavioural, Computational and Mechanical Systems. Auditory scenes are temporal and ephemeral yet pervasively influence human life. How humans negotiate such scenes has not been solved, a fact highlighted by attempts to build machines to respond to speech, warnings etc., in real-world situations with room reverberation, different talkers, and background noise. No one discipline can solve such problems. In this network outstanding researchers from physical, medical, human, and social sciences with interests in speech, music and audition will provide insights into how humans and machines localize, recognize, interpret and produce auditory events, and advance frontier technologies, e.g., automatic speech recognition, hearing prostheses, auditory monitoring/warning systems.Read moreRead less
What is successful public art today?: exploring how contemporary public art and memorial design shapes public engagement, perceptions and behaviour. Much public money is invested in public art and memorials. The research explores critical questions of value: what the public enjoys about such artworks, if and how artworks contribute amenity to public spaces, and whether recent artworks engage effectively with social memory, identity and politics. The research situates local practice within intern ....What is successful public art today?: exploring how contemporary public art and memorial design shapes public engagement, perceptions and behaviour. Much public money is invested in public art and memorials. The research explores critical questions of value: what the public enjoys about such artworks, if and how artworks contribute amenity to public spaces, and whether recent artworks engage effectively with social memory, identity and politics. The research situates local practice within international trends, to inform Australian designers, policymakers, art patrons and public space managers about recent innovations in technology, craft, creativity and critique, so they can create and choose public artworks and memorials which engage with the potentials of contemporary arts practice, the complexities of contemporary culture, and the diversity of social behaviour in public spaces.Read moreRead less
Curating Cities: the social and ecological potential of public art practice. This project researches the contribution of public art to eco-sustainable development, focusing on world’s best practice and potential benefits to Sydney and cities in general. It seeks to establish how the arts can promote environmentally beneficial behaviour change and the development of green infrastructure.