Filters reveal what flicker conceals: temporal processing in the human visual system. I have recently discovered a new form of camouflage using 10Hz luminance flicker. This project will quantify this effect and examine the extent to which it generalises across colour and spatial dimensions and to video sequences depicting natural scenes. This information is expected to provide foundational information to technologies relating to national security that rely on visual concealment. This research wi ....Filters reveal what flicker conceals: temporal processing in the human visual system. I have recently discovered a new form of camouflage using 10Hz luminance flicker. This project will quantify this effect and examine the extent to which it generalises across colour and spatial dimensions and to video sequences depicting natural scenes. This information is expected to provide foundational information to technologies relating to national security that rely on visual concealment. This research will examine the extent to which filtering out these camouflaging frequencies enhances our sensitivity to low temporal frequency information. This decamouflaging aspect of my research is expected to improve the clarity of digital video-based technologies including ultrasound, educational, info-tainment and defence applicationsRead moreRead less
Establishing how head and face movement properties contribute to the perception of speech and identity. The proposed studies provide an extensive research program into audio-visual speech processing and person identification: key components of face-to-face communication. The likely impact and benefits of the project concern its contribution to perceptual theory (linking signal, brain and behaviour) and its practical implications: For determining the viability of multimodal biometric identificati ....Establishing how head and face movement properties contribute to the perception of speech and identity. The proposed studies provide an extensive research program into audio-visual speech processing and person identification: key components of face-to-face communication. The likely impact and benefits of the project concern its contribution to perceptual theory (linking signal, brain and behaviour) and its practical implications: For determining the viability of multimodal biometric identification procedures by assessing the distinctiveness and permanence of AV speech characteristics. In the development of a visual dubbing technique that has potential for communication in noisy environments (and for the deaf) and for the development of a morphable model for AV presentation that has application for both first and second language learning.Read moreRead less
Linkage Infrastructure, Equipment And Facilities - Grant ID: LE0668448
Funder
Australian Research Council
Funding Amount
$150,000.00
Summary
See Hear! Multimodal Recording and Analysis Facility. High resolution recording and analysis will exploit the full potential of motion capture with progress towards automatic recognition of gesture and, eventually, real-time systems. Automatic tracking and recognition systems are in high demand and the interlacing of data from multiple modes is now computationally achievable. SeeHear! will be coded using techniques in multimodal fusion - tracking of bodies will be enhanced by locating and recogn ....See Hear! Multimodal Recording and Analysis Facility. High resolution recording and analysis will exploit the full potential of motion capture with progress towards automatic recognition of gesture and, eventually, real-time systems. Automatic tracking and recognition systems are in high demand and the interlacing of data from multiple modes is now computationally achievable. SeeHear! will be coded using techniques in multimodal fusion - tracking of bodies will be enhanced by locating and recognizing facial features, and a learning algorithm used to classify gesture from patterns of force and physiological response. In the future, full interactivity will be achieved by interconnecting visual and auditory data with a flow on to applications in the performing arts, rehabilitation and security.Read moreRead less
Image processing techniques for artificial human vision systems. Blindness affects millions of people worldwide and over 100,000 Australians. Our project supports quality of life improvements for them by developing image processing techniques necessary for artificial human vision systems: "bionic eyes". Our approach will extract the most visually informative content in a scene,allowing low resolution images to be generated which optimise usage of the limited number of eletrodes available in prot ....Image processing techniques for artificial human vision systems. Blindness affects millions of people worldwide and over 100,000 Australians. Our project supports quality of life improvements for them by developing image processing techniques necessary for artificial human vision systems: "bionic eyes". Our approach will extract the most visually informative content in a scene,allowing low resolution images to be generated which optimise usage of the limited number of eletrodes available in prototype bionic eye implants. Psychophysical tests presenting such modified images to normally sighted participants will verify the effectiveness of this approach. The techniques developed will provide a real-time image processing toolkit for visual protheses, with significant commercial and social benefits including enhancement of Australilia's neuroprostheses industry profile.Read moreRead less
Development Of The Listening In Spatialized Noise - Tonal Test (or LiSN-T)
Funder
National Health and Medical Research Council
Funding Amount
$227,136.00
Summary
In this project a novel listening test software will be developed for diagnosing spatial processing disorder in children. These children often have difficulties in understanding teachers in classrooms, which can significantly impact their ability to learn. The developed software will be specifically designed for diagnosing 5-year old children, before they enter primary school, and in contrast to existing tests will be independent of their language background.
Real-time Porosity: Using computer gaming technology to map and analyse pedestrian movement in public and private space. This project will make a major, and ongoing, contribution to our understanding of urban space in a major Australian city. The Porosity Lenses will enable a more complete understanding of pedestrian movement that the Emergency Information Coordination Unit (EICU) believes will directly contribute to protecting Australia from terrorism and crime. In the case of terrorism the soc ....Real-time Porosity: Using computer gaming technology to map and analyse pedestrian movement in public and private space. This project will make a major, and ongoing, contribution to our understanding of urban space in a major Australian city. The Porosity Lenses will enable a more complete understanding of pedestrian movement that the Emergency Information Coordination Unit (EICU) believes will directly contribute to protecting Australia from terrorism and crime. In the case of terrorism the socio/economic benefits of even the smallest success can be immeasurable. The need to anticipate and mitigate the impact of catastrophic events on the city will be balanced, in this study, by a concern to maintain freedom of circulation and promote civic opportunities within previously under-utilised zones.Read moreRead less
Surfacing urban wetlands in two urban renewal sites in Sydney. Urban wetlands in Australia provide benefits for climate change mitigation, pollution reduction, habitat provision and socioecological connection. However, in large cities like Sydney, urban wetlands are unseen because undergrounded, and, therefore not adequately understood. This illegibility, and loss of understanding by residents, planners and policy makers impedes wetlands' good management. This project surfaces wetlands through v ....Surfacing urban wetlands in two urban renewal sites in Sydney. Urban wetlands in Australia provide benefits for climate change mitigation, pollution reduction, habitat provision and socioecological connection. However, in large cities like Sydney, urban wetlands are unseen because undergrounded, and, therefore not adequately understood. This illegibility, and loss of understanding by residents, planners and policy makers impedes wetlands' good management. This project surfaces wetlands through visualisation in a multimodal knowledge platform focusing on two urban renewal sites, Green Square and Marrickville South. We leverage design ethnography to develop resources for strengthening multiple stakeholders’ socioecological engagement through methods empowering just, creative and open participation.Read moreRead less
Avatars and Identities. The avatar, a virtual representation of its user, is the key element of interface technology for everyday computer use in the twenty-first century. While specialist aspects of the avatar have received intensive attention from the technology industries and scholars, the focus of the work to date has been on the technical efficiency of the interface, rather than understanding the full social implications of its use. Through a historical, ethnographic and critical analysis o ....Avatars and Identities. The avatar, a virtual representation of its user, is the key element of interface technology for everyday computer use in the twenty-first century. While specialist aspects of the avatar have received intensive attention from the technology industries and scholars, the focus of the work to date has been on the technical efficiency of the interface, rather than understanding the full social implications of its use. Through a historical, ethnographic and critical analysis of the role of the avatar, in consultation with industry, this project offers a unique opportunity to develop a wider perspective that will contribute to an understanding of the uses and policies for the digital economy.Read moreRead less
Special Research Initiatives - Grant ID: SR0354596
Funder
Australian Research Council
Funding Amount
$20,000.00
Summary
Perception and Action in Auditory Scenes (PAAS): Neural, Behavioural, Computational and Mechanical Systems. Auditory scenes are temporal and ephemeral yet pervasively influence human life. How humans negotiate such scenes has not been solved, a fact highlighted by attempts to build machines to respond to speech, warnings etc., in real-world situations with room reverberation, different talkers, and background noise. No one discipline can solve such problems. In this network outstanding researche ....Perception and Action in Auditory Scenes (PAAS): Neural, Behavioural, Computational and Mechanical Systems. Auditory scenes are temporal and ephemeral yet pervasively influence human life. How humans negotiate such scenes has not been solved, a fact highlighted by attempts to build machines to respond to speech, warnings etc., in real-world situations with room reverberation, different talkers, and background noise. No one discipline can solve such problems. In this network outstanding researchers from physical, medical, human, and social sciences with interests in speech, music and audition will provide insights into how humans and machines localize, recognize, interpret and produce auditory events, and advance frontier technologies, e.g., automatic speech recognition, hearing prostheses, auditory monitoring/warning systems.Read moreRead less
Exploring Botanic Gardens Herbarium's value, via Environmental Aesthetics. . The project aims to aesthetically redefine engagement with the plant collection at Royal Botanic Gardens Herbarium (RBG) Sydney and to communicate its artistic, cultural and heritage value to the public through a Public Program of creative arts case studies. It's expected that new insights will arise from an environmental art methodology utilising the digitisation of the Herbarium specimens, so that audiences can intera ....Exploring Botanic Gardens Herbarium's value, via Environmental Aesthetics. . The project aims to aesthetically redefine engagement with the plant collection at Royal Botanic Gardens Herbarium (RBG) Sydney and to communicate its artistic, cultural and heritage value to the public through a Public Program of creative arts case studies. It's expected that new insights will arise from an environmental art methodology utilising the digitisation of the Herbarium specimens, so that audiences can interactively experience the plant archive through narratives that activate plants as underpinning ecosystems. Benefits to partners RBG, Bundanon Trust and Open Humanities Press will include the digital expansion of audience engagement with the Herbarium at RBG and Mt Annan and communication of collection’s significance.Read moreRead less