Filters reveal what flicker conceals: temporal processing in the human visual system. I have recently discovered a new form of camouflage using 10Hz luminance flicker. This project will quantify this effect and examine the extent to which it generalises across colour and spatial dimensions and to video sequences depicting natural scenes. This information is expected to provide foundational information to technologies relating to national security that rely on visual concealment. This research wi ....Filters reveal what flicker conceals: temporal processing in the human visual system. I have recently discovered a new form of camouflage using 10Hz luminance flicker. This project will quantify this effect and examine the extent to which it generalises across colour and spatial dimensions and to video sequences depicting natural scenes. This information is expected to provide foundational information to technologies relating to national security that rely on visual concealment. This research will examine the extent to which filtering out these camouflaging frequencies enhances our sensitivity to low temporal frequency information. This decamouflaging aspect of my research is expected to improve the clarity of digital video-based technologies including ultrasound, educational, info-tainment and defence applicationsRead moreRead less
Establishing how head and face movement properties contribute to the perception of speech and identity. The proposed studies provide an extensive research program into audio-visual speech processing and person identification: key components of face-to-face communication. The likely impact and benefits of the project concern its contribution to perceptual theory (linking signal, brain and behaviour) and its practical implications: For determining the viability of multimodal biometric identificati ....Establishing how head and face movement properties contribute to the perception of speech and identity. The proposed studies provide an extensive research program into audio-visual speech processing and person identification: key components of face-to-face communication. The likely impact and benefits of the project concern its contribution to perceptual theory (linking signal, brain and behaviour) and its practical implications: For determining the viability of multimodal biometric identification procedures by assessing the distinctiveness and permanence of AV speech characteristics. In the development of a visual dubbing technique that has potential for communication in noisy environments (and for the deaf) and for the development of a morphable model for AV presentation that has application for both first and second language learning.Read moreRead less
Linkage Infrastructure, Equipment And Facilities - Grant ID: LE0668448
Funder
Australian Research Council
Funding Amount
$150,000.00
Summary
See Hear! Multimodal Recording and Analysis Facility. High resolution recording and analysis will exploit the full potential of motion capture with progress towards automatic recognition of gesture and, eventually, real-time systems. Automatic tracking and recognition systems are in high demand and the interlacing of data from multiple modes is now computationally achievable. SeeHear! will be coded using techniques in multimodal fusion - tracking of bodies will be enhanced by locating and recogn ....See Hear! Multimodal Recording and Analysis Facility. High resolution recording and analysis will exploit the full potential of motion capture with progress towards automatic recognition of gesture and, eventually, real-time systems. Automatic tracking and recognition systems are in high demand and the interlacing of data from multiple modes is now computationally achievable. SeeHear! will be coded using techniques in multimodal fusion - tracking of bodies will be enhanced by locating and recognizing facial features, and a learning algorithm used to classify gesture from patterns of force and physiological response. In the future, full interactivity will be achieved by interconnecting visual and auditory data with a flow on to applications in the performing arts, rehabilitation and security.Read moreRead less
Image processing techniques for artificial human vision systems. Blindness affects millions of people worldwide and over 100,000 Australians. Our project supports quality of life improvements for them by developing image processing techniques necessary for artificial human vision systems: "bionic eyes". Our approach will extract the most visually informative content in a scene,allowing low resolution images to be generated which optimise usage of the limited number of eletrodes available in prot ....Image processing techniques for artificial human vision systems. Blindness affects millions of people worldwide and over 100,000 Australians. Our project supports quality of life improvements for them by developing image processing techniques necessary for artificial human vision systems: "bionic eyes". Our approach will extract the most visually informative content in a scene,allowing low resolution images to be generated which optimise usage of the limited number of eletrodes available in prototype bionic eye implants. Psychophysical tests presenting such modified images to normally sighted participants will verify the effectiveness of this approach. The techniques developed will provide a real-time image processing toolkit for visual protheses, with significant commercial and social benefits including enhancement of Australilia's neuroprostheses industry profile.Read moreRead less
Real-time Porosity: Using computer gaming technology to map and analyse pedestrian movement in public and private space. This project will make a major, and ongoing, contribution to our understanding of urban space in a major Australian city. The Porosity Lenses will enable a more complete understanding of pedestrian movement that the Emergency Information Coordination Unit (EICU) believes will directly contribute to protecting Australia from terrorism and crime. In the case of terrorism the soc ....Real-time Porosity: Using computer gaming technology to map and analyse pedestrian movement in public and private space. This project will make a major, and ongoing, contribution to our understanding of urban space in a major Australian city. The Porosity Lenses will enable a more complete understanding of pedestrian movement that the Emergency Information Coordination Unit (EICU) believes will directly contribute to protecting Australia from terrorism and crime. In the case of terrorism the socio/economic benefits of even the smallest success can be immeasurable. The need to anticipate and mitigate the impact of catastrophic events on the city will be balanced, in this study, by a concern to maintain freedom of circulation and promote civic opportunities within previously under-utilised zones.Read moreRead less
Surfacing urban wetlands in two urban renewal sites in Sydney. Urban wetlands in Australia provide benefits for climate change mitigation, pollution reduction, habitat provision and socioecological connection. However, in large cities like Sydney, urban wetlands are unseen because undergrounded, and, therefore not adequately understood. This illegibility, and loss of understanding by residents, planners and policy makers impedes wetlands' good management. This project surfaces wetlands through v ....Surfacing urban wetlands in two urban renewal sites in Sydney. Urban wetlands in Australia provide benefits for climate change mitigation, pollution reduction, habitat provision and socioecological connection. However, in large cities like Sydney, urban wetlands are unseen because undergrounded, and, therefore not adequately understood. This illegibility, and loss of understanding by residents, planners and policy makers impedes wetlands' good management. This project surfaces wetlands through visualisation in a multimodal knowledge platform focusing on two urban renewal sites, Green Square and Marrickville South. We leverage design ethnography to develop resources for strengthening multiple stakeholders’ socioecological engagement through methods empowering just, creative and open participation.Read moreRead less
Avatars and Identities. The avatar, a virtual representation of its user, is the key element of interface technology for everyday computer use in the twenty-first century. While specialist aspects of the avatar have received intensive attention from the technology industries and scholars, the focus of the work to date has been on the technical efficiency of the interface, rather than understanding the full social implications of its use. Through a historical, ethnographic and critical analysis o ....Avatars and Identities. The avatar, a virtual representation of its user, is the key element of interface technology for everyday computer use in the twenty-first century. While specialist aspects of the avatar have received intensive attention from the technology industries and scholars, the focus of the work to date has been on the technical efficiency of the interface, rather than understanding the full social implications of its use. Through a historical, ethnographic and critical analysis of the role of the avatar, in consultation with industry, this project offers a unique opportunity to develop a wider perspective that will contribute to an understanding of the uses and policies for the digital economy.Read moreRead less
Exploring Botanic Gardens Herbarium's value, via Environmental Aesthetics. . The project aims to aesthetically redefine engagement with the plant collection at Royal Botanic Gardens Herbarium (RBG) Sydney and to communicate its artistic, cultural and heritage value to the public through a Public Program of creative arts case studies. It's expected that new insights will arise from an environmental art methodology utilising the digitisation of the Herbarium specimens, so that audiences can intera ....Exploring Botanic Gardens Herbarium's value, via Environmental Aesthetics. . The project aims to aesthetically redefine engagement with the plant collection at Royal Botanic Gardens Herbarium (RBG) Sydney and to communicate its artistic, cultural and heritage value to the public through a Public Program of creative arts case studies. It's expected that new insights will arise from an environmental art methodology utilising the digitisation of the Herbarium specimens, so that audiences can interactively experience the plant archive through narratives that activate plants as underpinning ecosystems. Benefits to partners RBG, Bundanon Trust and Open Humanities Press will include the digital expansion of audience engagement with the Herbarium at RBG and Mt Annan and communication of collection’s significance.Read moreRead less
What is successful public art today?: exploring how contemporary public art and memorial design shapes public engagement, perceptions and behaviour. Much public money is invested in public art and memorials. The research explores critical questions of value: what the public enjoys about such artworks, if and how artworks contribute amenity to public spaces, and whether recent artworks engage effectively with social memory, identity and politics. The research situates local practice within intern ....What is successful public art today?: exploring how contemporary public art and memorial design shapes public engagement, perceptions and behaviour. Much public money is invested in public art and memorials. The research explores critical questions of value: what the public enjoys about such artworks, if and how artworks contribute amenity to public spaces, and whether recent artworks engage effectively with social memory, identity and politics. The research situates local practice within international trends, to inform Australian designers, policymakers, art patrons and public space managers about recent innovations in technology, craft, creativity and critique, so they can create and choose public artworks and memorials which engage with the potentials of contemporary arts practice, the complexities of contemporary culture, and the diversity of social behaviour in public spaces.Read moreRead less
Extinction Imaginaries: Mapping Affective Visual Cultures in Australasia. This project aims to provide NGOs with new strategies for raising awareness of environmental change by investigating what animal extinction means to Australians. Australasia has the highest global extinction rates, yet despite the wide circulation of visual images of extinction little is known about how they affect people. The project expects to address this critical gap by bringing innovative methodologies to the analysis ....Extinction Imaginaries: Mapping Affective Visual Cultures in Australasia. This project aims to provide NGOs with new strategies for raising awareness of environmental change by investigating what animal extinction means to Australians. Australasia has the highest global extinction rates, yet despite the wide circulation of visual images of extinction little is known about how they affect people. The project expects to address this critical gap by bringing innovative methodologies to the analysis of public responses to images of extinction and how they affect social imaginaries. Expected outcomes include research translations with environmental NGOs which should provide significant benefits by addressing public concern for the deteriorating ecosystems that future generations will inherit.
Read moreRead less