3D Diffusion Models for Generating and Understanding 3D Scenes. Diffusion models, such as DALL-E2 and Imagen, have achieved remarkable success in generating photorealistic images and hold promise to solve long-standing computer vision problems. However, 3D scene generation remains unexplored. This research project aims to bridge the gap by developing 3D diffusion models capable of generating complete 3D scenes. This will advance our theoretical understanding of diffusion in complex 3D environmen ....3D Diffusion Models for Generating and Understanding 3D Scenes. Diffusion models, such as DALL-E2 and Imagen, have achieved remarkable success in generating photorealistic images and hold promise to solve long-standing computer vision problems. However, 3D scene generation remains unexplored. This research project aims to bridge the gap by developing 3D diffusion models capable of generating complete 3D scenes. This will advance our theoretical understanding of diffusion in complex 3D environments and open up new possibilities for applications in fields such as virtual reality, architecture, and city planning. The proposed 3D diffusion models will also enhance the accuracy of computer vision tasks related to 3D scene understanding, such as object detection, tracking, and semantic segmentation.Read moreRead less
Using visual science to reduce the dangers of night driving. This project aims to develop novel tests of visual function relevant to the modern night driving environment. Night driving is challenging for all drivers and has been linked to poor visibility under low light conditions. This project will characterise the visual challenges of the modern night driving environment, develop visual tests that incorporate the dynamic light levels typical of night-time roads and assess the association of th ....Using visual science to reduce the dangers of night driving. This project aims to develop novel tests of visual function relevant to the modern night driving environment. Night driving is challenging for all drivers and has been linked to poor visibility under low light conditions. This project will characterise the visual challenges of the modern night driving environment, develop visual tests that incorporate the dynamic light levels typical of night-time roads and assess the association of these tests with night driving performance. The outcomes will contribute new knowledge regarding dynamic visual processing and the ageing visual system and will inform vision testing, potential interventions to improve visual function for night driving and reduce the dangers of night driving.Read moreRead less
Neural plasticity in older adult human vision. This project aims to expand our understanding of age related changes in brain function, specifically plasticity. The project will increase knowledge of the role of an inhibitory neurotransmitter GABA in visual plasticity. Expected outcomes include new knowledge regarding the regulation of brain function in adulthood, enabling future research and planning for societal benefit to older Australia.
Discovery Early Career Researcher Award - Grant ID: DE230101058
Funder
Australian Research Council
Funding Amount
$437,254.00
Summary
Glass-box Deep Machine Perception for Trustworthy Artificial Intelligence. Explainability and Transparency are the key values for development and deployment of Artificial Intelligence (AI) in Australia’s AI Ethics Framework for industry and governments. This project aims to build new tools to make the central technology of AI - deep learning - transparent and explainable. Its expected outputs are novel theory-driven algorithms and unconventional foundational blocks for deep learning that will al ....Glass-box Deep Machine Perception for Trustworthy Artificial Intelligence. Explainability and Transparency are the key values for development and deployment of Artificial Intelligence (AI) in Australia’s AI Ethics Framework for industry and governments. This project aims to build new tools to make the central technology of AI - deep learning - transparent and explainable. Its expected outputs are novel theory-driven algorithms and unconventional foundational blocks for deep learning that will allow humans to clearly interpret the reasoning process of this technology, which is currently not possible. It is expected to significantly advance our knowledge in machine intelligence and perception. Due to their fundamental nature, the project outcomes are likely to benefit industry and scientific frontiers alike.Read moreRead less
A Machine Learning Framework for Concrete Workability Estimation . Concrete is the most used construction material in Australia. The project aims to develop a system to measure the workability of concrete in transit in agitator trucks using advanced machine vision and machine learning, and provide a reliable alternative to the current practice of visually testing concrete workability by certified testers. Concrete that fails to meet workability requirements is one of the most frequent reasons fo ....A Machine Learning Framework for Concrete Workability Estimation . Concrete is the most used construction material in Australia. The project aims to develop a system to measure the workability of concrete in transit in agitator trucks using advanced machine vision and machine learning, and provide a reliable alternative to the current practice of visually testing concrete workability by certified testers. Concrete that fails to meet workability requirements is one of the most frequent reasons for rejection at construction sites, resulting in significant costs, waste, and delays. Multimodal data sources will be used to provide a reliable workability estimate in real time, enabling construction teams to identify and rectify workability issues in transit while continuously monitoring the adjustments effects.Read moreRead less
Shape4D: Modelling the Spatiotemporal Deformation Patterns in 3D Shapes. This research will develop new mathematical methods and algorithms that will enable the use of population-level longitudinal studies to model the spatial and temporal deformation patterns in 3D biological objects. Using novel geometric and deep learning techniques, it will create new methods that will allow the characterization of how the 3D shape of objects deforms with ageing, disease progression and interaction with thei ....Shape4D: Modelling the Spatiotemporal Deformation Patterns in 3D Shapes. This research will develop new mathematical methods and algorithms that will enable the use of population-level longitudinal studies to model the spatial and temporal deformation patterns in 3D biological objects. Using novel geometric and deep learning techniques, it will create new methods that will allow the characterization of how the 3D shape of objects deforms with ageing, disease progression and interaction with their environment, and the simulation of spatiotemporal deformations in anatomical organs. Benefits include a better understanding of growth processes, predictive models of how degenerative diseases progress and a computational framework that will assist in designing proper mitigation and intervention strategies.Read moreRead less
In-vivo functional imaging of cone photoreceptors and ganglion cell axons. Can we project a movie on a human retina, and measure the response of photoreceptor cells and connected nerve tissue? This project aims to investigate a new method for visualization of the quickest responses in human cone photoreceptors and nerve cells after a visible stimulus. Expected outcomes of this project include a better understanding of the origins of responses to a stimulus and how cells in the retina communicate ....In-vivo functional imaging of cone photoreceptors and ganglion cell axons. Can we project a movie on a human retina, and measure the response of photoreceptor cells and connected nerve tissue? This project aims to investigate a new method for visualization of the quickest responses in human cone photoreceptors and nerve cells after a visible stimulus. Expected outcomes of this project include a better understanding of the origins of responses to a stimulus and how cells in the retina communicate. The scientific results will be helpful in a better understanding of the development of vision in the infant eye, to study peripheral vision in elite athletes and to quantify performance of virtual reality equipment for the military. The IP on the technology can be licensed or used for start-up company.Read moreRead less
Tensor and Hypergraph Methods in Fitting Visual Data. This proposal will put an important class of clustering (extracting data that should fit a geometric model) on a more solid theoretical foundation. This will lead to better understanding of how to certify outcomes, efficiency, reliability etc. The type of clustering under consideration is relevant to many problems in machine learning and computer vision, as well as data mining and a wide variety of other settings.
Visual methods for advanced automation of underwater manipulation. This project will increase the autonomy of underwater robotic systems engaged in intervention and inspection tasks. Such activities are essential for the operation of subsea robotic systems used in offshore industries, scientific exploration and defence. Our approach will improve perception and situational awareness through the principled fusion of multiple navigation and camera sensors. We will use this improved scene understand ....Visual methods for advanced automation of underwater manipulation. This project will increase the autonomy of underwater robotic systems engaged in intervention and inspection tasks. Such activities are essential for the operation of subsea robotic systems used in offshore industries, scientific exploration and defence. Our approach will improve perception and situational awareness through the principled fusion of multiple navigation and camera sensors. We will use this improved scene understanding to effectively plan the motion of vehicles and manipulators through larger and more complex workspaces, enabling semi-supervised and autonomous task execution. Our project will demonstrate these capabilities in real-world deployments relevant to industry and marine science.Read moreRead less
Listen and learn - statistical learning and the adapting auditory brain. This project aims to explore the link between rapid neural adaptation - a form of learning referred to as statistical learning - and human listening performance in noisy environments. The project aims to generate a new understanding of mechanisms that contribute to listeners' abilities to understand speech in noise, and to complex communication disorders such as dyslexia. Expected outcomes will include increased capacity to ....Listen and learn - statistical learning and the adapting auditory brain. This project aims to explore the link between rapid neural adaptation - a form of learning referred to as statistical learning - and human listening performance in noisy environments. The project aims to generate a new understanding of mechanisms that contribute to listeners' abilities to understand speech in noise, and to complex communication disorders such as dyslexia. Expected outcomes will include increased capacity to investigate a broad range of cognitive and communication functions. Benefits will include potential technologies and algorithms to assist listening (in devices such as hearing aids), language development and reading.Read moreRead less