3D Diffusion Models for Generating and Understanding 3D Scenes. Diffusion models, such as DALL-E2 and Imagen, have achieved remarkable success in generating photorealistic images and hold promise to solve long-standing computer vision problems. However, 3D scene generation remains unexplored. This research project aims to bridge the gap by developing 3D diffusion models capable of generating complete 3D scenes. This will advance our theoretical understanding of diffusion in complex 3D environmen ....3D Diffusion Models for Generating and Understanding 3D Scenes. Diffusion models, such as DALL-E2 and Imagen, have achieved remarkable success in generating photorealistic images and hold promise to solve long-standing computer vision problems. However, 3D scene generation remains unexplored. This research project aims to bridge the gap by developing 3D diffusion models capable of generating complete 3D scenes. This will advance our theoretical understanding of diffusion in complex 3D environments and open up new possibilities for applications in fields such as virtual reality, architecture, and city planning. The proposed 3D diffusion models will also enhance the accuracy of computer vision tasks related to 3D scene understanding, such as object detection, tracking, and semantic segmentation.Read moreRead less
Discovery Early Career Researcher Award - Grant ID: DE230100477
Funder
Australian Research Council
Funding Amount
$421,554.00
Summary
Advancing Human Perception: Countering Evolving Malicious Fake Visual Data. The aim of this project is to provide new effective and generalisable deepfake detection methods for automatically detecting maliciously manipulated visual data generated by misused artificial intelligence (AI) techniques. It will present innovative computer vision and image processing knowledge and techniques, enabling the developed methods to advance human perception in recognising fake data, enhance cybersecurity, and ....Advancing Human Perception: Countering Evolving Malicious Fake Visual Data. The aim of this project is to provide new effective and generalisable deepfake detection methods for automatically detecting maliciously manipulated visual data generated by misused artificial intelligence (AI) techniques. It will present innovative computer vision and image processing knowledge and techniques, enabling the developed methods to advance human perception in recognising fake data, enhance cybersecurity, and protect privacy in AI applications. The anticipated outcomes should provide significant benefits to a wide range of applications, such as providing timely alerts to the media, government organisations, and the industry about misleading fake visual data, and preventing financial crimes on synthetic identity fraud.Read moreRead less
Discovery Early Career Researcher Award - Grant ID: DE240100967
Funder
Australian Research Council
Funding Amount
$366,000.00
Summary
Open-world computer vision by detecting and tracking hierarchical objects. This project examines the problem of detecting and tracking objects using computer vision. A fundamental limitation of current algorithms is that they require labelled training data for every object class and therefore cannot be trusted to operate in unconstrained environments. This project aims to address this limitation using novel techniques that incorporate hierarchical relationships between object classes. Expected o ....Open-world computer vision by detecting and tracking hierarchical objects. This project examines the problem of detecting and tracking objects using computer vision. A fundamental limitation of current algorithms is that they require labelled training data for every object class and therefore cannot be trusted to operate in unconstrained environments. This project aims to address this limitation using novel techniques that incorporate hierarchical relationships between object classes. Expected outcomes include new paradigms for algorithm design and evaluation, and establishing the problem as a focus of international research. The key practical benefit would be to accelerate the wider deployment of visual perception in applications such as autonomous vehicles, interactive robotics, and video analysis.Read moreRead less
Discovery Early Career Researcher Award - Grant ID: DE230101058
Funder
Australian Research Council
Funding Amount
$437,254.00
Summary
Glass-box Deep Machine Perception for Trustworthy Artificial Intelligence. Explainability and Transparency are the key values for development and deployment of Artificial Intelligence (AI) in Australia’s AI Ethics Framework for industry and governments. This project aims to build new tools to make the central technology of AI - deep learning - transparent and explainable. Its expected outputs are novel theory-driven algorithms and unconventional foundational blocks for deep learning that will al ....Glass-box Deep Machine Perception for Trustworthy Artificial Intelligence. Explainability and Transparency are the key values for development and deployment of Artificial Intelligence (AI) in Australia’s AI Ethics Framework for industry and governments. This project aims to build new tools to make the central technology of AI - deep learning - transparent and explainable. Its expected outputs are novel theory-driven algorithms and unconventional foundational blocks for deep learning that will allow humans to clearly interpret the reasoning process of this technology, which is currently not possible. It is expected to significantly advance our knowledge in machine intelligence and perception. Due to their fundamental nature, the project outcomes are likely to benefit industry and scientific frontiers alike.Read moreRead less
Learning to Reason in Reinforcement Learning. Deep Reinforcement Learning (RL) uses deep neural networks to represent and learn optimal decision-making policies for intelligent agents in complex environments. However, most RL approaches require millions of episodes to converge to good policies, making it difficult for RL to be applied in real-world scenarios taking significant resources. This project aims to equip RL with capabilities such as counterfactual reasoning and outcome anticipation to ....Learning to Reason in Reinforcement Learning. Deep Reinforcement Learning (RL) uses deep neural networks to represent and learn optimal decision-making policies for intelligent agents in complex environments. However, most RL approaches require millions of episodes to converge to good policies, making it difficult for RL to be applied in real-world scenarios taking significant resources. This project aims to equip RL with capabilities such as counterfactual reasoning and outcome anticipation to significantly reduce the number of interactions required, improve generalisation, and provide the agent with the capability to consider the cause-effects. These improvements would narrow the gap between AI and human capabilities and broaden the adoption of RL in real-world applications.Read moreRead less
A Machine Learning Framework for Concrete Workability Estimation . Concrete is the most used construction material in Australia. The project aims to develop a system to measure the workability of concrete in transit in agitator trucks using advanced machine vision and machine learning, and provide a reliable alternative to the current practice of visually testing concrete workability by certified testers. Concrete that fails to meet workability requirements is one of the most frequent reasons fo ....A Machine Learning Framework for Concrete Workability Estimation . Concrete is the most used construction material in Australia. The project aims to develop a system to measure the workability of concrete in transit in agitator trucks using advanced machine vision and machine learning, and provide a reliable alternative to the current practice of visually testing concrete workability by certified testers. Concrete that fails to meet workability requirements is one of the most frequent reasons for rejection at construction sites, resulting in significant costs, waste, and delays. Multimodal data sources will be used to provide a reliable workability estimate in real time, enabling construction teams to identify and rectify workability issues in transit while continuously monitoring the adjustments effects.Read moreRead less
Discovery Early Career Researcher Award - Grant ID: DE240100149
Funder
Australian Research Council
Funding Amount
$462,044.00
Summary
Adaptive and Efficient Robot Positioning Through Model and Task Fusion. This project aims to create fit-for-purpose positioning systems that continuously adapt to diverse and changing environments. The project expects to contribute to the knowledge across robotics, computer vision, and neuromorphic computing. Expected outcomes of this project include ground-breaking place recognition techniques that address two fundamental limitations in the state-of-the-art: continuous adaptation, critically im ....Adaptive and Efficient Robot Positioning Through Model and Task Fusion. This project aims to create fit-for-purpose positioning systems that continuously adapt to diverse and changing environments. The project expects to contribute to the knowledge across robotics, computer vision, and neuromorphic computing. Expected outcomes of this project include ground-breaking place recognition techniques that address two fundamental limitations in the state-of-the-art: continuous adaptation, critically important in safety-critical systems, and energy efficiency, critically important in resource-constrained systems. This should provide significant benefits, such as accelerated deployment of mobile robots, drones and augmented reality solutions in manufacturing, defence, healthcare, household, and space.Read moreRead less
Visual methods for advanced automation of underwater manipulation. This project will increase the autonomy of underwater robotic systems engaged in intervention and inspection tasks. Such activities are essential for the operation of subsea robotic systems used in offshore industries, scientific exploration and defence. Our approach will improve perception and situational awareness through the principled fusion of multiple navigation and camera sensors. We will use this improved scene understand ....Visual methods for advanced automation of underwater manipulation. This project will increase the autonomy of underwater robotic systems engaged in intervention and inspection tasks. Such activities are essential for the operation of subsea robotic systems used in offshore industries, scientific exploration and defence. Our approach will improve perception and situational awareness through the principled fusion of multiple navigation and camera sensors. We will use this improved scene understanding to effectively plan the motion of vehicles and manipulators through larger and more complex workspaces, enabling semi-supervised and autonomous task execution. Our project will demonstrate these capabilities in real-world deployments relevant to industry and marine science.Read moreRead less
Deep Adder Networks on Edge Devices. This project aims to empower edge devices with intelligence by developing advanced deep neural networks that address the conflict between the high resource requirements of deep learning and the generally inadequate performance of the edge. Multiplication has been the dominant type of operation in deep learning, though the addition is known to be much cheaper. This project expects to yield theories and algorithms that allow deep neural networks consisting of n ....Deep Adder Networks on Edge Devices. This project aims to empower edge devices with intelligence by developing advanced deep neural networks that address the conflict between the high resource requirements of deep learning and the generally inadequate performance of the edge. Multiplication has been the dominant type of operation in deep learning, though the addition is known to be much cheaper. This project expects to yield theories and algorithms that allow deep neural networks consisting of nearly pure additions to fulfil the requisites of accuracy, robustness, calibration and generalisation in real-world computer vision tasks. The success of this project will benefit deep learning-based products on smartphones or robots in health and cybersecurity.Read moreRead less
Discovery Early Career Researcher Award - Grant ID: DE230101591
Funder
Australian Research Council
Funding Amount
$419,154.00
Summary
Towards Real-world Continual Learning on Unrestricted Task Steams. This project aims to enable machines to continually learn without forgetting and accumulate knowledge from the sequential data streams containing diverse tasks. This project expects to advance the continual learning to unrestricted real-world task steams that are long-term and complex and promote artificial intelligence toward the human-level intelligence that can automatically evolve during interaction with the world. Expected o ....Towards Real-world Continual Learning on Unrestricted Task Steams. This project aims to enable machines to continually learn without forgetting and accumulate knowledge from the sequential data streams containing diverse tasks. This project expects to advance the continual learning to unrestricted real-world task steams that are long-term and complex and promote artificial intelligence toward the human-level intelligence that can automatically evolve during interaction with the world. Expected outcomes of this project include the paradigm-shifting continual learning framework and techniques for handling unrestricted task steams in real-world scenarios. They will benefit society and the economy nationally and internationally by enhancing the applicability of artificial intelligence.Read moreRead less