Deep visual understanding: learning to see in an unruly world. Deep Learning has achieved incredible success at an astonishing variety of Computer Vision tasks recently. This project aims to convey this success into the challenging domain of high-level image-based reasoning. It will extend deep learning to achieve flexible semantic reasoning about the content of images based on information gleaned from the huge volumes of data available on the Internet. The project expects to overcome one of the ....Deep visual understanding: learning to see in an unruly world. Deep Learning has achieved incredible success at an astonishing variety of Computer Vision tasks recently. This project aims to convey this success into the challenging domain of high-level image-based reasoning. It will extend deep learning to achieve flexible semantic reasoning about the content of images based on information gleaned from the huge volumes of data available on the Internet. The project expects to overcome one of the primary limitations of deep learning and will greatly increase its practical application to a range of industrial, cultural or health settings.Read moreRead less
Discovery Early Career Researcher Award - Grant ID: DE190100539
Funder
Australian Research Council
Funding Amount
$408,000.00
Summary
Towards conversational vision-based Artificial Intelligence. This project aims to develop a novel learning framework, Vision-Ask-Answer-Act (V3A). This framework will allow a machine to perform a sequence of actions via a conversation with human users, based on intricate processing of not just visual input, but human-computer verbal exchanges. Artificial intelligence has great potential as a tool for economic productivity and daily tasks. Applications in cars and assistant robots, still in their ....Towards conversational vision-based Artificial Intelligence. This project aims to develop a novel learning framework, Vision-Ask-Answer-Act (V3A). This framework will allow a machine to perform a sequence of actions via a conversation with human users, based on intricate processing of not just visual input, but human-computer verbal exchanges. Artificial intelligence has great potential as a tool for economic productivity and daily tasks. Applications in cars and assistant robots, still in their early days, typically require significant expertise to use effectively. The outcomes of this project will push the boundary of vision-language research to produce a conversational intelligent agent that can be easily used in common situations across industry, transport, the medical sector, and at home.Read moreRead less
Making Meta-learning Generalised . This project aims to develop novel machine learning techniques, termed generalised meta-learning, to make machines better utilise past experience to solve new tasks with few data. It expects to reduce the undesirable dependence of current machine learning on labelled data and significantly expand its application scope. Expected outcomes of the project consist of new theoretical results on meta-learning and a set of innovative algorithms that can support the bui ....Making Meta-learning Generalised . This project aims to develop novel machine learning techniques, termed generalised meta-learning, to make machines better utilise past experience to solve new tasks with few data. It expects to reduce the undesirable dependence of current machine learning on labelled data and significantly expand its application scope. Expected outcomes of the project consist of new theoretical results on meta-learning and a set of innovative algorithms that can support the building of next generation of computer vision systems to work in open and dynamic environments. This should be able to produce solid benefits to the science, society, and economy of Australian via the application of these advanced intelligent systems.Read moreRead less
New Paradigms for Robust Fitting: Kernelisation and Polyhedral Search. Outliers inevitably exist in visual data due to imperfect data acquisition or preprocessing. To enable computer vision applications that can perform reliably, robust fitting algorithms are necessary to counter the biasing influence of outliers. However, current robust algorithms are unsatisfactory: they are unreliable (due to using randomisation) or too computationally costly (due to using exhaustive search). This project wil ....New Paradigms for Robust Fitting: Kernelisation and Polyhedral Search. Outliers inevitably exist in visual data due to imperfect data acquisition or preprocessing. To enable computer vision applications that can perform reliably, robust fitting algorithms are necessary to counter the biasing influence of outliers. However, current robust algorithms are unsatisfactory: they are unreliable (due to using randomisation) or too computationally costly (due to using exhaustive search). This project will develop new robust algorithms to mitigate these shortcomings. It will do so by investigating two new paradigms of kernelisation and polyhedral search, which offer unprecedented theoretical insights into the problem. The outcomes will contribute towards computer vision applications that are more practical and reliable.Read moreRead less
Learning Robotic Navigation and Interaction from Object-based Semantic Maps. Our project aims to develop new learning algorithms that enable robots to perform high-complexity tasks that are currently impossible. Compared to existing methods that rely on low-level sensor data, we aim to achieve this by learning from a high-level graph representation of the environment that captures semantics, affordances, and geometry. The outcome would be robots capable of using human instructions to efficiently ....Learning Robotic Navigation and Interaction from Object-based Semantic Maps. Our project aims to develop new learning algorithms that enable robots to perform high-complexity tasks that are currently impossible. Compared to existing methods that rely on low-level sensor data, we aim to achieve this by learning from a high-level graph representation of the environment that captures semantics, affordances, and geometry. The outcome would be robots capable of using human instructions to efficiently learn complex interaction and navigation behaviours that transfer to unseen environments. Our research should benefit new applications in domains of economic and societal importance that are currently too complex, unsafe, and uncertain for robot assistants, such as aged care, advanced manufacturing and domestic robotics.Read moreRead less
Active Visual Navigation in an Unexplored Environment. This project will develop a new method for robotic navigation in which goals can be specified at a much higher level of abstraction than has previously been possible. This will be achieved using deep learning to make informed predictions about a scene layout, and navigating as an active observer in which the predictions informs actions. The outcome will be robotic agents capable of effective and efficient navigation and operation in previous ....Active Visual Navigation in an Unexplored Environment. This project will develop a new method for robotic navigation in which goals can be specified at a much higher level of abstraction than has previously been possible. This will be achieved using deep learning to make informed predictions about a scene layout, and navigating as an active observer in which the predictions informs actions. The outcome will be robotic agents capable of effective and efficient navigation and operation in previously unseen environments, and the ability to control such agents with more human-like instructions. Such capabilities are desirable, and in some cases essential, for autonomous robots in a variety of important application areas including automated warehousing and high-level control of autonomous vehicles. Read moreRead less
Collaborative Sensing and Learning for Maritime Situational Awareness. We aim to demonstrate coordinated autonomous sensing of naval assets in dynamic maritime environments, reducing the operational load required to deliver a high quality maritime situational awareness. A realistic simulation based approach will help us develop novel artificial intelligence technology including: self-adaptive strategies for dynamic asset allocation, embedded smart sensing capabilities for naval observation syste ....Collaborative Sensing and Learning for Maritime Situational Awareness. We aim to demonstrate coordinated autonomous sensing of naval assets in dynamic maritime environments, reducing the operational load required to deliver a high quality maritime situational awareness. A realistic simulation based approach will help us develop novel artificial intelligence technology including: self-adaptive strategies for dynamic asset allocation, embedded smart sensing capabilities for naval observation systems and novel approaches to continuous collaborative learning from multi-spectral media. In addition to the emerging partnership between participants, the project will advance sovereign capability to develop maritime intelligence gathering technology for the Royal Australian Navy to underpin stability in our region. Read moreRead less
Adapting Deep Learning for Real-world Medical Image Datasets. The project aims to investigate new deep learning modelling approaches to leverage real-world large-scale image data sets that contain noisy and incomplete labels and imbalanced class prevalence – to enable the use of these data sets for modelling deep learning classifiers. Expected outcomes include an innovative method for modelling deep learning classifiers. The research will involve new inter-disciplinary and international collabor ....Adapting Deep Learning for Real-world Medical Image Datasets. The project aims to investigate new deep learning modelling approaches to leverage real-world large-scale image data sets that contain noisy and incomplete labels and imbalanced class prevalence – to enable the use of these data sets for modelling deep learning classifiers. Expected outcomes include an innovative method for modelling deep learning classifiers. The research will involve new inter-disciplinary and international collaborations with machine learning and medical image analysis research institutions. This should provide significant benefits, such as better understanding of deep learning theory, new deep learning applications that can use previously unexplored data sets, and training for the future Australian workforce.Read moreRead less
Geometric reasoning in computer vision with using only 2D supervision. The aim of the project is to build a geometric reasoning system that can exhibit human like performance. Advances in autonomous systems such as vehicles, robots, and drones will transform the Australian and global economy. Geometric reasoning is fundamental to advancement in such AI and is the focus of this project. The project will leverage a theoretical breakthrough in the field of structure from motion; which will allow an ....Geometric reasoning in computer vision with using only 2D supervision. The aim of the project is to build a geometric reasoning system that can exhibit human like performance. Advances in autonomous systems such as vehicles, robots, and drones will transform the Australian and global economy. Geometric reasoning is fundamental to advancement in such AI and is the focus of this project. The project will leverage a theoretical breakthrough in the field of structure from motion; which will allow an AI to learn the 3D pose and shape of an object solely through 2D supervision. The project will provide new insights into how AI should understand the 3D world. Read moreRead less
Industrial Transformation Research Hubs - Grant ID: IH180100002
Funder
Australian Research Council
Funding Amount
$5,000,000.00
Summary
ARC Research Hub for Driving Farming Productivity and Disease Prevention. The ARC Research Hub for Driving Farming Productivity and Disease Prevention aims to increase farm production and disease prevention through advancing and transferring new artificial intelligence technologies into industrial deployment. The Hub will combine machine vision, machine learning, software quality control, engineering, biology, and farming industries to develop technologies to build more intelligent systems. Thes ....ARC Research Hub for Driving Farming Productivity and Disease Prevention. The ARC Research Hub for Driving Farming Productivity and Disease Prevention aims to increase farm production and disease prevention through advancing and transferring new artificial intelligence technologies into industrial deployment. The Hub will combine machine vision, machine learning, software quality control, engineering, biology, and farming industries to develop technologies to build more intelligent systems. These dynamic systems will help determine what goal to achieve and the most efficient plan to achieve it. This Hub is expected to contribute to higher farming efficiency, lower production costs and fewer disease risks, giving the Australian industry new business opportunities and an international competitive advantage.Read moreRead less