Making Meta-learning Generalised . This project aims to develop novel machine learning techniques, termed generalised meta-learning, to make machines better utilise past experience to solve new tasks with few data. It expects to reduce the undesirable dependence of current machine learning on labelled data and significantly expand its application scope. Expected outcomes of the project consist of new theoretical results on meta-learning and a set of innovative algorithms that can support the bui ....Making Meta-learning Generalised . This project aims to develop novel machine learning techniques, termed generalised meta-learning, to make machines better utilise past experience to solve new tasks with few data. It expects to reduce the undesirable dependence of current machine learning on labelled data and significantly expand its application scope. Expected outcomes of the project consist of new theoretical results on meta-learning and a set of innovative algorithms that can support the building of next generation of computer vision systems to work in open and dynamic environments. This should be able to produce solid benefits to the science, society, and economy of Australian via the application of these advanced intelligent systems.Read moreRead less
Personalised Online Learning Analytics by Exploring Multilayer Graph Data . Learning analytics is becoming a significant factor in reducing the drop-out rate of students in online learning. The aim of this project is to develop a reliable, robust, real-time analysis system that automatically reveals multilayered relationships, evaluates students' learning performance, and generates a personal study plan through discovery. This project includes the design of novel algorithms for multilayer graph ....Personalised Online Learning Analytics by Exploring Multilayer Graph Data . Learning analytics is becoming a significant factor in reducing the drop-out rate of students in online learning. The aim of this project is to develop a reliable, robust, real-time analysis system that automatically reveals multilayered relationships, evaluates students' learning performance, and generates a personal study plan through discovery. This project includes the design of novel algorithms for multilayer graph processing, pattern recognition in learning activities, learning performance assessment, and personalised study plan recommendations. The success of this project will significantly enhance the success of online education both in Australia and worldwide and; hence, will save time, money and resources for end users.Read moreRead less
Small Scalable Natural Language Models using Explicit Memory. Deep neural networks have had spectacular success in natural language processing, seeing wide-spread deployment as part of automatic assistant devices in homes and cars, and across many valuable industries including finance, medicine and law. Fueling this success is the use of ever larger models, with exponentially increasing training resources, accompanying hardware and energy demands. This project aims to develop more compact models ....Small Scalable Natural Language Models using Explicit Memory. Deep neural networks have had spectacular success in natural language processing, seeing wide-spread deployment as part of automatic assistant devices in homes and cars, and across many valuable industries including finance, medicine and law. Fueling this success is the use of ever larger models, with exponentially increasing training resources, accompanying hardware and energy demands. This project aims to develop more compact models, based on the incorporation of an explicit searchable memory, which will dramatically reduce model size, hardware requirements and energy usage. This will make modern natural language processing more accessible, while also providing greater flexibility, allowing for more adaptable and portable technologies.Read moreRead less
3D Vision Geometric Optimisation in Deep Learning. This project aims to develop a methodology for integrating the algorithms of 3D Vision Geometry and Optimization into the framework of Machine Learning and demonstrate the wide applicability of the new methods on a variety of challenging fundamental problems in Computer Vision. These include 3D geometric scene understanding, and estimation and prediction of human 2D/3D pose and activity. Applications of this technology are to be found in Intell ....3D Vision Geometric Optimisation in Deep Learning. This project aims to develop a methodology for integrating the algorithms of 3D Vision Geometry and Optimization into the framework of Machine Learning and demonstrate the wide applicability of the new methods on a variety of challenging fundamental problems in Computer Vision. These include 3D geometric scene understanding, and estimation and prediction of human 2D/3D pose and activity. Applications of this technology are to be found in Intelligent Transportation, Environment Monitoring, and Augmented Reality, applicable in smart-city planning and medical applications such as computer-enhanced surgery. The goal is to build Australia's competitive advantage in the forefront of ICT research and technology innovation.Read moreRead less
Deep Adder Networks on Edge Devices. This project aims to empower edge devices with intelligence by developing advanced deep neural networks that address the conflict between the high resource requirements of deep learning and the generally inadequate performance of the edge. Multiplication has been the dominant type of operation in deep learning, though the addition is known to be much cheaper. This project expects to yield theories and algorithms that allow deep neural networks consisting of n ....Deep Adder Networks on Edge Devices. This project aims to empower edge devices with intelligence by developing advanced deep neural networks that address the conflict between the high resource requirements of deep learning and the generally inadequate performance of the edge. Multiplication has been the dominant type of operation in deep learning, though the addition is known to be much cheaper. This project expects to yield theories and algorithms that allow deep neural networks consisting of nearly pure additions to fulfil the requisites of accuracy, robustness, calibration and generalisation in real-world computer vision tasks. The success of this project will benefit deep learning-based products on smartphones or robots in health and cybersecurity.Read moreRead less
Discovery Early Career Researcher Award - Grant ID: DE230101591
Funder
Australian Research Council
Funding Amount
$419,154.00
Summary
Towards Real-world Continual Learning on Unrestricted Task Steams. This project aims to enable machines to continually learn without forgetting and accumulate knowledge from the sequential data streams containing diverse tasks. This project expects to advance the continual learning to unrestricted real-world task steams that are long-term and complex and promote artificial intelligence toward the human-level intelligence that can automatically evolve during interaction with the world. Expected o ....Towards Real-world Continual Learning on Unrestricted Task Steams. This project aims to enable machines to continually learn without forgetting and accumulate knowledge from the sequential data streams containing diverse tasks. This project expects to advance the continual learning to unrestricted real-world task steams that are long-term and complex and promote artificial intelligence toward the human-level intelligence that can automatically evolve during interaction with the world. Expected outcomes of this project include the paradigm-shifting continual learning framework and techniques for handling unrestricted task steams in real-world scenarios. They will benefit society and the economy nationally and internationally by enhancing the applicability of artificial intelligence.Read moreRead less
Generative Visual Pre-training on Unlabelled Big Data. This project aims to develop a generative visual pre-training of large-scale deep neural networks on unlabelled big data. Developing pre-trained visual models that are accurate, robust, and efficient for downstream tasks is a keystone of modern computer vision, but it poses challenges and knowledge gaps to existing unsupervised representation learning. Expected outcomes include new theories and algorithms for unsupervised visual pre-training ....Generative Visual Pre-training on Unlabelled Big Data. This project aims to develop a generative visual pre-training of large-scale deep neural networks on unlabelled big data. Developing pre-trained visual models that are accurate, robust, and efficient for downstream tasks is a keystone of modern computer vision, but it poses challenges and knowledge gaps to existing unsupervised representation learning. Expected outcomes include new theories and algorithms for unsupervised visual pre-training, which are anticipated to deepen our understanding of visual representation and make it easier to build and deploy computer vision applications and services. Examples of benefits include modernising machines in manufacturing and farming with visual intelligence. Read moreRead less
Discovery Early Career Researcher Award - Grant ID: DE180100628
Funder
Australian Research Council
Funding Amount
$368,446.00
Summary
Machine vision techniques for solar power forecasting and generation. This project aims to advance the research in short-term solar power forecasting and optimise the generation process using machine vision techniques. This project will use cameras to capture images of sky and mirror surfaces of heliostats. The scientific novelties are the exploration of geometry-aware feature representations for solar power prediction and building three-dimensional models of mirror surfaces of heliostats to opt ....Machine vision techniques for solar power forecasting and generation. This project aims to advance the research in short-term solar power forecasting and optimise the generation process using machine vision techniques. This project will use cameras to capture images of sky and mirror surfaces of heliostats. The scientific novelties are the exploration of geometry-aware feature representations for solar power prediction and building three-dimensional models of mirror surfaces of heliostats to optimise the solar power generation process. The outcome is a working prototype to boost the solar power forecasting accuracy and a three-dimensional reconstruction system to be helpful for the solar power generation. These outcomes will highly benefit the short-term solar power forecasting, generation and electricity grid management systems.Read moreRead less
Data Complexity and Uncertainty-Resilient Deep Variational Learning. Enterprise data present increasingly significant characteristics and complexities, such as multi-aspect, heterogeneous and hierarchical features and interactions, and evolving dependencies and multi-distributions. They continue to significantly challenge the state-of-the-art probabilistic and neural learning systems with limited to insufficient capabilities and capacity. This research aims to develop a theory of flexible deep v ....Data Complexity and Uncertainty-Resilient Deep Variational Learning. Enterprise data present increasingly significant characteristics and complexities, such as multi-aspect, heterogeneous and hierarchical features and interactions, and evolving dependencies and multi-distributions. They continue to significantly challenge the state-of-the-art probabilistic and neural learning systems with limited to insufficient capabilities and capacity. This research aims to develop a theory of flexible deep variational learning transforming new deep probabilistic models with flexible variational neural mechanisms for analytically explainable, complexity-resilient analytics of real-life data. The outcomes are expected to fill important knowledge gaps and lift critical innovation competencies in wide domains.Read moreRead less
Exploiting Geometries of Learning for Fast, Adaptive and Robust AI. This project aims to uniquely exploit geometric manifolds in deep learning to advance the frontier of Artificial Intelligence (AI) research and applications in cybersecurity and general cognitive tasks. It expects to develop new theories, algorithms, tools, and technologies for machine learning systems that are fast, adaptive, lifelong and robust, even with limited supervision. Expected outcomes will enhance Australia's capabili ....Exploiting Geometries of Learning for Fast, Adaptive and Robust AI. This project aims to uniquely exploit geometric manifolds in deep learning to advance the frontier of Artificial Intelligence (AI) research and applications in cybersecurity and general cognitive tasks. It expects to develop new theories, algorithms, tools, and technologies for machine learning systems that are fast, adaptive, lifelong and robust, even with limited supervision. Expected outcomes will enhance Australia's capability and competitiveness in AI, and deliver robust and trustworthy learning technology. The project should provide significant benefits not only in advancing scientific and translational knowledge but also in accelerating AI innovations, safeguarding cyberspace, and reducing the burden on defence expenses in Australia.Read moreRead less