Deep Adder Networks on Edge Devices. This project aims to empower edge devices with intelligence by developing advanced deep neural networks that address the conflict between the high resource requirements of deep learning and the generally inadequate performance of the edge. Multiplication has been the dominant type of operation in deep learning, though the addition is known to be much cheaper. This project expects to yield theories and algorithms that allow deep neural networks consisting of n ....Deep Adder Networks on Edge Devices. This project aims to empower edge devices with intelligence by developing advanced deep neural networks that address the conflict between the high resource requirements of deep learning and the generally inadequate performance of the edge. Multiplication has been the dominant type of operation in deep learning, though the addition is known to be much cheaper. This project expects to yield theories and algorithms that allow deep neural networks consisting of nearly pure additions to fulfil the requisites of accuracy, robustness, calibration and generalisation in real-world computer vision tasks. The success of this project will benefit deep learning-based products on smartphones or robots in health and cybersecurity.Read moreRead less
Discovery Early Career Researcher Award - Grant ID: DE230101591
Funder
Australian Research Council
Funding Amount
$419,154.00
Summary
Towards Real-world Continual Learning on Unrestricted Task Steams. This project aims to enable machines to continually learn without forgetting and accumulate knowledge from the sequential data streams containing diverse tasks. This project expects to advance the continual learning to unrestricted real-world task steams that are long-term and complex and promote artificial intelligence toward the human-level intelligence that can automatically evolve during interaction with the world. Expected o ....Towards Real-world Continual Learning on Unrestricted Task Steams. This project aims to enable machines to continually learn without forgetting and accumulate knowledge from the sequential data streams containing diverse tasks. This project expects to advance the continual learning to unrestricted real-world task steams that are long-term and complex and promote artificial intelligence toward the human-level intelligence that can automatically evolve during interaction with the world. Expected outcomes of this project include the paradigm-shifting continual learning framework and techniques for handling unrestricted task steams in real-world scenarios. They will benefit society and the economy nationally and internationally by enhancing the applicability of artificial intelligence.Read moreRead less
Generative Visual Pre-training on Unlabelled Big Data. This project aims to develop a generative visual pre-training of large-scale deep neural networks on unlabelled big data. Developing pre-trained visual models that are accurate, robust, and efficient for downstream tasks is a keystone of modern computer vision, but it poses challenges and knowledge gaps to existing unsupervised representation learning. Expected outcomes include new theories and algorithms for unsupervised visual pre-training ....Generative Visual Pre-training on Unlabelled Big Data. This project aims to develop a generative visual pre-training of large-scale deep neural networks on unlabelled big data. Developing pre-trained visual models that are accurate, robust, and efficient for downstream tasks is a keystone of modern computer vision, but it poses challenges and knowledge gaps to existing unsupervised representation learning. Expected outcomes include new theories and algorithms for unsupervised visual pre-training, which are anticipated to deepen our understanding of visual representation and make it easier to build and deploy computer vision applications and services. Examples of benefits include modernising machines in manufacturing and farming with visual intelligence. Read moreRead less
Exploiting Geometries of Learning for Fast, Adaptive and Robust AI. This project aims to uniquely exploit geometric manifolds in deep learning to advance the frontier of Artificial Intelligence (AI) research and applications in cybersecurity and general cognitive tasks. It expects to develop new theories, algorithms, tools, and technologies for machine learning systems that are fast, adaptive, lifelong and robust, even with limited supervision. Expected outcomes will enhance Australia's capabili ....Exploiting Geometries of Learning for Fast, Adaptive and Robust AI. This project aims to uniquely exploit geometric manifolds in deep learning to advance the frontier of Artificial Intelligence (AI) research and applications in cybersecurity and general cognitive tasks. It expects to develop new theories, algorithms, tools, and technologies for machine learning systems that are fast, adaptive, lifelong and robust, even with limited supervision. Expected outcomes will enhance Australia's capability and competitiveness in AI, and deliver robust and trustworthy learning technology. The project should provide significant benefits not only in advancing scientific and translational knowledge but also in accelerating AI innovations, safeguarding cyberspace, and reducing the burden on defence expenses in Australia.Read moreRead less
Discovery Early Career Researcher Award - Grant ID: DE240100144
Funder
Australian Research Council
Funding Amount
$444,447.00
Summary
Universal Model Selection Criteria for Scientific Machine Learning. This project aims to develop provably reliable universal model selection criteria to facilitate trustworthy scientific machine learning. Combining stochastic methods with an innovative geometric approach to basic statistical principles, this project expects to characterise, combine, and refine the most successful heuristics for designing and training huge models, such as deep neural networks, into a cohesive theoretical framewor ....Universal Model Selection Criteria for Scientific Machine Learning. This project aims to develop provably reliable universal model selection criteria to facilitate trustworthy scientific machine learning. Combining stochastic methods with an innovative geometric approach to basic statistical principles, this project expects to characterise, combine, and refine the most successful heuristics for designing and training huge models, such as deep neural networks, into a cohesive theoretical framework. The expected outcomes include a general toolkit for assisting neural network design at the forefront of scientific applications. This should significantly improve the quality of scientific predictions by facilitating confident adoption of deep learning methods into the pantheon of trustworthy modeling techniques. Read moreRead less
Learning to Reason in Reinforcement Learning. Deep Reinforcement Learning (RL) uses deep neural networks to represent and learn optimal decision-making policies for intelligent agents in complex environments. However, most RL approaches require millions of episodes to converge to good policies, making it difficult for RL to be applied in real-world scenarios taking significant resources. This project aims to equip RL with capabilities such as counterfactual reasoning and outcome anticipation to ....Learning to Reason in Reinforcement Learning. Deep Reinforcement Learning (RL) uses deep neural networks to represent and learn optimal decision-making policies for intelligent agents in complex environments. However, most RL approaches require millions of episodes to converge to good policies, making it difficult for RL to be applied in real-world scenarios taking significant resources. This project aims to equip RL with capabilities such as counterfactual reasoning and outcome anticipation to significantly reduce the number of interactions required, improve generalisation, and provide the agent with the capability to consider the cause-effects. These improvements would narrow the gap between AI and human capabilities and broaden the adoption of RL in real-world applications.Read moreRead less
High Quality-of-Experience Real-time Video for Smart Online Shopping. This project aims to develop high quality-of-experience real-time video systems for smart shopping applications by devising new deep-neural-network-enhanced video delivery schemes. It will generate new knowledge of combined AI and network solutions to achieve high-quality and low-latency real-time video delivery, addressing unsatisfactory user experience intrinsically caused by network delay and bandwidth. Fundamental principl ....High Quality-of-Experience Real-time Video for Smart Online Shopping. This project aims to develop high quality-of-experience real-time video systems for smart shopping applications by devising new deep-neural-network-enhanced video delivery schemes. It will generate new knowledge of combined AI and network solutions to achieve high-quality and low-latency real-time video delivery, addressing unsatisfactory user experience intrinsically caused by network delay and bandwidth. Fundamental principles and an all-in-one platform will be developed to address research problems and the industrial partner’s practical problems. It will significantly benefit all shopping businesses and their customers in Australia, as well as all other video-related services (e.g., online education, video conferencing, etc.).Read moreRead less
Causal Knowledge-Empowered Adaptive Federated Learning. Federated learning tools are a promising framework for collaborative machine learning (ML) that also maintain data privacy; however, their ability to model heterogeneous data remains a key challenge. This project aims to develop a new learning scheme for coordinated training of ML models that successfully bridges variable data distributions. The framework proposed will be the first globally that can use causal knowledge to 1) handle data he ....Causal Knowledge-Empowered Adaptive Federated Learning. Federated learning tools are a promising framework for collaborative machine learning (ML) that also maintain data privacy; however, their ability to model heterogeneous data remains a key challenge. This project aims to develop a new learning scheme for coordinated training of ML models that successfully bridges variable data distributions. The framework proposed will be the first globally that can use causal knowledge to 1) handle data heterogeneity across devices and 2) address the real-world challenges when only a subset of devices have labelled data. Expected outcomes and benefits include the theoretical underpinnings and algorithms of causality-based collaborative training of ML models while better preserving the users’ data privacy.Read moreRead less
Data Complexity and Uncertainty-Resilient Deep Variational Learning. Enterprise data present increasingly significant characteristics and complexities, such as multi-aspect, heterogeneous and hierarchical features and interactions, and evolving dependencies and multi-distributions. They continue to significantly challenge the state-of-the-art probabilistic and neural learning systems with limited to insufficient capabilities and capacity. This research aims to develop a theory of flexible deep v ....Data Complexity and Uncertainty-Resilient Deep Variational Learning. Enterprise data present increasingly significant characteristics and complexities, such as multi-aspect, heterogeneous and hierarchical features and interactions, and evolving dependencies and multi-distributions. They continue to significantly challenge the state-of-the-art probabilistic and neural learning systems with limited to insufficient capabilities and capacity. This research aims to develop a theory of flexible deep variational learning transforming new deep probabilistic models with flexible variational neural mechanisms for analytically explainable, complexity-resilient analytics of real-life data. The outcomes are expected to fill important knowledge gaps and lift critical innovation competencies in wide domains.Read moreRead less