Deep Adder Networks on Edge Devices. This project aims to empower edge devices with intelligence by developing advanced deep neural networks that address the conflict between the high resource requirements of deep learning and the generally inadequate performance of the edge. Multiplication has been the dominant type of operation in deep learning, though the addition is known to be much cheaper. This project expects to yield theories and algorithms that allow deep neural networks consisting of n ....Deep Adder Networks on Edge Devices. This project aims to empower edge devices with intelligence by developing advanced deep neural networks that address the conflict between the high resource requirements of deep learning and the generally inadequate performance of the edge. Multiplication has been the dominant type of operation in deep learning, though the addition is known to be much cheaper. This project expects to yield theories and algorithms that allow deep neural networks consisting of nearly pure additions to fulfil the requisites of accuracy, robustness, calibration and generalisation in real-world computer vision tasks. The success of this project will benefit deep learning-based products on smartphones or robots in health and cybersecurity.Read moreRead less
Discovery Early Career Researcher Award - Grant ID: DE230101591
Funder
Australian Research Council
Funding Amount
$419,154.00
Summary
Towards Real-world Continual Learning on Unrestricted Task Steams. This project aims to enable machines to continually learn without forgetting and accumulate knowledge from the sequential data streams containing diverse tasks. This project expects to advance the continual learning to unrestricted real-world task steams that are long-term and complex and promote artificial intelligence toward the human-level intelligence that can automatically evolve during interaction with the world. Expected o ....Towards Real-world Continual Learning on Unrestricted Task Steams. This project aims to enable machines to continually learn without forgetting and accumulate knowledge from the sequential data streams containing diverse tasks. This project expects to advance the continual learning to unrestricted real-world task steams that are long-term and complex and promote artificial intelligence toward the human-level intelligence that can automatically evolve during interaction with the world. Expected outcomes of this project include the paradigm-shifting continual learning framework and techniques for handling unrestricted task steams in real-world scenarios. They will benefit society and the economy nationally and internationally by enhancing the applicability of artificial intelligence.Read moreRead less
Generative Visual Pre-training on Unlabelled Big Data. This project aims to develop a generative visual pre-training of large-scale deep neural networks on unlabelled big data. Developing pre-trained visual models that are accurate, robust, and efficient for downstream tasks is a keystone of modern computer vision, but it poses challenges and knowledge gaps to existing unsupervised representation learning. Expected outcomes include new theories and algorithms for unsupervised visual pre-training ....Generative Visual Pre-training on Unlabelled Big Data. This project aims to develop a generative visual pre-training of large-scale deep neural networks on unlabelled big data. Developing pre-trained visual models that are accurate, robust, and efficient for downstream tasks is a keystone of modern computer vision, but it poses challenges and knowledge gaps to existing unsupervised representation learning. Expected outcomes include new theories and algorithms for unsupervised visual pre-training, which are anticipated to deepen our understanding of visual representation and make it easier to build and deploy computer vision applications and services. Examples of benefits include modernising machines in manufacturing and farming with visual intelligence. Read moreRead less
Exploiting Geometries of Learning for Fast, Adaptive and Robust AI. This project aims to uniquely exploit geometric manifolds in deep learning to advance the frontier of Artificial Intelligence (AI) research and applications in cybersecurity and general cognitive tasks. It expects to develop new theories, algorithms, tools, and technologies for machine learning systems that are fast, adaptive, lifelong and robust, even with limited supervision. Expected outcomes will enhance Australia's capabili ....Exploiting Geometries of Learning for Fast, Adaptive and Robust AI. This project aims to uniquely exploit geometric manifolds in deep learning to advance the frontier of Artificial Intelligence (AI) research and applications in cybersecurity and general cognitive tasks. It expects to develop new theories, algorithms, tools, and technologies for machine learning systems that are fast, adaptive, lifelong and robust, even with limited supervision. Expected outcomes will enhance Australia's capability and competitiveness in AI, and deliver robust and trustworthy learning technology. The project should provide significant benefits not only in advancing scientific and translational knowledge but also in accelerating AI innovations, safeguarding cyberspace, and reducing the burden on defence expenses in Australia.Read moreRead less
High Quality-of-Experience Real-time Video for Smart Online Shopping. This project aims to develop high quality-of-experience real-time video systems for smart shopping applications by devising new deep-neural-network-enhanced video delivery schemes. It will generate new knowledge of combined AI and network solutions to achieve high-quality and low-latency real-time video delivery, addressing unsatisfactory user experience intrinsically caused by network delay and bandwidth. Fundamental principl ....High Quality-of-Experience Real-time Video for Smart Online Shopping. This project aims to develop high quality-of-experience real-time video systems for smart shopping applications by devising new deep-neural-network-enhanced video delivery schemes. It will generate new knowledge of combined AI and network solutions to achieve high-quality and low-latency real-time video delivery, addressing unsatisfactory user experience intrinsically caused by network delay and bandwidth. Fundamental principles and an all-in-one platform will be developed to address research problems and the industrial partner’s practical problems. It will significantly benefit all shopping businesses and their customers in Australia, as well as all other video-related services (e.g., online education, video conferencing, etc.).Read moreRead less
Data Complexity and Uncertainty-Resilient Deep Variational Learning. Enterprise data present increasingly significant characteristics and complexities, such as multi-aspect, heterogeneous and hierarchical features and interactions, and evolving dependencies and multi-distributions. They continue to significantly challenge the state-of-the-art probabilistic and neural learning systems with limited to insufficient capabilities and capacity. This research aims to develop a theory of flexible deep v ....Data Complexity and Uncertainty-Resilient Deep Variational Learning. Enterprise data present increasingly significant characteristics and complexities, such as multi-aspect, heterogeneous and hierarchical features and interactions, and evolving dependencies and multi-distributions. They continue to significantly challenge the state-of-the-art probabilistic and neural learning systems with limited to insufficient capabilities and capacity. This research aims to develop a theory of flexible deep variational learning transforming new deep probabilistic models with flexible variational neural mechanisms for analytically explainable, complexity-resilient analytics of real-life data. The outcomes are expected to fill important knowledge gaps and lift critical innovation competencies in wide domains.Read moreRead less