Unlocking Mass Mobile Video Analytics with Advanced Neural Memory Networks. This project will develop neural memory architectures and dense spatial-temporal bundle adjustment to predict movement, behaviour, and perform multi-sensor fusion across large asynchronous video feeds. This capability will allow us to better interrogate and analyse mass video information recorded from the vast number of smartphones, action cameras, and surveillance cameras which exist at public events of interest. Outcom ....Unlocking Mass Mobile Video Analytics with Advanced Neural Memory Networks. This project will develop neural memory architectures and dense spatial-temporal bundle adjustment to predict movement, behaviour, and perform multi-sensor fusion across large asynchronous video feeds. This capability will allow us to better interrogate and analyse mass video information recorded from the vast number of smartphones, action cameras, and surveillance cameras which exist at public events of interest. Outcomes include the ability to ingest multiple video feeds into a dense and dynamic 3D reconstruction for knowledge representation and discovery, and analysis of events and behaviour through new spatio-temporal analytic approaches. This will offer significant benefits for video forensic analysis, policing, and emergency response.Read moreRead less
Shape4D: Modelling the Spatiotemporal Deformation Patterns in 3D Shapes. This research will develop new mathematical methods and algorithms that will enable the use of population-level longitudinal studies to model the spatial and temporal deformation patterns in 3D biological objects. Using novel geometric and deep learning techniques, it will create new methods that will allow the characterization of how the 3D shape of objects deforms with ageing, disease progression and interaction with thei ....Shape4D: Modelling the Spatiotemporal Deformation Patterns in 3D Shapes. This research will develop new mathematical methods and algorithms that will enable the use of population-level longitudinal studies to model the spatial and temporal deformation patterns in 3D biological objects. Using novel geometric and deep learning techniques, it will create new methods that will allow the characterization of how the 3D shape of objects deforms with ageing, disease progression and interaction with their environment, and the simulation of spatiotemporal deformations in anatomical organs. Benefits include a better understanding of growth processes, predictive models of how degenerative diseases progress and a computational framework that will assist in designing proper mitigation and intervention strategies.Read moreRead less
Tensor and Hypergraph Methods in Fitting Visual Data. This proposal will put an important class of clustering (extracting data that should fit a geometric model) on a more solid theoretical foundation. This will lead to better understanding of how to certify outcomes, efficiency, reliability etc. The type of clustering under consideration is relevant to many problems in machine learning and computer vision, as well as data mining and a wide variety of other settings.
New Paradigms for Robust Fitting: Kernelisation and Polyhedral Search. Outliers inevitably exist in visual data due to imperfect data acquisition or preprocessing. To enable computer vision applications that can perform reliably, robust fitting algorithms are necessary to counter the biasing influence of outliers. However, current robust algorithms are unsatisfactory: they are unreliable (due to using randomisation) or too computationally costly (due to using exhaustive search). This project wil ....New Paradigms for Robust Fitting: Kernelisation and Polyhedral Search. Outliers inevitably exist in visual data due to imperfect data acquisition or preprocessing. To enable computer vision applications that can perform reliably, robust fitting algorithms are necessary to counter the biasing influence of outliers. However, current robust algorithms are unsatisfactory: they are unreliable (due to using randomisation) or too computationally costly (due to using exhaustive search). This project will develop new robust algorithms to mitigate these shortcomings. It will do so by investigating two new paradigms of kernelisation and polyhedral search, which offer unprecedented theoretical insights into the problem. The outcomes will contribute towards computer vision applications that are more practical and reliable.Read moreRead less
Deep visual understanding: learning to see in an unruly world. Deep Learning has achieved incredible success at an astonishing variety of Computer Vision tasks recently. This project aims to convey this success into the challenging domain of high-level image-based reasoning. It will extend deep learning to achieve flexible semantic reasoning about the content of images based on information gleaned from the huge volumes of data available on the Internet. The project expects to overcome one of the ....Deep visual understanding: learning to see in an unruly world. Deep Learning has achieved incredible success at an astonishing variety of Computer Vision tasks recently. This project aims to convey this success into the challenging domain of high-level image-based reasoning. It will extend deep learning to achieve flexible semantic reasoning about the content of images based on information gleaned from the huge volumes of data available on the Internet. The project expects to overcome one of the primary limitations of deep learning and will greatly increase its practical application to a range of industrial, cultural or health settings.Read moreRead less
Discovery Early Career Researcher Award - Grant ID: DE190100539
Funder
Australian Research Council
Funding Amount
$408,000.00
Summary
Towards conversational vision-based Artificial Intelligence. This project aims to develop a novel learning framework, Vision-Ask-Answer-Act (V3A). This framework will allow a machine to perform a sequence of actions via a conversation with human users, based on intricate processing of not just visual input, but human-computer verbal exchanges. Artificial intelligence has great potential as a tool for economic productivity and daily tasks. Applications in cars and assistant robots, still in their ....Towards conversational vision-based Artificial Intelligence. This project aims to develop a novel learning framework, Vision-Ask-Answer-Act (V3A). This framework will allow a machine to perform a sequence of actions via a conversation with human users, based on intricate processing of not just visual input, but human-computer verbal exchanges. Artificial intelligence has great potential as a tool for economic productivity and daily tasks. Applications in cars and assistant robots, still in their early days, typically require significant expertise to use effectively. The outcomes of this project will push the boundary of vision-language research to produce a conversational intelligent agent that can be easily used in common situations across industry, transport, the medical sector, and at home.Read moreRead less
Developing key vision technology for automation of aquaculture factory. This project aims to investigate structural, coloured textural, and hyperspectral analysis approaches to achieve automated lobster molt-cycle staging and classification to the level required for commercial production. High labour cost, water contamination, and disease transmission are major barriers in Australian bay lobster aquaculture inhibiting its large scale production. Automation of the production process and reducing ....Developing key vision technology for automation of aquaculture factory. This project aims to investigate structural, coloured textural, and hyperspectral analysis approaches to achieve automated lobster molt-cycle staging and classification to the level required for commercial production. High labour cost, water contamination, and disease transmission are major barriers in Australian bay lobster aquaculture inhibiting its large scale production. Automation of the production process and reducing the human contact with animals are of high priority in the development of this Australian-led emerging industry. The project aims to develop technology to bring this world- first aquaculture factory to large scale production, and create new export opportunities for lobsters and production systems.Read moreRead less
A Novel Automatic Neural Network Feature Extractor. This project aims to study feature extraction abilities of convolutional as well as traditional neural networks and develop a generic feature extractor which can be applied to wide variety of real-world image and non-image data. New concepts for automatic feature extraction, feature explanation, hybrid evolutionary algorithms and non-iterative ensemble learning will be introduced and evaluated. The expected outcomes are a generic feature extrac ....A Novel Automatic Neural Network Feature Extractor. This project aims to study feature extraction abilities of convolutional as well as traditional neural networks and develop a generic feature extractor which can be applied to wide variety of real-world image and non-image data. New concepts for automatic feature extraction, feature explanation, hybrid evolutionary algorithms and non-iterative ensemble learning will be introduced and evaluated. The expected outcomes are a generic feature extractor for automatically extracting features, an optimiser for finding optimal parameters and non-iterative ensemble learning technique for classification of features into classes. The impact of this project will be automatic feature extractors and classifiers for real-world applications.Read moreRead less
AUSLearn: AUtomated Sample Learning for Object Recognition. This project aims to enable computers to learn how to effectively use training samples for object recognition. Training sample is the only source used by computers to learn recognising objects. This project creates a new research direction that will enable the first full exploration of the power of samples. The aims will be enabled by leveraging the recent advances in reinforcement learning, fast training algorithms, and by developing n ....AUSLearn: AUtomated Sample Learning for Object Recognition. This project aims to enable computers to learn how to effectively use training samples for object recognition. Training sample is the only source used by computers to learn recognising objects. This project creates a new research direction that will enable the first full exploration of the power of samples. The aims will be enabled by leveraging the recent advances in reinforcement learning, fast training algorithms, and by developing novel deep learning algorithms. The new algorithms will benefit a wide range of applications, e.g. to effectively use car crash training samples for accurately identifying potential road crashes in transport and to effectively use rare medical imaging training data for robustly diagnosing diseases in health.Read moreRead less
Discovery Early Career Researcher Award - Grant ID: DE200101283
Funder
Australian Research Council
Funding Amount
$400,998.00
Summary
Data synthesis to quantitatively understand and improve vision systems. This project aims to build high-fidelity synthetic data, to understand how a machine vision system reacts to environmental factors and consequently improve the ability of the system to generalise in the real world. This project expects to generate new knowledge in the area of computer vision using innovative techniques of data synthesis, analysis, and domain adaptation. The expected outcomes include new scientific discoverie ....Data synthesis to quantitatively understand and improve vision systems. This project aims to build high-fidelity synthetic data, to understand how a machine vision system reacts to environmental factors and consequently improve the ability of the system to generalise in the real world. This project expects to generate new knowledge in the area of computer vision using innovative techniques of data synthesis, analysis, and domain adaptation. The expected outcomes include new scientific discoveries and domain adaptation algorithms derived from synthetic data for real-world applications. The benefits are expected to be widespread across sectors such as transportation, security, and manufacturing, including safer robotic navigation, defect detection, and smart video surveillance to improve community safety.Read moreRead less