Shape4D: Modelling the Spatiotemporal Deformation Patterns in 3D Shapes. This research will develop new mathematical methods and algorithms that will enable the use of population-level longitudinal studies to model the spatial and temporal deformation patterns in 3D biological objects. Using novel geometric and deep learning techniques, it will create new methods that will allow the characterization of how the 3D shape of objects deforms with ageing, disease progression and interaction with thei ....Shape4D: Modelling the Spatiotemporal Deformation Patterns in 3D Shapes. This research will develop new mathematical methods and algorithms that will enable the use of population-level longitudinal studies to model the spatial and temporal deformation patterns in 3D biological objects. Using novel geometric and deep learning techniques, it will create new methods that will allow the characterization of how the 3D shape of objects deforms with ageing, disease progression and interaction with their environment, and the simulation of spatiotemporal deformations in anatomical organs. Benefits include a better understanding of growth processes, predictive models of how degenerative diseases progress and a computational framework that will assist in designing proper mitigation and intervention strategies.Read moreRead less
Tensor and Hypergraph Methods in Fitting Visual Data. This proposal will put an important class of clustering (extracting data that should fit a geometric model) on a more solid theoretical foundation. This will lead to better understanding of how to certify outcomes, efficiency, reliability etc. The type of clustering under consideration is relevant to many problems in machine learning and computer vision, as well as data mining and a wide variety of other settings.
New Paradigms for Robust Fitting: Kernelisation and Polyhedral Search. Outliers inevitably exist in visual data due to imperfect data acquisition or preprocessing. To enable computer vision applications that can perform reliably, robust fitting algorithms are necessary to counter the biasing influence of outliers. However, current robust algorithms are unsatisfactory: they are unreliable (due to using randomisation) or too computationally costly (due to using exhaustive search). This project wil ....New Paradigms for Robust Fitting: Kernelisation and Polyhedral Search. Outliers inevitably exist in visual data due to imperfect data acquisition or preprocessing. To enable computer vision applications that can perform reliably, robust fitting algorithms are necessary to counter the biasing influence of outliers. However, current robust algorithms are unsatisfactory: they are unreliable (due to using randomisation) or too computationally costly (due to using exhaustive search). This project will develop new robust algorithms to mitigate these shortcomings. It will do so by investigating two new paradigms of kernelisation and polyhedral search, which offer unprecedented theoretical insights into the problem. The outcomes will contribute towards computer vision applications that are more practical and reliable.Read moreRead less
Deep visual understanding: learning to see in an unruly world. Deep Learning has achieved incredible success at an astonishing variety of Computer Vision tasks recently. This project aims to convey this success into the challenging domain of high-level image-based reasoning. It will extend deep learning to achieve flexible semantic reasoning about the content of images based on information gleaned from the huge volumes of data available on the Internet. The project expects to overcome one of the ....Deep visual understanding: learning to see in an unruly world. Deep Learning has achieved incredible success at an astonishing variety of Computer Vision tasks recently. This project aims to convey this success into the challenging domain of high-level image-based reasoning. It will extend deep learning to achieve flexible semantic reasoning about the content of images based on information gleaned from the huge volumes of data available on the Internet. The project expects to overcome one of the primary limitations of deep learning and will greatly increase its practical application to a range of industrial, cultural or health settings.Read moreRead less
Automated Integrity Assessment of Self-Piercing Rivet Joints: i4.0 Approach. Lightweighting in the car industry by the use of aluminium reduces emissions substantially. It entails joining the car body sections by self-piercing rivets rather than the traditional spot welds. We aim to fill the technology gap for effective quality control of these joints. The project expects to solve the problem by merging industry 4.0 principles, three-dimensional X-ray technology, machine learning computer vision ....Automated Integrity Assessment of Self-Piercing Rivet Joints: i4.0 Approach. Lightweighting in the car industry by the use of aluminium reduces emissions substantially. It entails joining the car body sections by self-piercing rivets rather than the traditional spot welds. We aim to fill the technology gap for effective quality control of these joints. The project expects to solve the problem by merging industry 4.0 principles, three-dimensional X-ray technology, machine learning computer vision and structural mechanics. The expected outcomes are technologies for automation-friendly assessment of these joints. This should benefit industries from medical to electronics to automatically spot a random and delicate abnormality within a solid of complex geometry, such as that in live tissue or an electronic circuit.Read moreRead less
Discovery Early Career Researcher Award - Grant ID: DE190100539
Funder
Australian Research Council
Funding Amount
$408,000.00
Summary
Towards conversational vision-based Artificial Intelligence. This project aims to develop a novel learning framework, Vision-Ask-Answer-Act (V3A). This framework will allow a machine to perform a sequence of actions via a conversation with human users, based on intricate processing of not just visual input, but human-computer verbal exchanges. Artificial intelligence has great potential as a tool for economic productivity and daily tasks. Applications in cars and assistant robots, still in their ....Towards conversational vision-based Artificial Intelligence. This project aims to develop a novel learning framework, Vision-Ask-Answer-Act (V3A). This framework will allow a machine to perform a sequence of actions via a conversation with human users, based on intricate processing of not just visual input, but human-computer verbal exchanges. Artificial intelligence has great potential as a tool for economic productivity and daily tasks. Applications in cars and assistant robots, still in their early days, typically require significant expertise to use effectively. The outcomes of this project will push the boundary of vision-language research to produce a conversational intelligent agent that can be easily used in common situations across industry, transport, the medical sector, and at home.Read moreRead less
Intelligent Virtual Human Companions. This research aims to develop intelligent virtual human companions that can seemingly integrate our immediate physical environment and understand their surroundings including people’s emotions, behaviours, actions and interactions. Such a technology will be enabled by leveraging recent advances in mixed/augmented reality technologies, and by developing innovative artificial intelligence and computer vision and graphics algorithms for dynamic real-world envir ....Intelligent Virtual Human Companions. This research aims to develop intelligent virtual human companions that can seemingly integrate our immediate physical environment and understand their surroundings including people’s emotions, behaviours, actions and interactions. Such a technology will be enabled by leveraging recent advances in mixed/augmented reality technologies, and by developing innovative artificial intelligence and computer vision and graphics algorithms for dynamic real-world environments. Unlike robots, the proposed technology will be low cost, readily deployable and customisable, and will not have any physical limitations or maintenance requirements. It will thus have a wide range of applications from elderly care, healthcare care to educational training.Read moreRead less
Developing key vision technology for automation of aquaculture factory. This project aims to investigate structural, coloured textural, and hyperspectral analysis approaches to achieve automated lobster molt-cycle staging and classification to the level required for commercial production. High labour cost, water contamination, and disease transmission are major barriers in Australian bay lobster aquaculture inhibiting its large scale production. Automation of the production process and reducing ....Developing key vision technology for automation of aquaculture factory. This project aims to investigate structural, coloured textural, and hyperspectral analysis approaches to achieve automated lobster molt-cycle staging and classification to the level required for commercial production. High labour cost, water contamination, and disease transmission are major barriers in Australian bay lobster aquaculture inhibiting its large scale production. Automation of the production process and reducing the human contact with animals are of high priority in the development of this Australian-led emerging industry. The project aims to develop technology to bring this world- first aquaculture factory to large scale production, and create new export opportunities for lobsters and production systems.Read moreRead less
A Novel Automatic Neural Network Feature Extractor. This project aims to study feature extraction abilities of convolutional as well as traditional neural networks and develop a generic feature extractor which can be applied to wide variety of real-world image and non-image data. New concepts for automatic feature extraction, feature explanation, hybrid evolutionary algorithms and non-iterative ensemble learning will be introduced and evaluated. The expected outcomes are a generic feature extrac ....A Novel Automatic Neural Network Feature Extractor. This project aims to study feature extraction abilities of convolutional as well as traditional neural networks and develop a generic feature extractor which can be applied to wide variety of real-world image and non-image data. New concepts for automatic feature extraction, feature explanation, hybrid evolutionary algorithms and non-iterative ensemble learning will be introduced and evaluated. The expected outcomes are a generic feature extractor for automatically extracting features, an optimiser for finding optimal parameters and non-iterative ensemble learning technique for classification of features into classes. The impact of this project will be automatic feature extractors and classifiers for real-world applications.Read moreRead less
Automatic video annotation by learning from web data. This project aims to study next-generation video annotation technologies to automatically tag raw videos using a huge set of semantic concepts. The project will study new domain adaptation schemes and frameworks in order to substantially improve video annotation performance. The resulting prototype system can be directly used by ordinary users worldwide to search their personal videos using textual queries. The system is also applicable to vi ....Automatic video annotation by learning from web data. This project aims to study next-generation video annotation technologies to automatically tag raw videos using a huge set of semantic concepts. The project will study new domain adaptation schemes and frameworks in order to substantially improve video annotation performance. The resulting prototype system can be directly used by ordinary users worldwide to search their personal videos using textual queries. The system is also applicable to video surveillance applications, which can enhance Australia’s homeland security.Read moreRead less