Two-way Auslan: Automatic Machine Translation of Australian Sign Language. This project aims to develop an automatic two-way machine-translation system between Auslan (Australian Sign Language) and English by researching and leveraging advanced computer vision and machine learning technology. The project expects to advance research in AI technology on topics including visual recognition, language processing and deep learning. This will boost Australia's national research capacity and global com ....Two-way Auslan: Automatic Machine Translation of Australian Sign Language. This project aims to develop an automatic two-way machine-translation system between Auslan (Australian Sign Language) and English by researching and leveraging advanced computer vision and machine learning technology. The project expects to advance research in AI technology on topics including visual recognition, language processing and deep learning. This will boost Australia's national research capacity and global competitiveness. Expected outcomes of this project will help to break the communication barriers between the Deaf and hearing population. This should provide significant benefits to Deaf communities through enhanced communication and improved quality-of-life, leading to a fair, more inclusive and resilient Australian society.Read moreRead less
Shape4D: Modelling the Spatiotemporal Deformation Patterns in 3D Shapes. This research will develop new mathematical methods and algorithms that will enable the use of population-level longitudinal studies to model the spatial and temporal deformation patterns in 3D biological objects. Using novel geometric and deep learning techniques, it will create new methods that will allow the characterization of how the 3D shape of objects deforms with ageing, disease progression and interaction with thei ....Shape4D: Modelling the Spatiotemporal Deformation Patterns in 3D Shapes. This research will develop new mathematical methods and algorithms that will enable the use of population-level longitudinal studies to model the spatial and temporal deformation patterns in 3D biological objects. Using novel geometric and deep learning techniques, it will create new methods that will allow the characterization of how the 3D shape of objects deforms with ageing, disease progression and interaction with their environment, and the simulation of spatiotemporal deformations in anatomical organs. Benefits include a better understanding of growth processes, predictive models of how degenerative diseases progress and a computational framework that will assist in designing proper mitigation and intervention strategies.Read moreRead less
Tensor and Hypergraph Methods in Fitting Visual Data. This proposal will put an important class of clustering (extracting data that should fit a geometric model) on a more solid theoretical foundation. This will lead to better understanding of how to certify outcomes, efficiency, reliability etc. The type of clustering under consideration is relevant to many problems in machine learning and computer vision, as well as data mining and a wide variety of other settings.
New Paradigms for Robust Fitting: Kernelisation and Polyhedral Search. Outliers inevitably exist in visual data due to imperfect data acquisition or preprocessing. To enable computer vision applications that can perform reliably, robust fitting algorithms are necessary to counter the biasing influence of outliers. However, current robust algorithms are unsatisfactory: they are unreliable (due to using randomisation) or too computationally costly (due to using exhaustive search). This project wil ....New Paradigms for Robust Fitting: Kernelisation and Polyhedral Search. Outliers inevitably exist in visual data due to imperfect data acquisition or preprocessing. To enable computer vision applications that can perform reliably, robust fitting algorithms are necessary to counter the biasing influence of outliers. However, current robust algorithms are unsatisfactory: they are unreliable (due to using randomisation) or too computationally costly (due to using exhaustive search). This project will develop new robust algorithms to mitigate these shortcomings. It will do so by investigating two new paradigms of kernelisation and polyhedral search, which offer unprecedented theoretical insights into the problem. The outcomes will contribute towards computer vision applications that are more practical and reliable.Read moreRead less
Deep visual understanding: learning to see in an unruly world. Deep Learning has achieved incredible success at an astonishing variety of Computer Vision tasks recently. This project aims to convey this success into the challenging domain of high-level image-based reasoning. It will extend deep learning to achieve flexible semantic reasoning about the content of images based on information gleaned from the huge volumes of data available on the Internet. The project expects to overcome one of the ....Deep visual understanding: learning to see in an unruly world. Deep Learning has achieved incredible success at an astonishing variety of Computer Vision tasks recently. This project aims to convey this success into the challenging domain of high-level image-based reasoning. It will extend deep learning to achieve flexible semantic reasoning about the content of images based on information gleaned from the huge volumes of data available on the Internet. The project expects to overcome one of the primary limitations of deep learning and will greatly increase its practical application to a range of industrial, cultural or health settings.Read moreRead less
Automated Integrity Assessment of Self-Piercing Rivet Joints: i4.0 Approach. Lightweighting in the car industry by the use of aluminium reduces emissions substantially. It entails joining the car body sections by self-piercing rivets rather than the traditional spot welds. We aim to fill the technology gap for effective quality control of these joints. The project expects to solve the problem by merging industry 4.0 principles, three-dimensional X-ray technology, machine learning computer vision ....Automated Integrity Assessment of Self-Piercing Rivet Joints: i4.0 Approach. Lightweighting in the car industry by the use of aluminium reduces emissions substantially. It entails joining the car body sections by self-piercing rivets rather than the traditional spot welds. We aim to fill the technology gap for effective quality control of these joints. The project expects to solve the problem by merging industry 4.0 principles, three-dimensional X-ray technology, machine learning computer vision and structural mechanics. The expected outcomes are technologies for automation-friendly assessment of these joints. This should benefit industries from medical to electronics to automatically spot a random and delicate abnormality within a solid of complex geometry, such as that in live tissue or an electronic circuit.Read moreRead less
Discovery Early Career Researcher Award - Grant ID: DE190100539
Funder
Australian Research Council
Funding Amount
$408,000.00
Summary
Towards conversational vision-based Artificial Intelligence. This project aims to develop a novel learning framework, Vision-Ask-Answer-Act (V3A). This framework will allow a machine to perform a sequence of actions via a conversation with human users, based on intricate processing of not just visual input, but human-computer verbal exchanges. Artificial intelligence has great potential as a tool for economic productivity and daily tasks. Applications in cars and assistant robots, still in their ....Towards conversational vision-based Artificial Intelligence. This project aims to develop a novel learning framework, Vision-Ask-Answer-Act (V3A). This framework will allow a machine to perform a sequence of actions via a conversation with human users, based on intricate processing of not just visual input, but human-computer verbal exchanges. Artificial intelligence has great potential as a tool for economic productivity and daily tasks. Applications in cars and assistant robots, still in their early days, typically require significant expertise to use effectively. The outcomes of this project will push the boundary of vision-language research to produce a conversational intelligent agent that can be easily used in common situations across industry, transport, the medical sector, and at home.Read moreRead less
Developing key vision technology for automation of aquaculture factory. This project aims to investigate structural, coloured textural, and hyperspectral analysis approaches to achieve automated lobster molt-cycle staging and classification to the level required for commercial production. High labour cost, water contamination, and disease transmission are major barriers in Australian bay lobster aquaculture inhibiting its large scale production. Automation of the production process and reducing ....Developing key vision technology for automation of aquaculture factory. This project aims to investigate structural, coloured textural, and hyperspectral analysis approaches to achieve automated lobster molt-cycle staging and classification to the level required for commercial production. High labour cost, water contamination, and disease transmission are major barriers in Australian bay lobster aquaculture inhibiting its large scale production. Automation of the production process and reducing the human contact with animals are of high priority in the development of this Australian-led emerging industry. The project aims to develop technology to bring this world- first aquaculture factory to large scale production, and create new export opportunities for lobsters and production systems.Read moreRead less
A Novel Automatic Neural Network Feature Extractor. This project aims to study feature extraction abilities of convolutional as well as traditional neural networks and develop a generic feature extractor which can be applied to wide variety of real-world image and non-image data. New concepts for automatic feature extraction, feature explanation, hybrid evolutionary algorithms and non-iterative ensemble learning will be introduced and evaluated. The expected outcomes are a generic feature extrac ....A Novel Automatic Neural Network Feature Extractor. This project aims to study feature extraction abilities of convolutional as well as traditional neural networks and develop a generic feature extractor which can be applied to wide variety of real-world image and non-image data. New concepts for automatic feature extraction, feature explanation, hybrid evolutionary algorithms and non-iterative ensemble learning will be introduced and evaluated. The expected outcomes are a generic feature extractor for automatically extracting features, an optimiser for finding optimal parameters and non-iterative ensemble learning technique for classification of features into classes. The impact of this project will be automatic feature extractors and classifiers for real-world applications.Read moreRead less
AUSLearn: AUtomated Sample Learning for Object Recognition. This project aims to enable computers to learn how to effectively use training samples for object recognition. Training sample is the only source used by computers to learn recognising objects. This project creates a new research direction that will enable the first full exploration of the power of samples. The aims will be enabled by leveraging the recent advances in reinforcement learning, fast training algorithms, and by developing n ....AUSLearn: AUtomated Sample Learning for Object Recognition. This project aims to enable computers to learn how to effectively use training samples for object recognition. Training sample is the only source used by computers to learn recognising objects. This project creates a new research direction that will enable the first full exploration of the power of samples. The aims will be enabled by leveraging the recent advances in reinforcement learning, fast training algorithms, and by developing novel deep learning algorithms. The new algorithms will benefit a wide range of applications, e.g. to effectively use car crash training samples for accurately identifying potential road crashes in transport and to effectively use rare medical imaging training data for robustly diagnosing diseases in health.Read moreRead less