Unlocking Mass Mobile Video Analytics with Advanced Neural Memory Networks. This project will develop neural memory architectures and dense spatial-temporal bundle adjustment to predict movement, behaviour, and perform multi-sensor fusion across large asynchronous video feeds. This capability will allow us to better interrogate and analyse mass video information recorded from the vast number of smartphones, action cameras, and surveillance cameras which exist at public events of interest. Outcom ....Unlocking Mass Mobile Video Analytics with Advanced Neural Memory Networks. This project will develop neural memory architectures and dense spatial-temporal bundle adjustment to predict movement, behaviour, and perform multi-sensor fusion across large asynchronous video feeds. This capability will allow us to better interrogate and analyse mass video information recorded from the vast number of smartphones, action cameras, and surveillance cameras which exist at public events of interest. Outcomes include the ability to ingest multiple video feeds into a dense and dynamic 3D reconstruction for knowledge representation and discovery, and analysis of events and behaviour through new spatio-temporal analytic approaches. This will offer significant benefits for video forensic analysis, policing, and emergency response.Read moreRead less
Shape4D: Modelling the Spatiotemporal Deformation Patterns in 3D Shapes. This research will develop new mathematical methods and algorithms that will enable the use of population-level longitudinal studies to model the spatial and temporal deformation patterns in 3D biological objects. Using novel geometric and deep learning techniques, it will create new methods that will allow the characterization of how the 3D shape of objects deforms with ageing, disease progression and interaction with thei ....Shape4D: Modelling the Spatiotemporal Deformation Patterns in 3D Shapes. This research will develop new mathematical methods and algorithms that will enable the use of population-level longitudinal studies to model the spatial and temporal deformation patterns in 3D biological objects. Using novel geometric and deep learning techniques, it will create new methods that will allow the characterization of how the 3D shape of objects deforms with ageing, disease progression and interaction with their environment, and the simulation of spatiotemporal deformations in anatomical organs. Benefits include a better understanding of growth processes, predictive models of how degenerative diseases progress and a computational framework that will assist in designing proper mitigation and intervention strategies.Read moreRead less
A Novel Automatic Neural Network Feature Extractor. This project aims to study feature extraction abilities of convolutional as well as traditional neural networks and develop a generic feature extractor which can be applied to wide variety of real-world image and non-image data. New concepts for automatic feature extraction, feature explanation, hybrid evolutionary algorithms and non-iterative ensemble learning will be introduced and evaluated. The expected outcomes are a generic feature extrac ....A Novel Automatic Neural Network Feature Extractor. This project aims to study feature extraction abilities of convolutional as well as traditional neural networks and develop a generic feature extractor which can be applied to wide variety of real-world image and non-image data. New concepts for automatic feature extraction, feature explanation, hybrid evolutionary algorithms and non-iterative ensemble learning will be introduced and evaluated. The expected outcomes are a generic feature extractor for automatically extracting features, an optimiser for finding optimal parameters and non-iterative ensemble learning technique for classification of features into classes. The impact of this project will be automatic feature extractors and classifiers for real-world applications.Read moreRead less
AUSLearn: AUtomated Sample Learning for Object Recognition. This project aims to enable computers to learn how to effectively use training samples for object recognition. Training sample is the only source used by computers to learn recognising objects. This project creates a new research direction that will enable the first full exploration of the power of samples. The aims will be enabled by leveraging the recent advances in reinforcement learning, fast training algorithms, and by developing n ....AUSLearn: AUtomated Sample Learning for Object Recognition. This project aims to enable computers to learn how to effectively use training samples for object recognition. Training sample is the only source used by computers to learn recognising objects. This project creates a new research direction that will enable the first full exploration of the power of samples. The aims will be enabled by leveraging the recent advances in reinforcement learning, fast training algorithms, and by developing novel deep learning algorithms. The new algorithms will benefit a wide range of applications, e.g. to effectively use car crash training samples for accurately identifying potential road crashes in transport and to effectively use rare medical imaging training data for robustly diagnosing diseases in health.Read moreRead less
In search of relevant things: A novel approach for image analysis. This project aims to investigate how experts’ cognitive processes may be transferred to computers for the automatic recognition of visual features. By merging computer and brain sciences, the project will characterise the way the brains of experts understand what is seen, in order to translate such a process in a new computer vision tool. This should provide significant benefits, such as automatic detection of threats or diseases ....In search of relevant things: A novel approach for image analysis. This project aims to investigate how experts’ cognitive processes may be transferred to computers for the automatic recognition of visual features. By merging computer and brain sciences, the project will characterise the way the brains of experts understand what is seen, in order to translate such a process in a new computer vision tool. This should provide significant benefits, such as automatic detection of threats or diseases in satellite and diagnostic imaging, respectively, among other applications. For the first time, the combination of how a computer analyses an image and how an expert interprets it will be used as a common language to enable machines to process visual information in a manner that mimics the way human brains do.Read moreRead less
Exploiting the Symmetry of Spatial Awareness for 21st Century Automation. This project aims to enable autonomous robotic systems to operate more robustly and more reliably in the complex, cluttered and dynamic environments found in real-world applications. Applying the latest understanding of symmetry in non-linear systems and control provides tools that can be used to develop new design methodologies for spatial awareness algorithms. The outcomes of this project should increase Australia's ca ....Exploiting the Symmetry of Spatial Awareness for 21st Century Automation. This project aims to enable autonomous robotic systems to operate more robustly and more reliably in the complex, cluttered and dynamic environments found in real-world applications. Applying the latest understanding of symmetry in non-linear systems and control provides tools that can be used to develop new design methodologies for spatial awareness algorithms. The outcomes of this project should increase Australia's capacity in high-tech systems and deliver world best open source code for spatial awareness problems to enable the next generation of automation in Australia.Read moreRead less
Leveraging 3D computer vision for camera-based precise geo-localisation. This project aims to develop advanced 3D computer vision and image processing technology that can turn regular cameras into high-precision location-sensing devices. Spatial Location is a fundamental type of information of our physical world. Determining the precise location of people, vehicle, and mobile devices is essential for many critical applications. Outcomes of the project will enable a wide range of novel applicatio ....Leveraging 3D computer vision for camera-based precise geo-localisation. This project aims to develop advanced 3D computer vision and image processing technology that can turn regular cameras into high-precision location-sensing devices. Spatial Location is a fundamental type of information of our physical world. Determining the precise location of people, vehicle, and mobile devices is essential for many critical applications. Outcomes of the project will enable a wide range of novel applications of significant social, environmental and economic value, such as Location-Aware Service, Environment Monitoring, Augmented Reality, Autonomous Vehicle, and Rapid Emergency Response. The project will enhance Australia's international competitive advantage in forefront of ICT research and technology innovation.Read moreRead less
Australian Laureate Fellowships - Grant ID: FL170100117
Funder
Australian Research Council
Funding Amount
$3,208,192.00
Summary
On snapping up semantics of dynamic pixels from moving cameras. The project aims to develop a suite of original models and algorithms for processing and understanding videos captured by moving cameras, and to establish the mathematical foundations for deep learning-based computer vision to provide theoretical underpinnings. The project expects to generate new knowledge that will transform moving-camera computer vision with step-changes in visual quality enhancement, compression and acceleration ....On snapping up semantics of dynamic pixels from moving cameras. The project aims to develop a suite of original models and algorithms for processing and understanding videos captured by moving cameras, and to establish the mathematical foundations for deep learning-based computer vision to provide theoretical underpinnings. The project expects to generate new knowledge that will transform moving-camera computer vision with step-changes in visual quality enhancement, compression and acceleration technologies, and solutions for fundamental computer vision tasks. A new concept of feature complexity for measuring the discriminant and learnable abilities of features from deep models will also be defined. The outcomes of the project will be critical for enabling autonomous machines to perceive and interact with the environment.Read moreRead less
Intelligent Virtual Human Companions. This research aims to develop intelligent virtual human companions that can seemingly integrate our immediate physical environment and understand their surroundings including people’s emotions, behaviours, actions and interactions. Such a technology will be enabled by leveraging recent advances in mixed/augmented reality technologies, and by developing innovative artificial intelligence and computer vision and graphics algorithms for dynamic real-world envir ....Intelligent Virtual Human Companions. This research aims to develop intelligent virtual human companions that can seemingly integrate our immediate physical environment and understand their surroundings including people’s emotions, behaviours, actions and interactions. Such a technology will be enabled by leveraging recent advances in mixed/augmented reality technologies, and by developing innovative artificial intelligence and computer vision and graphics algorithms for dynamic real-world environments. Unlike robots, the proposed technology will be low cost, readily deployable and customisable, and will not have any physical limitations or maintenance requirements. It will thus have a wide range of applications from elderly care, healthcare care to educational training.Read moreRead less
Automatic video annotation by learning from web data. This project aims to study next-generation video annotation technologies to automatically tag raw videos using a huge set of semantic concepts. The project will study new domain adaptation schemes and frameworks in order to substantially improve video annotation performance. The resulting prototype system can be directly used by ordinary users worldwide to search their personal videos using textual queries. The system is also applicable to vi ....Automatic video annotation by learning from web data. This project aims to study next-generation video annotation technologies to automatically tag raw videos using a huge set of semantic concepts. The project will study new domain adaptation schemes and frameworks in order to substantially improve video annotation performance. The resulting prototype system can be directly used by ordinary users worldwide to search their personal videos using textual queries. The system is also applicable to video surveillance applications, which can enhance Australia’s homeland security.Read moreRead less