Taming media for the masses: Computational frameworks for intelligent digital media capture, management, and sharing. The core issues tackled in this project are learning, recognition and application of semantics in multimedia data and the context of its creation and use - a foundational issue in pattern recognition with many applications. The project is part of the Institute for Multi-sensor Processing and Content Analysis whose aim is to tackle technical issues in large scale pattern recogniti ....Taming media for the masses: Computational frameworks for intelligent digital media capture, management, and sharing. The core issues tackled in this project are learning, recognition and application of semantics in multimedia data and the context of its creation and use - a foundational issue in pattern recognition with many applications. The project is part of the Institute for Multi-sensor Processing and Content Analysis whose aim is to tackle technical issues in large scale pattern recognition. By developing scalable and robust techniques to extract information from large scale multi-modal data, the applications include large scale surveillance systems from multi-modal data (e.g. airport security, smart homes for the aged), context-aware devices, and the next generation of media creation and repurposing tools - a fast-growing sector of the economy.Read moreRead less
Bridging the semantic gap for building effective content management systems: Computational media aesthetics. This project focuses on video abstraction and aims to bridge the semantic gap between the simplicity of available visual features and the richness of user descriptions. We examine how visual and aural techniques are brought together to influence the engagement of audience in a story portrayal. The major outcome will be a computational framework for extracting the semantics associated wi ....Bridging the semantic gap for building effective content management systems: Computational media aesthetics. This project focuses on video abstraction and aims to bridge the semantic gap between the simplicity of available visual features and the richness of user descriptions. We examine how visual and aural techniques are brought together to influence the engagement of audience in a story portrayal. The major outcome will be a computational framework for extracting the semantics associated with audiovisual elements in television/film, and scalable software tools that can rapidly and consistently analyse media along various aesthetic dimensions. It will allow for high-level annotation of media and the building of more effective content management systems with enhanced user querying capabilities.Read moreRead less
Concept-based retrieval and interpretation for large data sets. Access to on-line information is growing at an exponential rate, fuelled by advances in computing and
communications technologies. Current information retrieval methods are becoming ineffective due to
their reliance on simple term-based methods, resulting in a massive number of matches, of which only
a small proportion are relevant. We address this problem by developing new matching algorithms which
understand the underlying ....Concept-based retrieval and interpretation for large data sets. Access to on-line information is growing at an exponential rate, fuelled by advances in computing and
communications technologies. Current information retrieval methods are becoming ineffective due to
their reliance on simple term-based methods, resulting in a massive number of matches, of which only
a small proportion are relevant. We address this problem by developing new matching algorithms which
understand the underlying meaning of documents in database repositories - by building semantic
structures semi-automatically - and thus provide more relevant information to queries.
This project will be of great benefit to a multitude of end-users in medicine, history, law and many other disciplines.
Read moreRead less
Discovery Early Career Researcher Award - Grant ID: DE120102948
Funder
Australian Research Council
Funding Amount
$375,000.00
Summary
Interactive computer vision for image interpretation. This project aims at pushing forward the fundamental research in interactive computer vision. The outcome of this project will enable reliable and efficient solutions to real world image interpretation tasks, such as medical image analysis, financial document processing, and impact evaluation from natural disasters.
Discovery Early Career Researcher Award - Grant ID: DE140100180
Funder
Australian Research Council
Funding Amount
$394,305.00
Summary
Advancing Dense 3D Reconstruction of Non-rigid Scenes by Using a Moving Camera. This project will advance the fundamental research in geometric computer vision and develop a new framework for efficient dense three-dimensional reconstruction of non-rigid scenes by using a moving camera. It is expected that this project will bring about breakthroughs in geometric computer vision with many daily applications, including three-dimensional natural human-computer interaction, three-dimensional reconstr ....Advancing Dense 3D Reconstruction of Non-rigid Scenes by Using a Moving Camera. This project will advance the fundamental research in geometric computer vision and develop a new framework for efficient dense three-dimensional reconstruction of non-rigid scenes by using a moving camera. It is expected that this project will bring about breakthroughs in geometric computer vision with many daily applications, including three-dimensional natural human-computer interaction, three-dimensional reconstruction from historical movies and three-dimensional realistic animations. Its outcomes will enable users to capture and manipulate their surrounding dynamic world in three-dimensions easily and conveniently. This project will alleviate many of the major difficulties (dense correspondences, long sequences, complex deformations) with conventional non-rigid reconstruction methods.Read moreRead less
Leveraging 3D computer vision for camera-based precise geo-localisation. This project aims to develop advanced 3D computer vision and image processing technology that can turn regular cameras into high-precision location-sensing devices. Spatial Location is a fundamental type of information of our physical world. Determining the precise location of people, vehicle, and mobile devices is essential for many critical applications. Outcomes of the project will enable a wide range of novel applicatio ....Leveraging 3D computer vision for camera-based precise geo-localisation. This project aims to develop advanced 3D computer vision and image processing technology that can turn regular cameras into high-precision location-sensing devices. Spatial Location is a fundamental type of information of our physical world. Determining the precise location of people, vehicle, and mobile devices is essential for many critical applications. Outcomes of the project will enable a wide range of novel applications of significant social, environmental and economic value, such as Location-Aware Service, Environment Monitoring, Augmented Reality, Autonomous Vehicle, and Rapid Emergency Response. The project will enhance Australia's international competitive advantage in forefront of ICT research and technology innovation.Read moreRead less
Hybrid optimisation for automatic large-scale video annotation. Optimization is the basis for solving many problems in Computer Vision, such as three-dimensional geometry recovery, image segmentation, scene labeling and object recognition. This project will develop new optimisation techniques and demonstrate their suitability for large-scale video annotation, which is key to visual data mining and scene understanding.
Robust and scalable change detection in geo-spatial data. A flood of data in the form of text, images and video emanate from a proliferation of sensors. These data are collected but rarely analysed, rendering it meaningless. This project aims to develop new software and techniques to detect changes over time in large scale geographically referenced data (for example photomaps) for use across numerous domains.
Australian Laureate Fellowships - Grant ID: FL170100117
Funder
Australian Research Council
Funding Amount
$3,208,192.00
Summary
On snapping up semantics of dynamic pixels from moving cameras. The project aims to develop a suite of original models and algorithms for processing and understanding videos captured by moving cameras, and to establish the mathematical foundations for deep learning-based computer vision to provide theoretical underpinnings. The project expects to generate new knowledge that will transform moving-camera computer vision with step-changes in visual quality enhancement, compression and acceleration ....On snapping up semantics of dynamic pixels from moving cameras. The project aims to develop a suite of original models and algorithms for processing and understanding videos captured by moving cameras, and to establish the mathematical foundations for deep learning-based computer vision to provide theoretical underpinnings. The project expects to generate new knowledge that will transform moving-camera computer vision with step-changes in visual quality enhancement, compression and acceleration technologies, and solutions for fundamental computer vision tasks. A new concept of feature complexity for measuring the discriminant and learnable abilities of features from deep models will also be defined. The outcomes of the project will be critical for enabling autonomous machines to perceive and interact with the environment.Read moreRead less
Shape4D: Modelling the Spatiotemporal Deformation Patterns in 3D Shapes. This research will develop new mathematical methods and algorithms that will enable the use of population-level longitudinal studies to model the spatial and temporal deformation patterns in 3D biological objects. Using novel geometric and deep learning techniques, it will create new methods that will allow the characterization of how the 3D shape of objects deforms with ageing, disease progression and interaction with thei ....Shape4D: Modelling the Spatiotemporal Deformation Patterns in 3D Shapes. This research will develop new mathematical methods and algorithms that will enable the use of population-level longitudinal studies to model the spatial and temporal deformation patterns in 3D biological objects. Using novel geometric and deep learning techniques, it will create new methods that will allow the characterization of how the 3D shape of objects deforms with ageing, disease progression and interaction with their environment, and the simulation of spatiotemporal deformations in anatomical organs. Benefits include a better understanding of growth processes, predictive models of how degenerative diseases progress and a computational framework that will assist in designing proper mitigation and intervention strategies.Read moreRead less