Intelligent Virtual Human Companions. This research aims to develop intelligent virtual human companions that can seemingly integrate our immediate physical environment and understand their surroundings including people’s emotions, behaviours, actions and interactions. Such a technology will be enabled by leveraging recent advances in mixed/augmented reality technologies, and by developing innovative artificial intelligence and computer vision and graphics algorithms for dynamic real-world envir ....Intelligent Virtual Human Companions. This research aims to develop intelligent virtual human companions that can seemingly integrate our immediate physical environment and understand their surroundings including people’s emotions, behaviours, actions and interactions. Such a technology will be enabled by leveraging recent advances in mixed/augmented reality technologies, and by developing innovative artificial intelligence and computer vision and graphics algorithms for dynamic real-world environments. Unlike robots, the proposed technology will be low cost, readily deployable and customisable, and will not have any physical limitations or maintenance requirements. It will thus have a wide range of applications from elderly care, healthcare care to educational training.Read moreRead less
Natural form, aesthetics and the human brain. This project aims to study how the brain represents the emotion of aesthetic experience. This project will establish the characteristics of flowers and floral design that govern their appeal using large scale web based data collection, and identify the neural representation of floral beauty using integrative data analysis. Outcomes of the project are expected to help flower growers and designers with product planning, supporting industry sustainabili ....Natural form, aesthetics and the human brain. This project aims to study how the brain represents the emotion of aesthetic experience. This project will establish the characteristics of flowers and floral design that govern their appeal using large scale web based data collection, and identify the neural representation of floral beauty using integrative data analysis. Outcomes of the project are expected to help flower growers and designers with product planning, supporting industry sustainability. The project will also establish how the brain generates positive experience in response to our visual environment, promoting well-being by enabling informed visual design decisions.Read moreRead less
Automatic video annotation by learning from web data. This project aims to study next-generation video annotation technologies to automatically tag raw videos using a huge set of semantic concepts. The project will study new domain adaptation schemes and frameworks in order to substantially improve video annotation performance. The resulting prototype system can be directly used by ordinary users worldwide to search their personal videos using textual queries. The system is also applicable to vi ....Automatic video annotation by learning from web data. This project aims to study next-generation video annotation technologies to automatically tag raw videos using a huge set of semantic concepts. The project will study new domain adaptation schemes and frameworks in order to substantially improve video annotation performance. The resulting prototype system can be directly used by ordinary users worldwide to search their personal videos using textual queries. The system is also applicable to video surveillance applications, which can enhance Australia’s homeland security.Read moreRead less
Unlocking Mass Mobile Video Analytics with Advanced Neural Memory Networks. This project will develop neural memory architectures and dense spatial-temporal bundle adjustment to predict movement, behaviour, and perform multi-sensor fusion across large asynchronous video feeds. This capability will allow us to better interrogate and analyse mass video information recorded from the vast number of smartphones, action cameras, and surveillance cameras which exist at public events of interest. Outcom ....Unlocking Mass Mobile Video Analytics with Advanced Neural Memory Networks. This project will develop neural memory architectures and dense spatial-temporal bundle adjustment to predict movement, behaviour, and perform multi-sensor fusion across large asynchronous video feeds. This capability will allow us to better interrogate and analyse mass video information recorded from the vast number of smartphones, action cameras, and surveillance cameras which exist at public events of interest. Outcomes include the ability to ingest multiple video feeds into a dense and dynamic 3D reconstruction for knowledge representation and discovery, and analysis of events and behaviour through new spatio-temporal analytic approaches. This will offer significant benefits for video forensic analysis, policing, and emergency response.Read moreRead less
Automatic Training Data Search and Model Evaluation by Measuring Domain Gap. We aim to investigate computer vision training data and test data, using automatically generated data sets for facial expression recognition and object re-identification. This project expects to quantify and understand the domain gap, the distribution difference between training and test data sets. Expected outcomes of this project are insights on measuring the domain gap, the ability to estimate model performance witho ....Automatic Training Data Search and Model Evaluation by Measuring Domain Gap. We aim to investigate computer vision training data and test data, using automatically generated data sets for facial expression recognition and object re-identification. This project expects to quantify and understand the domain gap, the distribution difference between training and test data sets. Expected outcomes of this project are insights on measuring the domain gap, the ability to estimate model performance without accessing expensive test labels and improvements to system generalisation. This should provide significant benefits for computer vision applications that currently require expensive labelling, and commercial and economic benefits across sectors such as transportation, security and manufacturing.Read moreRead less
Learning kernel-based high-order visual representation for image retrieval. Image retrieval plays a key role in many practical applications. The recent increase of real-world applications calls for higher retrieval accuracy. This project aims to address this issue by exploring advanced visual representation that models the high-order information of image content. This project expects to generate new knowledge in the area of computer vision by developing a novel image retrieval framework. Expecte ....Learning kernel-based high-order visual representation for image retrieval. Image retrieval plays a key role in many practical applications. The recent increase of real-world applications calls for higher retrieval accuracy. This project aims to address this issue by exploring advanced visual representation that models the high-order information of image content. This project expects to generate new knowledge in the area of computer vision by developing a novel image retrieval framework. Expected outcomes include theory development on visual representation and more effective retrieval techniques. This should provide significant benefits, such as improving public information access services, facilitating environmental monitoring, and enhancing smart traffic management.Read moreRead less
Shape4D: Modelling the Spatiotemporal Deformation Patterns in 3D Shapes. This research will develop new mathematical methods and algorithms that will enable the use of population-level longitudinal studies to model the spatial and temporal deformation patterns in 3D biological objects. Using novel geometric and deep learning techniques, it will create new methods that will allow the characterization of how the 3D shape of objects deforms with ageing, disease progression and interaction with thei ....Shape4D: Modelling the Spatiotemporal Deformation Patterns in 3D Shapes. This research will develop new mathematical methods and algorithms that will enable the use of population-level longitudinal studies to model the spatial and temporal deformation patterns in 3D biological objects. Using novel geometric and deep learning techniques, it will create new methods that will allow the characterization of how the 3D shape of objects deforms with ageing, disease progression and interaction with their environment, and the simulation of spatiotemporal deformations in anatomical organs. Benefits include a better understanding of growth processes, predictive models of how degenerative diseases progress and a computational framework that will assist in designing proper mitigation and intervention strategies.Read moreRead less
In search of relevant things: A novel approach for image analysis. This project aims to investigate how experts’ cognitive processes may be transferred to computers for the automatic recognition of visual features. By merging computer and brain sciences, the project will characterise the way the brains of experts understand what is seen, in order to translate such a process in a new computer vision tool. This should provide significant benefits, such as automatic detection of threats or diseases ....In search of relevant things: A novel approach for image analysis. This project aims to investigate how experts’ cognitive processes may be transferred to computers for the automatic recognition of visual features. By merging computer and brain sciences, the project will characterise the way the brains of experts understand what is seen, in order to translate such a process in a new computer vision tool. This should provide significant benefits, such as automatic detection of threats or diseases in satellite and diagnostic imaging, respectively, among other applications. For the first time, the combination of how a computer analyses an image and how an expert interprets it will be used as a common language to enable machines to process visual information in a manner that mimics the way human brains do.Read moreRead less
Automatic Machine Learning with Imperfect Data for Video Analysis . This project aims to propose new algorithms and technologies for constructing an efficient video analysis system, which will be aligned with Australia’s science and research priorities. Specifically, during this project, a novel network structure search method based on auto machine learning will be proposed, an unsupervised domain adaptation algorithm will be developed, and a generative data augmentation method will be construct ....Automatic Machine Learning with Imperfect Data for Video Analysis . This project aims to propose new algorithms and technologies for constructing an efficient video analysis system, which will be aligned with Australia’s science and research priorities. Specifically, during this project, a novel network structure search method based on auto machine learning will be proposed, an unsupervised domain adaptation algorithm will be developed, and a generative data augmentation method will be constructed. All of these will construct a stable and efficient deep neural network, which is able to process large size videos captured from real scenarios in high efficiencies. Various fields, such as health care service and cybersecurity, will benefit hugely from this project.Read moreRead less
Tensor and Hypergraph Methods in Fitting Visual Data. This proposal will put an important class of clustering (extracting data that should fit a geometric model) on a more solid theoretical foundation. This will lead to better understanding of how to certify outcomes, efficiency, reliability etc. The type of clustering under consideration is relevant to many problems in machine learning and computer vision, as well as data mining and a wide variety of other settings.