Semantic Vectorisation: From Bitmaps to Intelligent Representations. The objective of this innovative project is to provide a solution to the open question of representing natural images by semantically rich vector graphics. The challenges are to identify key visual and temporal elements for images and videos, and efficiently decompose the visual data into semantic vector representations that are faithful to original data, compact and editable. The project aims to investigate new bitmap-to-vecto ....Semantic Vectorisation: From Bitmaps to Intelligent Representations. The objective of this innovative project is to provide a solution to the open question of representing natural images by semantically rich vector graphics. The challenges are to identify key visual and temporal elements for images and videos, and efficiently decompose the visual data into semantic vector representations that are faithful to original data, compact and editable. The project aims to investigate new bitmap-to-vector conversion methods. It is expected to develop a framework where semantic labels and hyperlinks can be embedded in visual data automatically. It hopes to pioneer the creation of a web of images where the links are on image/video regions. New image simplification, stylisation, and non-photorealistic rendering methods are expected to be provided.Read moreRead less
Development of a three dimensional audio-visual next generation speech recognition system. To overcome the disadvantages of current Audio-Visual Speech Recognition Systems, we propose a set of robust algorithms in three dimensional computer vision and speech processing. The proposed system will have far-reaching implications in various areas, for example, human-machine interaction for speech recognition in automated dialog systems and voice-to-text conversions.
Solve it or Ignore it? The Challenge of Alignment Distortion and Creating Next Generation Automatic Facial Expression Detection. The last two decades have seen an escalating interest in automating the coding of facial expressions. Despite this keen interest, the promise of computer vision systems to accurately code facial expressions in natural circumstances remains elusive. Our interdisciplinary team will research a new paradigm to account for facial alignment distortion directly rather than ai ....Solve it or Ignore it? The Challenge of Alignment Distortion and Creating Next Generation Automatic Facial Expression Detection. The last two decades have seen an escalating interest in automating the coding of facial expressions. Despite this keen interest, the promise of computer vision systems to accurately code facial expressions in natural circumstances remains elusive. Our interdisciplinary team will research a new paradigm to account for facial alignment distortion directly rather than aiming to achieve invariance to it. The project will also research new data agnostic feature compaction capabilities to enable scalable learning on the world’s largest and challenging expression dataset available to us through international collaboration. Tackling these two major open problems will make accurate coding of facial expressions in natural environments achievable.Read moreRead less
Audio Visual Speech Recognition. Even though significant advances have been made in automatic speech recognition using acoustic information, the recognition accuracies are still poor in noisy and hostile environments such as in crowds, traffic, factory floors etc. In many of these applications visual information is or can easily be made available in addition to the audio. The aim of this project is to achieve an order of magnitude improvement in speech recognition accuracies in adverse environme ....Audio Visual Speech Recognition. Even though significant advances have been made in automatic speech recognition using acoustic information, the recognition accuracies are still poor in noisy and hostile environments such as in crowds, traffic, factory floors etc. In many of these applications visual information is or can easily be made available in addition to the audio. The aim of this project is to achieve an order of magnitude improvement in speech recognition accuracies in adverse environments by joint processing and modelling of the acoustic modality with visual information in the form of lip shapes and movements. The outcomes will be useful in human computer interaction in adverse environments as well as in the transcription and mining of multimedia data.
Read moreRead less
Advanced Sonar Sensing for Robotics. Robotics research is heavily dependent on fast, accurate, reliable and cheap sensors. Sonar sensing can fulfil these requirements in air and underwater environments. This project will advance this sensor technology by providing sonar with high-speed accurate measurement and classification capabilities that function on moving platforms. The sonar will adapt and monitor differing environmental conditions allowing the sensor data to be integrated better with ....Advanced Sonar Sensing for Robotics. Robotics research is heavily dependent on fast, accurate, reliable and cheap sensors. Sonar sensing can fulfil these requirements in air and underwater environments. This project will advance this sensor technology by providing sonar with high-speed accurate measurement and classification capabilities that function on moving platforms. The sonar will adapt and monitor differing environmental conditions allowing the sensor data to be integrated better with other sensors, such as laser and stereo vision. Interference rejection will be incorporated that will allow the sensor to operate in conjunction with other sonar. Applications of the technology will be robotic mapping, localisation, navigation and exploration.Read moreRead less
System Identification of Complex System Models. This project lies within an ARC Research Priority Area. Namely, "Frontier Technologies". It involves the development of new technologies and fundamental theory that take data records from physical or abstract systems and generate mathematical models for use in prediction, control and diagnosis of the underlying system. In light of this, the project also lies within the ARC Research Priority Area of "Smart Information Use",
Real-time signal processing and distributed robotic telescope networking for co-detection of gravitational waves and their optical counterparts. An international collaboration of scientists will employ a global network of telescopes and detectors to search for ripples in space-time. The project will use novel computational tools to study exotic phenomena in the distant Universe.
Video plasticity: Scalable video coding with inherently consistent motion. This project aims to improve how video coders represent motion, leading to more efficient motion descriptions and fewer distinct motion fields. The project will develop motion inference algorithms that ensure consistent motion descriptions throughout a group of pictures, allowing seamless integration of scalable video coding, motion compensated temporal filtering and motion compensated frame interpolation operations. The ....Video plasticity: Scalable video coding with inherently consistent motion. This project aims to improve how video coders represent motion, leading to more efficient motion descriptions and fewer distinct motion fields. The project will develop motion inference algorithms that ensure consistent motion descriptions throughout a group of pictures, allowing seamless integration of scalable video coding, motion compensated temporal filtering and motion compensated frame interpolation operations. The project is expected to support an efficient and interactive video browsing experience, largely decoupled from original frame rate and resolution; and deliver practical solutions that can be efficiently implemented on consumer devices.Read moreRead less
Building a Talking Head via Dynamic & 3D-Static, and Age- & Ethnically-Varied Databases: Perceptibility and Acceptability. This project will provide cutting edge realistic, perceptible talking head animation. Based on rich 3D face motion and static face databases, it will allow the study of the facial structure of specific groups of people, and the creation of a lasting cultural heritage of faces. Information in these databases will be useful for research in high-quality 3D face reconstruction ....Building a Talking Head via Dynamic & 3D-Static, and Age- & Ethnically-Varied Databases: Perceptibility and Acceptability. This project will provide cutting edge realistic, perceptible talking head animation. Based on rich 3D face motion and static face databases, it will allow the study of the facial structure of specific groups of people, and the creation of a lasting cultural heritage of faces. Information in these databases will be useful for research in high-quality 3D face reconstruction, with applications as wide as multimodal Biometric Identification, finding lost children, and security systems. The novel methods in this project will also advance auditory-visual speech and emotion research with particular commercial applications in telecommunications, human-machine interfaces, foreign language teaching, humanoid development, animation, and film.Read moreRead less
Advanced Processing for Through-the-Wall Radar Imaging. There is currently considerable interest around the world in imaging systems that can 'see' through-the-walls. This project is at the cutting edge of through-the-wall radar imaging research and technology. It will benefit both the defence and security industries, and position Australia among the leading countries in this technology, as only a handful of research teams around the world have the necessary background and expertise in this area ....Advanced Processing for Through-the-Wall Radar Imaging. There is currently considerable interest around the world in imaging systems that can 'see' through-the-walls. This project is at the cutting edge of through-the-wall radar imaging research and technology. It will benefit both the defence and security industries, and position Australia among the leading countries in this technology, as only a handful of research teams around the world have the necessary background and expertise in this area. The research outcomes will enhance the capability of the military, law enforcement, counter-terrorism, and search and rescue personnel. It will play a vital role in protecting and safeguarding Australia from terrorism and crime.Read moreRead less