Development of a three dimensional audio-visual next generation speech recognition system. To overcome the disadvantages of current Audio-Visual Speech Recognition Systems, we propose a set of robust algorithms in three dimensional computer vision and speech processing. The proposed system will have far-reaching implications in various areas, for example, human-machine interaction for speech recognition in automated dialog systems and voice-to-text conversions.
Intelligent Virtual Human Companions. This research aims to develop intelligent virtual human companions that can seemingly integrate our immediate physical environment and understand their surroundings including people’s emotions, behaviours, actions and interactions. Such a technology will be enabled by leveraging recent advances in mixed/augmented reality technologies, and by developing innovative artificial intelligence and computer vision and graphics algorithms for dynamic real-world envir ....Intelligent Virtual Human Companions. This research aims to develop intelligent virtual human companions that can seemingly integrate our immediate physical environment and understand their surroundings including people’s emotions, behaviours, actions and interactions. Such a technology will be enabled by leveraging recent advances in mixed/augmented reality technologies, and by developing innovative artificial intelligence and computer vision and graphics algorithms for dynamic real-world environments. Unlike robots, the proposed technology will be low cost, readily deployable and customisable, and will not have any physical limitations or maintenance requirements. It will thus have a wide range of applications from elderly care, healthcare care to educational training.Read moreRead less
Advanced Computer Vision Techniques for Marine Ecology. Ever expanding human activity coupled with climate change has severely damaged marine ecosystems, which play a key role in our planet's ability to sustain life. Yet automated technology to monitor the health of our oceans still does not exist, with marine scientists still having today to process manually a massive amount of raw underwater imagery. This research aims to address this bottleneck by developing advanced computer vision tools for ....Advanced Computer Vision Techniques for Marine Ecology. Ever expanding human activity coupled with climate change has severely damaged marine ecosystems, which play a key role in our planet's ability to sustain life. Yet automated technology to monitor the health of our oceans still does not exist, with marine scientists still having today to process manually a massive amount of raw underwater imagery. This research aims to address this bottleneck by developing advanced computer vision tools for rapid, large-scale, automatic identification of marine species. Such an automated technology is expected to greatly benefit marine ecological studies in terms of speed, cost, accuracy of the spatial/temporal sampling and thus in better quantifying the level of environmental change marine ecosystems can tolerate.Read moreRead less
Advanced three-dimensional Computer Vision Algorithms for 'Find and Grasp' Future Robots. This project addresses crucial limitations of existing vision systems for the robot grasping of irregular objects in messy living environments. This project aims to undertake fundamental research into novel three-dimensional vision algorithms, exploiting multiple modalities (two-dimensional+three-dimensional+video) for scene labelling, object classification, scene segmentation and grasp synthesis to enable ....Advanced three-dimensional Computer Vision Algorithms for 'Find and Grasp' Future Robots. This project addresses crucial limitations of existing vision systems for the robot grasping of irregular objects in messy living environments. This project aims to undertake fundamental research into novel three-dimensional vision algorithms, exploiting multiple modalities (two-dimensional+three-dimensional+video) for scene labelling, object classification, scene segmentation and grasp synthesis to enable future robots to operate in unstructured environments with highly occluded and cluttered objects. It is expected to significantly advance research and to have broad applications, including home robotics to improve the quality of life of elders and people with special needs. These algorithms may also be used in security (explosive manipulation) and agriculture (field crop harvesting).Read moreRead less