Emergent cues underlying the perception of shape, colour, and material . This goal of this project is to identify the information the visual system uses to extract the three-dimensional structure and material composition of objects. This project aims to generate an advanced understanding of the information that supports these perceptual abilities and to advance our understanding how this information is learned from exposure to natural scenes. The findings of this work are expected to benefit ou ....Emergent cues underlying the perception of shape, colour, and material . This goal of this project is to identify the information the visual system uses to extract the three-dimensional structure and material composition of objects. This project aims to generate an advanced understanding of the information that supports these perceptual abilities and to advance our understanding how this information is learned from exposure to natural scenes. The findings of this work are expected to benefit our understanding of the human visual system, and to provide insights into the information needed to advance the development of deep neural networks (machine learning) that exploit the same information used by humans to guide our behavior and recognize objects and materials.Read moreRead less
Learning Robotic Navigation and Interaction from Object-based Semantic Maps. Our project aims to develop new learning algorithms that enable robots to perform high-complexity tasks that are currently impossible. Compared to existing methods that rely on low-level sensor data, we aim to achieve this by learning from a high-level graph representation of the environment that captures semantics, affordances, and geometry. The outcome would be robots capable of using human instructions to efficiently ....Learning Robotic Navigation and Interaction from Object-based Semantic Maps. Our project aims to develop new learning algorithms that enable robots to perform high-complexity tasks that are currently impossible. Compared to existing methods that rely on low-level sensor data, we aim to achieve this by learning from a high-level graph representation of the environment that captures semantics, affordances, and geometry. The outcome would be robots capable of using human instructions to efficiently learn complex interaction and navigation behaviours that transfer to unseen environments. Our research should benefit new applications in domains of economic and societal importance that are currently too complex, unsafe, and uncertain for robot assistants, such as aged care, advanced manufacturing and domestic robotics.Read moreRead less
Discovery Early Career Researcher Award - Grant ID: DE220101390
Funder
Australian Research Council
Funding Amount
$402,900.00
Summary
Towards Human-like Machine Perception for Embodied AI. This project aims to investigate human-like visual perception, whereby AI machines can see and interpret the world like a human. The expected outputs will empower AI machines with the abilities of human-centered visual recognition and annotation-efficient learning through a set of deep learning techniques, and the ability to actively gather visual information through a reinforcement learning methodology (for decision support). This research ....Towards Human-like Machine Perception for Embodied AI. This project aims to investigate human-like visual perception, whereby AI machines can see and interpret the world like a human. The expected outputs will empower AI machines with the abilities of human-centered visual recognition and annotation-efficient learning through a set of deep learning techniques, and the ability to actively gather visual information through a reinforcement learning methodology (for decision support). This research is fundamental to the creation of embodied AI machines, which are expected to provide assistance to humans in industry, education and health. It thus will indicate immediate applications embracing autonomous vehicles and domestic robotics, providing scientific, social and economic benefits for Australia.Read moreRead less
How the brain generates robust behaviour in noisy sensory environments. This project aims to investigate the origins of variability in the control of movements. This project expects to generate new knowledge in the area of sensory and motor neuroscience by determining how variability in the activity of sensory and motor neurons accounts for variability in the initiation and control of eye movements. Expected outcomes of this project include international collaboration, development of new methods ....How the brain generates robust behaviour in noisy sensory environments. This project aims to investigate the origins of variability in the control of movements. This project expects to generate new knowledge in the area of sensory and motor neuroscience by determining how variability in the activity of sensory and motor neurons accounts for variability in the initiation and control of eye movements. Expected outcomes of this project include international collaboration, development of new methods for imaging neural activity in vivo, and refinement of theories concerning the cause and implications of noise in the brain. This should provide significant benefits such as a better understanding of why our movements are variable, and whether it is desirable or possible to minimise this variability. Read moreRead less
Assistive micro-navigation for vision impaired people. This project aims to develop novel algorithms to transform a simple camera into a smart sensor, that can enable a vision-impaired person to navigate freely and without additional aids in a crowded area. Such a smart sensor will be endowed with the capability to detect and locate obstacles, identify the walking path, recognise objects and traffic signs and convey step-by-step instructions to the user. The project outcomes are expected to impr ....Assistive micro-navigation for vision impaired people. This project aims to develop novel algorithms to transform a simple camera into a smart sensor, that can enable a vision-impaired person to navigate freely and without additional aids in a crowded area. Such a smart sensor will be endowed with the capability to detect and locate obstacles, identify the walking path, recognise objects and traffic signs and convey step-by-step instructions to the user. The project outcomes are expected to improve the well-being and accessibility to public areas for vision-impaired people and reduce physical access disparities for this disadvantaged and vulnerable group. Furthermore, technologies developed in this project can potentially be adapted for use in related special navigation applications such as road safety, self-driving vehicles, and autonomous robots.Read moreRead less
New Paradigms for Robust Fitting: Kernelisation and Polyhedral Search. Outliers inevitably exist in visual data due to imperfect data acquisition or preprocessing. To enable computer vision applications that can perform reliably, robust fitting algorithms are necessary to counter the biasing influence of outliers. However, current robust algorithms are unsatisfactory: they are unreliable (due to using randomisation) or too computationally costly (due to using exhaustive search). This project wil ....New Paradigms for Robust Fitting: Kernelisation and Polyhedral Search. Outliers inevitably exist in visual data due to imperfect data acquisition or preprocessing. To enable computer vision applications that can perform reliably, robust fitting algorithms are necessary to counter the biasing influence of outliers. However, current robust algorithms are unsatisfactory: they are unreliable (due to using randomisation) or too computationally costly (due to using exhaustive search). This project will develop new robust algorithms to mitigate these shortcomings. It will do so by investigating two new paradigms of kernelisation and polyhedral search, which offer unprecedented theoretical insights into the problem. The outcomes will contribute towards computer vision applications that are more practical and reliable.Read moreRead less
Perceiving and misperceiving the causes of optical structure. This project aims to understand the conditions that cause humans to misperceive the shape and surface properties of real-world materials. Most natural materials are translucent to varying degrees, but little is known about how light is transported through them or how such materials are perceived or misperceived. This project will determine the conditions and causes responsible for the misperception of material properties and shape, an ....Perceiving and misperceiving the causes of optical structure. This project aims to understand the conditions that cause humans to misperceive the shape and surface properties of real-world materials. Most natural materials are translucent to varying degrees, but little is known about how light is transported through them or how such materials are perceived or misperceived. This project will determine the conditions and causes responsible for the misperception of material properties and shape, and will offer practical information about what can be done to minimise such misperceptions. The outcomes of the project are expected to lead to new techniques for depicting and manipulating real-world translucent materials in computer graphics, virtual reality, and gaming industries.Read moreRead less
Adapting Deep Learning for Real-world Medical Image Datasets. The project aims to investigate new deep learning modelling approaches to leverage real-world large-scale image data sets that contain noisy and incomplete labels and imbalanced class prevalence – to enable the use of these data sets for modelling deep learning classifiers. Expected outcomes include an innovative method for modelling deep learning classifiers. The research will involve new inter-disciplinary and international collabor ....Adapting Deep Learning for Real-world Medical Image Datasets. The project aims to investigate new deep learning modelling approaches to leverage real-world large-scale image data sets that contain noisy and incomplete labels and imbalanced class prevalence – to enable the use of these data sets for modelling deep learning classifiers. Expected outcomes include an innovative method for modelling deep learning classifiers. The research will involve new inter-disciplinary and international collaborations with machine learning and medical image analysis research institutions. This should provide significant benefits, such as better understanding of deep learning theory, new deep learning applications that can use previously unexplored data sets, and training for the future Australian workforce.Read moreRead less
Defense against adversarial attacks on deep learning in computer vision. Computer vision applications rely heavily on deep learning, which is highly vulnerable to being fooled by adding subtle perturbations to object/image textures that are imperceptible to humans. This project aims to develop defense mechanisms to detect and remove adversarial patterns from the input images. The project expects to advance knowledge in understanding the vulnerabilities of deep learning, and to design deep learni ....Defense against adversarial attacks on deep learning in computer vision. Computer vision applications rely heavily on deep learning, which is highly vulnerable to being fooled by adding subtle perturbations to object/image textures that are imperceptible to humans. This project aims to develop defense mechanisms to detect and remove adversarial patterns from the input images. The project expects to advance knowledge in understanding the vulnerabilities of deep learning, and to design deep learning architectures that are inherently robust. The outcomes of this project will increase the security and reliability of computer vision by detecting, reporting and nullifying such attacks and will benefit the general public and industry on many fronts.Read moreRead less
Precision Pollination: Data-driven enhancements to boost crop yield. The project aims to transform industrial crop pollination from an intuitive domain to one where decisions are based on sound data and best-practice principles. It proposes to achieve this modernisation of global pollination practice by developing novel technologies to operate a three-stage loop: honeybee pollination monitoring, simulation-based forecasting, and management. This is intended to ensure that the capability of honey ....Precision Pollination: Data-driven enhancements to boost crop yield. The project aims to transform industrial crop pollination from an intuitive domain to one where decisions are based on sound data and best-practice principles. It proposes to achieve this modernisation of global pollination practice by developing novel technologies to operate a three-stage loop: honeybee pollination monitoring, simulation-based forecasting, and management. This is intended to ensure that the capability of honeybees to provide essential ecosystem services is informed by transferable, standardised data acquisition and management techniques that maintain bee health and maximise pollination. The anticipated outcomes are higher fruit yields and quality, and a beneficial step-change in industry productivity and profitability.Read moreRead less