Filters reveal what flicker conceals: temporal processing in the human visual system. I have recently discovered a new form of camouflage using 10Hz luminance flicker. This project will quantify this effect and examine the extent to which it generalises across colour and spatial dimensions and to video sequences depicting natural scenes. This information is expected to provide foundational information to technologies relating to national security that rely on visual concealment. This research wi ....Filters reveal what flicker conceals: temporal processing in the human visual system. I have recently discovered a new form of camouflage using 10Hz luminance flicker. This project will quantify this effect and examine the extent to which it generalises across colour and spatial dimensions and to video sequences depicting natural scenes. This information is expected to provide foundational information to technologies relating to national security that rely on visual concealment. This research will examine the extent to which filtering out these camouflaging frequencies enhances our sensitivity to low temporal frequency information. This decamouflaging aspect of my research is expected to improve the clarity of digital video-based technologies including ultrasound, educational, info-tainment and defence applicationsRead moreRead less
Broadcasting 3D Audio: Recording, Transmission, and Playback. With the current state of the art, a performance at the Sydney Opera House cannot be recorded and broadcast such that you can listen to it as if you are in the best seat of the house. The goal of our project is to develop the ultimate form of multi-channel audio broadcasting to create this experience. We will develop and implement effective systems for recording, broadcasting and playback of 3D audio in three different scenarios: indi ....Broadcasting 3D Audio: Recording, Transmission, and Playback. With the current state of the art, a performance at the Sydney Opera House cannot be recorded and broadcast such that you can listen to it as if you are in the best seat of the house. The goal of our project is to develop the ultimate form of multi-channel audio broadcasting to create this experience. We will develop and implement effective systems for recording, broadcasting and playback of 3D audio in three different scenarios: individual headphone reproduction; small loudspeaker array reproduction; and large loudspeaker array reproduction. We will create optimal recording techniques and broadcasting software for each of these playback techniques.Read moreRead less
A Layered Controlled Natural Language for Knowledge Representation. In this research project we will develop a controlled natural language for knowledge representation that has the potential to bridge the gap between fragments of natural language and formal languages. This controlled language will be based on a variety of increasing sophisticated layers, each building upon those below it by providing enhancements in expressive power. Sentences of the controlled language will be unambiguously tra ....A Layered Controlled Natural Language for Knowledge Representation. In this research project we will develop a controlled natural language for knowledge representation that has the potential to bridge the gap between fragments of natural language and formal languages. This controlled language will be based on a variety of increasing sophisticated layers, each building upon those below it by providing enhancements in expressive power. Sentences of the controlled language will be unambiguously translatable into a corresponding formal language. Anyone who can read and write English can immediately use the controlled language with the help an intelligent text editor. This technology will make it possible for non-specialists to write problem specifications in terms of the application domain without the need to formally encode the information.Read moreRead less
Designing for visual and auditory attention in complex high-tempo worlds. This research addresses the national priority of developing frontier technologies through smart information use. Advanced display technologies are positioned for rapid uptake in many sectors of the economy but are not fully tested. Results of our research will generalise to manufacturing, defence, aviation, and medicine. Given the focus on anaesthesia in this proposal, our research may help to make anaesthesia safer for pa ....Designing for visual and auditory attention in complex high-tempo worlds. This research addresses the national priority of developing frontier technologies through smart information use. Advanced display technologies are positioned for rapid uptake in many sectors of the economy but are not fully tested. Results of our research will generalise to manufacturing, defence, aviation, and medicine. Given the focus on anaesthesia in this proposal, our research may help to make anaesthesia safer for patients and easier for anaesthetists to administer. With this research, an Australian group will enhance its international lead in the area of innovative interfaces for safety critical applications. The proposed research should lead to further inventions that have the potential to benefit Australian industry.Read moreRead less
Building a Prototype for Quality Information Retrieval from the Internet. This projects aims to consider fundamental issues in implementing a prototype quality information retrieval system from the world wide web. These issues include: retrieval of relevant pages to a given topic using a focussed crawler; text categorisation of the retrieved web pages; quality selection criteria with the formulation of a quality index to determine quality of retrieved pages, and user interface design to obtain r ....Building a Prototype for Quality Information Retrieval from the Internet. This projects aims to consider fundamental issues in implementing a prototype quality information retrieval system from the world wide web. These issues include: retrieval of relevant pages to a given topic using a focussed crawler; text categorisation of the retrieved web pages; quality selection criteria with the formulation of a quality index to determine quality of retrieved pages, and user interface design to obtain relevance feedback. The outcome will be a prototype system useful to business and industry though to guide our thinking we will use issues in constructing a quality digital library collection as a sounding board.
Read moreRead less
How, What and Who in Human Communication: Movement of Face and Voice. The aim of this project is to identify the essential characteristics of tone, affect, and identity from face and voice using a combination of signal processing, biological, and behavioural techniques in order to develop a comprehensive model of auditory-visual speech processing and communication. This research will significantly improve understanding of the basis of auditory-visual perception and production in tonal languages ....How, What and Who in Human Communication: Movement of Face and Voice. The aim of this project is to identify the essential characteristics of tone, affect, and identity from face and voice using a combination of signal processing, biological, and behavioural techniques in order to develop a comprehensive model of auditory-visual speech processing and communication. This research will significantly improve understanding of the basis of auditory-visual perception and production in tonal languages and in affective communication, facilitate links between neurophysiological processes and auditory-visual speech processing; and contribute to applications in automatic person recognition, automatic speech recognition, text-to-speech systems, and talking head aids for the hearing impaired.Read moreRead less
Special Research Initiatives - Grant ID: SR0354596
Funder
Australian Research Council
Funding Amount
$20,000.00
Summary
Perception and Action in Auditory Scenes (PAAS): Neural, Behavioural, Computational and Mechanical Systems. Auditory scenes are temporal and ephemeral yet pervasively influence human life. How humans negotiate such scenes has not been solved, a fact highlighted by attempts to build machines to respond to speech, warnings etc., in real-world situations with room reverberation, different talkers, and background noise. No one discipline can solve such problems. In this network outstanding researche ....Perception and Action in Auditory Scenes (PAAS): Neural, Behavioural, Computational and Mechanical Systems. Auditory scenes are temporal and ephemeral yet pervasively influence human life. How humans negotiate such scenes has not been solved, a fact highlighted by attempts to build machines to respond to speech, warnings etc., in real-world situations with room reverberation, different talkers, and background noise. No one discipline can solve such problems. In this network outstanding researchers from physical, medical, human, and social sciences with interests in speech, music and audition will provide insights into how humans and machines localize, recognize, interpret and produce auditory events, and advance frontier technologies, e.g., automatic speech recognition, hearing prostheses, auditory monitoring/warning systems.Read moreRead less
Beamforming with acoustic vector sensors for audio user interfaces. We aim to create new Audio User Interfaces (AUIs) for the automatic separation and annotation of audio from complex sound scenes using acoustic vector sensor beamforming technology. Specifically, we will develop: speech AUIs for noisy, multi-talker, reverberant environments; and sound transcription AUIs for the deaf. Ultimately, users will be able to walk into a room, hold conversations and leave with a searchable, automatically ....Beamforming with acoustic vector sensors for audio user interfaces. We aim to create new Audio User Interfaces (AUIs) for the automatic separation and annotation of audio from complex sound scenes using acoustic vector sensor beamforming technology. Specifically, we will develop: speech AUIs for noisy, multi-talker, reverberant environments; and sound transcription AUIs for the deaf. Ultimately, users will be able to walk into a room, hold conversations and leave with a searchable, automatically-generated transcript of the audio events, tagged with metadata. The application of these technologies will create new possibilities for recording audio in the music, radio, TV industries, and future home based audio communication systems.Read moreRead less
Discovery Early Career Researcher Award - Grant ID: DE220100265
Funder
Australian Research Council
Funding Amount
$417,000.00
Summary
A closed-loop human–agent learning framework to enhance decision making. This project aims to design a foundational human–agent learning framework to augment the decision making process, using reinforcement and closed-loop mechanisms to enable symbiosis between a human and an artificial-intelligence agent. It envisages significant new technologies to promote controllability and efficient and safe exploration of an environment for decision actions – drastically boosting learning effectiveness and ....A closed-loop human–agent learning framework to enhance decision making. This project aims to design a foundational human–agent learning framework to augment the decision making process, using reinforcement and closed-loop mechanisms to enable symbiosis between a human and an artificial-intelligence agent. It envisages significant new technologies to promote controllability and efficient and safe exploration of an environment for decision actions – drastically boosting learning effectiveness and interpretability in decision making. Expected outcomes will benefit national cybersecurity by improving our understanding of vulnerabilities and threats involving decision actions, and by ensuring that human feedback and evaluations can help prevent catastrophic events in explorations of dynamic and complex environments.Read moreRead less
Sonification for complex, mission-critical work environments. Human operators must often pay attention to an immediate task while monitoring background information, but intrusive alarms often capture operators' attention inappropriately. We investigate how continuous auditory information ("sonification") can provide low-level background information when all is normal, yet capture attention to abnormalities only when needed. The results of three experiments will determine the most effective combi ....Sonification for complex, mission-critical work environments. Human operators must often pay attention to an immediate task while monitoring background information, but intrusive alarms often capture operators' attention inappropriately. We investigate how continuous auditory information ("sonification") can provide low-level background information when all is normal, yet capture attention to abnormalities only when needed. The results of three experiments will determine the most effective combination of visual and auditory information delivery; how well sonification captures attention when needed; and whether sonification captures attention to deviations from expected changes. Our findings will help establish principles of attentional mapping that significantly extend current approaches to interactive systems design.Read moreRead less