Human factors issues associated with the use of speech technology in the cockpit

The human factors issues associated with the use of voice technology in the cockpit are summarized. The formulation of the LHX avionics suite is described and the allocation of tasks to voice in the cockpit is discussed. State-of-the-art speech recognition technology is reviewed. Finally, a questionnaire designed to tap pilot opinions concerning the allocation of tasks to voice input and output in the cockpit is presented. This questionnaire was designed to be administered to operational AH-1G Cobra gunship pilots. Half of the questionnaire deals specifically with the AH-1G cockpit and the types of tasks pilots would like to have performed by voice in this existing rotorcraft. The remaining portion of the questionnaire deals with an undefined rotorcraft of the future and is aimed at determining what types of tasks these pilots would like to have performed by voice technology if anything was possible, i.e. if there were no technological constraints

Study to determine potential flight applications and human factors design guidelines for voice recognition and synthesis systems

A study was conducted to determine potential commercial aircraft flight deck applications and implementation guidelines for voice recognition and synthesis. At first, a survey of voice recognition and synthesis technology was undertaken to develop a working knowledge base. Then, numerous potential aircraft and simulator flight deck voice applications were identified and each proposed application was rated on a number of criteria in order to achieve an overall payoff rating. The potential voice recognition applications fell into five general categories: programming, interrogation, data entry, switch and mode selection, and continuous/time-critical action control. The ratings of the first three categories showed the most promise of being beneficial to flight deck operations. Possible applications of voice synthesis systems were categorized as automatic or pilot selectable and many were rated as being potentially beneficial. In addition, voice system implementation guidelines and pertinent performance criteria are proposed. Finally, the findings of this study are compared with those made in a recent NASA study of a 1995 transport concept

Intelligent Voice Email Agent: A Multimedia Solution

Intelligent agent theory is an important concept in artificial intelligent area. An intelligent agent, in a nutshell, is an intelligent program that uses agent communication protocols to exchange information for automatic problem solving, performing specific tasks on behalf of their users. Our objective is to investigate what an intelligent agent consists of and to implement several important aspects of it. In particular, we are interested in an intelligent agent that is able to take care of the incoming messages while the user is concentrating on some other duties. We develop an agent-based design framework and implement an intelligent agent system - voice email system that monitors incoming emails for us while we are surfing the Internet. A special feature of this system is that the agent reads any new messages for users. This initiative is based on the perception of real world needs and the academic research development. Based on what we have done, we can extend our agent capabilities. For example, two mail agents should be able to communicate each other to achieve more complicated task

Speech function in persons with Parkinson\u27s disease: effects of environment, task and treatment

Parkinson’s Disease (PD) is a degenerative neurological disease affecting aspects of movement, including speech. Persons with PD are reported to have better speech functioning in the clinical setting than in the home setting, but this has not been quantified. New methodologies in ambulatory measures of speech are emerging that allow investigation of non-clinical settings. The following questions are addressed: Is speech different between environments in PD and in healthy controls? Can clinical tasks predict speech behaviors in the home? Is treatment proven effective by measures in the home? What can we glean from methods of measurement of speech function in the home? The experiment included 13 persons with PD and 12 healthy controls, studied in the clinical and home environments, and 7 of those 13 persons with PD participated in a treatment study. Major findings included: Spontaneous speech intelligibility, not intensity, was the differentiating factor between persons with PD and healthy controls. Intelligibility and intensity were not related. Both groups presented with higher sentence intensity in the home environment. Spontaneous speech intelligibility in the clinic was related to spontaneous speech intelligibility in the home. The Sentence Intelligibility Test emerged as the best predictor of spontaneous speech intelligibility in the home. Differences between pilot treatment groups measured in the home on intensity and intelligibility were not large enough to make a clinical trial feasible. Individual differences may account for many of these results, for example more severely impaired patients may have shown different data. Drawing conclusions regarding the home environment via measures outside the home should be carefully considered. Ambulatory measures of speech are a viable option for studying speech function in non-clinical settings, and technology is advancing. Further investigation is needed to develop methodologies and normative values for speech in the home

Usefulness, localizability, humanness, and language-benefit: additional evaluation criteria for natural language dialogue systems

Human–computer dialogue systems interact with human users using natural language. We used the ALICE/AIML chatbot architecture as a platform to develop a range of chatbots covering different languages, genres, text-types, and user-groups, to illustrate qualitative aspects of natural language dialogue system evaluation. We present some of the different evaluation techniques used in natural language dialogue systems, including black box and glass box, comparative, quantitative, and qualitative evaluation. Four aspects of NLP dialogue system evaluation are often overlooked: “usefulness” in terms of a user’s qualitative needs, “localizability” to new genres and languages, “humanness” or “naturalness” compared to human–human dialogues, and “language benefit” compared to alternative interfaces. We illustrated these aspects with respect to our work on machine-learnt chatbot dialogue systems; we believe these aspects are worthwhile in impressing potential new users and customers

The development and implementation of a single-line intelligent digital telephone answering unit on a personal computer

ThesisCommercial telephone answering machines are limited to some extent by one or more of the following factors: • limited facilities • difficult to upgrade • nonstandard telephone interfacing • expensive • lack of user-friendliness • lack of dialogue and intelligence The purpose of this study is to design an intelligent digital telephone system which will overcome as many of the above-mentioned problems as possible. The following features are proposed and will be discussed: The use of a commonly available, but powerful, personal computer processor and memory instead of the elementary and rigid processor and magnetic tape storage units of the commercial telephone answering machine . This allows the quick storage and retrieval of digitized messages, each with its individual name, time and date stamp. Using the personal computer's hardware and not duplicating the processor and memory units allows a more cost-effective system upgrade. Upgrades mainly consist of software changes and minor hardware changes. This means that an upgrade does not implicate a total hardware redesign. Standards as prescribed by the local switching network standards and the Department of Post and Telecommunications, apply to this design and are applicable for licensing of the product. It is evident that the cost of this project and design is kept minimal by not duplicating expensive components like the microprocessor and the memory units, although these are used in the design. In this respect upgrades are software orientated to further limit the costs. The personal computer is equipped with a display which allows the user to make easy selections in order to execute the required instructions or to obtain information by using the help functions. This real-time help function eliminates the need for a user manual. Dialogue between user and personal computer over the telephone network offers a simple method of delivering information without the need for any extra equipment such as modems, keyboards or display units. The software used on the personal computer is designed in such a way that the system is intelligent and capable of decision making. Communication from the public telephone network is possible by using the telephone keypad and Dual Tone Multifrequency (DTMF) signalling

Development of the Carbon Nanotube Thermoacoustic Loudspeaker

Traditional speakers make sound by attaching a coil to a cone and moving that coil back and forth in a magnetic field (aka moving coil loudspeakers). The physics behind how to generate sound via this velocity boundary condition has largely been unchanged for over a hundred years. Interestingly, around the time moving coil loudspeakers were first investigated the idea of using heat to generate sound was also known. These thermoacoustic speakers heat and cool a thin material at acoustic frequencies to generate the pressure wave (i.e. they use a thermal boundary condition). Unfortunately, when the thermoacoustic principle was initially discovered there was no material with the right properties to heat and cool fast enough. Carbon nanotube (CNT) loudspeakers first generated sound early in the 21st century. At that time there were many questions unanswered about their place in the sound generation toolbox of an engineer. The main goal of this dissertation was to continue the development of the CNT loudspeaker with focus on practical usage for an acoustic engineer. Prior to 2014, when this effort began, most of the published development work was from material scientists with objective acoustic performance data presented that was not useful beyond the scope of that particular publication. For example, low sound pressure levels in the nearfield at low power inputs was a common metric. Therefore, this effort had three main objectives with emphasis placed on acquiring data at levels and in nomenclature that would be useful to acoustic engineers so they could bring the technology to market, if adequate. Investigation into the true power efficiency of CNT loudspeakers Investigation into alternative methods to linearize the pressure response of CNT loudspeakers Investigation into the sound quality of CNT loudspeakers Overall, it was found that CNT loudspeakers are approximately four orders of magnitude less power efficient than traditional moving coil loudspeakers. The non-linear pressure output of the CNT loudspeakers can be linearized with a variety of drive signal processing methods, but the selection of which method to use depends on a variety of factors (e.g. amplification architecture available). In general, all methods studied are on the same order of magnitude power efficiency, but the direct current offset and amplitude modulation drive signal processing methods are superior in terms of sound quality

Parametric synthesis of sign language

The isolation of the deaf community from mainstream society is in part due to the lack of knowledge most hearing people have of sign language. To most, there seems to be little need to learn a language that is spoken by such a small minority unless perhaps a relative is unable to hear. Even with a desire to learn, the task may seem insurmountable due to the unique formational and grammatical rules of the language. This linguistic rift has led to the call for an automatic translation system with the ability to take voice or written text as input and produce a comprehensive sequence of signed gestures through computing. This thesis focused on the development of the foundation of a system that would receive English language input and generate a sequence of related signed gestures each synthesized from their basic kinematic parameters. A technique of sign specification for a computer-based translation system was developed through the use of Python objects and functions. Sign definitions, written as Python algorithms, were used to drive the simulation engine of a human-modeling software known as Jack. This research suggests that 3-dimensional computer graphics can be utilized in the production of sign representations that are intelligible and natural in appearance