A Dialogue-Management Evaluation Study

We present a highly portable and cooperative dialogue-manager component of a developing, Slovenian and Croatian spoken dialogue system for weather-information retrieval. In order to evaluate the performance of this component, two Wizard-of-Oz experiments were performed. The only difference between both experiment settings was in the dialogue-management manner, i.e., while in the first experiment dialogue management was performed by a human, the wizard, in the second experiment it was performed by the newly-implemented dialogue-manager component. The data from both Wizard-of-Oz experiments was evaluated with the PARADISE evaluation framework, a potential general methodology for evaluating and comparing different versions of spoken-language dialogue systems. The study ascertains remarkable differences in the performance functions when taking different satisfaction-measure sums or even individual scores as the target to be predicted, it demonstrates the need for the introduced dialogue costs em database parameters, and it confirms the dialogue manager\u27s cooperativity subject to the incorporated knowledge representation

The educational scorecard: The Start of our Journey

Against a backdrop of public sector cuts, increasing university fees and high youth unemployment, we are facing challenges in Higher Education to demonstrate the value of our courses. Assessing the value of learning, however, is not straight forward. This paper reports on a study of evaluation processes on a post-graduate, professionally accredited diploma delivered at a selection of post 1992 universities. The driver for the study was a concern that current evaluation processes do not fully demonstrate the value of the course nor take into account the needs of multiple stakeholders. The project included benchmarking University evaluation processes and conducting a dialogue with stakeholders. The study adopted a qualitative management research approach, involving: a review of current practice, comparison with a sample of equivalent courses, and consultation (in the form of focus groups and semi-structured interviews) with a sample of students and employers. The paper discusses findings and proposes recommendations for future evaluation procedures in the design of an ‘educational scorecard’ for the course. Kaplan and Norton’s ‘balanced scorecard (1996) concept was adapted to provide a mechanism to represent and balance the needs of different stakeholder groups in the education process. We argue that we cannot truly assess accountability and comparability without engaging a range of stakeholders, not only in soliciting their views on the outcome of the learning but also in the design and implementation of evaluation processes. The ‘educational scorecard’ presented in this paper is developed specifically for the post-graduate diploma in Human Resource Management (PDHRM) at Leeds Metropolitan University and the report concludes with some initial reflections on the benefits of adopting the scorecard methodology The proposed model is flexible and may be adapted for other HE institutions and courses

The position and tasks of international organizations in the labor migration management

Purpose: The purpose of this note is to present the main international organizations involved in the labor migration management, to reveal their position and to evaluate their work in migration macroeconomic processes, identify obstacles to effective control of labor migrants flows at the global level. Design/Methodology/Approach: Methods of expert evaluations, comparison, generalization, classification and analysis were used in the study. The study is based on the legislation analysis of the International labor Organization and other specialized agencies of the United Nations. Findings: The author has investigated the position and tasks in labor force management of key international organizations dealing with labor migration at the global level. An important aspect of their activity is the comprehensive evaluation of migration processes, drawing up a global architecture of the migration, the relationship of the Sustainable Development Goals 2015-2030 with the population migration, as well as the establishment of a dialogue between different countries, the creation of international discussion platforms, the application of human rights norms to the regulation of the migration and the strengthening of the international legal regime in the field of migration. The author investigated the main trends in the global labor migration management, emphasizes the need for the formation of a multi-level migration management system carried out the analysis of the Global Compact for Safe, Regular and Orderly Migration. Practical implications: The results of the research will contribute to study international organizations on the labor migration global management. Originality/Value: Intergovernmental organizations is an important additional tool in building an international system of labor migration management. Donor and recipient countries of migrant workers, as well as international organizations often have different goals and objectives, but they are united by one global goal.peer-reviewe

Measuring stress and cognitive load effects on the perceived quality of a multimodal dialogue system

In this paper we present the results of a pilot study investigating the impact of stress and cognitive load on the perceived interaction quality of a multimodal dialogue system for crisis management. Four test subjects interacted with the system in four differently configured trials aiming to induce low/high levels of stress and cognitive load. To measure the level of stress and cognitive load physiological sensors and subjective ratings were collected. After each trial the subjects filled in an evaluation questionnaire regarding the system interaction quality. In the end we conducted an in-depth interview with each subject. The trials were recorded with a webcam to facilitate the behaviour analysis. Results showed that both factors have an influence on the way subjects perceived the interaction quality, whereas the cognitive load seems to have a higher impact. Further quantitative experiments are needed in order to validate the results and quantify the weight of each factor. \u

A software based mentor system

This thesis describes the architecture, implementation issues and evaluation of Mentor - an educational support system designed to mentor students in their university studies. Students can ask (by typing) natural language questions and Mentor will use several educational paradigms to present information from its Knowledge Base or from data-mined online Web sites to respond. Typically the questions focus on the student’s assignments or in their preparation for their examinations. Mentor is also pro-active in that it prompts the student with questions such as "Have you started your assignment yet?". If the student responds and enters into a dialogue with Mentor, then, based upon the student’s questions and answers, it guides them through a Directed Learning Path planned by the lecturer, specific to that assessment. The objectives of the research were to determine if such a system could be designed, developed and applied in a large-scale, real-world environment and to determine if the resulting system was beneficial to students using it. The study was significant in that it provided an analysis of the design and implementation of the system as well as a detailed evaluation of its use. This research integrated the Computer Science disciplines of network communication, natural language parsing, user interface design and software agents, together with pedagogies from the Computer Aided Instruction and Intelligent Tutoring System fields of Education. Collectively, these disciplines provide the foundation for the two main thesis research areas of Dialogue Management and Tutorial Dialogue Systems. The development and analysis of the Mentor System required the design and implementation of an easy to use text based interface as well as a hyper- and multi-media graphical user interface, a client-server system, and a dialogue management system based on an extensible kernel. The multi-user Java-based client-server system used Perl-5 Regular Expression pattern matching for Natural Language Parsing along with a state-based Dialogue Manager and a Knowledge Base marked up using the XML-based Virtual Human Markup Language. The kernel was also used in other Dialogue Management applications such as with computer generated Talking Heads. The system also enabled a user to easily program their own knowledge into the Knowledge Base as well as to program new information retrieval or management tasks so that the system could grow with the user. The overall framework to integrate and manage the above components into a usable system employed suitable educational pedagogies that helped in the student’s learning process. The thesis outlines the learning paradigms used in, and summarises the evaluation of, three course-based Case Studies of university students’ perception of the system to see how effective and useful it was, and whether students benefited from using it. This thesis will demonstrate that Mentor met its objectives and was very successful in helping students with their university studies. As one participant indicated: ‘I couldn’t have done without it.

Health insurance in Zaire

This study of health insurance systems in Zaire was carried out as part of a larger program of initiatives designed to improve the sustainability of health care systems and increase the health status of the Zairian population. This paper presents the objectives of the study and a discussion of the economic aspects of health insurance, background information about the health sector and health financing systems in Zaire and highlights of previous related work. The major motivations for this study were: (a) to provide information for the ongoing social sector adjustment dialogue in Zaire; and (b) to serve as a case study in the World Bank's Region Study of Health Finance. Specifically, the study sought to document different types of insurance systems in Zaire, and to conduct in-depth case studies of several schemes. The in-depth case studies presented in this report evaluate the design, management operational efficiency of four health insurance programs from both rural and urban areas. The case studies also attempt to analyze the effects of insurance on equity of access, utilization of health care services, and mobilization of financial resources for the health sector. From these analyses, the report draws conclusions about the advantages and disadvantages of health insurance programs as a means of financing health care services in Zaire, and suggests avenues for future research, policy, and programming initiatives.Health Monitoring&Evaluation,Insurance Law,Health Economics&Finance,Insurance&Risk Mitigation,Health Systems Development&Reform

Dialogue-based evaluation as a creative climate indicator

This paper examines how different forms of performance evaluation relate to aspects of the creative climate in a major pharmaceutical company. The study was based on a large employee-attitude survey that was distributed to all company employees. The study analyses survey results from 5,333 employees at five R&D sites. The results indicate that management’s evaluation of employees (either dialogue-based or control-based) relates to the type of motivation (intrinsic or extrinsic) that drives employees, to their style of thinking (value-focused thinking) and on their attitudes to organizational creativity. The paper then discusses implications of these findings for HRM

Membangun Komunitas Belajar Profesional Untuk Meningkatkan Mutu Pendidikan Di Sekolah

The research aims is to find answer on how to develop the capacity of school management to improve the quality of education. The Study was conducted by using qualitative approach through case studies at two senior high school. This study concluded that the capacity of school management developed through professional learning communities with a focus on exemplary leadership, studying with teachers and other personnel of the management process, the development of creativity in solving problems, and providing the conditions of a healthy work environment can improve the quality of education. Researchers recommend a few things for school: 1) open the involvement of various parties to assess the success of the school; 2) manage the flow of information becomes more smoothly for all parties concerned; 3) moderate malfunction of certain parties who have problems in performing their duties and functions or in solving his/her problems; 4) strengthening the sense of family as a community; 5) do reflection to the involvement of each PTK; 6) reproduce the process of dialogue, reflection, and evaluation; and 7) create a cozy atmosphere of the school mental fatigue (burnout). The results of this study fill the empty space in the process of developing the school management capacity, particularly in the context of schools in Indonesia