Italian translation of the questionnaire for professional training evaluation

This works illustrates the psychometric properties of the Italian version of the Questionnaire for Professional Training Evaluation (Q4TE), validated by Grohmann and Kauffeld (2013). This 12-item questionnaire provides evaluation for different training outcomes, it is time efficient and applicable to several professional contexts, and it shows sound psychometric properties. In order to test the Italian form, we led two studies. In study 1 (N=125), an EFA led to a two-factor solution accounting for short and long-term training outcomes. In study 2 (N=122) a five-model comparison was performed. Although at a first stage a two factor solutions seemed to emerge, CFA found the best fit in a 6 inter-correlated first-order factors model (satisfaction, utility, knowledge, application to practice, individual organizational results and global organizational results). Relationships with learning transfer, transfer quantity, type of training, training methodologies, and individual variables (gender, age, tenure) are explored. Limitations, research and practical implications are discussed

Expert system verification and validation study. Delivery 1: Survey and interview questions

The NASA funded questionnaire is presented to help define the state-of-the-practice in the formal evaluation of Expert Systems on current NASA and industry applications. The answers to this questionnaire, together with follow-up interviews, will provide realistic answers to the following questions: (1) How much evaluation is being performed; (2) What evaluation techniques are in use; and (3) What, if any, are the unique issues in evaluating Expert Systems

Laptops for teachers: An evaluation of the TELA scheme in schools (Years 1 to 3)

The purpose of this evaluation is to investigate the impacts of the Laptops for Teachers Scheme: TELA (referred to from here as the TELA scheme) on teachers’ work over a period of three years (2006, 2007, 2008) and to record emerging changes in laptop use. This evaluation report presents findings from the three annual cycles of national focus groups and questionnaires with Years 1 to 3 teachers in New Zealand primary schools. In this evaluation, two methods of data collection were used: first, three focus groups were held with teachers in face-to-face meetings and second, a questionnaire was sent to teachers in a range of schools. The focus groups allowed teachers to talk about changes in their use of the laptop over the three years. Focus groups were held in the Taranaki, Wellington and Marlborough areas. The questionnaire asked teachers about various aspects of their laptops experience, including school support for laptops, professional development, their use of laptops at home and in school, and their goals for future use. In this final report, questionnaire results are presented together with the results from the focus groups held over three years

The National Academy for Gifted and Talented Youth : evaluation of the summer school 2003

An evaluation was carried out of the second year of functioning of the National Academy for Gifted and Talented Youth (NAGTY) with an emphasis on the summer schools as experienced by the students, their parents and the course leaders. The evaluation included pre and post questionnaires sent to students and their parents, as well as interviews with students and course leaders. Specifically, a pre-summer school experience questionnaire was sent to students and a post-summer school questionnaire was sent to both students and parents. Also, a sample (n=87) of students who had responded to the first questionnaire were interviewed at the end of the three-week period at all five sites to obtain their views on the summer school experience. Finally, 26 of the 28 course leaders involved were interviewed during the third week of the summer school

Today's problems with the evaluation methods of full lightning impulse parameters as described in IEC 60060-1

In this paper the present problems with the evaluation methods for lightning impulse parameters, as defined in IEC 60060-1, are described. Also the current practice of evaluation in many laboratories world-wide, that is obtained by a questionnaire, is presented. Some of the work performed up the present time and the initial conclusions are reported, then some recommendations are made for future work

An evaluation of the Amblyopia and Strabismus Questionnaire using Rasch analysis

noPURPOSE. To evaluate whether the Amblyopia and Strabismus Questionnaire (A&SQ) is a suitable instrument for the assessment of vision-related quality-of life (VR-QoL) in individuals with strabismus and/or amblyopia. METHODS. The A&SQ was completed by 102 individuals, all of whom had amblyopia, strabismus, or both. Rasch analysis was used to evaluate the usefulness of individual questionnaire items (i.e., questions); the response-scale performance; how well the items targeted VR-QoL; whether individual items showed response bias, depending on factors such as whether strabismus was present; and dimensionality. RESULTS. Items relating to concerns about the appearance of the eyes were applicable only to those with strabismus, and many items showed large ceiling effects. The response scale showed disordered responses and underused response options, which improved after the number of response options was reduced from five to three. This change improved the discriminative ability of the questionnaire (person separation index increased from 1.98 to 2.11). Significant bias was found between strabismic and nonstrabismic respondents. Separate Rasch analyses conducted for subjects with and without strabismus indicated that all A&SQ items seemed appropriate for individuals with strabismus (Rasch infit values between 0.60 and 1.40), but several items fitted the model poorly in amblyopes without strabismus. The AS&Q was not found to be unidimensional. CONCLUSIONS. The findings highlight the limitations of the A&SQ instrument in the assessment of VR-QoL in subjects with strabismus and especially in those with amblyopia alone. The results suggest that separate instruments are needed to quantify VR-QoL in amblyopes with and without strabismus

Evaluation of the Psychometric Properties of the Five Facet of Mindfulness Questionnaire.

ObjectiveThe Five Facet of Mindfulness Questionnaire (FFMQ) is widely used to assess mindfulness. The present study provides a psychometric evaluation of the FFMQ that includes item response theory (IRT) analyses and evaluation of item characteristic curves.MethodWe administered the FFMQ, the Beck Depression Inventory-II, the Ruminative Response Scale, and the Emotion Regulation Questionnaire to a heterogenous sample of 240 community-based adults. We estimated internal consistency reliability, item-scale correlations, categorical confirmatory factor analysis, and IRT graded response models for the FFMQ. We also estimated correlations among the FFMQ scales and correlations with the other measures included in the study.ResultsInternal consistency reliabilities for the five FFMQ scales were 0.82 or higher. A five-factor categorical model fit the data well. IRT-estimated item characteristic curves indicated that the five response options were monotonically ordered for most of the items. Product-moment correlations between simple-summated scoring and IRT scoring of the scales were 0.97 or higher.ConclusionsThe FFMQ accurately identifies varying levels of trait mindfulness. IRT-derived estimates will inform future adaptations to the FFMQ (e.g., briefer versions) and the development of future mindfulness instruments

Ride quality evaluation 1: Questionnaire studies of airline passenger comfort

As part of a larger effort to assess passenger comfort in aircraft, two questionnaires were administered: one to ground-based respondents; the other to passengers in flight. Respondents indicated the importance of various factors influencing their satisfaction with a trip, the perceived importance of various physical factors in determining their level of comfort, and the ease of time spent performing activities in flight. The in-flight sample also provided a rating of their level of comfort and of their willingness to fly again. Comfort ratings were examined in relation to (1) type of respondent, (2) type of aircraft, (3) characteristics of the passengers, (4) ease of performing activities, and (5) willingness to fly again

Exploring User Satisfaction in a Tutorial Dialogue System

Abstract User satisfaction is a common evaluation metric in task-oriented dialogue systems, whereas tutorial dialogue systems are often evaluated in terms of student learning gain. However, user satisfaction is also important for such systems, since it may predict technology acceptance. We present a detailed satisfaction questionnaire used in evaluating the BEETLE II system (REVU-NL), and explore the underlying components of user satisfaction using factor analysis. We demonstrate interesting patterns of interaction between interpretation quality, satisfaction and the dialogue policy, highlighting the importance of more finegrained evaluation of user satisfaction