109 research outputs found

    5 − 4 ≠ 4 − 3: On the Uneven Gaps between Different Levels of Graded User Satisfaction in Interactive Information Retrieval Evaluation

    Get PDF
    Similar to other ground truth measures, graded user satisfaction has been frequently employed as a continuous variable in information retrieval evaluation based on the assumption that intervals between adjacent grades are quantitatively equal. To examine the validity of equal-gap assumption and explore dynamic perceptual thresholds triggering grade changes in search evaluation, we investigate the extent to which users are sensitive to changes in search efforts and outcomes across different gaps of graded satisfaction. Experiments on four user study datasets (15,337 queries) indicate that 1) User satisfaction sensitivity, especially to offline evaluation metrics, changes significantly across gaps in satisfaction scale; 2) the size and direction of changes in sensitivity vary across study settings, search types, and intentions, especially within “3-5” scale subrange. This study speaks to the fundamentals of user-centered evaluation and advances the knowledge of heterogeneity in satisfaction sensitivity to search efforts and gains and implicit changes in evaluation thresholds

    Far-Infrared Spectroscopy of Cationic Polycyclic Aromatic Hydrocarbons: Zero Kinetic Energy Photoelectron Spectroscopy of Pentacene Vaporized from Laser Desorption

    Get PDF
    doi:10.1088/0004-637X/715/1/485The distinctive set of infrared (IR) emission bands at 3.3, 6.2, 7.7, 8.6, and 11.3 ÎŒm are ubiquitously seen in a wide variety of astrophysical environments. They are generally attributed to polycyclic aromatic hydrocarbon (PAH) molecules. However, not a single PAH species has yet been identified in space, as the mid-IR vibrational bands are mostly representative of functional groups and thus do not allow one to fingerprint individual PAH molecules. In contrast, the far-IR (FIR) bands are sensitive to the skeletal characteristics of a molecule, hence they are important for chemical identification of unknown species. With an aim to offer laboratory astrophysical data for the Herschel Space Observatory, Stratospheric Observatory for Infrared Astronomy, and similar future space missions, in this work we report neutral and cation FIR spectroscopy of pentacene (C22H14), a five-ring PAH molecule. We report three IR active modes of cationic pentacene at 53.3, 84.8, and 266 ÎŒm that may be detectable by space missions such as the SAFARI instrument on board SPICA. In the experiment, pentacene is vaporized from a laser desorption source and cooled by a supersonic argon beam. We have obtained results from two-color resonantly enhanced multiphoton ionization and two-color zero kinetic energy photoelectron (ZEKE) spectroscopy. Several skeletal vibrational modes of the first electronically excited state of the neutral species and those of the cation are assigned, with the aid of ab initio and density functional calculations. Although ZEKE is governed by the Franck-Condon principle different from direct IR absorption or emission, vibronic coupling in the long ribbon-like molecule results in the observation of a few IR active modes. Within the experimental resolution of ~7 cm-1, the frequency values from our calculation agree with the experiment for the cation, but differ for the electronically excited intermediate state. Consequently, modeling of the intensity distribution is difficult and may require explicit inclusion of vibronic interactions.This work is supported by the National Aeronautics and Space Administration under award No. NNX09AC03G. A.L. is supported in part by the NSF grant AST 07-07866, a Spitzer Theory grant and a Herschel Theory grant

    Grading by AI makes me feel fairer? How different evaluators affect college students’ perception of fairness

    Get PDF
    IntroductionIn the field of education, new technologies have enhanced the objectivity and scientificity of educational evaluation. However, concerns have been raised about the fairness of evaluators, such as artificial intelligence (AI) algorithms. This study aimed to assess college students’ perceptions of fairness in educational evaluation scenarios through three studies using experimental vignettes.MethodsThree studies were conducted involving 172 participants in Study 1, 149 in Study 2, and 145 in Study 3. Different evaluation contexts were used in each study to assess the influence of evaluators on students’ perception of fairness. Information transparency and explanations for evaluation outcomes were also examined as potential moderators.ResultsStudy 1 found that different evaluators could significantly influence the perception of fairness under three evaluation contexts. Students perceived AI algorithms as fairer evaluators than teachers. Study 2 revealed that information transparency was a mediator, indicating that students perceived higher fairness with AI algorithms due to increased transparency compared with teachers. Study 3 revealed that the explanation of evaluation outcomes moderated the effect of evaluator on students’ perception of fairness. Specifically, when provided with explanations for evaluation results, the effect of evaluator on students’ perception of fairness was lessened.DiscussionThis study emphasizes the importance of information transparency and comprehensive explanations in the evaluation process, which is more crucial than solely focusing on the type of evaluators. It also draws attention to potential risks like algorithmic hegemony and advocates for ethical considerations, including privacy regulations, in integrating new technologies into educational evaluation systems. Overall, this study provides valuable theoretical insights and practical guidance for conducting fairer educational evaluations in the era of new technologies
    • 

    corecore