The effects of privacy-non-invasive interventions on cheating prevention and user experience in unproctored online assessments: An empirical study

peer reviewedPreventing cheating without invading test-takers’ privacy in high-stakes online summative assessments poses a challenge, especially when the assessment is remote and unproctored. We conducted a between-subjects experiment (N = 997) in a realistic online test simulation to investigate the effects of three privacy-non-invasive anti-cheating interventions (honor code reminder, warning message, and monitoring message) on cheating prevention from a user-centered perspective. The quantitative results indicated that, compared to a control condition, displaying a honor code reminder during an online test worked best in lowering the odds of cheating. None of the interventions affected user experience and test-taking self-efficacy significantly. Further open-ended questions revealed that interventions can cause distraction which in turn could potentially evoke negative emotions. The decision to cheat was influenced by the extent to which interventions conveyed that cheating is wrong and also by test-takers’ perception of getting caught if they cheated. We derived recommendations for a fair and cheating-preventive unproctored online assessment for researchers and practitioners

Content and form in public address : an analysis of the relative influences of the major components of speech upon the listener

A speech; whether prepared or impromptu, ought to be a communicative process. For a speech when defined as discourse delivered to an audience, (1) is a communicative process by which information may be given and received. Inherent in the phrase given and received is the assumption that the speaker anticipates that his listener will understand and respond, and that the speech will be understood as it was intended. The difficulty present in this intent - response theory is the problem of insuring that the listener will understand enough to respond to what the speaker has said. In an effort to ensure response, a speaker may make use of various factors of speech which help to enhance understanding. What these factors are and how they are observed and responded to by the listener are essential questions to be considered in this study

Five-Factor Model as a Predictor for Spoken Dialog Systems

Human behavior varies widely as does the design of spoken dialog systems (SDS). The search for predictors to match a user’s preference and efficiency for a specific dialog interface type in an SDS was the focus of this research. By using personality as described by the Five-Factor Method (FFM) and the Wizard of Oz technique for delivering three system initiatives of the SDS, participants interacted with each of the SDS initiatives in scheduling an airline flight. The three system initiatives were constructed as strict system, which did not allow the user control of the interaction; mixed system, which allowed the user some control of the interaction but with a system override; and user system, which allowed the user control of the interaction. In order to eliminate gender bias in using the FFM as the instrument, participants were matched in gender and age. Participants were 18 years old to 70 years old, passed a hearing test, had no disability that prohibited the use of the SDS, and were native English speakers. Participants completed an adult consent form, a 50-question personality assessment as described by the FFM, and the interaction with the SDS. Participants also completed a system preference indication form at the end of the interaction. Observations for efficiency were recorded on paper by the researcher. Although the findings did not show a definitive predictor for a SDS due to the small population sample, by using a multinomial regression approach to the statistical analysis, odds ratios of the data helped draw conclusions that support certain personality factors as important roles in a user’s preference and efficiency in choosing and using a SDS. This gives an area for future research. Also, the presumption that preference and efficiency always match was not supported by the results from two of the three systems. An additional area for future research was discovered in the gender data. Although not an initial part of the research, the data shows promise in predicting preference and efficiency for certain SDS. Future research is indicated

Registered nurses' experiences with, and feelings and attitudes towards, interRAI-LTCF in New Zealand in 2017 : a thesis presented in partial fulfillment of the requirements for the degree of Master of Philosophy in Health at Massey University, Albany, New Zealand

Background The International Resident Assessment Instrument for Long Term Care Facilities (interRAI-­‐LTCF) is a web-­‐based assessment tool designed to comprehensively assess older adults (>65 years) living in aged residential care. InterRAI-­‐LTCF is used in over thirty countries, but in 2015 New Zealand (NZ) was the first country where it was made mandatory in all facilities. No previous research about Registered Nurses’ (RN) views on interRAI-­‐LTCF in NZ has been conducted. The purpose of this study was to explore RNs’ experiences, feelings and attitudes towards interRAI-­‐LTCF, and what they believed would improve their experiences. Methods The study was qualitative, using an exploratory and descriptive approach. Twelve interviews were conducted 18 months after interRAI-­‐LTCF became mandatory in NZ. The interview questions were based on a United Theory of Acceptance and Use of Technology (UTAUT) model with some modifications. Findings were analysed thematically. Results The findings reveal that RNs of all ages embrace technology, and have mostly positive attitudes towards interRAI-­‐LTCF as a standardised and comprehensive assessment tool. Limited value however is seen in dementia and end of life care. RNs report good experiences with trainers and venues, but inconsistency between training courses. Negative feelings towards interRAI-­‐LTCF were caused by insufficient time to complete assessments, often due to duplication of data entry and insufficient RNs trained. RNs also feel apprehensive about the annual Assessment & Intelligence Systems, Inc. (AIS) competency tests. RNs believe the development of automated care plans and an automated password retrieval system would improve their experience. They also suggested that specific cultural considerations for Māori residents should be reviewed. Conclusion Overall RNs supported the use of interRAI-­‐LTCF as a comprehensive assessment tool. Duplication in data entry, insufficient training, and the annual AIS tests caused most stress and negative feelings. Recommendations were made to rectify this. Key Words Older adults, interRAI-­‐LTCF, Registered Nurses, aged residential care, UTAU

An Assessment of Contextual Design and Its Applicability to the Design of Educational Technologies

Thesis (PhD) - Indiana University, School of Education, 2008Increased use of computing technology in support of learning necessitates the collaboration of instructional designers with technology designers. Yet the instructional designer portrayed in current instructional design textbooks does not participate in technology design but instead designs instructional strategies and materials that are implemented by others. For instructional systems design as a field to move towards the kinds of collaborative work required for the development of effective, innovative educational technologies, there is a need for methods that can integrate the concerns and activities of both instructional and technology designers. This research critically examines a human-computer interaction design method, contextual design (CD), assessing how practitioners employ and characterize it as a method and explores its potential utility in instructional systems design. CD is briefly described and available evaluative studies are summarized. Next, three studies are presented: a case study of CD usage in the design of a digital music library, a case study of CD integrating with another design approach called PRInCiPleS, and a learning-oriented analysis of CD work models. Based on the findings of the literature review and these three studies, a practitioner survey and interview guide were developed. Results from 106 survey respondents and 16 interviews characterized CD as a guiding framework and a collection of useful techniques. However, because of its resource requirements and other limitations, the method is rarely used in full or exclusively. Respondents reported valuing the ability of CD to uncover and communicate user needs but also suggested CD did not provide a means of resolving conflicts between user needs and organizational objectives. Implications of these results are explored for three constituencies: developer-designers of instructional places or interactive materials, educators of instructional designers who will work with software developers, and educational researchers and their graduate students

User Interfaces for Patient-Centered Communication of Health Status and Care Progress

The recent trend toward patients participating in their own healthcare has opened up numerous opportunities for computing research. This dissertation focuses on how technology can foster this participation, through user interfaces to effectively communicate personal health status and care progress to hospital patients. I first characterize the design space for electronic information communication to patients through field studies conducted in multiple hospital settings. These studies utilize a combination of survey instruments, and low- and high-fidelity prototypes, including a document-editing prototype through which users can view and manage clinical data to automatically associate it with progress notes. The prototype, activeNotes, includes the first known techniques supporting clinical information requests directly within a document editor. A usage study with ICU physicians at New York-Presbyterian Hospital (NYP) substantiated our design and revealed how electronic information related to patient status and care progress is derived from a typical Electronic Health Record system. Insights gained from this study informed following studies to understand how to design abstracted, plain-language views suitable for patients. We gauged both patient and physician responses to information display prototypes deployed in patient rooms for a formative study exploring their design. Following my reports on this study, I discuss the design, development and pilot evaluations of a prototype Personal Health Record application providing live, abstracted clinical information for patients at NYP. The portal, evaluated by cardiothoracic surgery patients, is the first of its kind to allow patients to capture and monitor live data related to their care. Patient use of the portal influenced the subsequent design of tools to support users in making sense of online medication information. These tools, designed with nurses and pharmacists and evaluated by cardiothoracic surgery patients at NYP, were developed using topic modeling approaches and text analysis techniques. Embodied in a prototype called Remedy, they enable rapid filtering and comparison of medication-related search results, based on a number of website features and content topics. I conclude by discussing how findings from this series of studies can help shape the ongoing design and development of patient-centered technology

A two-stage framework for designing visual analytics systems to augment organizational analytical processes

A perennially interesting research topic in the field of visual analytics is how to effectively develop systems that support organizational knowledge worker’s decision-making and reasoning processes. The primary objective of a visual analytic system is to facilitate analytical reasoning and discovery of insights through interactive visual interfaces. It also enables the transfer of capability and expertise from where it resides to where it is needed–across individuals, and organizations as necessary. The problem is, however, most domain analytical practices generally vary from organizations to organizations. This leads to the diversified design of visual analytics systems in incorporating domain analytical processes, making it difficult to generalize the success from one domain to another. Exacerbating this problem is the dearth of general models of analytical workflows available to enable such timely and effective designs. To alleviate these problems, this dissertation presents a two-stage framework for informing the design of a visual analytics system. This two-stage design framework builds upon and extends current practices pertaining to analytical workflow and focuses, in particular, on investigating its effect on the design of visual analytics systems for organizational environments. It aims to empower organizations with more systematic and purposeful information analyses through modeling the domain users’ reasoning processes. The first stage in this framework is an Observation and Designing stage, in which a visual analytic system is designed and implemented to abstract and encapsulate general organizational analytical processes, through extensive collaboration with domain users. The second stage is the User-centric Refinement stage, which aims at interactively enriching and refining the already encapsulated domain analysis process based on understanding user’s intentions through analyzing their task behavior. To implement this framework in the process of designing a visual analytics system, this dissertation proposes four general design recommendations that, when followed, empower such systems to bring the users closer to the center of their analytical processes. This dissertation makes three primary contributions: first, it presents a general characterization of the analytical workflow in organizational environments. This characterization fills in the blank of the current lack of such an analytical model and further represents a set of domain analytical tasks that are commonly applicable to various organizations. Secondly, this dissertation describes a two-stage framework for facilitating the domain users’ workflows through integrating their analytical models into interactive visual analytics systems. Finally, this dissertation presents recommendations and suggestions on enriching and refining domain analysis through capturing and analyzing knowledge workers’ analysis processes. To exemplify the generalizability of these design recommendations, this dissertation presents three visual analytics systems that are developed following the proposed recommendations, including Taste for Xerox Corporation, OpsVis for Microsoft, and IRSV for the U.S. Department of Transportation. All of these systems are deployed to domain knowledge workers and are adopted for their analytical practices. Extensive empirical evaluations are further conducted to demonstrate efficacy of these systems in facilitating domain analytical processes