Towards the Situated Engagement Evaluation Model (SEEM) : making the invisible visible

This thesis explores the multifaceted concept of engagement within online learning environments. Key research aims are to suggest approaches and an extendable model for evaluating, monitoring and developing understanding of online learner engagement. The overall intention is to offer educators insight, practical guidance and tools for supporting timely intervention in fostering learner engagement. This thesis reviews the major theoretical perspectives on learning and highlights the role of student engagement in relation to the research literature. It discusses the limitations of the methods applied in current research and attempts to address this problem by crossing the disciplinary boundaries to draw together a range of perspectives and methodologies. A review of the literature provides a foundation for a learner engagement evaluation model that employs a variety of evaluation methods and accommodates the possible diversity of learning experiences. The proposed ‘Situated Engagement Evaluation Model’ (SEEM) is positioned to reflect the wide theoretical perspective of social learning. It constitutes a comprehensive system of intertwined components (Learning Content; Pedagogical Design Elements; Learning Profiles; and Dialogue and Communication) that learners may interact with, and integrates dynamically changing preferences and predispositions (e.g. cultural, emotional, cognitive) potentially informative in engagement studies. Prior to (and independently of) the development of SEEM, four empirical studies were conducted and reported here. These explored patterns of online engagement with respect to learning content, learning profiles, patterns of communication and elements of pedagogical design. Studies were then revisited to evaluate the usefulness of SEEM for monitoring and evaluating student engagement, and to discuss its potential for guiding intervention to improve learning experiences. The practical relevance for integrated and automated implementation of SEEM in online learning is considered further

Internet-based medical education: a realist review of what works, for whom and in what circumstances

http://creativecommons.org/licenses/by/2.0

Emerging from out of the shadows? Service user and carer involvement in systematic reviews

The systematic review methodology literature refers to the importance of involving stakeholders, including service users and carers, in the research. However, compared with other aspects of the methodology, this aspect of conducting systematic reviews is under-developed and the practice of involvement appears highly variable. This article draws on the experience of working with service users and carers in one systematic review to review the barriers to participation and the components of effective involvement. It suggests that quality standards can be identified for service user and carer involvement in systematic reviews, which will benefit policy and practice development

Automated Crowdturfing Attacks and Defenses in Online Review Systems

Malicious crowdsourcing forums are gaining traction as sources of spreading misinformation online, but are limited by the costs of hiring and managing human workers. In this paper, we identify a new class of attacks that leverage deep learning language models (Recurrent Neural Networks or RNNs) to automate the generation of fake online reviews for products and services. Not only are these attacks cheap and therefore more scalable, but they can control rate of content output to eliminate the signature burstiness that makes crowdsourced campaigns easy to detect. Using Yelp reviews as an example platform, we show how a two phased review generation and customization attack can produce reviews that are indistinguishable by state-of-the-art statistical detectors. We conduct a survey-based user study to show these reviews not only evade human detection, but also score high on "usefulness" metrics by users. Finally, we develop novel automated defenses against these attacks, by leveraging the lossy transformation introduced by the RNN training and generation cycle. We consider countermeasures against our mechanisms, show that they produce unattractive cost-benefit tradeoffs for attackers, and that they can be further curtailed by simple constraints imposed by online service providers

Routine administration of Health Related Quality of Life (HRQoL) and needs assessment instruments to improve psychological outcome: a systematic review

Background. Routine administration of Health Related Quality of Life (HRQoL) and needs assessment instruments has been advocated as part of clinical care to aid the recognition of psychosocial problems, to inform clinical decision making, to monitor therapeutic response and to facilitate patient-doctor communication. However, their adoption is not without cost and the benefit of their use is unclear. Method. A systematic review was conducted. We sought experimental studies that examined the addition of routinely administered measures of HRQoL to care in both psychiatric and non-psychiatric settings. We searched the following databases: MEDLINE, EMBASE, CINAHL, PsycLIT and Cochrane Controlled Trials Register (to 2000). Data were extracted independently and a narrative synthesis of results was presented. Results. Nine randomized and quasi-randomized studies conducted in non-psychiatric settings were found. All the instruments used included an assessment of mental well-being, with specific questions relating to depression and anxiety. The routine feedback of these instruments had little impact on the recognition of mental disorders or on longer term psychosocial functioning. While clinicians welcomed the information these instruments imparted, their results were rarely incorporated into routine clinical decision making. No studies were found that examined the value of routine assessment and feedback of HRQoL or patient needs in specialist psychiatric care settings. Conclusions. Routine HRQoL measurement is a costly exercise and there is no robust evidence to suggest that it is of benefit in improving psychosocial outcomes of patients managed in non-psychiatric settings. Major policy initiatives to increase the routine collection and use of outcome measures in psychiatric settings are unevaluated

The Mediation Effect of Trusting Beliefs on the Relationship Between Expectation-Confirmation and Satisfaction with the Usage of Online Product Recommendation

Online Product Recommendations (OPRs) are increasingly available to onlinecustomers as a value-added self-service in evaluating and choosing a product.Research has highlighted several advantages that customers can gain from usingOPRs. However, the realization of these advantages depends on whether and towhat extent customers embrace and fully utilise them. The relatively low OPR USAgerate indicates that customers have not yet developed trust in OPRs’ performance.Past studies also have established that satisfaction is a valid measure of systemperformance and a consistent significant determinant of users’ continuous systemusage. Therefore, this study aimed to examine the mediation effect of trustingbeliefs on the relationship between expectation-confirmation and satisfaction. Theproposed research model is tested using data collected via an online survey from626 existing users of OPRs. The empirical results revealed that social-psychologicalbeliefs (perceived confirmation and trust) are significant contributors to customersatisfaction with OPRs. Additionally, trusting beliefs partially mediate the impactof perceived confirmation on customer satisfaction. Moreover, this study validatesthe extensions of the interpersonal trust construct to trust in OPRs and examinesthe nomological validity of trust in terms of competence, benevolence, andintegrity. The findings provide a number of theoretical and practical implications.&nbsp

Patient-reported depression measures in cancer: a meta-review

The patient-reported depression measures that perform best in oncology settings have not yet been identified. We did a meta-review to integrate the findings of reviews of more than 50 depression measures used in adults with, or recovering from, any type of cancer. We searched Medline, PsycINFO, Embase, and grey literature from 1999 to 2014 to identify 19 reviews representing 372 primary studies. 11 reviews were rated as being of high quality (defined as meeting at least 20 criteria in the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement). The Hospital Anxiety Depression Scale (HADS) was the most thoroughly evaluated measure, but was limited by cutpoint variability. The HADS had moderate screening utility indices and was least recommended in advanced cancer or palliative care. The Beck Depression Inventory was more generalisable across cancer types and disease stages, with good indices for screening and case finding. The Center for Epidemiologic Studies Depression Scale was the best-weighted measure in terms of responsiveness. This meta-review provides a comprehensive overview of the strengths and limitations of available depression measures. It can inform the choice of the best measure for specific settings and purposes

Reviews

Martin Oliver (ed.), Innovation in the Evaluation of Learning Technology, London: University of North London, 1998. ISBN: 1–85377–256–9. Softback, 242 pages, £15.00