London School of Economics and Political Science

LSE Research Online
Not a member yet
    96845 research outputs found

    Validating the use of large language models for psychological text classification

    No full text
    Large language models (LLMs) are being used to classify texts into categories informed by psychological theory (‘psychological text classification’). However, the use of LLMs in psychological text classification requires validation, and it remains unclear exactly how psychologists should prompt and validate LLMs for this purpose. To address this gap, we examined the potential of using LLMs for psychological text classification, focussing on ways to ensure validity. We employed OpenAI’s GPT-4o to classify (1) reported speech in online diaries, (2) other-initiations of conversational repair in Reddit dialogues, and (3) harm reported in healthcare complaints submitted to NHS hospitals and trusts. Employing a two-stage methodology, we developed and tested the validity of the prompts used to instruct GPT-4o using manually labelled data (N=1,500 for each task). First, we iteratively developed three types of prompts using one-third of each manually coded dataset, examining their semantic validity, exploratory predictive validity, and content validity. Second, we performed a confirmatory predictive validity test on the final prompts using the remaining two-thirds of each dataset. Our findings contribute to the literature by demonstrating that LLMs can serve as valid coders of psychological phenomena in text, on the condition that researchers work with the LLM to secure semantic, predictive, and content validity. They also demonstrate the potential of using LLMs in rapid and cost-effective iterations over big qualitative datasets, enabling psychologists to explore and iteratively refine their concepts and operationalisations during manual coding and classifier development. Accordingly, as a secondary contribution, we demonstrate that LLMs allow for an intellectual partnership with the researcher, defined by a synergistic and recursive text classification process where the LLM’s generative nature facilitates validity checks. We argue that using LLMs for psychological text classification may signify a paradigm shift towards a novel, iterative approach that may improve the validity of psychological concepts and operationalisations

    POS1552-HPR A synthesis of guidance available for assessing methodological quality and grading of evidence from qualitative research to inform clinical recommendations: a systematic review

    No full text
    Background Qualitative research is crucial to understand key stakeholders experiences and perspectives of care and health services. However, there is a lack of explicit frameworks and guidelines about how best to use qualitative evidence to formulate clinical recommendations. Part of the problem includes uncertainties about the contributions of qualitative research to the evidence, and the empirical and theoretical basis for appraising and synthesizing qualitative evidence in a standardized manner. In addition, most existing grading systems of qualitative research originates from quantitative research, and there is no clear guidance about how to incorporate qualitative research into the evidence hierarchy. Objectives To conduct a systematic literature review (SLR) to answer two research questions (RQ): RQ1) What guidance (e.g., tools, checklists, frameworks) exists to assess the methodological quality of qualitative research employed to inform clinical recommendations?; RQ2) What methods exist specifically to grade levels of evidence for qualitative research? Methods The protocol for this review was registered on www.researchregistry.com (reviewregistry1240). Electronic databases (PubMed/Medline, EMBASE, Web of Science, COCHRANE, Emcare, PsycINFO, ERIC, Academic Search Premier, Sociological Abstracts, ProQuest Dissertations and Thesis Global) were searched for published and unpublished studies. Searches were completed from inception to 23rd October 2020. No restrictions were applied to clinical population. Eligible studies for both questions included primary articles and guideline documents available in English, describing the: i) development; ii) application of validated tools (e.g., checklists); iii) guidance on how to assess methodological quality of qualitive research and iv) guidance on how to grade levels of qualitative evidence. Opinion pieces and conference abstracts were excluded. Manual searches of the reference lists of full text articles were conducted. Two reviewers independently screened the titles, abstracts, and full text. A narrative synthesis was conducted to identify key aspects between the included studies. Results 9071 records were retrieved (Figure 1). After de-duplication and title/abstract screening, 51 full-articles articles were assessed for eligibility yielding 15 included articles. For RQ1, six articles were included that described six tools (1) The society for Critical Care Medicine Family – Cantered Care Guidelines; 2) Nursing Management of the Second Stage of Labour evidence based clinical practice guidelines; 3) Jonna Briggs Institute Critical Appraisal of Qualitative Studies; 4) Critical Skill's Appraisal Programme (CASP) and 6) the Modified CASP checklist). All tools ranged from 10 to 30 items, and evaluated research design, recruitment, ethical rigour, data collection and data analysis. Seven articles described one approach (GRADE CER-Qual) to assess methodological quality of qualitative research. This approach advised on the importance for assessing methodological limitations. For RQ2, two articles were included, one described a qualitative hierarchy of evidence, and another described a research pyramid that included a section on qualitative research. Figure 1 PRISMA diagram of included papers Conclusion This review highlights lack of consensus and limited availability of tools, checklists, and approaches to 1) appraise the methodological quality of qualitative research used to inform clinical recommendations and 2) grade levels of evidence for qualitative research. Current research agendas will need to determine the most relevant and appropriate method for the quality appraisal of qualitative research. This way, qualitative research could be more consistently and appropriately applied to the development of clinical recommendations. References N/A Disclosure of Interests Mandeep Sekhon: None declared, Annette de Thurah: None declared, George E. Fragoulis: None declared, Tanja Stamm: None declared, T.P.M. Vliet Vlieland: None declared, Bente Appel Esbensen: None declared, Heidi Lempp: None declared, Lindsay Bearne: None declared, Marios Kouloumas: None declared, Polina Pchelnikova: None declared, Thijs W. Swinnen: None declared, Chris Blunt: None declared, Ricardo J. O. Ferreira: None declared, Loreto Carmona: None declared, Elena Nikiphorou Speakers bureau: Celltrion, Pfizer, Sanofi, Gilead, Galapgos, AbbVie, Eli Lilly, Grant/research support from: Pfizer, Eli Lill

    Introduction

    No full text
    The chapter introduces the main purpose and themes of the book. It highlights the lack of engagement between the English School of International Relations and International Political Economy and suggests how the gap between them can be bridged. The two major aims of the book are: to establish the market as a primary institution of global international society; and to trace its emergence and fluctuating fortunes from the nineteenth century until today. The chapter ends with two injunctions. The first is to the English School, to incorporate the market, and the economic sector into its scheme of modern primary institutions. The second is to International Political Economy to take on board the distinction between primary and secondary institutions, which allows us to analyse the evolution of the global economy as part of the wider international structure of global international society. The chapter ends with an overview of the book

    Platforms, programmability, and precarity: the platformization of research repositories in academic libraries

    Get PDF
    We investigate in this article how repository platforms change the sharing and preservation of digital objects in academic libraries. We use evidence drawn from semi-structured interviews with 31 data repository managers working at 21 universities using the product Figshare for institutions. We first show that repository managers use this platform to bring together actors, technologies and processes usually scattered across the library to assign to them the tasks that they value less—such as data preparation or IT maintenance—and spend more time engaging in activities they appreciate—such as raising awareness of data sharing. While this platformization of data management improves their job satisfaction, we reveal how it simultaneously accentuates the outsourcing of libraries’ core mission to private actors. We eventually discuss how this platformization can deskill librarians and perpetuate precarity politics in university libraries

    Reintegrative retributivism

    No full text
    Pessimistic empirical evidence about the reformatory and deterrent effects of punitive treatment poses a challenge for all justificatory theories of punishment. Yet, the dominant progressive view remains that punishment is required for the most serious crimes. This paper outlines an empirically sensitive prospectus for justifying punitive treatment through understanding the importance of reintegration. On this view, punishment can be viewed as a preferred alternative to the rigours of social ostracism, a common way of dealing with offenders in lieu of formal criminal justice. Adopting reintegration as a primary aim encourages taking a longer view which focuses on desistance from criminality rather than only on reform at the point of release from formal punishment. The view outlined in this paper enables a vindication of reintegrative punishment even when it is not the most immediately efficient means of reforming offenders. In making this argument, I develop the modern retributive platform in criminal justice theory, identify various overlooked yet key nuances in the relationship between reintegration and reform, and argue for greater theoretical and practical attention to how the state can make the communities they serve more receptive to reintegrating offenders

    Decoding organisational attractiveness: a fuzzy multi-criteria decision-making approach

    No full text
    Purpose High-skilled employees are crucial for sustained competitive advantage of organisations. In the “war for talent”, organisations must position themselves as attractive employers. This study aims to introduce a unified framework to systematically identify and prioritise organisational attractiveness (OA) components, focusing on the extreme context of the airline industry. Design/methodology/approach Treating OA as a multi-criteria decision-making (MCDM) situation, this study uses the Fuzzy Delphi Method to validate key OA factors and the Fuzzy Analytical Hierarchy Process to prioritise them based on experts’ judgements. Findings This study identifies 5 criteria and 22 sub-criteria for OA, with job characteristics and person–job fit as most critical. These elements signal employment quality and skill–job alignment, reducing information asymmetry and attracting talent. Practical implications This research provides a practical framework for airline managers to identify and prioritise key aspects of OA to enhance their value proposition and attract and retain qualified employees. For policymakers, applying the OA framework supports informed policy decisions on employment standards and workforce development. Originality/value This research introduces a fuzzy OA index and a framework that enhances OA. By incorporating signalling theory into a fuzzy MCDM approach, it systematically addresses key OA components, offering a strategic method to boost OA

    How WeChat official account marketing activities enhance brand loyalty among yoga consumers: the role of consumer trust and shopping motivations

    No full text
    Purpose The purpose of this research is to investigate how WeChat official account marketing activities influence consumer brand loyalty through instrument- and emotion-based paths (i.e. cognitive and affective brand trust) and how these paths operate depending on consumer shopping motivation. Design/methodology/approach We tested hypotheses using structural equation modeling with a three-wave online survey of two-week intervals administered to 179 individuals who follow the WeChat official account of a yoga gym brand. Findings WeChat official account marketing activities are positively related to cognitive and affective brand trust. Affective trust mediated the relationship between WeChat official account marketing activities and brand loyalty, and hedonic motivation moderated this relationship. Originality/value Our research extends the current knowledge by articulating that the influence of WeChat official account marketing activities on brand loyalty is mediated by affective brand trust, and hedonic motivation as a key contingency affects this mediation effect

    Chatham House during the Second World War

    No full text

    55,327

    full texts

    87,560

    metadata records
    Updated in last 30 days.
    LSE Research Online is based in United Kingdom
    Access Repository Dashboard
    Do you manage LSE Research Online? Access insider analytics, issue reports and manage access to outputs from your repository in the CORE Repository Dashboard!