4 research outputs found
Recommended from our members
Black box no more: a scoping review of AI governance frameworks to guide procurement and adoption of AI in medical imaging and radiotherapy in the UK
Technological advancements in computer science have started to bring artificial intelligence (AI) from the bench closer to the bedside. While there is still lots to do and improve, AI models in medical imaging and radiotherapy are rapidly being developed and increasingly deployed in clinical practice. At the same time, AI governance frameworks are still under development. Clinical practitioners involved with procuring, deploying, and adopting AI tools in the UK should be well-informed about these AI governance frameworks. This scoping review aimed to map out available literature on AI governance in the UK, focusing on medical imaging and radiotherapy. Searches were performed on Google Scholar, Pubmed, and the Cochrane Library, between June and July 2022. Of 4225 initially identified sources, 35 were finally included in this review. A comprehensive conceptual AI governance framework was proposed, guided by the need for rigorous AI validation and evaluation procedures, the accreditation rules and standards, and the fundamental ethical principles of AI. Fairness, transparency, trustworthiness, and explainability should be drivers of all AI models deployed in clinical practice. Appropriate staff education is also mandatory to ensure AI's safe and responsible use. Multidisciplinary teams under robust leadership will facilitate AI adoption, and it is crucial to involve patients, the public, and practitioners in decision-making. Collaborative research should be encouraged to enhance and promote innovation, while caution should be paid to the ongoing auditing of AI tools to ensure safety and clinical effectiveness
Recommended from our members
Black box no more: A cross-sectional multi-disciplinary survey for exploring governance and guiding adoption of AI in medical imaging and radiotherapy in the UK
Background
Medical Imaging and radiotherapy (MIRT) are at the forefront of artificial intelligence applications. The exponential increase of these applications has made governance frameworks necessary to uphold safe and effective clinical adoption. There is little information about how healthcare practitioners in MIRT in the UK use AI tools, their governance and associated challenges, opportunities and priorities for the future.
Methods
This cross-sectional survey was open from November to December 2022 to MIRT professionals who had knowledge or made use of AI tools, as an attempt to map out current policy and practice and to identify future needs. The survey was electronically distributed to the participants. Statistical analysis included descriptive statistics and inferential statistics on the SPSS statistical software. Content analysis was employed for the open-ended questions.
Results
Among the 245 responses, the following were emphasised as central to AI adoption: governance frameworks, practitioner training, leadership, and teamwork within the AI ecosystem. Prior training was strongly correlated with increased knowledge about AI tools and frameworks. However, knowledge of related frameworks remained low, with different professionals showing different affinity to certain frameworks related to their respective roles. Common challenges and opportunities of AI adoption were also highlighted, with recommendations for future practice
Recommended from our members
AI implementation in the UK landscape: Knowledge of AI governance, perceived challenges and opportunities, and ways forward for radiographers
Introduction
Despite the rapid increase of AI-enabled applications deployed in clinical practice, many challenges exist around AI implementation, including the clarity of governance frameworks, usability of validation of AI models, and customisation of training for radiographers. This study aimed to explore the perceptions of diagnostic and therapeutic radiographers, with existing theoretical and/or practical knowledge of AI, on issues of relevance to the field, such as AI implementation, including knowledge of AI governance and procurement, perceptions about enablers and challenges and future priorities for AI adoption.
Methods
An online survey was designed and distributed to UK-based qualified radiographers who work in medical imaging and/or radiotherapy and have some previous theoretical and/or practical knowledge of working with AI. Participants were recruited through the researchers’ professional networks on social media with support from the AI advisory group of the Society and College of Radiographers. Survey questions related to AI training/education, knowledge of AI governance frameworks, data privacy procedures, AI implementation considerations, and priorities for AI adoption. Descriptive statistics were employed to analyse the data, and chi-square tests were used to explore significant relationships between variables.
Results
In total, 88 valid responses were received. Most radiographers (56.6 %) had not received any AI-related training. Also, although approximately 63 % of them used an evaluation framework to assess AI models’ performance before implementation, many (36.9 %) were still unsure about suitable evaluation methods. Radiographers requested clearer guidance on AI governance, ample time to implement AI in their practice safely, adequate funding, effective leadership, and targeted support from AI champions. AI training, robust governance frameworks, and patient and public involvement were seen as priorities for the successful implementation of AI by radiographers.
Conclusion
AI implementation is progressing within radiography, but without customised training, clearer governance, key stakeholder engagement and suitable new roles created, it will be hard to harness its benefits and minimise related risks.
Implications for practice
The results of this study highlight some of the priorities and challenges for radiographers in relation to AI adoption, namely the need for developing robust AI governance frameworks and providing optimal AI training
Target Product Profile for a Machine Learning–Automated Retinal Imaging Analysis Software for Use in English Diabetic Eye Screening: Protocol for a Mixed Methods Study
\ua9 2024 JMIR Publications Inc.. All rights reserved.Background: Diabetic eye screening (DES) represents a significant opportunity for the application of machine learning (ML) technologies, which may improve clinical and service outcomes. However, successful integration of ML into DES requires careful product development, evaluation, and implementation. Target product profiles (TPPs) summarize the requirements necessary for successful implementation so these can guide product development and evaluation. Objective: This study aims to produce a TPP for an ML-automated retinal imaging analysis software (ML-ARIAS) system for use in DES in England. Methods: This work will consist of 3 phases. Phase 1 will establish the characteristics to be addressed in the TPP. A list of candidate characteristics will be generated from the following sources: an overview of systematic reviews of diagnostic test TPPs; a systematic review of digital health TPPs; and the National Institute for Health and Care Excellence’s Evidence Standards Framework for Digital Health Technologies. The list of characteristics will be refined and validated by a study advisory group (SAG) made up of representatives from key stakeholders in DES. This includes people with diabetes; health care professionals; health care managers and leaders; and regulators and policy makers. In phase 2, specifications for these characteristics will be drafted following a series of semistructured interviews with participants from these stakeholder groups. Data collected from these interviews will be analyzed using the shortlist of characteristics as a framework, after which specifications will be drafted to create a draft TPP. Following approval by the SAG, in phase 3, the draft will enter an internet-based Delphi consensus study with participants sought from the groups previously identified, as well as ML-ARIAS developers, to ensure feasibility. Participants will be invited to score characteristic and specification pairs on a scale from “definitely exclude” to “definitely include,” and suggest edits. The document will be iterated between rounds based on participants’ feedback. Feedback on the draft document will be sought from a group of ML-ARIAS developers before its final contents are agreed upon in an in-person consensus meeting. At this meeting, representatives from the stakeholder groups previously identified (minus ML-ARIAS developers, to avoid bias) will be presented with the Delphi results and feedback of the user group and asked to agree on the final contents by vote. Results: Phase 1 was completed in November 2023. Phase 2 is underway and expected to finish in March 2024. Phase 3 is expected to be complete in July 2024. Conclusions: The multistakeholder development of a TPP for an ML-ARIAS for use in DES in England will help developers produce tools that serve the needs of patients, health care providers, and their staff. The TPP development process will also provide methods and a template to produce similar documents in other disease areas