GraphCare: Enhancing Healthcare Predictions with Personalized Knowledge Graphs

Clinical predictive models often rely on patients' electronic health records (EHR), but integrating medical knowledge to enhance predictions and decision-making is challenging. This is because personalized predictions require personalized knowledge graphs (KGs), which are difficult to generate from patient EHR data. To address this, we propose \textsc{GraphCare}, an open-world framework that uses external KGs to improve EHR-based predictions. Our method extracts knowledge from large language models (LLMs) and external biomedical KGs to build patient-specific KGs, which are then used to train our proposed Bi-attention AugmenTed (BAT) graph neural network (GNN) for healthcare predictions. On two public datasets, MIMIC-III and MIMIC-IV, \textsc{GraphCare} surpasses baselines in four vital healthcare prediction tasks: mortality, readmission, length of stay (LOS), and drug recommendation. On MIMIC-III, it boosts AUROC by 17.6\% and 6.6\% for mortality and readmission, and F1-score by 7.9\% and 10.8\% for LOS and drug recommendation, respectively. Notably, \textsc{GraphCare} demonstrates a substantial edge in scenarios with limited data availability. Our findings highlight the potential of using external KGs in healthcare prediction tasks and demonstrate the promise of \textsc{GraphCare} in generating personalized KGs for promoting personalized medicine.Comment: ICLR 202

Foundation Metrics: Quantifying Effectiveness of Healthcare Conversations powered by Generative AI

Generative Artificial Intelligence is set to revolutionize healthcare delivery by transforming traditional patient care into a more personalized, efficient, and proactive process. Chatbots, serving as interactive conversational models, will probably drive this patient-centered transformation in healthcare. Through the provision of various services, including diagnosis, personalized lifestyle recommendations, and mental health support, the objective is to substantially augment patient health outcomes, all the while mitigating the workload burden on healthcare providers. The life-critical nature of healthcare applications necessitates establishing a unified and comprehensive set of evaluation metrics for conversational models. Existing evaluation metrics proposed for various generic large language models (LLMs) demonstrate a lack of comprehension regarding medical and health concepts and their significance in promoting patients' well-being. Moreover, these metrics neglect pivotal user-centered aspects, including trust-building, ethics, personalization, empathy, user comprehension, and emotional support. The purpose of this paper is to explore state-of-the-art LLM-based evaluation metrics that are specifically applicable to the assessment of interactive conversational models in healthcare. Subsequently, we present an comprehensive set of evaluation metrics designed to thoroughly assess the performance of healthcare chatbots from an end-user perspective. These metrics encompass an evaluation of language processing abilities, impact on real-world clinical tasks, and effectiveness in user-interactive conversations. Finally, we engage in a discussion concerning the challenges associated with defining and implementing these metrics, with particular emphasis on confounding factors such as the target audience, evaluation methods, and prompt techniques involved in the evaluation process.Comment: 13 pages, 4 figures, 2 tables, journal pape

Conversational Health Agents: A Personalized LLM-Powered Agent Framework

Conversational Health Agents (CHAs) are interactive systems that provide healthcare services, such as assistance and diagnosis. Current CHAs, especially those utilizing Large Language Models (LLMs), primarily focus on conversation aspects. However, they offer limited agent capabilities, specifically lacking multi-step problem-solving, personalized conversations, and multimodal data analysis. Our aim is to overcome these limitations. We propose openCHA, an open-source LLM-powered framework, to empower conversational agents to generate a personalized response for users' healthcare queries. This framework enables developers to integrate external sources including data sources, knowledge bases, and analysis models, into their LLM-based solutions. openCHA includes an orchestrator to plan and execute actions for gathering information from external sources, essential for formulating responses to user inquiries. It facilitates knowledge acquisition, problem-solving capabilities, multilingual and multimodal conversations, and fosters interaction with various AI platforms. We illustrate the framework's proficiency in handling complex healthcare tasks via three demonstrations. Moreover, we release openCHA as open source available to the community via GitHub.Comment: 23 pages, 6 figures, 3 tables, journal pape

Pathways to democratized healthcare: Envisioning human-centered AI-as-a-service for customized diagnosis and rehabilitation

The ongoing digital revolution in the healthcare sector, emphasized by bodies like the US Food and Drug Administration (FDA), is paving the way for a shift towards person-centric healthcare models. These models consider individual needs, turning patients from passive recipients to active participants. A key factor in this shift is Artificial Intelligence (AI), which has the capacity to revolutionize healthcare delivery due to its ability to personalize it. With the rise of software in healthcare and the proliferation of the Internet of Things (IoT), a surge of digital data is being produced. This data, alongside improvements in AI’s explainability, is facilitating the spread of person-centric healthcare models, aiming at improving health management and patient experience. This paper outlines a human-centered methodology for the development of an AI-as-a-service platform with the goal of broadening access to personalized healthcare. This approach places humans at its core, aiming to augment, not replace, human capabilities and integrate in current processes. The primary research question guiding this study is: “How can Human-Centered AI principles be considered when designing an AI-as-a-service platform that democratizes access to personalized healthcare?” This informed both our research direction and investigation. Our approach involves a design fiction methodology, engaging clinicians from different domains to gather their perspectives on how AI can meet their needs by envisioning potential future scenarios and addressing possible ethical and social challenges. Additionally, we incorporate Meta-Design principles, investigating opportunities for users to modify the AI system based on their experiences. This promotes a platform that evolves with the user and considers many different perspectives