Closed-loop control of anesthesia : survey on actual trends, challenges and perspectives

Automation empowers self-sustainable adaptive processes and personalized services in many industries. The implementation of the integrated healthcare paradigm built on Health 4.0 is expected to transform any area in medicine due to the lightning-speed advances in control, robotics, artificial intelligence, sensors etc. The two objectives of this article, as addressed to different entities, are: i) to raise awareness throughout the anesthesiologists about the usefulness of integrating automation and data exchange in their clinical practice for providing increased attention to alarming situations, ii) to provide the actualized insights of drug-delivery research in order to create an opening horizon towards precision medicine with significantly improved human outcomes. This article presents a concise overview on the recent evolution of closed-loop anesthesia delivery control systems by means of control strategies, depth of anesthesia monitors, patient modelling, safety systems, and validation in clinical trials. For decades, anesthesia control has been in the midst of transformative changes, going from simple controllers to integrative strategies of two or more components, but not achieving yet the breakthrough of an integrated system. However, the scientific advances that happen at high speed need a modern review to identify the current technological gaps, societal implications, and implementation barriers. This article provides a good basis for control research in clinical anesthesia to endorse new challenges for intelligent systems towards individualized patient care. At this connection point of clinical and engineering frameworks through (semi-) automation, the following can be granted: patient safety, economical efficiency, and clinicians' efficacy

The use of reinforcement learning algorithms to meet the challenges of an artificial pancreas

Blood glucose control, for example, in diabetes mellitus or severe illness, requires strict adherence to a protocol of food, insulin administration and exercise personalized to each patient. An artificial pancreas for automated treatment could boost quality of glucose control and patients' independence. The components required for an artificial pancreas are: i) continuous glucose monitoring (CGM), ii) smart controllers and iii) insulin pumps delivering the optimal amount of insulin. In recent years, medical devices for CGM and insulin administration have undergone rapid progression and are now commercially available. Yet, clinically available devices still require regular patients' or caregivers' attention as they operate in open-loop control with frequent user intervention. Dosage-calculating algorithms are currently being studied in intensive care patients [1] , for short overnight control to supplement conventional insulin delivery [2] , and for short periods where patients rest and follow a prescribed food regime [3] . Fully automated algorithms that can respond to the varying activity levels seen in outpatients, with unpredictable and unreported food intake, and which provide the necessary personalized control for individuals is currently beyond the state-of-the-art. Here, we review and discuss reinforcement learning algorithms, controlling insulin in a closed-loop to provide individual insulin dosing regimens that are reactive to the immediate needs of the patient

Towards Real-World Applications of Personalized Anesthesia Using Policy Constraint Q Learning for Propofol Infusion Control

Automated anesthesia promises to enable more precise and personalized anesthetic administration and free anesthesiologists from repetitive tasks, allowing them to focus on the most critical aspects of a patient's surgical care. Current research has typically focused on creating simulated environments from which agents can learn. These approaches have demonstrated good experimental results, but are still far from clinical application. In this paper, Policy Constraint Q-Learning (PCQL), a data-driven reinforcement learning algorithm for solving the problem of learning anesthesia strategies on real clinical datasets, is proposed. Conservative Q-Learning was first introduced to alleviate the problem of Q function overestimation in an offline context. A policy constraint term is added to agent training to keep the policy distribution of the agent and the anesthesiologist consistent to ensure safer decisions made by the agent in anesthesia scenarios. The effectiveness of PCQL was validated by extensive experiments on a real clinical anesthesia dataset. Experimental results show that PCQL is predicted to achieve higher gains than the baseline approach while maintaining good agreement with the reference dose given by the anesthesiologist, using less total dose, and being more responsive to the patient's vital signs. In addition, the confidence intervals of the agent were investigated, which were able to cover most of the clinical decisions of the anesthesiologist. Finally, an interpretable method, SHAP, was used to analyze the contributing components of the model predictions to increase the transparency of the model.Comment: 11 pages, 7 figure

Smart portable pen for continuous monitoring of anaesthetics in human serum with machine learning

Continuous monitoring of anaesthetics infusion is demanded by anaesthesiologists to help in defining personalized dose, hence reducing risks and side effects. We propose the first piece of technology tailored explicitly to close the loop between anaesthesiologist and patient with continuous drug monitoring. Direct detection of drugs is achieved with electrochemical techniques, and several options are present in literature to measure propofol (widely used anaesthetics). Still, the sensors proposed do not enable in-situ detection, they do not provide this information continuously, and they are based on bulky and costly lab equipment. In this paper, we present a novel smart pen-shaped electronic system for continuous monitoring of propofol in human serum. The system consists of a needle-shaped sensor, a quasi digital front-end, a smart machine learning data processing, in a single wireless battery-operated embedded device featuring Bluetooth Low Energy (BLE) communication. The system has been tested and characterized in real, undiluted human serum, at 37°C. The device features a limit of detection of 3.8µM, meeting the requirement of the target application, with an electronics system 59% smaller and 81% less power consuming w.r.t. the state-of-the-art, using a smart machine learning classification for data processing, which guarantees up to twenty continuous measure

A review on model-based and model-free approaches to control soft actuators and their potentials in colonoscopy

Colorectal cancer (CRC) is the third most common cancer worldwide and responsible for approximately 1 million deaths annually. Early screening is essential to increase the chances of survival, and it can also reduce the cost of treatments for healthcare centres. Colonoscopy is the gold standard for CRC screening and treatment, but it has several drawbacks, including difficulty in manoeuvring the device, patient discomfort, and high cost. Soft endorobots, small and compliant devices thatcan reduce the force exerted on the colonic wall, offer a potential solution to these issues. However, controlling these soft robots is challenging due to their deformable materials and the limitations of mathematical models. In this Review, we discuss model-free and model-based approaches for controlling soft robots that can potentially be applied to endorobots for colonoscopy. We highlight the importance of selecting appropriate control methods based on various parameters, such as sensor and actuator solutions. This review aims to contribute to the development of smart control strategies for soft endorobots that can enhance the effectiveness and safety of robotics in colonoscopy. These strategies can be defined based on the available information about the robot and surrounding environment, control demands, mechanical design impact and characterization data based on calibration.<br/

Network and systems medicine: Position paper of the European Collaboration on Science and Technology action on Open Multiscale Systems Medicine

Introduction: Network and systems medicine has rapidly evolved over the past decade, thanks to computational and integrative tools, which stem in part from systems biology. However, major challenges and hurdles are still present regarding validation and translation into clinical application and decision making for precision medicine. Methods: In this context, the Collaboration on Science and Technology Action on Open Multiscale Systems Medicine (OpenMultiMed) reviewed the available advanced technologies for multidimensional data generation and integration in an open-science approach as well as key clinical applications of network and systems medicine and the main issues and opportunities for the future. Results: The development of multi-omic approaches as well as new digital tools provides a unique opportunity to explore complex biological systems and networks at different scales. Moreover, the application of findable, applicable, interoperable, and reusable principles and the adoption of standards increases data availability and sharing for multiscale integration and interpretation. These innovations have led to the first clinical applications of network and systems medicine, particularly in the field of personalized therapy and drug dosing. Enlarging network and systems medicine application would now imply to increase patient engagement and health care providers as well as to educate the novel generations of medical doctors and biomedical researchers to shift the current organ- and symptom-based medical concepts toward network- and systems-based ones for more precise diagnoses, interventions, and ideally prevention. Conclusion: In this dynamic setting, the health care system will also have to evolve, if not revolutionize, in terms of organization and management