A deep reinforcement learning based homeostatic system for unmanned position control

Deep Reinforcement Learning (DRL) has been proven to be capable of designing an optimal control theory by minimising the error in dynamic systems. However, in many of the real-world operations, the exact behaviour of the environment is unknown. In such environments, random changes cause the system to reach different states for the same action. Hence, application of DRL for unpredictable environments is difficult as the states of the world cannot be known for non-stationary transition and reward functions. In this paper, a mechanism to encapsulate the randomness of the environment is suggested using a novel bio-inspired homeostatic approach based on a hybrid of Receptor Density Algorithm (an artificial immune system based anomaly detection application) and a Plastic Spiking Neuronal model. DRL is then introduced to run in conjunction with the above hybrid model. The system is tested on a vehicle to autonomously re-position in an unpredictable environment. Our results show that the DRL based process control raised the accuracy of the hybrid model by 32%.N/

Bounded Rationality and Heuristics in Humans and in Artificial Cognitive Systems

In this paper I will present an analysis of the impact that the notion of “bounded rationality”, introduced by Herbert Simon in his book “Administrative Behavior”, produced in the field of Artificial Intelligence (AI). In particular, by focusing on the field of Automated Decision Making (ADM), I will show how the introduction of the cognitive dimension into the study of choice of a rational (natural) agent, indirectly determined - in the AI field - the development of a line of research aiming at the realisation of artificial systems whose decisions are based on the adoption of powerful shortcut strategies (known as heuristics) based on “satisficing” - i.e. non optimal - solutions to problem solving. I will show how the “heuristic approach” to problem solving allowed, in AI, to face problems of combinatorial complexity in real-life situations and still represents an important strategy for the design and implementation of intelligent systems

Development of an automated plasmapheresis system for the treatment of sepsis

This thesis was previously held under moratorium from 10/02/2020 to 10/02/2022Background: Sepsis is one of the leading cause of death in ICU. The causes of sepsis could be viral, bacterial, fungal infection, also, and in some instances trauma. When a local response to the infection becomes a systemic response, the immune system becomes chaotic. Cytokines are produced in an uncontrolled way, resulting in a cytokines storm. The immune system enters a hyperactivation status that leads to multiple organ failures. Despite advances in the medical treatment and clinical experience, there is currently no single medication approved for treating sepsis. Thus, removal of the plasma that contains the inflammatory mediators is a potential solution to reduce their effect in the body. Objectives: The aim of this project is to develop a device that is able to separate plasma from whole blood. The device should be able to generate secondary flow to enhance the performance by reducing the formation of cake layer. In addition, the device should be fully automated in order to simplify the technology for the end user. Approach: Design using computer aided design employing different methods for producing secondary flow, investigate the impact of these techniques on formed blood element, by assessment of shear stress. The design was 3D printed to investigate the performance in term of plasma filtration using different membranes with different effective pore area. The next step was to increase the dimension of the rig and test the increase in surface area on flux rate. In addition, an automation system was designed and assembled in order to control the transmembrane pressure, blood pump and plasma replacement pump through feedback from sensors read by a microcontroller. Results: The device was able to separate the plasma from the blood. The polyethersulfone membrane that has higher effective pore size had higher filtration rate. By increasing the size of the rig, the filtration volume increased. Also, the methods used to increase the flux were able to improve the flux rate. The automation system was tested and functioned well. Different flow rates were tested to investigate the performance of the system, and the results demonstrated the relationship between the flow rate and flux rate. In the TMP range 40-50 mmHg, at 260 ml/min flow rate, was the optimum flux rate. The device had the ability to run for 12 hours with a constant flux rate. The device achieved this with little haemolysis (pfHb <4 mg/L).Background: Sepsis is one of the leading cause of death in ICU. The causes of sepsis could be viral, bacterial, fungal infection, also, and in some instances trauma. When a local response to the infection becomes a systemic response, the immune system becomes chaotic. Cytokines are produced in an uncontrolled way, resulting in a cytokines storm. The immune system enters a hyperactivation status that leads to multiple organ failures. Despite advances in the medical treatment and clinical experience, there is currently no single medication approved for treating sepsis. Thus, removal of the plasma that contains the inflammatory mediators is a potential solution to reduce their effect in the body. Objectives: The aim of this project is to develop a device that is able to separate plasma from whole blood. The device should be able to generate secondary flow to enhance the performance by reducing the formation of cake layer. In addition, the device should be fully automated in order to simplify the technology for the end user. Approach: Design using computer aided design employing different methods for producing secondary flow, investigate the impact of these techniques on formed blood element, by assessment of shear stress. The design was 3D printed to investigate the performance in term of plasma filtration using different membranes with different effective pore area. The next step was to increase the dimension of the rig and test the increase in surface area on flux rate. In addition, an automation system was designed and assembled in order to control the transmembrane pressure, blood pump and plasma replacement pump through feedback from sensors read by a microcontroller. Results: The device was able to separate the plasma from the blood. The polyethersulfone membrane that has higher effective pore size had higher filtration rate. By increasing the size of the rig, the filtration volume increased. Also, the methods used to increase the flux were able to improve the flux rate. The automation system was tested and functioned well. Different flow rates were tested to investigate the performance of the system, and the results demonstrated the relationship between the flow rate and flux rate. In the TMP range 40-50 mmHg, at 260 ml/min flow rate, was the optimum flux rate. The device had the ability to run for 12 hours with a constant flux rate. The device achieved this with little haemolysis (pfHb <4 mg/L)