Reinforcement learning in a multi-agent framework for pedestrian simulation

El objetivo de la tesis consiste en la utilización de Aprendizaje por refuerzo (Reinforcement Learning) para generar simulaciones plausibles de peatones en diferentes entornos. Metodología Se ha desarrollado un marco de trabajo multi-agente donde cada agente virtual que aprende un comportamiento de navegación por interacción con el mundo virtual en el que se encuentra junto con el resto de agentes. El mundo virtual es simulado con un motor físico (ODE) que está calibrado con parámetros de peatones humanos extraídos de la bibliografía de la materia. El marco de trabajo es flexible y permite utilizar diferentes algoritmos de aprendizaje (en concreto Q-Learning y Sarsa(lambda) en combinación con diferentes técnicas de generalización del espacio de estados (en concreto cuantización Vectorial y tile coding). Como herramientas de análisis de los comportamientos aprendidos se utilizan diagramas fundamentales (relación velocidad/densidad), mapas de densidad, cronogramas y rendimientos (en términos del porcentaje de agentes que consiguen llegar al objetivo). Conclusiones: Tras una batería de experimentos en diferentes escenarios (un total de 6 escenarios distintos) y los correspondientes analisis de resultados, las conclusiones son las siguientes: - Se han conseguido comportamientos plausibles de peatones -Los comportamientos son robustos al escalado y presentan capacidades de abstracción (comportamientos a niveles táctico y de planificación) -Los comportamientos aprendidos son capaces de generar comportamientos colectivos emergentes -La comparación con otro modelo de peatones estandar (Modelo de Helbing) y los análisis realizados a nivel de diagramas fundamentales, indican que la dinámica aprendida es coherente y similar a una dinámica de peatones

Using Inverse Reinforcement Learning with Real Trajectories to Get More Trustworthy Pedestrian Simulation

Reinforcement learning is one of the most promising machine learning techniques to get intelligent behaviors for embodied agents in simulations. The output of the classic Temporal Difference family of Reinforcement Learning algorithms adopts the form of a value function expressed as a numeric table or a function approximator. The learned behavior is then derived using a greedy policy with respect to this value function. Nevertheless, sometimes the learned policy does not meet expectations, and the task of authoring is difficult and unsafe because the modification of one value or parameter in the learned value function has unpredictable consequences in the space of the policies it represents. This invalidates direct manipulation of the learned value function as a method to modify the derived behaviors. In this paper, we propose the use of Inverse Reinforcement Learning to incorporate real behavior traces in the learning process to shape the learned behaviors, thus increasing their trustworthiness (in terms of conformance to reality). To do so, we adapt the Inverse Reinforcement Learning framework to the navigation problem domain. Specifically, we use Soft Q-learning, an algorithm based on the maximum causal entropy principle, with MARL-Ped (a Reinforcement Learning-based pedestrian simulator) to include information from trajectories of real pedestrians in the process of learning how to navigate inside a virtual 3D space that represents the real environment. A comparison with the behaviors learned using a Reinforcement Learning classic algorithm (Sarsa(λ)) shows that the Inverse Reinforcement Learning behaviors adjust significantly better to the real trajectories

Peritoneal Dissemination of Hepatoid Carcinoma of the Ovary Treated with Cytoreductive Surgery and Hyperthermic Intraoperative Intraperitoneal Chemotherapy

Hepatoid carcinoma of the ovary (HCO) was first reported in 1987 in 5 cases of malignant ovarian tumors which were similar to hepatocarcinoma in the histological analysis. We report the first case in the literature of a patient diagnosed with HCO treated using HIPEC after extensive cytoreductive surgery, and we discuss the value of this therapeutical option in patients with HCO

Full-wave analysis and design of broadband turnstile junctions

The efficient design of broadband turnstile junctions compensated with piled-up cylindrical metallic posts is discussed in this contribution. Very high relative bandwidths can be obtained, while maintaining the diameter of the input circular access port lower than the width of the rectangular waveguide ports, thus reducing the number of excited higher order circular waveguide modes. A novel full-wave analysis tool has also been implemented in order to reduce the CPU effort related to the complete design process.San Blas Oltra, ÁA.; Pérez Soler, FJ.; Gil Raga, J.; Mira Pérez, FE.; Boria Esbert, VE.; Gimeno Martinez, B. (2011). Full-wave analysis and design of broadband turnstile junctions. Progress In Electromagnetics Research Letters. 24:149-158. doi:10.2528/PIERL11051703S1491582

¿La evaluación evoluciona? Una experiencia de coevaluación en ABP

Desde hace 8 años, el grado de Ingeniería Multimedia imparte el 4º curso utilizando Aprendizaje Basado en Proyectos (ABP) e integrando a todas las asignaturas en él. El programa ha tenido mucho éxito, pero siempre ha acusado un problema, la evaluación. Al tratarse de un trabajo en grupo altamente colaborativo, que integra a todas las asignaturas del curso y que durante los dos semestres trabaja en un único gran proyecto, es muy difícil discernir el trabajo real realizado por cada componente del equipo, produciéndose descompensaciones o incluso malas prácticas. Durante años, se ha tratado de adoptar medidas para paliar esta situación, pero persisten algunas disfunciones. Para solucionarlo, hemos diseñado e implantado una metodología de coevaluación, alineada con la gestión del programa ABP y que persigue dos objetivos: procurar un reparto de nota asociado con el esfuerzo individual realizado, basado en información objetiva y cuantificable, junto con una evaluación formativa y sumativa justa; y desarrollar las habilidades blandas imprescindibles hoy en día en entornos de trabajo colaborativos. En este artículo presentamos la herramienta de coevaluación desarrollada, la valoración realizada sobre la herramienta por las/os participantes en la experiencia y exalumnos de años anteriores, y los resultados obtenidos hasta la fecha.For the last 8 years, the Multimedia Engineering degree has been teaching the 4th year using Project Based Learning (PBL) and integrating all the subjects in it. The program has been very successful, but there has always been one problem: assessment. As it is a highly collaborative group work, integrating all the subjects of the course and working on a single large project during the two semesters, it is very difficult to discern the real work done by each member, causing imbalances or even malpractice. For years, we have tried to adopt measures to mitigate this situation, but without any positive results. To solve this problem, we have designed and implemented a co-evaluation methodology, aligned with the PBL program management, which has two objectives: to ensure a distribution of points associated with the individual effort, based on objective and measurable information, together with a fair formative and summative evaluation; and to develop the soft skills that are essential in current collaborative work environments. In this article we present the co-evaluation tool developed, the assessment made of the tool by the participants in the experience and alumni from previous years, and the results obtained to date.El presente trabajo ha contado con una ayuda del Programa de Redes de investigación en docencia universitaria del Instituto de Ciencias de la Educación de la Universidad de Alicante (convocatoria 2021-22). Ref.: 5490, Diseño y desarrollo de una metodología y plataforma TIC para coevaluación en ABP

Lipid profile, cardiovascular disease and mortality in a Mediterranean high-risk population: The ESCARVAL-RISK study.

The potential impact of targeting different components of an adverse lipid profile in populations with multiple cardiovascular risk factors is not completely clear. This study aims to assess the association between different components of the standard lipid profile with all-cause mortality and hospitalization due to cardiovascular events in a high-risk population. This prospective registry included high risk adults over 30 years old free of cardiovascular disease (2008-2012). Diagnosis of hypertension, dyslipidemia or diabetes mellitus was inclusion criterion. Lipid biomarkers were evaluated. Primary endpoints were all-cause mortality and hospital admission due to coronary heart disease or stroke. We estimated adjusted rate ratios (aRR), absolute risk differences and population attributable risk associated with adverse lipid profiles. 51,462 subjects were included with a mean age of 62.6 years (47.6% men). During an average follow-up of 3.2 years, 919 deaths, 1666 hospitalizations for coronary heart disease and 1510 hospitalizations for stroke were recorded. The parameters that showed an increased rate for total mortality, coronary heart disease and stroke hospitalization were, respectively, low HDL-Cholesterol: aRR 1.25, 1.29 and 1.23; high Total/HDL-Cholesterol: aRR 1.22, 1.38 and 1.25; and high Triglycerides/HDL-Cholesterol: aRR 1.21, 1.30, 1.09. The parameters that showed highest population attributable risk (%) were, respectively, low HDL-Cholesterol: 7.70, 11.42, 8.40; high Total/HDL-Cholesterol: 6.55, 12.47, 8.73; and high Triglycerides/HDL-Cholesterol: 8.94, 15.09, 6.92. In a population with cardiovascular risk factors, HDL-cholesterol, Total/HDL-cholesterol and triglycerides/HDL-cholesterol ratios were associated with a higher population attributable risk for cardiovascular disease compared to other common biomarkers.S

Calidad de las elecciones a titular del Ejecutivo en el Centro y Centro-occidente de México

Este libro, que tiene por objetivo analizar la calidad de las elecciones celebradas entre 2006 y 2011 para ocupar la titularidad del Poder Ejecutivo de las 14 entidades federativas de la República Mexicana que conforman las regiones Centro y Centro-occidente de este país, ha sido elaborado por investigadores pertenecientes a la Red Nacional de Investigación sobre la Calidad de la Democracia en México (Renicadem), la cual cuenta con un equipo de investigación en cada una de las entidades federativas del país. A su vez, esta Red constituye una de las cuatro líneas temáticas que componen la red temática del Conacyt “Sociedad civil y calidad de la democracia”. Con todo, la presente obra puede considerarse, en dos sentidos, como el resultado parcial de estudios realizados por investigadores que conforman la mencionada Renicadem. Por un lado, trata sólo de una de las varias dimensiones que esta Red ha establecido como necesarias para analizar la calidad de la democracia: la calidad electoral (otras dimensiones, que se encuentran en proceso de investigación, son calidad de vida, rendición de cuentas y Estado de derecho). También es parcial porque no abarca la totalidad de la República Mexicana, sino únicamente a las 14 entidades indicadas.UAE

Lipid profile, cardiovascular disease and mortality in a Mediterranean high-risk population: the ESCARVAL-RISK study

The potential impact of targeting different components of an adverse lipid profile in populations with multiple cardiovascular risk factors is not completely clear. This study aims to assess the association between different components of the standard lipid profile with all cause mortality and hospitalization due to cardiovascular events in a high-risk population. Methods This prospective registry included high risk adults over 30 years old free of cardiovascular disease (2008±2012). Diagnosis of hypertension, dyslipidemia or diabetes mellitus was inclusion criterion. Lipid biomarkers were evaluated. Primary endpoints were all-cause mortality and hospital admission due to coronary heart disease or stroke. We estimated adjusted rate ratios (aRR), absolute risk differences and population attributable risk associated with adverse lipid profiles. Results 51,462 subjects were included with a mean age of 62.6 years (47.6% men). During an average follow-up of 3.2 years, 919 deaths, 1666 hospitalizations for coronary heart disease and 1510 hospitalizations for stroke were recorded. The parameters that showed an increased rate for total mortality, coronary heart disease and stroke hospitalization were, respectively, low HDL-Cholesterol: aRR 1.25, 1.29 and 1.23; high Total/HDL-Cholesterol: aRR 1.22, 1.38 and 1.25; and high Triglycerides/HDL-Cholesterol: aRR 1.21, 1.30, 1.09. The parameters that showed highest population attributable risk (%) were, respectively, low HDL-Cholesterol: 7.70, 11.42, 8.40; high Total/HDL-Cholesterol: 6.55, 12.47, 8.73; and high Triglycerides/ HDL-Cholesterol: 8.94, 15.09, 6.92. Conclusions In a population with cardiovascular risk factors, HDL-cholesterol, Total/HDL-cholesterol and triglycerides/HDL-cholesterol ratios were associated with a higher population attributable risk for cardiovascular disease compared to other common biomarkers