16 research outputs found
Deep Reinforcement Learning for Time-Critical Wilderness Search And Rescue Using Drones
Traditional search and rescue methods in wilderness areas can be
time-consuming and have limited coverage. Drones offer a faster and more
flexible solution, but optimizing their search paths is crucial. This paper
explores the use of deep reinforcement learning to create efficient search
missions for drones in wilderness environments. Our approach leverages a priori
data about the search area and the missing person in the form of a probability
distribution map. This allows the deep reinforcement learning agent to learn
optimal flight paths that maximize the probability of finding the missing
person quickly. Experimental results show that our method achieves a
significant improvement in search times compared to traditional coverage
planning and search planning algorithms. In one comparison, deep reinforcement
learning is found to outperform other algorithms by over , a difference
that can mean life or death in real-world search operations. Additionally,
unlike previous work, our approach incorporates a continuous action space
enabled by cubature, allowing for more nuanced flight patterns.Comment: 16 pages, 19 figures. Submitte
GIS Data Driven Probability Map Generation for Search and Rescue Using Agents
Predicting the final resting location of a missing person is critical for search and rescue operations with limited resources. To improve the accuracy and speed of these predictions, simulated agents can be created to replicate the behavior of the missing person. In this paper, we introduce an agent-based model, to simulate various psychological profiles, that move over a physical landscape incorporating real-world data in their decision-making without relying on per-location training. The resultant probability density map of the missing person's location was the result of a combination of Monte Carlo simulations and mobility-time-based sampling. General trends in the data were comparable to historical data sets available. This work presents a flexible agent that can be employed by search and rescue that easily extends to various locations
Deep reinforcement learning for time-critical wilderness search and rescue using drones
Traditional search and rescue methods in wilderness areas can be time-consuming and have limited coverage. Drones offer a faster and more flexible solution, but optimizing their search paths is crucial for effective operations. This paper proposes a novel algorithm using deep reinforcement learning to create efficient search paths for drones in wilderness environments. Our approach leverages a priori data about the search area and the missing person in the form of a probability distribution map. This allows the policy to learn optimal flight paths that maximize the probability of finding the missing person quickly. Experimental results show that our method achieves a significant improvement in search times compared to traditional coverage planning and search planning algorithms by over 160%, a difference that can mean life or death in real-world search operations Additionally, unlike previous work, our approach incorporates a continuous action space enabled by cubature, allowing for more nuanced flight patterns
Predictive probability density mapping for search and rescue using an agent-based approach with sparse data
Predicting the location where a lost person could be found is crucial for search and rescue operations with limited resources. To improve the precision and efficiency of these predictions, simulated agents can be created to emulate the behavior of the lost person. Within this study, we introduce an innovative agent-based model designed to replicate diverse psychological profiles of lost persons, allowing these agents to navigate real-world landscapes while making decisions autonomously without the need for location-specific training. The probability distribution map depicting the potential location of the lost person emerges through a combination of Monte Carlo simulations and mobility-time-based sampling. Validation of the model is achieved using real-world Search and Rescue data to train a Gaussian Process model. This allows generalization of the data to sample initial starting points for the agents during validation. Comparative analysis with historical data showcases promising outcomes relative to alternative methods. This work introduces a flexible agent that can be employed in search and rescue operations, offering adaptability across various geographical locations
Optimal path planning using psychological profiling in drone-assisted missing person search
Search and rescue operations are all time-sensitive and this is especially true when searching for a vulnerable missing person, such as a child or elderly person suffering dementia. Recently, Police Scotland Air Support Unit has begun the deployment of drones to assist in missing person searches with success, although the efficacy of the search relies upon the expertise of the drone operator. In this paper, several algorithms for planning the search path are compared to determine which approach has the highest probability of finding the missing person in the shortest time. In addition to this, the use of á priori psychological profile information of the subject to create a probability map of likely locations within the search area was explored. This map is then used within a nonlinear optimization to determine the optimal flight path for a given search area and subject profile. Two optimization solvers were compared; genetic algorithms, and particle swarm optimization. Finally, the most effective algorithm was used to create a coverage path for a real-life location, for which Police Scotland Air Support Unit completed multiple test flights. The generated flight paths based on the predicted intent of the lost person were found to perform statistically better than those of the expert police operators
Autonomous mission planning for planetary surface exploration using a team of micro rovers
One of the fundamental limiting factors in planetary exploration is the level of autonomy achieved by planetary exploration rovers. This study proposes a novel methodology for the coordination of an autonomous multi-robot team that evaluates efficient exploration routes in Jezero crater, Mars. A map is generated consisting of a 3D terrain model, traversability analysis, and probability distribution map of points of scientific interest. A three-stage mission planner generates an efficient team-wide route, which maximises the accumulated probability of identifying points of interest. A 4D RRT* algorithm is used to determine smooth and flat paths for individual rovers, following the team-wide route planner, and prioritized planning is used to coordinate a safe set of individual paths. The above methodology is shown to coordinate safe and efficient rover paths, which ensure the rovers remain within their nominal pitch and roll limits throughout operation
Multiancestry analysis of the HLA locus in Alzheimer’s and Parkinson’s diseases uncovers a shared adaptive immune response mediated by HLA-DRB1*04 subtypes
Across multiancestry groups, we analyzed Human Leukocyte Antigen (HLA) associations in over 176,000 individuals with Parkinson’s disease (PD) and Alzheimer’s disease (AD) versus controls. We demonstrate that the two diseases share the same protective association at the HLA locus. HLA-specific fine-mapping showed that hierarchical protective effects of HLA-DRB1*04 subtypes best accounted for the association, strongest with HLA-DRB1*04:04 and HLA-DRB1*04:07, and intermediary with HLA-DRB1*04:01 and HLA-DRB1*04:03. The same signal was associated with decreased neurofibrillary tangles in postmortem brains and was associated with reduced tau levels in cerebrospinal fluid and to a lower extent with increased Aβ42. Protective HLA-DRB1*04 subtypes strongly bound the aggregation-prone tau PHF6 sequence, however only when acetylated at a lysine (K311), a common posttranslational modification central to tau aggregation. An HLA-DRB1*04-mediated adaptive immune response decreases PD and AD risks, potentially by acting against tau, offering the possibility of therapeutic avenues
Enhancing Reinforcement Learning in Sensor Fusion: A Comparative Analysis of Cubature and Sampling-based Integration Methods for Rover Search Planning
Inferior Frontal Sulcal Hyperintensities on Brain MRI Are Associated with Amyloid Positivity beyond Age—Results from the Multicentre Observational DELCODE Study
Inferior frontal sulcal hyperintensities (IFSHs) on fluid-attenuated inversion recovery (FLAIR) sequences have been proposed to be indicative of glymphatic dysfunction. Replication studies in large and diverse samples are nonetheless needed to confirm them as an imaging biomarker. We investigated whether IFSHs were tied to Alzheimer's disease (AD) pathology and cognitive performance. We used data from 361 participants along the AD continuum, who were enrolled in the multicentre DELCODE study. The IFSHs were rated visually based on FLAIR magnetic resonance imaging. We performed ordinal regression to examine the relationship between the IFSHs and cerebrospinal fluid-derived amyloid positivity and tau positivity (Aβ42/40 ratio ≤ 0.08; pTau181 ≥ 73.65 pg/mL) and linear regression to examine the relationship between cognitive performance (i.e., Mini-Mental State Examination and global cognitive and domain-specific performance) and the IFSHs. We controlled the models for age, sex, years of education, and history of hypertension. The IFSH scores were higher in those participants with amyloid positivity (OR: 1.95, 95% CI: 1.05-3.59) but not tau positivity (OR: 1.12, 95% CI: 0.57-2.18). The IFSH scores were higher in older participants (OR: 1.05, 95% CI: 1.00-1.10) and lower in males compared to females (OR: 0.44, 95% CI: 0.26-0.76). We did not find sufficient evidence linking the IFSH scores with cognitive performance after correcting for demographics and AD biomarker positivity. IFSHs may reflect the aberrant accumulation of amyloid β beyond age.</p
New insights into the genetic etiology of Alzheimer's disease and related dementias.
Characterization of the genetic landscape of Alzheimer's disease (AD) and related dementias (ADD) provides a unique opportunity for a better understanding of the associated pathophysiological processes. We performed a two-stage genome-wide association study totaling 111,326 clinically diagnosed/'proxy' AD cases and 677,663 controls. We found 75 risk loci, of which 42 were new at the time of analysis. Pathway enrichment analyses confirmed the involvement of amyloid/tau pathways and highlighted microglia implication. Gene prioritization in the new loci identified 31 genes that were suggestive of new genetically associated processes, including the tumor necrosis factor alpha pathway through the linear ubiquitin chain assembly complex. We also built a new genetic risk score associated with the risk of future AD/dementia or progression from mild cognitive impairment to AD/dementia. The improvement in prediction led to a 1.6- to 1.9-fold increase in AD risk from the lowest to the highest decile, in addition to effects of age and the APOE ε4 allele
