48 research outputs found

    Perception and Prediction in Multi-Agent Urban Traffic Scenarios for Autonomous Driving

    Get PDF
    In multi-agent urban scenarios, autonomous vehicles navigate an intricate network of interactions with a variety of agents, necessitating advanced perception modeling and trajectory prediction. Research to improve perception modeling and trajectory prediction in autonomous vehicles is fundamental to enhance safety and efficiency in complex driving scenarios. Better data association for 3D multi-object tracking ensures consistent identification and tracking of multiple objects over time, crucial in crowded urban environments to avoid mis-identifications that can lead to unsafe maneuvers or collisions. Effective context modeling for 3D object detection aids in interpreting complex scenes, effectively dealing with challenges like noisy or missing points in sensor data, and occlusions. It enables the system to infer properties of partially observed or obscured objects, enhancing the robustness of the autonomous system in varying conditions. Furthermore, improved trajectory prediction of surrounding vehicles allows an autonomous vehicle to anticipate future actions of other road agents and adapt accordingly, crucial in scenarios like merging lanes, making unprotected turns, or navigating intersections. In essence, these research directions are key to mitigating risks in autonomous driving, and facilitating seamless interaction with other road users. In Part I, we address the task of improving perception modeling for AV systems. Concretely our contributions are: (i) FANTrack introduces a novel application of Convolutional Neural Networks (CNNs) for real-time 3D Multi-object Tracking (MOT) in autonomous driving, addressing challenges such as varying number of targets, track fragmentation, and noisy detections, thereby enhancing the accuracy of perception capabilities for safe and efficient navigation. (ii) FANTrack proposes to leverage both visual and 3D bounding box data, utilizing Siamese networks and hard-mining, to enhance the similarity functions used in data associations for 3D Multi-object Tracking (MOT). (iii) SA-Det3D introduces a globally-adaptive Full Self-Attention (FSA) module for enhanced feature extraction in 3D object detection, overcoming the limitations of traditional convolution-based techniques by facilitating adaptive context aggregation from entire point-cloud data, thereby bolstering perception modeling in autonomous driving. (iv) SA-Det3D also introduces the Deformable Self-Attention (DSA) module, a scalable adaptation for global context assimilation in large-scale point-cloud datasets, designed to select and focus on most informative regions, thereby improving the quality of feature descriptors and perception modeling in autonomous driving. In Part II, we focus on the task of improving trajectory prediction of surrounding agents. Concretely, our contributions are: (i) SSL-Lanes introduces a self-supervised learning approach for motion forecasting in autonomous driving that enhances accuracy and generalizability without compromising inference speed or model simplicity, utilizing pseudo-labels from pretext tasks for learning transferable motion patterns. (ii) The second contribution in SSL-Lanes is the design of comprehensive experiments to demonstrate that SSL-Lanes can yield more generalizable and robust trajectory predictions than traditional supervised learning approaches. (iii) SSL-Interactions presents a new framework that utilizes pretext tasks to enhance interaction modeling for trajectory prediction in autonomous driving. (iv) SSL-Interactions advances the prediction of agent trajectories in interaction-centric scenarios by creating a curated dataset that explicitly labels meaningful interactions, thus enabling the effective training of a predictor utilizing pretext tasks and enhancing the modeling of agent-agent interactions in autonomous driving environments

    High throughput surface mass spectrometry-based proteomics & metabolomics for biological applications

    Get PDF
    Surface-based mass spectrometry analysis benefits from the minimum sample preparation required and high throughput nature of the analysis (few minutes per sample) and shows therefore potential for tackling current issues in the field of proteomics and metabolomics. This thesis aims to develop a robust high throughput methodology for the quantitative analysis of surface-adsorbed proteins and for untargeted metabolomics One of the current problems in the field of biomaterials research is the limited understanding of the mechanistic behind cell attachment and behaviour on polymeric substrates. Fully synthetic substrates have been identified which support growth and survival of human pluripotent stem cells. Pluripotent stem cells are a valuable cell type for regenerative medicine due to their ability to differentiate into the three germ layers. To treat a single patient, more than a billion stem cells are required. Current cell systems use biological feeder layers for stem cell expansion. However, these animal-derived matrices are expensive, undefined, and show high batch-to-batch variation. In order to move towards reproducible, industrial culturing of stem cells a suitable growth substrate needs to be defined. Through high throughput biomaterials discovery, it was shown that some fully synthetic polymers can maintain stem cell cultures to a similar level as biological substrates. Current understanding of the response of cells on those synthetic polymers is relatively poor. Research has shown that coating of synthetic polymers with culture medium-derived proteins increase the cell attachment which is required for cell survival. This shows the potential role of culture medium proteins in the response mechanism of cells on synthetic polymers. However, current technology does not allow analysis of (combinatorial) polymer libraries which has limited the understanding of relation between cell response and physicochemical properties and molecular features of the polymers. A full understanding of the cell-polymer response mechanism would allow the development and rationalisation of synthetic polymers for culturing of pluripotent stem cells. It was shown that liquid extraction surface analysis-tandem mass spectrometry (LESA-MS/MS) is a suitable analytical technique for the analysis of in situ digested proteins. LESA is a commercial system which can automatically extract analytes from a given substrate and directly introduce the sample in to the MS. Here, this potential was further explored for polymer array screening as well as polymers taken forward for scale-up experiments. A suitable substrate was chosen (Droplet Microarray) which allowed control over the spreading of the monomer solutions, digestion solution, and organic extraction solvent for reproducible MS results. With carefully optimised LESA and MS parameters, difference in protein adsorption could be detected between different chemical surfaces. These difference in protein adsorption did not show a good correlation with the observed cell response (attachment and number of pluripotent stem cells). Through multivariate modelling was found that surface chemistry was found to play a role in protein adsorption. Whilst array screening did not reveal solid evidence of the importance of protein adsorption in relation to cellular response, experiments of protein adsorption on a larger surface area (6-well plates) revealed higher protein adsorption on polymers with higher numbers of pluripotent stem cells. Altogether, LESA-MS/MS shows to be an interesting tool to quantitatively assess protein adsorption on synthetic polymers. The developed methodology can not only be further used to study more complex growth media for human cell lines, but also extended study the relation between protein adsorption and response of different organisms. The addition of LESA-MS/MS to high throughput screening of material microarrays might reveal vital information and could assist in proper choice of polymers for biomedical purposes. Further interest of surface analysis comes from the field of oncometabolomics. In this thesis, paediatric ependymoma were analysed by Orbitrap secondary ion mass spectrometry (3D OrbiSIMS) and LESA-MS/MS. The main challenge here was to acquire data using only minimal tumour tissue which was available in the form of a tumour tissue microarray. By analysing the same tumour tissue with two complementary mass spectrometry techniques, a more complete metabolite profile could be obtained. Moreover, the combination of 3D OrbiSIMS and LESA-MS/MS data followed by partial-least squares discriminant analysis (PLS-DA) permitted the classification of tumour tissue based on eventual recurrence. This means that certain metabolite levels are indicative of tumour relapse. Understanding these changes in metabolite abundance along with the changes in corresponding metabolic pathways could open new insight into ependymoma relapse. Further, this analytical strategy would be suitable to study other types of (tumour) tissues

    High throughput surface mass spectrometry-based proteomics & metabolomics for biological applications

    Get PDF
    Surface-based mass spectrometry analysis benefits from the minimum sample preparation required and high throughput nature of the analysis (few minutes per sample) and shows therefore potential for tackling current issues in the field of proteomics and metabolomics. This thesis aims to develop a robust high throughput methodology for the quantitative analysis of surface-adsorbed proteins and for untargeted metabolomics One of the current problems in the field of biomaterials research is the limited understanding of the mechanistic behind cell attachment and behaviour on polymeric substrates. Fully synthetic substrates have been identified which support growth and survival of human pluripotent stem cells. Pluripotent stem cells are a valuable cell type for regenerative medicine due to their ability to differentiate into the three germ layers. To treat a single patient, more than a billion stem cells are required. Current cell systems use biological feeder layers for stem cell expansion. However, these animal-derived matrices are expensive, undefined, and show high batch-to-batch variation. In order to move towards reproducible, industrial culturing of stem cells a suitable growth substrate needs to be defined. Through high throughput biomaterials discovery, it was shown that some fully synthetic polymers can maintain stem cell cultures to a similar level as biological substrates. Current understanding of the response of cells on those synthetic polymers is relatively poor. Research has shown that coating of synthetic polymers with culture medium-derived proteins increase the cell attachment which is required for cell survival. This shows the potential role of culture medium proteins in the response mechanism of cells on synthetic polymers. However, current technology does not allow analysis of (combinatorial) polymer libraries which has limited the understanding of relation between cell response and physicochemical properties and molecular features of the polymers. A full understanding of the cell-polymer response mechanism would allow the development and rationalisation of synthetic polymers for culturing of pluripotent stem cells. It was shown that liquid extraction surface analysis-tandem mass spectrometry (LESA-MS/MS) is a suitable analytical technique for the analysis of in situ digested proteins. LESA is a commercial system which can automatically extract analytes from a given substrate and directly introduce the sample in to the MS. Here, this potential was further explored for polymer array screening as well as polymers taken forward for scale-up experiments. A suitable substrate was chosen (Droplet Microarray) which allowed control over the spreading of the monomer solutions, digestion solution, and organic extraction solvent for reproducible MS results. With carefully optimised LESA and MS parameters, difference in protein adsorption could be detected between different chemical surfaces. These difference in protein adsorption did not show a good correlation with the observed cell response (attachment and number of pluripotent stem cells). Through multivariate modelling was found that surface chemistry was found to play a role in protein adsorption. Whilst array screening did not reveal solid evidence of the importance of protein adsorption in relation to cellular response, experiments of protein adsorption on a larger surface area (6-well plates) revealed higher protein adsorption on polymers with higher numbers of pluripotent stem cells. Altogether, LESA-MS/MS shows to be an interesting tool to quantitatively assess protein adsorption on synthetic polymers. The developed methodology can not only be further used to study more complex growth media for human cell lines, but also extended study the relation between protein adsorption and response of different organisms. The addition of LESA-MS/MS to high throughput screening of material microarrays might reveal vital information and could assist in proper choice of polymers for biomedical purposes. Further interest of surface analysis comes from the field of oncometabolomics. In this thesis, paediatric ependymoma were analysed by Orbitrap secondary ion mass spectrometry (3D OrbiSIMS) and LESA-MS/MS. The main challenge here was to acquire data using only minimal tumour tissue which was available in the form of a tumour tissue microarray. By analysing the same tumour tissue with two complementary mass spectrometry techniques, a more complete metabolite profile could be obtained. Moreover, the combination of 3D OrbiSIMS and LESA-MS/MS data followed by partial-least squares discriminant analysis (PLS-DA) permitted the classification of tumour tissue based on eventual recurrence. This means that certain metabolite levels are indicative of tumour relapse. Understanding these changes in metabolite abundance along with the changes in corresponding metabolic pathways could open new insight into ependymoma relapse. Further, this analytical strategy would be suitable to study other types of (tumour) tissues

    Enhancing Federated Learning Robustness and Fairness in Non-IID Scenarios

    Get PDF
    Federated Learning is a distributed machine learning paradigm that allows multiple clients to collaboratively train a joint model without sharing the raw data. Despite its advantages, FL faces the security issues inherent to its decentralized nature, and FL clients often encounter unfair treatment from the design that prioritizes server interests. Today, many studies have been proposed to mitigate the research gap; nevertheless, in the absence of a non-IID setting, ensuring robustness and fairness in FL remains an open problem. Therefore, in this thesis, we study several topics on the robustness and fairness of FL in non-IID scenarios, including attack surface reduction, poisoning attack defense, and implicit class-level fair enhancement. We start by investigating FL's non-IID resource and propose the Mini FL framework. Based on a predefined grouping principle, Mini FL assigns similar clients to different groups and aggregates them respectively to achieve attack surface reduction. Then, we focus on defending against FL poisoning attacks. For the Label Flipping Attack, we introduce the HSCS FL method. It evaluates the accuracy of each class in both global and local models in each iteration. These accuracies are then translated into a score, and only clients with top scores are included in the current aggregation. For the Class Imbalance Attack, we introduce the Class-Balanced FL framework. This approach dynamically determines the aggregation weight for each client, considering their potential contribution to the current global model, thereby preventing the joint model biases toward specific data distributions. Lastly, we propose the ICB FL method to enhance FL fairness. This framework enables the server to identify implicit classes and dynamically distribute weights, ensuring a similar learning performance across these implicit classes. We provide mathematical proofs for each scheme and framework we proposed and conduct experiments to show their effectiveness

    Homeobox genes in the development and regeneration of the cephalochordate Branchiostoma lanceolatum and the polychaete annelid Spirobranchus lamarcki

    Get PDF
    The development of complex animal morphology requires the extremely sophisticated spatiotemporal coordination of cell behaviour and communication. Homeobox genes encode transcription factors that are deployed in developmental processes to control the expression of other genes in particular locations and contexts. Many homeobox genes are highly conserved and act in similar roles between distantly-related animals that derive from the roles of their ancestral orthologues. The way that these genes have differentially evolved between taxa, and the effect that these changes have on the development and morphology of animals, is critical to our understanding of metazoan evolution. One particular developmental context, the regeneration of missing tissue, offers a unique perspective on evolutionary developmental biology because of its relationship to ontogenic development and its surprising diversity of retention and process between animal taxa. I examined the homeobox gene content of transcriptomes taken from the mature and regenerating tissue of the post-anal tail of Branchiostoma lanceolatum, a well-studied cephalochordate with a highly conserved genome, and the evolutionarily novel operculum of Spirobranchus lamarcki, a sedentarian annelid. In S. lamarcki regeneration, a diverse variety of homeobox genes is expressed, and the regenerative expression response is substantial. The discovery of several difficult-to-classify homeobox genes lead to the substantial expansion and improvement of the classification of a variety of homeobox genes undergoing unusual rapid and expansive evolution in the Spiralia, including dozens of TALE and PRD class genes, a new orthology group, and a strange S. lamarcki Hox gene. In B. lanceolatum, a similar diversity of expressed genes is observed but a milder regenerative response. One transcriptomic sequence in particular, identified as Pax3/7, led to the discovery that this well-studied gene has a previously unnoticed duplication in cephalochordates. This discovery has implications for ongoing study of vertebrate and cephalochordate neural plate border evolution
    corecore