3,844 research outputs found

    Mobile Device Background Sensors: Authentication vs Privacy

    Get PDF
    The increasing number of mobile devices in recent years has caused the collection of a large amount of personal information that needs to be protected. To this aim, behavioural biometrics has become very popular. But, what is the discriminative power of mobile behavioural biometrics in real scenarios? With the success of Deep Learning (DL), architectures based on Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs), such as Long Short-Term Memory (LSTM), have shown improvements compared to traditional machine learning methods. However, these DL architectures still have limitations that need to be addressed. In response, new DL architectures like Transformers have emerged. The question is, can these new Transformers outperform previous biometric approaches? To answers to these questions, this thesis focuses on behavioural biometric authentication with data acquired from mobile background sensors (i.e., accelerometers and gyroscopes). In addition, to the best of our knowledge, this is the first thesis that explores and proposes novel behavioural biometric systems based on Transformers, achieving state-of-the-art results in gait, swipe, and keystroke biometrics. The adoption of biometrics requires a balance between security and privacy. Biometric modalities provide a unique and inherently personal approach for authentication. Nevertheless, biometrics also give rise to concerns regarding the invasion of personal privacy. According to the General Data Protection Regulation (GDPR) introduced by the European Union, personal data such as biometric data are sensitive and must be used and protected properly. This thesis analyses the impact of sensitive data in the performance of biometric systems and proposes a novel unsupervised privacy-preserving approach. The research conducted in this thesis makes significant contributions, including: i) a comprehensive review of the privacy vulnerabilities of mobile device sensors, covering metrics for quantifying privacy in relation to sensitive data, along with protection methods for safeguarding sensitive information; ii) an analysis of authentication systems for behavioural biometrics on mobile devices (i.e., gait, swipe, and keystroke), being the first thesis that explores the potential of Transformers for behavioural biometrics, introducing novel architectures that outperform the state of the art; and iii) a novel privacy-preserving approach for mobile biometric gait verification using unsupervised learning techniques, ensuring the protection of sensitive data during the verification process

    Predicting Alder shrub expansion in Sub-Arctic Alaska using machine learning, satellite data, and environmental variables

    Get PDF
    The wider Fairbanks area, a sub-Arctic region of Alaska, USA, is home to a variety of alpine, oroarctic tundra that is being impacted by climate warming. This has resulted in an infilling and expansion of shrubs across the tundra and an elevational increase in the range limits of tall shrubs. Expansion of Alder (a key pioneer tall shrub) is thought to result from Arctic warming and shifts in its spread are likely to be a result of such warming. Alder can fix atmospheric nitrogen by virtue of a mutualistic association with soil bacteria, which subsequently becomes available to other shrubs, potentially relieving local soil nitrogen limitations and promoting a positive growth response to climate warming. This potential landscape-scale change requires information of change at a suitable scale. However, Alder and other tall shrubs have been hard to measure using existing remote sensing approaches alone. This is mainly due to issues surrounding data availability and suitable spatial resolution of imagery. Satellite remote sensing and environmental data are combined to create a map of Alder expansion across the wider Fairbanks area. A methodology is presented where ecological variables are integrated into prediction maps using a combination of regression and machine learning to estimate spatial extents. A baseline for a minimum number of high resolution training polygons is found to understand minimum required inputs. Field-based validation data were collected using a random sampling design across four different locations within the Yukon-Koyukuk area, Alaska. The combination of satellite data and environmental variables yields the best results for predicting Alder locations across the study area with a model accuracy of 0.99 and User’s accuracy of 43.66%. Orthomosaics as validation data are found to be very useful, enabling better quantification of smaller plant functional types for more accurate error matrix class assignment increasing overall model accuracy

    Self-supervised learning for transferable representations

    Get PDF
    Machine learning has undeniably achieved remarkable advances thanks to large labelled datasets and supervised learning. However, this progress is constrained by the labour-intensive annotation process. It is not feasible to generate extensive labelled datasets for every problem we aim to address. Consequently, there has been a notable shift in recent times toward approaches that solely leverage raw data. Among these, self-supervised learning has emerged as a particularly powerful approach, offering scalability to massive datasets and showcasing considerable potential for effective knowledge transfer. This thesis investigates self-supervised representation learning with a strong focus on computer vision applications. We provide a comprehensive survey of self-supervised methods across various modalities, introducing a taxonomy that categorises them into four distinct families while also highlighting practical considerations for real-world implementation. Our focus thenceforth is on the computer vision modality, where we perform a comprehensive benchmark evaluation of state-of-the-art self supervised models against many diverse downstream transfer tasks. Our findings reveal that self-supervised models often outperform supervised learning across a spectrum of tasks, albeit with correlations weakening as tasks transition beyond classification, particularly for datasets with distribution shifts. Digging deeper, we investigate the influence of data augmentation on the transferability of contrastive learners, uncovering a trade-off between spatial and appearance-based invariances that generalise to real-world transformations. This begins to explain the differing empirical performances achieved by self-supervised learners on different downstream tasks, and it showcases the advantages of specialised representations produced with tailored augmentation. Finally, we introduce a novel self-supervised pre-training algorithm for object detection, aligning pre-training with downstream architecture and objectives, leading to reduced localisation errors and improved label efficiency. In conclusion, this thesis contributes a comprehensive understanding of self-supervised representation learning and its role in enabling effective transfer across computer vision tasks

    Data-assisted modeling of complex chemical and biological systems

    Get PDF
    Complex systems are abundant in chemistry and biology; they can be multiscale, possibly high-dimensional or stochastic, with nonlinear dynamics and interacting components. It is often nontrivial (and sometimes impossible), to determine and study the macroscopic quantities of interest and the equations they obey. One can only (judiciously or randomly) probe the system, gather observations and study trends. In this thesis, Machine Learning is used as a complement to traditional modeling and numerical methods to enable data-assisted (or data-driven) dynamical systems. As case studies, three complex systems are sourced from diverse fields: The first one is a high-dimensional computational neuroscience model of the Suprachiasmatic Nucleus of the human brain, where bifurcation analysis is performed by simply probing the system. Then, manifold learning is employed to discover a latent space of neuronal heterogeneity. Second, Machine Learning surrogate models are used to optimize dynamically operated catalytic reactors. An algorithmic pipeline is presented through which it is possible to program catalysts with active learning. Third, Machine Learning is employed to extract laws of Partial Differential Equations describing bacterial Chemotaxis. It is demonstrated how Machine Learning manages to capture the rules of bacterial motility in the macroscopic level, starting from diverse data sources (including real-world experimental data). More importantly, a framework is constructed though which already existing, partial knowledge of the system can be exploited. These applications showcase how Machine Learning can be used synergistically with traditional simulations in different scenarios: (i) Equations are available but the overall system is so high-dimensional that efficiency and explainability suffer, (ii) Equations are available but lead to highly nonlinear black-box responses, (iii) Only data are available (of varying source and quality) and equations need to be discovered. For such data-assisted dynamical systems, we can perform fundamental tasks, such as integration, steady-state location, continuation and optimization. This work aims to unify traditional scientific computing and Machine Learning, in an efficient, data-economical, generalizable way, where both the physical system and the algorithm matter

    Proceedings of SIRM 2023 - The 15th European Conference on Rotordynamics

    Get PDF
    It was our great honor and pleasure to host the SIRM Conference after 2003 and 2011 for the third time in Darmstadt. Rotordynamics covers a huge variety of different applications and challenges which are all in the scope of this conference. The conference was opened with a keynote lecture given by Rainer Nordmann, one of the three founders of SIRM “Schwingungen in rotierenden Maschinen”. In total 53 papers passed our strict review process and were presented. This impressively shows that rotordynamics is relevant as ever. These contributions cover a very wide spectrum of session topics: fluid bearings and seals; air foil bearings; magnetic bearings; rotor blade interaction; rotor fluid interactions; unbalance and balancing; vibrations in turbomachines; vibration control; instability; electrical machines; monitoring, identification and diagnosis; advanced numerical tools and nonlinearities as well as general rotordynamics. The international character of the conference has been significantly enhanced by the Scientific Board since the 14th SIRM resulting on one hand in an expanded Scientific Committee which meanwhile consists of 31 members from 13 different European countries and on the other hand in the new name “European Conference on Rotordynamics”. This new international profile has also been emphasized by participants of the 15th SIRM coming from 17 different countries out of three continents. We experienced a vital discussion and dialogue between industry and academia at the conference where roughly one third of the papers were presented by industry and two thirds by academia being an excellent basis to follow a bidirectional transfer what we call xchange at Technical University of Darmstadt. At this point we also want to give our special thanks to the eleven industry sponsors for their great support of the conference. On behalf of the Darmstadt Local Committee I welcome you to read the papers of the 15th SIRM giving you further insight into the topics and presentations

    Efficient Sensor Placement from Regression with Sparse Gaussian Processes in Continuous and Discrete Spaces

    Full text link
    We present a novel approach based on sparse Gaussian processes (SGPs) to address the sensor placement problem for monitoring spatially (or spatiotemporally) correlated phenomena such as temperature and precipitation. Existing Gaussian process (GP) based sensor placement approaches use GPs with known kernel function parameters to model a phenomenon and subsequently optimize the sensor locations in a discretized representation of the environment. In our approach, we fit an SGP with known kernel function parameters to randomly sampled unlabeled locations in the environment and show that the learned inducing points of the SGP inherently solve the sensor placement problem in continuous spaces. Using SGPs avoids discretizing the environment and reduces the computation cost from cubic to linear complexity. When restricted to a candidate set of sensor placement locations, we can use greedy sequential selection algorithms on the SGP's optimization bound to find good solutions. We also present an approach to efficiently map our continuous space solutions to discrete solution spaces using the assignment problem, which gives us discrete sensor placements optimized in unison. Moreover, we generalize our approach to model sensors with non-point field-of-view and integrated observations by leveraging the inherent properties of GPs and SGPs. Our experimental results on three real-world datasets show that our approaches generate solution placements that result in reconstruction quality that is consistently on par or better than the prior state-of-the-art approach while being significantly faster. Our computationally efficient approaches will enable both large-scale sensor placement, and fast sensor placement for informative path planning problems.Comment: 11 pages, 4 figures, preprint, supplementar

    Multi-Level Data-Driven Battery Management: From Internal Sensing to Big Data Utilization

    Get PDF
    Battery management system (BMS) is essential for the safety and longevity of lithium-ion battery (LIB) utilization. With the rapid development of new sensing techniques, artificial intelligence and the availability of huge amounts of battery operational data, data-driven battery management has attracted ever-widening attention as a promising solution. This review article overviews the recent progress and future trend of data-driven battery management from a multi-level perspective. The widely-explored data-driven methods relying on routine measurements of current, voltage, and surface temperature are reviewed first. Within a deeper understanding and at the microscopic level, emerging management strategies with multi-dimensional battery data assisted by new sensing techniques have been reviewed. Enabled by the fast growth of big data technologies and platforms, the efficient use of battery big data for enhanced battery management is further overviewed. This belongs to the upper and the macroscopic level of the data-driven BMS framework. With this endeavor, we aim to motivate new insights into the future development of next-generation data-driven battery management

    Integrating Experimental and Computational Approaches to Optimize 3D Bioprinting of Cancer Cells

    Get PDF
    A key feature distinguishing 3D bioprinting from other 3D cell culture techniques is its precise control over created structures. This property allows for the high-resolution fabrication of biomimetic structures with controlled structural and mechanical properties such as porosity, permeability, and stiffness. However, for bioprinting to be successful, a comprehensive understanding of cell behavior is essential, yet challenging. This includes the survivability of cells throughout the printing process, their interactions with the printed structures, and their responses to environmental cues after printing. There are numerous variables in bioprinting which influence the cell behavior, so bioprinting quality during and after the procedure. Thus, to achieve desirable results, it is necessary to consider and optimize these influential variables. So far, these optimizations have been accomplished primarily through trial and error and replicating several experiments, a procedure that is not only time-consuming but also costly. This issue motivated the development of computational techniques in the bioprinting process to more precisely predict and elucidate cells’ function within 3D printed structures during and after printing. During printing, we developed predictive machine learning models to determine the effect of different variables such as cell type, bioink formulation, printing settings parameters, and crosslinking condition on cell viability in extrusion-based bioprinting. To do this, we first created a dataset of these parameters for gelatin and alginate-based bioinks and the corresponding cell viability by integrating data obtained in our laboratory and those derived from the literature. Then, we developed regression and classification neural networks to predict cell viability based on these bioprinting variables. Compared to models that have been developed so far, the performance of our models was superior and showed great prediction results. The study further demonstrated that among the variables investigated in bioprinting, cell type, printing pressure, and crosslinker concentration, respectively, had the most significant impact on the survival of cells. Additionally, we introduced a new optimization strategy that employs the Bayesian optimization model based on the developed regression neural network to determine the optimal combination of the selected bioprinting parameters for maximizing cell viability and eliminating trial-and-error experiments. In our study, this strategy enabled us to identify the optimal crosslinking parameters, within a specified range, including those not previously explored, resulting in optimum cell viability. Finally, we experimentally validated the optimization model's performance. After printing, we developed a cellular automata model for the first time to predict and elucidate the post-printing cell behavior within the 3D bioprinted construct. To improve our model, we bioprinted a 3D construct using cell-laden hydrogel and evaluated cellular functions, including viability and proliferation, in 11 days. The results showed that our model successfully simulated the 3D bioprinted structure and captured in-vitro observations. The proposed model is beneficial for demonstrating complex cellular systems, including cellular proliferation, movement, cell interactions with the environment (e.g., extracellular microenvironment and neighboring cells), and cell aggregation within the scaffold. We also demonstrated that this computational model could predict post-printing biological functions for different initial cell numbers in bioink and different bioink formulations with gelatin and alginate without replicating several in-vitro measurements. Taken all together, this thesis introduces novel bioprinting process design strategies by presenting mathematical and computational frameworks for both during and after bioprinting. We believe such frameworks will substantially impact 3D bioprinting's future application and inspire researchers to further realize how computational methods might be utilized to advance in-vitro 3D bioprinting research
    • 

    corecore