1,594 research outputs found

    Modular lifelong machine learning

    Get PDF
    Deep learning has drastically improved the state-of-the-art in many important fields, including computer vision and natural language processing (LeCun et al., 2015). However, it is expensive to train a deep neural network on a machine learning problem. The overall training cost further increases when one wants to solve additional problems. Lifelong machine learning (LML) develops algorithms that aim to efficiently learn to solve a sequence of problems, which become available one at a time. New problems are solved with less resources by transferring previously learned knowledge. At the same time, an LML algorithm needs to retain good performance on all encountered problems, thus avoiding catastrophic forgetting. Current approaches do not possess all the desired properties of an LML algorithm. First, they primarily focus on preventing catastrophic forgetting (Diaz-Rodriguez et al., 2018; Delange et al., 2021). As a result, they neglect some knowledge transfer properties. Furthermore, they assume that all problems in a sequence share the same input space. Finally, scaling these methods to a large sequence of problems remains a challenge. Modular approaches to deep learning decompose a deep neural network into sub-networks, referred to as modules. Each module can then be trained to perform an atomic transformation, specialised in processing a distinct subset of inputs. This modular approach to storing knowledge makes it easy to only reuse the subset of modules which are useful for the task at hand. This thesis introduces a line of research which demonstrates the merits of a modular approach to lifelong machine learning, and its ability to address the aforementioned shortcomings of other methods. Compared to previous work, we show that a modular approach can be used to achieve more LML properties than previously demonstrated. Furthermore, we develop tools which allow modular LML algorithms to scale in order to retain said properties on longer sequences of problems. First, we introduce HOUDINI, a neurosymbolic framework for modular LML. HOUDINI represents modular deep neural networks as functional programs and accumulates a library of pre-trained modules over a sequence of problems. Given a new problem, we use program synthesis to select a suitable neural architecture, as well as a high-performing combination of pre-trained and new modules. We show that our approach has most of the properties desired from an LML algorithm. Notably, it can perform forward transfer, avoid negative transfer and prevent catastrophic forgetting, even across problems with disparate input domains and problems which require different neural architectures. Second, we produce a modular LML algorithm which retains the properties of HOUDINI but can also scale to longer sequences of problems. To this end, we fix the choice of a neural architecture and introduce a probabilistic search framework, PICLE, for searching through different module combinations. To apply PICLE, we introduce two probabilistic models over neural modules which allows us to efficiently identify promising module combinations. Third, we phrase the search over module combinations in modular LML as black-box optimisation, which allows one to make use of methods from the setting of hyperparameter optimisation (HPO). We then develop a new HPO method which marries a multi-fidelity approach with model-based optimisation. We demonstrate that this leads to improvement in anytime performance in the HPO setting and discuss how this can in turn be used to augment modular LML methods. Overall, this thesis identifies a number of important LML properties, which have not all been attained in past methods, and presents an LML algorithm which can achieve all of them, apart from backward transfer

    Visual Cortical Traveling Waves: From Spontaneous Spiking Populations to Stimulus-Evoked Models of Short-Term Prediction

    Get PDF
    Thanks to recent advances in neurotechnology, waves of activity sweeping across entire cortical regions are now routinely observed. Moreover, these waves have been found to impact neural responses as well as perception, and the responses themselves are found to be structured as traveling waves. How exactly do these waves arise? Do they confer any computational advantages? These traveling waves represent an opportunity for an expanded theory of neural computation, in which their dynamic local network activity may complement the moment-to-moment variability of our sensory experience. This thesis aims to help uncover the origin and role of traveling waves in the visual cortex through three Works. In Work 1, by simulating a network of conductance-based spiking neurons with realistically large network size and synaptic density, distance-dependent horizontal axonal time delays were found to be important for the widespread emergence of spontaneous traveling waves consistent with those in vivo. Furthermore, these waves were found to be a dynamic mechanism of gain modulation that may explain the in-vivo result of their modulation of perception. In Work 2, the Kuramoto oscillator model was formulated in the complex domain to study a network possessing distance-dependent time delays. Like in Work 1, these delays produced traveling waves, and the eigenspectrum of the complex-valued delayed matrix, containing a delay operator, provided an analytical explanation of them. In Work 3, the model from Work 2 was adapted into a recurrent neural network for the task of forecasting the frames of videos, with the question of how such a biologically constrained model may be useful in visual computation. We found that the wave activity emergent in this network was helpful, as they were tightly linked with high forecast performance, and shuffle controls revealed simultaneous abolishment of both the waves and performance. All together, these works shed light on the possible origins and uses of traveling waves in the visual cortex. In particular, time delays profoundly shape the spatiotemporal dynamics into traveling waves. This was confirmed numerically (Work 1) and analytically (Work 2). In Work 3, these waves were found to aid in the dynamic computation of visual forecasting

    Enforcing C++ type integrity with fast dynamic casting, member function protections and an exploration of C++ beneath the surface

    Get PDF
    The C++ type system provides a programmer with modular class features and inheritance capabilities. Upholding the integrity of all class types, known as type-safety, is paramount in preventing type vulnerabilities and exploitation. However, type confusion vulnerabilities are all too common in C++ programs. The lack of low-level type-awareness creates an environment where advanced exploits, like counterfeit object-orientated programming (COOP), can flourish. Although type confusion and COOP exist in different research fields, they both take advantage of inadequate enforcement of type-safety. Most type confusion defence research has focused on type inclusion testing, with varying degrees of coverage and performance overheads. COOP defences, on the other hand, have predominantly featured control flow integrity (CFI) defence measures, which until very recently, were thought to be sound. We investigate both of these topics and challenge prevailing wisdom, arguing that: 1. optimised dynamic casting is better suited to preventing type confusion and 2. enforcing type integrity may be the only defence against COOP. Type confusion vulnerabilities are often the result of substituting dynamic casting with an inappropriate static casting method. Dynamic casting is often avoided due to memory consumption and run-time overheads, with some developers turning off run-time type information (RTTI) altogether. However, without RTTI, developers lose not only secure casting but virtual inheritance as well. We argue that improving the performance of dynamic casting can make it a viable option for preventing type confusion vulnerabilities. In this thesis, we present MemCast, a memoising wrapper for the dynamic cast operator that increases its speed to that of a dynamic dispatch. A new variant of the COOP exploit (COOPLUS) has identified a weakness in almost all modern, C++-semantic-aware CFI defences. The weakness is that they allow derived class functions to be invoked using corrupted base class instances, specifically where an attacker replaces the object's virtual pointer with one from a derived type object. A CFI defence overestimates the set of target functions at a dispatch site to cover all possible control-flow paths of a polymorphic object. Thus COOPLUS takes advantage of the lack of type integrity between related types at dispatch sites. In this thesis, we argue that CFI is an unsuitable defence against COOPLUS, and type integrity must be applied. Hence we propose a type integrity defence called Member Function Integrity (MFI) that brings type awareness to member functions and prevents any member function from operating on an invalid object type. To understand the low-level techniques deployed in MemCast and our MFI defence policy, one has to appreciate the memory layout of the objects themselves and the conventions used by member functions that operate on them. However, in our research, we did not find adequate introductory literature specific to modern compilers. For this reason, we supplied our own self-contained introduction to low-level object-orientation. This thesis has three contributions: a primer on C++ object layouts, an optimised dynamic casting technique that reduces the casting cost to that of a dynamic dispatch, and a new defence policy proposal (MFI) to mitigate all known COOP exploits

    Borealis: An Advanced Digital Hardware and Software Design for SuperDARN Radar Systems

    Get PDF
    The Borealis radar system is a hardware and software upgrade to the conventional Super Dual Auroral Radar Network radar system, which has been used since the early 1990s. The conventional system has hardware and software that is aging, and many components are no longer supported. Limitations of the conventional system limit radar and data techniques for scientific discovery. Using software defined radios, Borealis has improved the flexibility, capabilities, and security of the radar system. Borealis has improved system monitoring and diagnostics and enables more complex experiments. Borealis provides improvements in spatial and temporal resolution. The system can perform full field-of-view imaging, pulse phase encoding and simultaneous multi-frequency operations. With Borealis, data quality and system reliability has been improved. New radar and signal processing techniques are in development to further improve the capabilities of the system and of the data quality

    Single-Frequency Network Terrestrial Broadcasting with 5GNR Numerology

    Get PDF
    L'abstract è presente nell'allegato / the abstract is in the attachmen

    Electronic Devices for the Combination of Electrically Controlled Drug Release, Electrostimulation, and Optogenetic Stimulation for Nerve Tissue Regeneration

    Full text link
    [ES] La capacidad de las células madre para proliferar formando distintas células especializadas les otorga la potencialidad de servir de base para terapias efectivas para patologías cuyo tratamiento era inimaginable hasta hace apenas dos décadas. Sin embargo, esta capacidad se encuentra mediada por estímulos fisiológicos, químicos, y eléctricos, específicos y complejos, que dificultan su traslación a la rutina clínica. Por ello, las células madre representan un campo de estudio en el que se invierten amplios esfuerzos por parte de la comunidad científica. En el ámbito de la regeneración nerviosa, para modular su desarrollo y diferenciación el tratamiento farmacológico, la electroestimulación, y la estimulación optogenética son técnicas que están consiguiendo prometedores resultados. Es por ello por lo que en la presente tesis se ha desarrollado un conjunto de sistemas electrónicos para permitir la aplicación combinada de estas técnicas in vitro, con perspectiva a su aplicación in vivo. Hemos diseñado una novedosa tecnología para la liberación eléctricamente controlada de fármacos. Esta tecnología está basada en nanopartículas de sílice mesoporosa y puertas moleculares de bipiridina-heparina. Las puertas moleculares son electroquímicamente reactivas, y encierran los fármacos en el interior de las nanopartículas, liberándolos ante un estímulo eléctrico. Hemos caracterizado esta tecnología, y la hemos validado mediante la liberación controlada de rodamina en cultivos celulares de HeLa. Para la combinación de liberación controlada de fármacos y electroestimulación hemos desarrollado dispositivos que permiten aplicar los estímulos eléctricos de forma configurable desde una interfaz gráfica de usuario. Además, hemos diseñado un módulo de expansión que permite multiplexar las señales eléctricas a diferentes cultivos celulares. Además, hemos diseñado un dispositivo de estimulación optogenética. Este tipo de estimulación consiste en la modificación genética de las células para que sean sensibles a la radiación lumínica de determinada longitud de onda. En el ámbito de la regeneración de tejido mediante células precursoras neurales, es de interés poder inducir ondas de calcio, favoreciendo su diferenciación en neuronas y la formación de circuitos sinápticos. El dispositivo diseñado permite obtener imágenes en tiempo real mediante microscopía confocal de las respuestas transitorias de las células al ser irradiadas. El dispositivo se ha validado irradiando neuronas modificadas con luz pulsada de 100 ms. También hemos diseñado un dispositivo electrónico complementario de medida de irradiancia con el doble fin de permitir la calibración del equipo de irradiancia y medir la irradiancia en tiempo real durante los experimentos in vitro. Los resultados del uso de los bioactuadores en procesos complejos y dinámicos, como la regeneración de tejido nervioso, son limitados en lazo abierto. Uno de los principales aspectos analizados es el desarrollo de biosensores que permitiesen la cuantización de ciertas biomoléculas para ajustar la estimulación suministrada en tiempo real. Por ejemplo, la segregación de serotonina es una respuesta identificada en la elongación de células precursoras neurales, pero hay otras biomoléculas de interés para la implementación de un control en lazo cerrado. Entre las tecnologías en el estado del arte, los biosensores basados en transistores de efecto de campo (FET) funcionalizados con aptámeros son realmente prometedores para esta aplicación. Sin embargo, esta tecnología no permitía la medición simultánea de más de una biomolécula objetivo en un volumen reducido debido a las interferencias entre los distintos FETs, cuyos terminales se encuentran inmersos en la solución. Por ello, hemos desarrollado instrumentación electrónica capaz de medir simultáneamente varios de estos biosensores, y la hemos validado mediante la medición simultánea de pH y la detección preliminar de serotonina y glutamato.[CA] La capacitat de les cèl·lules mare per a proliferar formant diferents cèl·lules especialitzades els atorga la potencialitat de servir de base per a teràpies efectives per a patologies el tractament de les quals era inimaginable fins fa a penes dues dècades. No obstant això, aquesta capacitat es troba mediada per estímuls fisiològics, químics, i elèctrics, específics i complexos, que dificulten la seua translació a la rutina clínica. Per això, les cèl·lules mare representen un camp d'estudi en el qual s'inverteixen amplis esforços per part de la comunitat científica. En l'àmbit de la regeneració nerviosa, per a modular el seu desenvolupament i diferenciació el tractament farmacològic, l'electroestimulació, i l'estimulació optogenética són tècniques que estan aconseguint prometedors resultats. És per això que en la present tesi s'ha desenvolupat un conjunt de sistemes electrònics per a permetre l'aplicació combinada d'aquestes tècniques in vitro, amb perspectiva a la seua aplicació in vivo. Hem dissenyat una nova tecnologia per a l'alliberament elèctricament controlat de fàrmacs. Aquesta tecnologia està basada en nanopartícules de sílice mesoporosa i portes moleculars de bipiridina-heparina. Les portes moleculars són electroquímicament reactives, i tanquen els fàrmacs a l'interior de les nanopartícules, alliberant-los davant un estímul elèctric. Hem caracteritzat aquesta tecnologia, i l'hem validada mitjançant l'alliberament controlat de rodamina en cultius cel·lulars de HeLa. Per a la combinació d'alliberament controlat de fàrmacs i electroestimulació hem desenvolupat dispositius que permeten aplicar els estímuls elèctrics de manera configurable des d'una interfície gràfica d'usuari. A més, hem dissenyat un mòdul d'expansió que permet multiplexar els senyals elèctrics a diferents cultius cel·lulars. A més, hem dissenyat un dispositiu d'estimulació optogenètica. Aquest tipus d'estimulació consisteix en la modificació genètica de les cèl·lules perquè siguen sensibles a la radiació lumínica de determinada longitud d'ona. En l'àmbit de la regeneració de teixit mitjançant cèl·lules precursores neurals, és d'interés poder induir ones de calci, afavorint la seua diferenciació en neurones i la formació de circuits sinàptics. El dispositiu dissenyat permet obtindré imatges en temps real mitjançant microscòpia confocal de les respostes transitòries de les cèl·lules en ser irradiades. El dispositiu s'ha validat irradiant neurones modificades amb llum polsada de 100 ms. També hem dissenyat un dispositiu electrònic complementari de mesura d'irradiància amb el doble fi de permetre el calibratge de l'equip d'irradiància i mesurar la irradiància en temps real durant els experiments in vitro. Els resultats de l'ús dels bioactuadors en processos complexos i dinàmics, com la regeneració de teixit nerviós, són limitats en llaç obert. Un dels principals aspectes analitzats és el desenvolupament de biosensors que permeteren la quantització de certes biomolècules per a ajustar l'estimulació subministrada en temps real. Per exemple, la segregació de serotonina és una resposta identificada amb l'elongació de les cèl·lules precursores neurals, però hi ha altres biomolècules d'interés per a la implementació d'un control en llaç tancat. Entre les tecnologies en l'estat de l'art, els biosensors basats en transistors d'efecte de camp (FET) funcionalitzats amb aptàmers són realment prometedors per a aquesta aplicació. No obstant això, aquesta tecnologia no permetia el mesurament simultani de més d'una biomolècula objectiu en un volum reduït a causa de les interferències entre els diferents FETs, els terminals dels quals es troben immersos en la solució. Per això, hem desenvolupat instrumentació electrònica capaç de mesurar simultàniament diversos d'aquests biosensors i els hem validat amb mesurament simultani del pH i la detecció preliminar de serotonina i glutamat.[EN] The stem cells' ability to proliferate to form different specialized cells gives them the potential to serve as the basis for effective therapies for pathologies whose treatment was unimaginable until just two decades ago. However, this capacity is mediated by specific and complex physiological, chemical, and electrical stimuli that complicate their translation to clinical routine. For this reason, stem cells represent a field of study in which the scientific community is investing a great deal of effort. In the field of nerve regeneration, to modulate their development and differentiation, pharmacological treatment, electrostimulation, and optogenetic stimulation are techniques that are achieving promising results. For this reason, we have developed a set of electronic systems to allow the combined application of these techniques in vitro, with a view to their application in vivo. We have designed a novel technology for the electrically controlled release of drugs. This technology is based on mesoporous silica nanoparticles and bipyridine-heparin molecular gates. The molecular gates are electrochemically reactive and entrap the drugs inside the nanoparticles, releasing them upon electrical stimulus. We have characterized this technology and validated it by controlled release of rhodamine in HeLa cell cultures. For combining electrostimulation and controlled drug release we have developed devices that allow applying the different electrical stimuli in a configurable way from a graphical user interface. In addition, we have designed an expansion module that allows multiplexing electrical signals to different cell cultures. In addition, we have designed an optogenetic stimulation device. This type of stimulation consists of genetically modifying cells to make them sensitive to light radiation of a specific wavelength. In tissue regeneration using neural precursor cells, it is interesting to be able to induce calcium waves, favoring the cell differentiation into neurons and the formation of synaptic circuits. The designed device enable the obtention of real-time images through confocal microscopy of the transient responses of cells upon irradiation. The device has been validated by irradiating modified neurons with 100 ms pulsed light stimulation. We have also designed a complementary electronic irradiance measurement device to allow calibration of the irradiator equipment and measuring irradiance in real time during in vitro experiments. The results of using bioactuators in complex and dynamic processes, such as nerve tissue regeneration, are limited in an open loop. One of the main aspects analyzed is the development of biosensors that would allow quantifying of specific biomolecules to adjust the stimulation provided in real time. For instance, serotonin secretion is an identified response of neural precursor cells elongation, among other biomolecules of interest for the implementation of a closed-loop control. Among the state-of-the-art technologies, biosensors based on field effect transistors (FETs) functionalized with aptamers are promising for this application. However, this technology did not allow the simultaneous measurement of more than one target biomolecule in a small volume due to interferences between the different FETs, whose terminals are immersed in the solution. This is why we have developed electronic instrumentation capable of simultaneously measuring several of these biosensors, and we have validated it with the simultaneous pH measurement and the preliminary detection of serotonin and glutamate.Monreal Trigo, J. (2023). Electronic Devices for the Combination of Electrically Controlled Drug Release, Electrostimulation, and Optogenetic Stimulation for Nerve Tissue Regeneration [Tesis doctoral]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/19384

    Towards Authentication of IoMT Devices via RF Signal Classification

    Get PDF
    The increasing reliance on the Internet of Medical Things (IoMT) raises great concern in terms of cybersecurity, either at the device’s physical level or at the communication and transmission level. This is particularly important as these systems process very sensitive and private data, including personal health data from multiple patients such as real-time body measurements. Due to these concerns, cybersecurity mechanisms and strategies must be in place to protect these medical systems, defending them from compromising cyberattacks. Authentication is an essential cybersecurity technique for trustworthy IoMT communications. However, current authentication methods rely on upper-layer identity verification or key-based cryptography which can be inadequate to the heterogeneous Internet of Things (IoT) environments. This thesis proposes the development of a Machine Learning (ML) method that serves as a foundation for Radio Frequency Fingerprinting (RFF) in the authentication of IoMT devices in medical applications to improve the flexibility of such mechanisms. This technique allows the authentication of medical devices by their physical layer characteristics, i.e. of their emitted signal. The development of ML models serves as the foundation for RFF, allowing it to evaluate and categorise the released signal and enable RFF authentication. Multiple feature take part of the proposed decision making process of classifying the device, which then is implemented in a medical gateway, resulting in a novel IoMT technology.A confiança crescente na IoMT suscita grande preocupação em termos de cibersegurança, quer ao nível físico do dispositivo quer ao nível da comunicação e ao nível de transmissão. Isto é particularmente importante, uma vez que estes sistemas processam dados muito sensíveis e dados, incluindo dados pessoais de saúde de diversos pacientes, tais como dados em tempo real de medidas do corpo. Devido a estas preocupações, os mecanismos e estratégias de ciber-segurança devem estar em vigor para proteger estes sistemas médicos, defendendo-os de ciberataques comprometedores. A autenticação é uma técnica essencial de ciber-segurança para garantir as comunicações em sistemas IoMT de confiança. No entanto, os métodos de autenticação atuais focam-se na verificação de identidade na camada superior ou criptografia baseada em chaves que podem ser inadequadas para a ambientes IoMT heterogéneos. Esta tese propõe o desenvolvimento de um método de ML que serve como base para o RFF na autenticação de dispositivos IoMT para melhorar a flexibilidade de tais mecanismos. Isto permite a autenticação dos dispositivos médicos pelas suas características de camada física, ou seja, a partir do seu sinal emitido. O desenvolvimento de modelos de ML serve de base para o RFF, permitindo-lhe avaliar e categorizar o sinal libertado e permitir a autenticação do RFF. Múltiplas features fazem parte do processo de tomada de decisão proposto para classificar o dispositivo, que é implementada num gateway médico, resultando numa nova tecnologia IoMT

    General Course Catalog [2022/23 academic year]

    Get PDF
    General Course Catalog, 2022/23 academic yearhttps://repository.stcloudstate.edu/undergencat/1134/thumbnail.jp
    corecore