432 research outputs found
Recommended from our members
Synaptic plasticity and memory addressing in biological and artificial neural networks
Biological brains are composed of neurons, interconnected by synapses to create large complex networks. Learning and memory occur, in large part, due to synaptic plasticity -- modifications in the efficacy of information transmission through these synaptic connections. Artificial neural networks model these with neural "units" which communicate through synaptic weights. Models of learning and memory propose synaptic plasticity rules that describe and predict the weight modifications. An equally important but under-evaluated question is the selection of \textit{which} synapses should be updated in response to a memory event. In this work, we attempt to separate the questions of synaptic plasticity from that of memory addressing.
Chapter 1 provides an overview of the problem of memory addressing and a summary of the solutions that have been considered in computational neuroscience and artificial intelligence, as well as those that may exist in biology. Chapter 2 presents in detail a solution to memory addressing and synaptic plasticity in the context of familiarity detection, suggesting strong feedforward weights and anti-Hebbian plasticity as the respective mechanisms. Chapter 3 proposes a model of recall, with storage performed by addressing through local third factors and neo-Hebbian plasticity, and retrieval by content-based addressing. In Chapter 4, we consider the problem of concurrent memory consolidation and memorization. Both storage and retrieval are performed by content-based addressing, but the plasticity rule itself is implemented by gradient descent, modulated according to whether an item should be stored in a distributed manner or memorized verbatim. However, the classical method for computing gradients in recurrent neural networks, backpropagation through time, is generally considered unbiological. In Chapter 5 we suggest a more realistic implementation through an approximation of recurrent backpropagation.
Taken together, these results propose a number of potential mechanisms for memory storage and retrieval, each of which separates the mechanism of synaptic updating -- plasticity -- from that of synapse selection -- addressing. Explicit studies of memory addressing may find applications not only in artificial intelligence but also in biology. In artificial networks, for example, selectively updating memories in large language models can help improve user privacy and security. In biological ones, understanding memory addressing can help with health outcomes and treating memory-based illnesses such as Alzheimers or PTSD
Beam scanning by liquid-crystal biasing in a modified SIW structure
A fixed-frequency beam-scanning 1D antenna based on Liquid Crystals (LCs) is designed for application in 2D scanning with lateral alignment. The 2D array environment imposes full decoupling of adjacent 1D antennas, which often conflicts with the LC requirement of DC biasing: the proposed design accommodates both. The LC medium is placed inside a Substrate Integrated Waveguide (SIW) modified to work as a Groove Gap Waveguide, with radiating slots etched on the upper broad wall, that radiates as a Leaky-Wave Antenna (LWA). This allows effective application of the DC bias voltage needed for tuning the LCs. At the same time, the RF field remains laterally confined, enabling the possibility to lay several antennas in parallel and achieve 2D beam scanning. The design is validated by simulation employing the actual properties of a commercial LC medium
BDS GNSS for Earth Observation
For millennia, human communities have wondered about the possibility of observing
phenomena in their surroundings, and in particular those affecting the Earth on which they live.
More generally, it can be conceptually defined as Earth observation (EO) and is the collection of
information about the biological, chemical and physical systems of planet Earth. It can be undertaken
through sensors in direct contact with the ground or airborne platforms (such as weather balloons and
stations) or remote-sensing technologies. However, the definition of EO has only become significant
in the last 50 years, since it has been possible to send artificial satellites out of Earth’s orbit.
Referring strictly to civil applications, satellites of this type were initially designed to provide
satellite images; later, their purpose expanded to include the study of information on land
characteristics, growing vegetation, crops, and environmental pollution. The data collected are used
for several purposes, including the identification of natural resources and the production of accurate
cartography. Satellite observations can cover the land, the atmosphere, and the oceans.
Remote-sensing satellites may be equipped with passive instrumentation such as infrared or
cameras for imaging the visible or active instrumentation such as radar. Generally, such satellites are
non-geostationary satellites, i.e., they move at a certain speed along orbits inclined with respect to the
Earth’s equatorial plane, often in polar orbit, at low or medium altitude, Low Earth Orbit (LEO) and
Medium Earth Orbit (MEO), thus covering the entire Earth’s surface in a certain scan time (properly
called ’temporal resolution’), i.e., in a certain number of orbits around the Earth.
The first remote-sensing satellites were the American NASA/USGS Landsat Program;
subsequently, the European: ENVISAT (ENVironmental SATellite), ERS (European Remote-Sensing
satellite), RapidEye, the French SPOT (Satellite Pour l’Observation de laTerre), and the Canadian
RADARSAT satellites were launched. The IKONOS, QuickBird, and GeoEye-1 satellites were
dedicated to cartography. The WorldView-1 and WorldView-2 satellites and the COSMO-SkyMed
system are more recent. The latest generation are the low payloads called Small Satellites, e.g., the
Chinese BuFeng-1 and Fengyun-3 series.
Also, Global Navigation Satellite Systems (GNSSs) have captured the attention of researchers
worldwide for a multitude of Earth monitoring and exploration applications. On the other hand,
over the past 40 years, GNSSs have become an essential part of many human activities. As is widely
noted, there are currently four fully operational GNSSs; two of these were developed for military
purposes (American NAVstar GPS and Russian GLONASS), whilst two others were developed for
civil purposes such as the Chinese BeiDou satellite navigation system (BDS) and the European
Galileo. In addition, many other regional GNSSs, such as the South Korean Regional Positioning
System (KPS), the Japanese quasi-zenital satellite system (QZSS), and the Indian Regional Navigation
Satellite System (IRNSS/NavIC), will become available in the next few years, which will have
enormous potential for scientific applications and geomatics professionals.
In addition to their traditional role of providing global positioning, navigation, and timing (PNT)
information, GNSS navigation signals are now being used in new and innovative ways. Across the
globe, new fields of scientific study are opening up to examine how signals can provide information
about the characteristics of the atmosphere and even the surfaces from which they are reflected before
being collected by a receiver.
EO researchers monitor global environmental systems using in situ and remote monitoring tools.
Their findings provide tools to support decision makers in various areas of interest, from security
to the natural environment. GNSS signals are considered an important new source of information
because they are a free, real-time, and globally available resource for the EO community
Behavior quantification as the missing link between fields: Tools for digital psychiatry and their role in the future of neurobiology
The great behavioral heterogeneity observed between individuals with the same
psychiatric disorder and even within one individual over time complicates both
clinical practice and biomedical research. However, modern technologies are an
exciting opportunity to improve behavioral characterization. Existing
psychiatry methods that are qualitative or unscalable, such as patient surveys
or clinical interviews, can now be collected at a greater capacity and analyzed
to produce new quantitative measures. Furthermore, recent capabilities for
continuous collection of passive sensor streams, such as phone GPS or
smartwatch accelerometer, open avenues of novel questioning that were
previously entirely unrealistic. Their temporally dense nature enables a
cohesive study of real-time neural and behavioral signals.
To develop comprehensive neurobiological models of psychiatric disease, it
will be critical to first develop strong methods for behavioral quantification.
There is huge potential in what can theoretically be captured by current
technologies, but this in itself presents a large computational challenge --
one that will necessitate new data processing tools, new machine learning
techniques, and ultimately a shift in how interdisciplinary work is conducted.
In my thesis, I detail research projects that take different perspectives on
digital psychiatry, subsequently tying ideas together with a concluding
discussion on the future of the field. I also provide software infrastructure
where relevant, with extensive documentation.
Major contributions include scientific arguments and proof of concept results
for daily free-form audio journals as an underappreciated psychiatry research
datatype, as well as novel stability theorems and pilot empirical success for a
proposed multi-area recurrent neural network architecture.Comment: PhD thesis cop
LIPIcs, Volume 261, ICALP 2023, Complete Volume
LIPIcs, Volume 261, ICALP 2023, Complete Volum
Infomorphic networks: Locally learning neural networks derived from partial information decomposition
Understanding the intricate cooperation among individual neurons in
performing complex tasks remains a challenge to this date. In this paper, we
propose a novel type of model neuron that emulates the functional
characteristics of biological neurons by optimizing an abstract local
information processing goal. We have previously formulated such a goal function
based on principles from partial information decomposition (PID). Here, we
present a corresponding parametric local learning rule which serves as the
foundation of "infomorphic networks" as a novel concrete model of neural
networks. We demonstrate the versatility of these networks to perform tasks
from supervised, unsupervised and memory learning. By leveraging the
explanatory power and interpretable nature of the PID framework, these
infomorphic networks represent a valuable tool to advance our understanding of
cortical function.Comment: 31 pages, 5 figure
General Course Catalog [2022/23 academic year]
General Course Catalog, 2022/23 academic yearhttps://repository.stcloudstate.edu/undergencat/1134/thumbnail.jp
1-D broadside-radiating leaky-wave antenna based on a numerically synthesized impedance surface
A newly-developed deterministic numerical technique for the automated design of metasurface antennas is applied here for the first time to the design of a 1-D printed Leaky-Wave Antenna (LWA) for broadside radiation. The surface impedance synthesis process does not require any a priori knowledge on the impedance pattern, and starts from a mask constraint on the desired far-field and practical bounds on the unit cell impedance values. The designed reactance surface for broadside radiation exhibits a non conventional patterning; this highlights the merit of using an automated design process for a design well known to be challenging for analytical methods. The antenna is physically implemented with an array of metal strips with varying gap widths and simulation results show very good agreement with the predicted performance
Nonlinear Systems
Open Mathematics is a challenging notion for theoretical modeling, technical analysis, and numerical simulation in physics and mathematics, as well as in many other fields, as highly correlated nonlinear phenomena, evolving over a large range of time scales and length scales, control the underlying systems and processes in their spatiotemporal evolution. Indeed, available data, be they physical, biological, or financial, and technologically complex systems and stochastic systems, such as mechanical or electronic devices, can be managed from the same conceptual approach, both analytically and through computer simulation, using effective nonlinear dynamics methods. The aim of this Special Issue is to highlight papers that show the dynamics, control, optimization and applications of nonlinear systems. This has recently become an increasingly popular subject, with impressive growth concerning applications in engineering, economics, biology, and medicine, and can be considered a veritable contribution to the literature. Original papers relating to the objective presented above are especially welcome subjects. Potential topics include, but are not limited to: Stability analysis of discrete and continuous dynamical systems; Nonlinear dynamics in biological complex systems; Stability and stabilization of stochastic systems; Mathematical models in statistics and probability; Synchronization of oscillators and chaotic systems; Optimization methods of complex systems; Reliability modeling and system optimization; Computation and control over networked systems
- …