Learning Variational Models with Unrolling and Bilevel Optimization

In this paper we consider the problem of learning variational models in the context of supervised learning via risk minimization. Our goal is to provide a deeper understanding of the two approaches of learning of variational models via bilevel optimization and via algorithm unrolling. The former considers the variational model as a lower level optimization problem below the risk minimization problem, while the latter replaces the lower level optimization problem by an algorithm that solves said problem approximately. Both approaches are used in practice, but unrolling is much simpler from a computational point of view. To analyze and compare the two approaches, we consider a simple toy model, and compute all risks and the respective estimators explicitly. We show that unrolling can be better than the bilevel optimization approach, but also that the performance of unrolling can depend significantly on further parameters, sometimes in unexpected ways: While the stepsize of the unrolled algorithm matters a lot (and learning the stepsize gives a significant improvement), the number of unrolled iterations plays a minor role

On the Interplay of Subset Selection and Informed Graph Neural Networks

Machine learning techniques paired with the availability of massive datasets dramatically enhance our ability to explore the chemical compound space by providing fast and accurate predictions of molecular properties. However, learning on large datasets is strongly limited by the availability of computational resources and can be infeasible in some scenarios. Moreover, the instances in the datasets may not yet be labelled and generating the labels can be costly, as in the case of quantum chemistry computations. Thus, there is a need to select small training subsets from large pools of unlabelled data points and to develop reliable ML methods that can effectively learn from small training sets. This work focuses on predicting the molecules atomization energy in the QM9 dataset. We investigate the advantages of employing domain knowledge-based data sampling methods for an efficient training set selection combined with informed ML techniques. In particular, we show how maximizing molecular diversity in the training set selection process increases the robustness of linear and nonlinear regression techniques such as kernel methods and graph neural networks. We also check the reliability of the predictions made by the graph neural network with a model-agnostic explainer based on the rate distortion explanation framework

Cannabinoid type 2 receptors mediate a cell type-specific self-inhibition in cortical neurons

Endogenous cannabinoids are diffusible lipid ligands of the main cannabinoid receptors type 1 and 2 (CB1R and CB2R). In the central nervous system endocannabinoids are produced in an activity-dependent manner and have been identified as retrograde modulators of synaptic transmission. Additionally, some neurons display a cell-autonomous slow self-inhibition (SSI) mediated by endocannabinoids. In these neurons, repetitive action potential firing triggers the production of endocannabinoids, which induce a long-lasting hyperpolarization of the membrane potential, rendering the cells less excitable. Different endocannabinoid receptors and effector mechanisms have been described underlying SSI in different cell types and brain areas. Here, we investigate SSI in neurons of layer 2/3 in the somatosensory cortex. High-frequency bursts of action potentials induced SSI in pyramidal cells (PC) and regular spiking non-pyramidal cells (RSNPC), but not in fast-spiking interneurons (FS). In RSNPCs the hyperpolarization was accompanied by a change in input resistance due to the activation of G protein-coupled inward-rectifying K+ (GIRK) channels. A CB2R-specific agonist induced the long-lasting hyperpolarization, whereas preincubation with a CB2R-specific inverse agonist suppressed SSI. Additionally, using cannabinoid receptor knockout mice, we found that SSI was still intact in CB1R-deficient but abolished in CB2R-deficient mice. Taken together, we describe an additional SSI mechanism in which the activity-induced release of endocannabinoids activates GIRK channels via CB2Rs. These findings expand our knowledge about cell type-specific differential neuronal cannabinoid receptor signaling and suggest CB2R-selective compounds as potential therapeutic approaches

Recruitment of release sites underlies chemical presynaptic potentiation at hippocampal mossy fiber boutons

Synaptic plasticity is a cellular model for learning and memory. However, the expression mechanisms underlying presynaptic forms of plasticity are not well understood. Here, we investigate functional and structural correlates of presynaptic potentiation at large hippocampal mossy fiber boutons induced by the adenylyl cyclase activator forskolin. We performed 2-photon imaging of the genetically encoded glutamate sensor iGlu(u) that revealed an increase in the surface area used for glutamate release at potentiated terminals. Time-gated stimulated emission depletion microscopy revealed no change in the coupling distance between P/Q-type calcium channels and release sites mapped by Munc13-1 cluster position. Finally, by high-pressure freezing and transmission electron microscopy analysis, we found a fast remodeling of synaptic ultrastructure at potentiated boutons: Synaptic vesicles dispersed in the terminal and accumulated at the active zones, while active zone density and synaptic complexity increased. We suggest that these rapid and early structural rearrangements might enable long-term increase in synaptic strength

Increased and synchronous recruitment of release sites underlies hippocampal mossy fiber presynaptic potentiation

Synaptic plasticity is a cellular model for learning and memory. However, the expression mechanisms underlying presynaptic forms of plasticity are not well understood. Here, we investigate functional and structural correlates of long-term potentiation at large hippocampal mossy fiber boutons induced by the adenylyl cyclase activator forskolin. We performed two-photon imaging of the genetically encoded glutamate sensor iGlu(u) that revealed an increase in the surface area used for glutamate release at potentiated terminals. Moreover, time-gated stimulated emission depletion microscopy revealed no change in the coupling distance between immunofluorescence signals from calcium channels and release sites. Finally, by high-pressure freezing and transmission electron microscopy analysis, we found a fast remodeling of synaptic ultrastructure at potentiated boutons: synaptic vesicles dispersed in the terminal and accumulated at the active zones, while active zone density and synaptic complexity increased. We suggest that these rapid and early structural rearrangements likely enable long-term increase in synaptic strength

Species-specific differences in synaptic transmission and plasticity

Synaptic transmission and plasticity in the hippocampus are integral factors in learning and memory. While there has been intense investigation of these critical mechanisms in the brain of rodents, we lack a broader understanding of the generality of these processes across species. We investigated one of the smallest animals with conserved hippocampal macroanatomy—the Etruscan shrew, and found that while synaptic properties and plasticity in CA1 Schaffer collateral synapses were similar to mice, CA3 mossy fiber synapses showed striking differences in synaptic plasticity between shrews and mice. Shrew mossy fibers have lower long term plasticity compared to mice. Short term plasticity and the expression of a key protein involved in it, synaptotagmin 7 were also markedly lower at the mossy fibers in shrews than in mice. We also observed similar lower expression of synaptotagmin 7 in the mossy fibers of bats that are evolutionarily closer to shrews than mice. Species specific differences in synaptic plasticity and the key molecules regulating it, highlight the evolutionary divergence of neuronal circuit functions

EURADOS Strategic Research Agenda 2020: Vision for the Dosimetry of Ionising Radiation

\ua9 The Author(s) 2021. Published by Oxford University Press. Since 2012, the European Radiation Dosimetry Group (EURADOS) has developed its Strategic Research Agenda (SRA), which contributes to the identification of future research needs in radiation dosimetry in Europe. Continued scientific developments in this field necessitate regular updates and, consequently, this paper summarises the latest revision of the SRA, with input regarding the state of the art and vision for the future contributed by EURADOS Working Groups and through a stakeholder workshop. Five visions define key issues in dosimetry research that are considered important over at least the next decade. They include scientific objectives and developments in (i) updated fundamental dose concepts and quantities, (ii) improved radiation risk estimates deduced from epidemiological cohorts, (iii) efficient dose assessment for radiological emergencies, (iv) integrated personalised dosimetry in medical applications and (v) improved radiation protection of workers and the public. This SRA will be used as a guideline for future activities of EURADOS Working Groups but can also be used as guidance for research in radiation dosimetry by the wider community. It will also be used as input for a general European research roadmap for radiation protection, following similar previous contributions to the European Joint Programme for the Integration of Radiation Protection Research, under the Horizon 2020 programme (CONCERT). The full version of the SRA is available as a EURADOS report (www.eurados.org)

Intra-oral compartment pressures: a biofunctional model and experimental measurements under different conditions of posture

Oral posture is considered to have a major influence on the development and reoccurrence of malocclusion. A biofunctional model was tested with the null hypotheses that (1) there are no significant differences between pressures during different oral functions and (2) between pressure measurements in different oral compartments in order to substantiate various postural conditions at rest by intra-oral pressure dynamics. Atmospheric pressure monitoring was simultaneously carried out with a digital manometer in the vestibular inter-occlusal space (IOS) and at the palatal vault (sub-palatal space, SPS). Twenty subjects with normal occlusion were evaluated during the open-mouth condition (OC), gently closed lips (semi-open compartment condition, SC), with closed compartments after the generation of a negative pressure (CCN) and swallowing (SW). Pressure curve characteristics were compared between the different measurement phases (OC, SC, CCN, SW) as well as between the two compartments (IOS, SPS) using analysis of variance and Wilcoxon matched-pairs tests adopting a significance level of α = 0.05. Both null hypotheses were rejected. Average pressures (IOS, SPS) in the experimental phases were 0.0, −0.08 (OC); −0.16, −1.0 (SC); −48.79, −81.86 (CCN); and −29.25, −62.51 (SW) mbar. CCN plateau and peak characteristics significantly differed between the two compartments SPS and IOS. These results indicate the formation of two different intra-oral functional anatomical compartments which provide a deeper understanding of orofacial biofunctions and explain previous observations of negative intra-oral pressures at rest

EURADOS education and training activities

This paper provides a summary of the Education and Training (E&amp ; T) activities that have been developed and organized by the European Radiation Dosimetry Group (EURADOS) in recent years and in the case of Training Courses over the last decade. These E&amp ; T actions include short duration Training Courses on well-established topics organized within the activity of EURADOS Working Groups (WGs), or one-day events integrated in the EURADOS Annual Meeting (workshops, winter schools, the intercomparison participants' sessions and the learning network, among others). Moreover, EURADOS has recently established a Young Scientist Grant and a Young Scientist Award. The Grant supports young scientists by encouraging them to perform research projects at other laboratories of the EURADOS network. The Award is given in recognition of excellent work developed within the WGs' work programme. Additionally, EURADOS supports the dissemination of knowledge in radiation dosimetry by promoting and endorsing conferences such as the individual monitoring (IM) series, the neutron and ion dosimetry symposia (NEUDOS) and contributions to E&amp ; T sessions at specific events