Probing speech emotion recognition transformers for linguistic knowledge

Large, pre-trained neural networks consisting of self-attention layers (transformers) have recently achieved state-of-the-art results on several speech emotion recognition (SER) datasets. These models are typically pre-trained in self-supervised manner with the goal to improve automatic speech recognition performance -- and thus, to understand linguistic information. In this work, we investigate the extent in which this information is exploited during SER fine-tuning. Using a reproducible methodology based on open-source tools, we synthesise prosodically neutral speech utterances while varying the sentiment of the text. Valence predictions of the transformer model are very reactive to positive and negative sentiment content, as well as negations, but not to intensifiers or reducers, while none of those linguistic features impact arousal or dominance. These findings show that transformers can successfully leverage linguistic information to improve their valence predictions, and that linguistic analysis should be included in their testing

Probing Speech Emotion Recognition Transformers for Linguistic Knowledge

Large, pre-trained neural networks consisting of self-attention layers (transformers) have recently achieved state-of-the-art results on several speech emotion recognition (SER) datasets. These models are typically pre-trained in self-supervised manner with the goal to improve automatic speech recognition performance -- and thus, to understand linguistic information. In this work, we investigate the extent in which this information is exploited during SER fine-tuning. Using a reproducible methodology based on open-source tools, we synthesise prosodically neutral speech utterances while varying the sentiment of the text. Valence predictions of the transformer model are very reactive to positive and negative sentiment content, as well as negations, but not to intensifiers or reducers, while none of those linguistic features impact arousal or dominance. These findings show that transformers can successfully leverage linguistic information to improve their valence predictions, and that linguistic analysis should be included in their testing.Comment: This work has been submitted for publication to Interspeech 202

Sprouting and intussusceptive angiogenesis in postpneumonectomy lung growth: mechanisms of alveolar neovascularization

In most rodents and some other mammals, the removal of one lung results in compensatory growth associated with dramatic angiogenesis and complete restoration of lung capacity. One pivotal mechanism in neoalveolarization is neovascularization, because without angiogenesis new alveoli can not be formed. The aim of this study is to image and analyze three-dimensionally the different patterns of neovascularization seen following pneumonectomy in mice on a sub-micron-scale. C57/BL6 mice underwent a left-sided pneumonectomy. Lungs were harvested at various timepoints after pneumonectomy. Volume analysis by microCT revealed a striking increase of 143 percent in the cardiac lobe 14 days after pneumonectomy. Analysis of microvascular corrosion casting demonstrated spatially heterogenous vascular densitities which were in line with the perivascular and subpleural compensatory growth pattern observed in anti-PCNA-stained lung sections. Within these regions an expansion of the vascular plexus with increased pillar formations and sprouting angiogenesis, originating both from pre-existing bronchial and pulmonary vessels was observed. Also, type II pneumocytes and alveolar macrophages were seen to participate actively in alveolar neo-angiogenesis after pneumonectomy. 3D-visualizations obtained by high-resolution synchrotron radiation X-ray tomographic microscopy showed the appearance of double-layered vessels and bud-like alveolar baskets as have already been described in normal lung development. Scanning electron microscopy data of microvascular architecture also revealed a replication of perialveolar vessel networks through septum formation as already seen in developmental alveolarization. In addition, the appearance of pillar formations and duplications on alveolar entrance ring vessels in mature alveoli are indicative of vascular remodeling. These findings indicate that sprouting and intussusceptive angiogenesis are pivotal mechanisms in adult lung alveolarization after pneumonectomy. Various forms of developmental neoalveolarization may also be considered to contribute in compensatory lung regeneration. Electronic supplementary material The online version of this article (doi:10.1007/s10456-013-9399-9) contains supplementary material, which is available to authorized users

Empagliflozin inhibits Na + /H + exchanger activity in human atrial cardiomyocytes

Aims Recent clinical trials have proven gliflozins to be cardioprotective in diabetic and non-diabetic patients. However, the underlying mechanisms are incompletely understood. A potential inhibition of cardiac Na+/H(+)exchanger 1 (NHE1) has been suggested in animal models. We investigated the effect of empagliflozin on NHE1 activity in human atrial cardiomyocytes. Methods and results Expression of NHE1 was assessed in human atrial and ventricular tissue via western blotting. NHE activity was measured as the maximal slope of pH recovery after NH(4)(+)pulse in isolated carboxy-seminaphtarhodafluor 1 (SNARF1)-acetoxymethylester-loaded murine ventricular and human atrial cardiomyocytes. NHE1 is abundantly expressed in human atrial and ventricular tissue. Interestingly, compared with patients without heart failure (HF), atrial NHE1 expression was significantly increased in patients with HF with preserved ejection fraction and atrial fibrillation. The largest increase in atrial and ventricular NHE1 expression, however, was observed in patients with end-stage HF undergoing heart transplantation. Importantly, acute exposure to empagliflozin (1 mu mol/L, 10 min) significantly inhibited NHE activity to a similar extent in human atrial myocytes and mouse ventricular myocytes. This inhibition was also achieved by incubation with the well-described selective NHE inhibitor cariporide (10 mu mol/L, 10 min). Conclusions This is the first study systematically analysing NHE1 expression in human atrial and ventricular myocardium of HF patients. We show that empagliflozin inhibits NHE in human cardiomyocytes. The extent of NHE inhibition was comparable with cariporide and may potentially contribute to the improved outcome of patients in clinical trials

Electricity Spot Market Design 2030-2050

Driven by the climate conference in Paris in December 2015 countries worldwide are confronted with the question of how to shape their power system and how to establish alternative technologies to reduce harmful CO2 emissions. The German government plans that even before the year 2050, all electricity generated and consumed in Germany should be greenhouse gas neutral [1]. To successfully integrate renewable energies, a future energy system must be able to handle the intermittent nature of renewable energy sources such as wind and solar. One important means to address such electricity production variability is demand-side flexibility. Here, industry plays a major role in responding to variable electricity supply with adequate flexibility. This is where the Kopernikus project SynErgie comes in with more than 80 project partners from academia, industry, governmental, and non-governmental organizations as well as energy suppliers and network operators. The Kopernikus project SynErgie investigates how to best leverage demand-side flexibility in the German industry. The current electricity market design in Germany is not well suited to deal with increasing levels of renewable energy, and it does not embrace demand-side flexibility. Almost 6GW of curtailed power in 2019 provide evidence that changes are needed with respect to the rules governing electricity markets. These rules were designed at a time when electricity generation was concentrated on a few large and dispatchable conventional power plants and demand was considered inelastic. The SynErgie Cluster IV investigates how a future-proof electricity market design should be organized. The corresponding Work Package IV.3.1 more specifically deals with analyzing and designing allocation and pricing rules on electricity spot markets. The resulting design must be well suited to accommodate demand-side flexibility and address the intermittent nature of important renewable energy sources. This whitepaper is the result of a fruitful collaboration among the partners involved in SynErgie Cluster IV which include Germany’s leading research organizations and practitioners in the field. The collaboration led to an expert workshop in October 2020 with participation from a number of international energy market experts such as Mette Bjørndal (NHH), Endre Bjørndal (NHH), Peter Cramton (University of Maryland and University of Cologne), and Raphael Heffron (University of Dundee). The whitepaper details the key recommendations from this workshop. In particular, the whitepaper recommends a move to a locational, marginal price-based system together with new bidding formats allowing to better express flexibility. We argue in favor of a one-step introduction of locational, marginal prices instead of repeatedly splitting existing zones. Frequent zone splitting involves recurring political debates as well as short- and long-run instabilities affecting the basis for financial contracts, for example. Importantly, the definition of stable prize zones is very challenging with increasing levels of distributed and renewable energy sources. The recommendation is the outcome of an intense debate about advantages and downsides of different policy alternatives. However, such a transition to locational, marginal prices is not without challenges, and it is a call to arms for the research community, policymakers, and practitioners to develop concepts on how to best facilitate the transition and ensure a reliable and efficient electricity market of the future

Verantwortungsbewusster Umgang mit IT-Sicherheitslücken : Problemlagen und Optimierungsoptionen für ein effizientes Zusammenwirken zwischen IT-Sicherheitsforschung und IT-Verantwortlichen

IT-Sicherheitslücken in Hard- und Software betreffen private, unternehmerische und auch staatliche Systeme. Sobald eine Ausnutzung der Lücken technisch möglich ist, stellen sie eine Bedrohung für die IT-Sicherheit aller Beteiligten dar. Konkret betroffen sind Bürger:innen und Unternehmen als Nutzende, Hersteller von Soft- und Hardware sowie staatliche (kritische) IT-Infrastruktur. Es ist daher im gesamtgesellschaftlichen Interesse, die Zahl der ausnutzbaren Sicherheitslücken so gering wie möglich zu halten. Dieses Whitepaper führt in die rechtlichen und praktischen Probleme der IT-Sicherheitsforschung ein. Zugleich zeigt es vor allem rechtliche Auswege auf, die perspektivisch zu einer rechtssicheren IT-Sicherheitsforschung führen

Analysis of Motor Function in the Tg4-42 Mouse Model of Alzheimer’s Disease

Alzheimer’s disease (AD) is a neurodegenerative disorder and the most common form of dementia. Hallmarks of AD are memory impairments and cognitive deficits, but non-cognitive impairments, especially motor dysfunctions are also associated with the disease and may even precede classic clinical symptoms. With an aging society and increasing hospitalization of the elderly, motor deficits are of major interest to improve independent activities in daily living. Consistent with clinical findings, a variety of AD mouse models develop motor deficits as well. We investigated the motor function of 3- and 7-month-old Tg4-42 mice in comparison to wild-type controls and 5XFAD mice and discuss the results in context with several other AD mouse model. Our study shows impaired balance and motor coordination in aged Tg4-42 mice in the balance beam and rotarod test, while general locomotor activity and muscle strength is not impaired at 7 months. The cerebellum is a major player in the regulation and coordination of balance and locomotion through practice. Particularly, the rotarod test is able to detect cerebellar deficits. Furthermore, supposed cerebellar impairment was verified by 18F-FDG PET/MRI. Aged Tg4-42 mice showed reduced cerebellar glucose metabolism in the 18F-FDG PET. Suggesting that, deficits in coordination and balance are most likely due to cerebellar impairment. In conclusion, Tg4-42 mice develop motor deficits before memory deficits, without confounding memory test. Thus, making the Tg4-42 mouse model a good model to study the effects on cognitive decline of therapies targeting motor impairments

Familie - Generation - Institution. Generationenkonzepte in der Vormoderne

Dieser Band versammelt Beiträge zu Generationenbeziehungen und Generationenkonzepten in der Vormoderne, die auf eine Tagung des DFG-Graduiertenkollegs 'Generationenbewusstsein und Generationenkonflikte in Antike und Mittelalter' in Bamberg zurückgehen. Die behandelten Untersuchungsgegenstände reichen von den antiken Diadochenreichen über die ottonische Königsfamilie des 10. und 11. Jahrhunderts bis zum frühneuzeitlichen Landadel Westfalens. Dabei werden historische, literaturwissenschaftliche und soziologische Fragestellungen aufgegriffen, um den Erkenntniswert des Konzepts 'Generation' interdisziplinär zu diskutieren.This volume brings together contributions on generational relations and concepts of generation in Early Modernity given on the occasion of a conference organized at Bamberg by the Research Training Group of the German Research Foundation (DFG) 'Generational Awareness and Generational Conflicts in Antiquity and the Middle Ages'. The topics ranged from the ancient Diadoch kingdoms to the history of the Ottonian royal family of the 10th and 11th centuries and the early modern landed gentry in Westfalia. Addressing questions from historical, literary and social studies the validity of the concept of 'generation' was discussed among scholars and students from a variety of disciplines

Electricity Market Design 2030-2050: Moving Towards Implementation

Climate change and ambitious emission-reduction targets call for an extensive decarbonization of electricity systems, with increasing levels of Renewable Energy Sources (RES) and demand flexibility to balance the variable and intermittent electricity supply. A successful energy transition will lead to an economically and ecologically sustainable future with an affordable, reliable, and carbon-neutral supply of electricity. In order to achieve these objectives, a consistent and enabling market design is required. The Kopernikus Project SynErgie investigates how demand flexibility of the German industry can be leveraged and how a future-proof electricity market design should be organized, with more than 80 project partners from academia, industry, governmental and non-governmental organizations, energy suppliers, and network operators. In our SynErgie Whitepaper Electricity Spot Market Design 2030-2050 [1], we argued for a transition towards Locational Marginal Prices (LMPs) (aka. nodal prices) in Germany in a single step as a core element of a sustainable German energy policy. We motivated a well-designed transition towards LMPs, discussed various challenges, and provided a new perspective on electricity market design in terms of technological opportunities, bid languages, and strategic implications. This second SynErgie Whitepaper Electricity Market Design 2030-2050: Moving Towards Implementation aims at further concretizing the future German market design and provides first guidelines for an implementation of LMPs in Germany. Numerical studies –while not being free of abstractions –give evidence that LMPs generate efficient locational price signals and contribute to manage the complex coordination challenge in (long-term) electricity markets, ultimately reducing price differences between nodes. Spot and derivatives markets require adjustments in order to enable an efficient dispatch and price discovery, while maintaining high liquidity and low transaction costs. Moreover, a successful LMP implementation requires an integration into European market coupling and appropriate interfaces for distribution grids as well as sector coupling. Strategic implications with regard to long-term investments need to be considered, along with mechanisms to support RES investments. As a facilitator for an LMP system, digital technologies should be considered jointly with the market design transition under an enabling regulatory framework. Additional policies can address distributional effects of an LMP system and further prevent market power abuse. Overall, we argue for a well-designed electricity spot market with LMPs, composed of various auctions at different time frames, delivering an efficient market clearing, considering grid constraints, co-optimizing ancillary services, and providing locational prices according to a carefully designed pricing scheme. The spot market is tightly integrated with liquid and accessible derivatives markets, embedded into European market coupling mechanisms, and allows for functional interfaces to distribution systems and other energy sectors. Long-term resource adequacy is ensured and existing RES policies transition properly to the new market design. Mechanisms to mitigate market power and distributional effects are in place and the market design leverages the potential of modern information technologies. Arapid expansion of wind andsolar capacity will be needed to decarbonize the integrated energy system but will most likely also increase the scarcity of the infrastructure. Therefore, an efficient use of the resource "grid" will be a key factor of a successful energy transition. The implementation of an LMPs system of prices with finer space and time granularity promises many upsides and can be a cornerstone for a futureproof electricity system, economic competitiveness, and a decarbonized economy and society. Among the upsides, demand response (and other market participants with opportunity costs) can be efficiently and coherently incentivized to address network constraints, a task zonal systems with redispatch fail at. The transition to LMPs requires a thorough consideration of all the details and specifications involved in the new market design. With this whitepaper, we provide relevant perspectives and first practical guidelines for this crucial milestone of the energy transition