Text–to–Video: Image Semantics and NLP

When aiming at automatically translating an arbitrary text into a visual story, the main challenge consists in finding a semantically close visual representation whereby the displayed meaning should remain the same as in the given text. Besides, the appearance of an image itself largely influences how its meaningful information is transported towards an observer. This thesis now demonstrates that investigating in both, image semantics as well as the semantic relatedness between visual and textual sources enables us to tackle the challenging semantic gap and to find a semantically close translation from natural language to a corresponding visual representation. Within the last years, social networking became of high interest leading to an enormous and still increasing amount of online available data. Photo sharing sites like Flickr allow users to associate textual information with their uploaded imagery. Thus, this thesis exploits this huge knowledge source of user generated data providing initial links between images and words, and other meaningful data. In order to approach visual semantics, this work presents various methods to analyze the visual structure as well as the appearance of images in terms of meaningful similarities, aesthetic appeal, and emotional effect towards an observer. In detail, our GPU-based approach efficiently finds visual similarities between images in large datasets across visual domains and identifies various meanings for ambiguous words exploring similarity in online search results. Further, we investigate in the highly subjective aesthetic appeal of images and make use of deep learning to directly learn aesthetic rankings from a broad diversity of user reactions in social online behavior. To gain even deeper insights into the influence of visual appearance towards an observer, we explore how simple image processing is capable of actually changing the emotional perception and derive a simple but effective image filter. To identify meaningful connections between written text and visual representations, we employ methods from Natural Language Processing (NLP). Extensive textual processing allows us to create semantically relevant illustrations for simple text elements as well as complete storylines. More precisely, we present an approach that resolves dependencies in textual descriptions to arrange 3D models correctly. Further, we develop a method that finds semantically relevant illustrations to texts of different types based on a novel hierarchical querying algorithm. Finally, we present an optimization based framework that is capable of not only generating semantically relevant but also visually coherent picture stories in different styles.Bei der automatischen Umwandlung eines beliebigen Textes in eine visuelle Geschichte, besteht die größte Herausforderung darin eine semantisch passende visuelle Darstellung zu finden. Dabei sollte die Bedeutung der Darstellung dem vorgegebenen Text entsprechen. Darüber hinaus hat die Erscheinung eines Bildes einen großen Einfluß darauf, wie seine bedeutungsvollen Inhalte auf einen Betrachter übertragen werden. Diese Dissertation zeigt, dass die Erforschung sowohl der Bildsemantik als auch der semantischen Verbindung zwischen visuellen und textuellen Quellen es ermöglicht, die anspruchsvolle semantische Lücke zu schließen und eine semantisch nahe Übersetzung von natürlicher Sprache in eine entsprechend sinngemäße visuelle Darstellung zu finden. Des Weiteren gewann die soziale Vernetzung in den letzten Jahren zunehmend an Bedeutung, was zu einer enormen und immer noch wachsenden Menge an online verfügbaren Daten geführt hat. Foto-Sharing-Websites wie Flickr ermöglichen es Benutzern, Textinformationen mit ihren hochgeladenen Bildern zu verknüpfen. Die vorliegende Arbeit nutzt die enorme Wissensquelle von benutzergenerierten Daten welche erste Verbindungen zwischen Bildern und Wörtern sowie anderen aussagekräftigen Daten zur Verfügung stellt. Zur Erforschung der visuellen Semantik stellt diese Arbeit unterschiedliche Methoden vor, um die visuelle Struktur sowie die Wirkung von Bildern in Bezug auf bedeutungsvolle Ähnlichkeiten, ästhetische Erscheinung und emotionalem Einfluss auf einen Beobachter zu analysieren. Genauer gesagt, findet unser GPU-basierter Ansatz effizient visuelle Ähnlichkeiten zwischen Bildern in großen Datenmengen quer über visuelle Domänen hinweg und identifiziert verschiedene Bedeutungen für mehrdeutige Wörter durch die Erforschung von Ähnlichkeiten in Online-Suchergebnissen. Des Weiteren wird die höchst subjektive ästhetische Anziehungskraft von Bildern untersucht und "deep learning" genutzt, um direkt ästhetische Einordnungen aus einer breiten Vielfalt von Benutzerreaktionen im sozialen Online-Verhalten zu lernen. Um noch tiefere Erkenntnisse über den Einfluss des visuellen Erscheinungsbildes auf einen Betrachter zu gewinnen, wird erforscht, wie alleinig einfache Bildverarbeitung in der Lage ist, tatsächlich die emotionale Wahrnehmung zu verändern und ein einfacher aber wirkungsvoller Bildfilter davon abgeleitet werden kann. Um bedeutungserhaltende Verbindungen zwischen geschriebenem Text und visueller Darstellung zu ermitteln, werden Methoden des "Natural Language Processing (NLP)" verwendet, die der Verarbeitung natürlicher Sprache dienen. Der Einsatz umfangreicher Textverarbeitung ermöglicht es, semantisch relevante Illustrationen für einfache Textteile sowie für komplette Handlungsstränge zu erzeugen. Im Detail wird ein Ansatz vorgestellt, der Abhängigkeiten in Textbeschreibungen auflöst, um 3D-Modelle korrekt anzuordnen. Des Weiteren wird eine Methode entwickelt die, basierend auf einem neuen hierarchischen Such-Anfrage Algorithmus, semantisch relevante Illustrationen zu Texten verschiedener Art findet. Schließlich wird ein optimierungsbasiertes Framework vorgestellt, das nicht nur semantisch relevante, sondern auch visuell kohärente Bildgeschichten in verschiedenen Bildstilen erzeugen kann

Image Effect of Ambush Marketing: The Case of FIFA Soccer World Cup 2010

Ambush marketing is becoming a more and more relevant topic. However, most research has remained descriptive. No study has yet considered the image effects of ambush marketing using a causal model. Thus, the present paper provides a causal model of ambush marketing focusing on cognitive and affective image and their effects on downstream variables such as attitudes and purchase intention. The results of an online-survey with 278 respondents show that for typical sports brands affective image has a stronger impact on attitude towards the ambusher brand. In contrast, for atypical sport brands cognitive image has a stronger impact on the evaluation of the ambusher. Further, a strong impact of attitude towards the ambusher brand on purchase intention has been identified

Midwives’ engagement in smoking- and alcohol-prevention in prenatal care before and after the introduction of practice guidelines in Switzerland : comparison of survey findings from 2008 and 2018

Background: Evidence suggests that cigarette smoking and alcohol consumption during pregnancy negatively impacts fetal health. Health agencies across countries have developed specific guidelines for health professionals in perinatal care to strengthen their role in smoking and alcohol use prevention. One such example is the “Guideline on Screening and Counselling for prevention of cigarette smoking and alcohol consumption before, during, and after pregnancy” introduced by the Swiss Midwives Association in 2011. The current study assesses the changes in midwives’ engagement in smoking and alcohol use prevention before (2008) and after the introduction of the Guideline (2018). Further, the current study examines differences across regions (German vs. French speaking regions), graduation years (before and after the introduction of the Guideline) and different work settings (hospital vs. self-employed). Methods: Survey data were collected in 2008 (n = 366) and in 2018 (n = 459). Differences in how midwives engaged in smoking and alcohol use prevention between 2008 and 2018 were assessed with chi-square tests, as were differences across German and French speaking regions, graduation years (before and after the introduction of the Guideline) and across different work settings (working in hospitals or as self-employed). Results: An increase in midwives’ awareness of the risks of consuming even small quantities of cigarettes and alcohol for the unborn child between 2008 and 2018 is evident. Explaining the risks to pregnant women who smoke or use alcohol remained the most frequently reported prevention strategy. However, engagement with more extensive smoking and alcohol use preventive strategies across the whole course of pregnancy, such as assisting women in the elaboration of a plan to stop smoking/alcohol use, remained limited. Conclusions: Seven years after its introduction, the effectiveness of the Guideline in increasing midwives’ engagement in smoking and alcohol use prevention appears limited despite midwives’ increased awareness

Evidenzbasierter Einsatz von Protonenpumpeninhibitoren

Protonenpumpeninhibitoren (PPIs) werden als Mittel der ersten Wahl bei säurebedingten Erkrankungen wie GERD, peptische Ulcuserkrankung und zur Eradikation des Helicobacter pylori eingesetzt. Wegen ihres ausgezeichneten Sicherheitsprofils werden sie sehr häufig und oft ohne vorliegende gerechtfertigte Indikation verschrieben. Auch PPIs zeigen unerwünschte Nebenwirkungen, vor allem bei Langzeiteinnahme, und interagieren mit anderen Arzneistoffen durch Senkung des pH-Wertes im Magen oder durch Interaktion über das CYP2C19-Enzym. Anhand evidenzbasierter Guidelines und aktueller Studien wurde eine Checkliste angefertigt, mit deren Hilfe überprüft werden kann, ob die PPI-Gabe gerechtfertigt oder nicht gerechtfertigt ist. Die Überprüfung der Anwendbarkeit der Liste erfolgte im SMZO Wien. Es zeigte sich, dass bei einer Mehrzahl der Patienten die PPI-Gabe nicht gerechtfertigt war. Die Gründe der nicht gerechtfertigten Gabe waren eine PPI-Gabe bei Multimedikation und eine zu hohe Dosis bei der Prophylaxe NSAID/ASS-assoziierter Ulcera. Weiters konnte festgestellt werden, dass die simultane Gabe von Clopidogrel plus PPI sehr umstritten ist. Eine weitere Datenerhebung mithilfe der erstellten Checkliste ist auf jeden Fall sinnvoll. Vor allem auch, um die anderen Indikationsgebiete der PPIs zu durchleuchten und um weitere Gründe eventuell nicht gerechtfertigter PPI-Verschreibungen zu ermitteln, mit dem Ziel des rationalen Einsatzes der Protonenpumpeninhibitoren

Experimental investigation of forces along anchors subjected to dynamic loading under tension and compression in field tests

Full-scale field tests of dynamic rockfall have been performed on a flexible SPIDER Avalanche System to study the dynamic force distribution along the foundations under dynamic loading. Therefore, an anchor to measure dynamic tensile forces and a pile to measure dynamic compressive forces were each equipped with strain gauges. Furthermore, a static pull loading test with load steps of one-minute duration was performed on the anchor to highlight the difference between dynamic and static loading. Effective kinetic energies applied on the net of the SPIDER Avalanche System range from 25 to 492 kJ with impact velocities between 17 and 25 m/s. The results show that the dynamic forces close to the pile- and anchor head are higher and that they are decreasing with increasing distance of pile and anchor. However, the dynamic tensile force distribution is non-linear over the length of the anchor, whereas the dynamic compressive force distribution is linear along the pile length. The comparison of static and dynamic tensile forces shows that dynamic tensile forces are depleted within a shorter distance of the anchor compared to the static tensile forces. Dynamic tensile forces present 25% less in value than the static tensile forces

The Nitrogen Content in the Fruiting Body and Mycelium of Pleurotus Ostreatus and Its Utilization as a Medium Component in Thraustochytrid Fermentation

Following the idea of a circular bioeconomy, the use of side streams as substitutes for cultivation media (components) in bioprocesses would mean an enormous economic and ecological advantage. Costly compounds in conventional media for the production of the triterpene squalene in thraustochytrids are the main carbon source and complex nitrogen sources. Among other side streams examined, extracts from the spent mycelium of the basidiomycete Pleurotus ostreatus were best-suited to acting as alternative nitrogen sources in cultivation media for thraustochytrids. The total nitrogen (3.76 ± 0.01 and 4.24 ± 0.04%, respectively) and protein (16.47 ± 0.06 and 18.57 ± 0.18%, respectively) contents of the fruiting body and mycelium were determined. The fungal cells were hydrolyzed and extracted to generate accessible nitrogen sources. Under preferred conditions, the extracts from the fruiting body and mycelium contained 73.63 ± 1.19 and 89.93 ± 7.54 mM of free amino groups, respectively. Cultivations of Schizochytrium sp. S31 on a medium using a mycelium extract as a complex nitrogen source showed decelerated growth but a similar squalene yield (123.79 ± 14.11 mg/L after 216 h) compared to a conventional medium (111.29 ± 19.96 mg/L, although improvable by additional complex nitrogen source)

Zwei Beispiele aus der Praxis des Musikunterrichts

Die hier vorgestellten Beispiele aus der Praxis des Musikunterrichts in dritten und vierten Klassen stellen vielfältige Bezüge her zu den vier im Beitrag von Constanze Rora und Lutz Schäfer beschriebenen Dimensionen ästhetischer Erfahrung und möchten Anregung sein, ästhetische Erfahrungen im eigenen Unterricht zu ermöglichen. Es werden jeweils zunächst der Ablauf des Unterrichtsvorschlags vorgestellt und dann in einem weiteren Schritt die Bezüge zum theoretischen Rahmen aufgezeigt. (DIPF/Orig.

Potentials of using milk performance data and FAMACHA score as indicators for Targeted Selective Treatment in Lacaune dairy sheep in Switzerland

Targeted Selective Treatment (TST) is one approach to slow down the development of anthelmintic resistance. Its success is closely linked to the correct identification of animals in need of treatment. In dairy goats it has been proposed to use milk yield as TST indicator and to focus treatments on high yielding dairy goats. In dairy sheep the relationship between milk performance and infection with gastrointestinal nematodes (GIN) is not well known. The aim of this study was to investigate the relationship between milk yield and GIN infection in dairy sheep and based on this, to evaluate milk performance data as a potential TST indicator. Overall 1159 Lacaune ewes of 15 dairy sheep farms in Switzerland were included in the study. The ewes were phenotyped once between August and December 2019, when they were at least 70 days in milk (DIM). Individual faecal samples were taken from every ewe to determine the nematode egg concentration per gram faeces (EPG). In addition, the clinical parameters FAMACHA score and packed cell volume (PCV) were measured. Linear mixed models were used to analyse the effects of the collected parameters on EPG. EPG increased significantly with increasing test day milk yields (P = 0.002), indicating high yielding ewes to be less resistant to GIN infections than low yielding ewes. The effect was most pronounced in earlier lactation but remained within a moderate range. Overall, our results indicated the potential of using milk yield data of rather early lactation as TST indicator in dairy sheep. On farms with predominantly H. contortus the combination with FAMACHA might improve the correct identification of highly infected ewes, as FAMACHA was correlated with EPG (r = 0.37, P < 0.001)