Visual Question Answering with Memory-Augmented Networks

In this paper, we exploit a memory-augmented neural network to predict accurate answers to visual questions, even when those answers occur rarely in the training set. The memory network incorporates both internal and external memory blocks and selectively pays attention to each training exemplar. We show that memory-augmented neural networks are able to maintain a relatively long-term memory of scarce training exemplars, which is important for visual question answering due to the heavy-tailed distribution of answers in a general VQA setting. Experimental results on two large-scale benchmark datasets show the favorable performance of the proposed algorithm with a comparison to state of the art.Comment: CVPR 201

Leptogenesis, Dark Matter and Higgs Phenomenology at TeV

We propose an interesting model of neutrino masses to realize leptogenesis and dark matter at the TeV scale. A real scalar is introduced to naturally realize the Majorana masses of the right-handed neutrinos. We also include a new Higgs doublet that contributes to the dark matter of the universe. The neutrino masses come from the vacuum expectation value of the triplet Higgs scalar. The right-handed neutrinos are not constrained by the neutrino masses and hence they could generate leptogenesis at the TeV scale without subscribing to resonant leptogenesis. In our model, all new particles could be observable at the forthcoming Large Hardon Collider or the proposed future International Linear Collider.Comment: 7 pages, 3 figures. References added. Accepted by NP

Rule-embedded network for audio-visual voice activity detection in live musical video streams

Detecting anchor's voice in live musical streams is an important preprocessing for music and speech signal processing. Existing approaches to voice activity detection (VAD) primarily rely on audio, however, audio-based VAD is difficult to effectively focus on the target voice in noisy environments. With the help of visual information, this paper proposes a rule-embedded network to fuse the audio-visual (A-V) inputs to help the model better detect target voice. The core role of the rule in the model is to coordinate the relation between the bi-modal information and use visual representations as the mask to filter out the information of non-target sound. Experiments show that: 1) with the help of cross-modal fusion by the proposed rule, the detection result of A-V branch outperforms that of audio branch; 2) the performance of bi-modal model far outperforms that of audio-only models, indicating that the incorporation of both audio and visual signals is highly beneficial for VAD. To attract more attention to the cross-modal music and audio signal processing, a new live musical video corpus with frame-level label is introduced.Comment: Submitted to ICASSP 202

Silica-rich vein formation in an evolving stress field, Atlantis Bank Oceanic Core Complex

© The Author(s), 2020. This article is distributed under the terms of the Creative Commons Attribution License. The definitive version was published in Ma, Q., Dick, H. J. B., Urann, B., & Zhou, H. Silica-rich vein formation in an evolving stress field, Atlantis Bank Oceanic Core Complex. Geochemistry Geophysics Geosystems, 21(7), (2020): e2019GC008795, doi:10.1029/2019GC008795.Drilling 809‐m Hole U1473A in the gabbro batholith at the Atlantis Bank Oceanic Core Complex (OCC) found two felsic vein generations: late magmatic fractionates, rich in deuteric water, hosted by oxide gabbros, and anatectic veins associated with dike intrusion and introduction of seawater‐derived volatiles. Microtextures show a change from compressional to tensional stress during vein formation. Temperatures and oxidation state were obtained from amphibole‐plagioclase and oxide pairs in the adjacent gabbros. Type I veins generally have reverse shear‐sense, with restricted ΔFMQ, high Mt/Ilm ratios, and low‐amphibole Cl/F indicating deuteric fluids. They formed during percolation and fractionation of Fe‐Ti‐rich melts into the primary olivine gabbro. Type II veins are usually hosted by olivine gabbro, occur at dike contacts and the margins of normal‐sense shear zones. They are undeformed or weakly deformed, with highly variable ΔFMQ, low Mt/Ilm ratios, and high‐amphibole Cl/F, indicating seawater‐derived fluids. The detachment fault on which the gabbro massif was emplaced rooted near the base of the dike‐gabbro transition beneath the rift valley. The ingress of seawater volatiles began at >800°C and penetrated at least ~590 m into the lower crust during extensional faulting in the rift valley and adjacent rift mountains. The sequence of the felsic vein formation likely reflects asymmetric diapiric flow, with a reversal of the stress regime, and a transition from juvenile to seawater‐derived volatiles. This, in turn, is consistent with fault capture leading to the large asymmetries in spreading rates during OCC formations and heat flow beneath the rift mountains.This study was supported by the Chinese National Key Basic Research Program (Grant 2012CB417300). H. Dick and B. Urann were supported by U.S. National Science Foundation (Grant OCE‐MG&G 8371300). Emmanuel Codillo provided numerous useful comments and moral support. We thank N. Chatterjee for assistance in analyzing major element mineral composition in the MIT Electron Microprobe Laboratory. The great contributions of 360 Scientific Party for their initial shipboard description and interpretations of the Hole U1473A cores made this work possible. Special thanks go to C. J. MacLeod, Expedition cochief scientist, and Peter Blum, staff scientist, Stephen Midgley, IODP operations superintendent, and Siem Offshore James Samuel McLelland, offshore installation manager, ship's master Terry Skinner, and the crew and drillers on the JOIDES Resolution

Resonances in rotationally inelastic scattering of OH(X2ΠX^2\Pi) with helium and neon

We present detailed calculations on resonances in rotationally and spin-orbit inelastic scattering of OH (X\,^2\Pi, j=3/2, F_1, f) radicals with He and Ne atoms. We calculate new \emph{ab initio} potential energy surfaces for OH-He, and the cross sections derived from these surfaces compare favorably with the recent crossed beam scattering experiment of Kirste \emph{et al.} [Phys. Rev. A \textbf{82}, 042717 (2010)]. We identify both shape and Feshbach resonances in the integral and differential state-to-state scattering cross sections, and we discuss the prospects for experimentally observing scattering resonances using Stark decelerated beams of OH radicals.Comment: 14 pages, 15 Figure

Attention-based cross-modal fusion for audio-visual voice activity detection in musical video streams

Many previous audio-visual voice-related works focus on speech, ignoring the singing voice in the growing number of musical video streams on the Internet. For processing diverse musical video data, voice activity detection is a necessary step. This paper attempts to detect the speech and singing voices of target performers in musical video streams using audiovisual information. To integrate information of audio and visual modalities, a multi-branch network is proposed to learn audio and image representations, and the representations are fused by attention based on semantic similarity to shape the acoustic representations through the probability of anchor vocalization. Experiments show the proposed audio-visual multi-branch network far outperforms the audio-only model in challenging acoustic environments, indicating the cross-modal information fusion based on semantic correlation is sensible and successful.Comment: Accepted by INTERSPEECH 202

Universal Seesaw from Left-Right and Peccei-Quinn Symmetry Breaking

To generate the lepton and quark masses in the left-right symmetric models, we can consider a universal seesaw scenario by integrating out heavy fermion singlets which have the Yukawa couplings with the fermion and Higgs doublets. The universal seesaw scenario can also accommodate the leptogenesis with Majorana or Dirac neutrinos. We show the fermion singlets can obtain their heavy masses from certain global symmetry breaking, which is driven by one complex scalar singlet or two. The global symmetry can be identified to the Peccei-Quinn symmetry since it is mediated to the standard model quarks at tree and/or loop level.Comment: 4 page

Trajectory of Substance Use Disorders and Collegiate Recovery in Emerging Adults

Abstract Collegiate Recovery Programs (CRPs) provide services to support emerging adults achieve academic success, while maintaining substance use disorder recovery. College and university campuses can often be considered abstinence-hostile environments, giving rise to the need of support services for students in recovery. A nationwide survey to understand the efficacy of services provided by CRPs was conducted to assess the demographics and academic profiles of students involved with CRPs. Co-occurring disorders including mental health issues, criminal histories, utilizations of recovery services and 12-step groups, and work histories of students were also assessed. CRPs can provide services and an environment to students that increase recovery capital domains. Recovery capital domains such as spirituality, health and wellness, academics, critical thinking and discernment, personal achievement, and service opportunities may be related to metrics of academic success such as grade point average. However, measuring success for those in substance use disorder recovery through academics metrics alone could present a barrier to improving recovery services. Assessing the effectiveness of CRP programs through the lens of recovery capital offers a strengths-based, wholistic approach to improving services for students in recovery. Future directions include administering comprehensive measurements for recovery success, in addition to academic metrics, for students that are members of CRP. Keywords: Substance Use Recovery; Emerging Adults; Collegiate Recovery Program

Unified picture for Dirac neutrinos, dark matter, dark energy and matter-antimatter asymmetry

We propose a unified scenario to generate the masses of Dirac neutrinos and cold dark matter at the TeV scale, understand the origin of dark energy and explain the matter-antimatter asymmetry of the universe. This model can lead to significant impact on the Higgs searches at LHC.Comment: 5 pages, 3 figures. Title changed. Abstract, introduction and summary revised. References added. Model and conclusion unchange

Protection against cartilage and bone destruction by systemic interleukin-4 treatment in established murine type II collagen-induced arthritis

INTRODUCTION: Rheumatoid arthritis (RA) is associated with an increased production of a range of cytokines including tumour necrosis factor (TNF)-α and interleukin (IL)-1, which display potent proinflammatory actions that are thought to contribute to the pathogenesis of the disease. Although TNF-α seems to be the major cytokine in the inflammatory process, IL-1 is the key mediator with regard to cartilage and bone destruction. Apart from direct blockade of IL-1/TNF, regulation can be exerted at the level of modulatory cytokines such as IL-4 and IL-10. IL-4 is a pleiotropic T-cell derived cytokine that can exert either suppressive or stimulatory effects on different cell types, and was originally identified as a B-cell growth factor and regulator of humoral immune pathways. IL-4 is produced by activated CD4(+) T cells and it promotes the maturation of Th2 cells. IL-4 stimulates proliferation, differentiation and activation of several cell types, including fibroblasts, endothelial cells and epithelial cells. IL-4 is also known to be a potent anti-inflammatory cytokine that acts by inhibiting the synthesis of proinflammatory cytokines such as IL-1, TNF-α, IL-6, IL-8 and IL-12 by macrophages and monocytes. Moreover, IL-4 stimulates the synthesis of several cytokine inhibitors such as interleukin-1 receptor antagonist (IL-1Ra), soluble IL-1-receptor type II and TNF receptors IL-4 suppresses metalloproteinase production and stimulates tissue inhibitor of metalloproteinase-1 production in human mononuclear phagocytes and cartilage explants, indicating a protective effect of IL-4 towards extracellular matrix degradation. Furthermore, IL-4 inhibits both osteoclast activity and survival, and thereby blocks bone resorption in vitro. Of great importance is that IL-4 could not be detected in synovial fluid or in tissues. This absence of IL-4 in the joint probably contributes to the disturbance in the Th1/Th2 balance in chronic RA. Collagen-induced arthritis (CIA) is a widely used model of arthritis that displays several features of human RA. Recently it was demonstrated that the onset of CIA is under stringent control of IL-4 and IL-10. Furthermore, it was demonstrated that exposure to IL-4 during the immunization stage reduced onset and severity of CIA. However, after cessation of IL-4 treatment disease expression increased to control values. AIMS: Because it was reported that IL-4 suppresses several proinflammatory cytokines and matrix degrading enzymes and upregulates inhibitors of both cytokines and catabolic enzymes, we investigated the tissue protective effect of systemic IL-4 treatment using established murine CIA as a model. Potential synergy of low dosages of anti-inflammatory glucocorticosteroids and IL-4 was also evaluated. METHODS: DBA-1J/Bom mice were immunized with bovine type II collagen and boosted at day 21. Mice with established CIA were selected at day 28 after immunization and treated for days with IL-4, prednisolone, or combinations of prednisolone and IL-4. Arthritis score was monitored visually. Joint pathology was evaluated by histology, radiology and serum cartilage oligomeric matrix protein (COMP). In addition, serum levels of IL-1Ra and anticollagen antibodies were determined. RESULTS: Treatment of established CIA with IL-4 (1 μg/day) resulted in suppression of disease activity as depicted in Figure 1. Of great interest is that, although 1 μg/day IL-4 had only a moderate effect on the inflammatory component of the disease activity, it strongly reduced cartilage pathology, as determined by histological examination (Fig. 1). Moreover, serum COMP levels were significantly reduced, confirming decreased cartilage involvement. In addition, both histological and radiological analysis showed that bone destruction was prevented (Fig. 1). Systemic IL-4 administration increased serum IL-1Ra levels and reduced anticollagen type II antibody levels. Treatment with low-dose IL-4 (0.1 μg/day) was ineffective in suppressing disease score, serum COMP or joint destruction. Synergistic suppression of both arthritis severity and COMP levels was noted when low-dose IL-4 was combined with prednisolone (0.05 mg/kg/day), however, which in itself was not effective. DISCUSSION: In the present study, we demonstrate that systemic IL-4 treatment ameliorates disease progression of established CIA. Although clinical disease progression was only arrested and not reversed, clear protection against cartilage and bone destruction was noted. This is in accord with findings in both human RA and animal models of RA that show that inflammation and tissue destruction sometimes are uncoupled processes. Of great importance is that, although inflammation was still present, strong reduction in serum COMP was found after exposure to IL-4. This indicated that serum COMP levels reflected cartilage damage, although a limited contribution of the inflamed synovium cannot be excluded. Increased serum IL-1Ra level (twofold) was found after systemic treatment with IL-4, but it is not likely that this could explain the suppression of CIA. We and others have reported that high dosages of IL-1Ra are needed for marked suppression of CIA. As reported previously, lower dosages of IL-4 did not reduce clinical disease severity of established CIA. Of importance is that combined treatment of low dosages of IL-4 and IL-10 appeared to have more potent anti-inflammatory effects, and markedly protected against cartilage destruction. Improved anti-inflammatory effect was achieved with IL-4/prednisolone treatment. In addition, synergistic effects were found for the reduction of cartilage and bone destruction. This indicates that systemic IL-4/prednisolone treatment may provide a cartilage and bone protective therapy for human RA