Language as the Medium: Multimodal Video Classification through text only

Despite an exciting new wave of multimodal machine learning models, current approaches still struggle to interpret the complex contextual relationships between the different modalities present in videos. Going beyond existing methods that emphasize simple activities or objects, we propose a new model-agnostic approach for generating detailed textual descriptions that captures multimodal video information. Our method leverages the extensive knowledge learnt by large language models, such as GPT-3.5 or Llama2, to reason about textual descriptions of the visual and aural modalities, obtained from BLIP-2, Whisper and ImageBind. Without needing additional finetuning of video-text models or datasets, we demonstrate that available LLMs have the ability to use these multimodal textual descriptions as proxies for ``sight'' or ``hearing'' and perform zero-shot multimodal classification of videos in-context. Our evaluations on popular action recognition benchmarks, such as UCF-101 or Kinetics, show these context-rich descriptions can be successfully used in video understanding tasks. This method points towards a promising new research direction in multimodal classification, demonstrating how an interplay between textual, visual and auditory machine learning models can enable more holistic video understanding.Comment: Accepted at "What is Next in Multimodal Foundation Models?" (MMFM) workshop at ICCV 202

World Society for Virology first international conference: Tackling global virus epidemics.

Funder: Department of Health, Australian GovernmentThis communication summarizes the presentations given at the 1st international conference of the World Society for Virology (WSV) held virtually during 16-18 June 2021, under the theme of tackling global viral epidemics. The purpose of this biennial meeting is to foster international collaborations and address important viral epidemics in different hosts. The first day included two sessions exclusively on SARS-CoV-2 and COVID-19. The other two days included one plenary and three parallel sessions each. Last not least, 16 sessions covered 140 on-demand submitted talks. In total, 270 scientists from 49 countries attended the meeting, including 40 invited keynote speakers

World Society for Virology first international conference: Tackling global virus epidemics

This communication summarizes the presentations given at the 1st international conference of the World Society for Virology (WSV) held virtually during 16–18 June 2021, under the theme of tackling global viral epidemics. The purpose of this biennial meeting is to foster international collaborations and address important viral epidemics in different hosts. The first day included two sessions exclusively on SARS-CoV-2 and COVID-19. The other two days included one plenary and three parallel sessions each. Last not least, 16 sessions covered 140 on-demand submitted talks. In total, 270 scientists from 49 countries attended the meeting, including 40 invited keynote speakers.Peer reviewe

The FANCM:p.Arg658* truncating variant is associated with risk of triple-negative breast cancer

Abstract: Breast cancer is a common disease partially caused by genetic risk factors. Germline pathogenic variants in DNA repair genes BRCA1, BRCA2, PALB2, ATM, and CHEK2 are associated with breast cancer risk. FANCM, which encodes for a DNA translocase, has been proposed as a breast cancer predisposition gene, with greater effects for the ER-negative and triple-negative breast cancer (TNBC) subtypes. We tested the three recurrent protein-truncating variants FANCM:p.Arg658*, p.Gln1701*, and p.Arg1931* for association with breast cancer risk in 67,112 cases, 53,766 controls, and 26,662 carriers of pathogenic variants of BRCA1 or BRCA2. These three variants were also studied functionally by measuring survival and chromosome fragility in FANCM−/− patient-derived immortalized fibroblasts treated with diepoxybutane or olaparib. We observed that FANCM:p.Arg658* was associated with increased risk of ER-negative disease and TNBC (OR = 2.44, P = 0.034 and OR = 3.79; P = 0.009, respectively). In a country-restricted analysis, we confirmed the associations detected for FANCM:p.Arg658* and found that also FANCM:p.Arg1931* was associated with ER-negative breast cancer risk (OR = 1.96; P = 0.006). The functional results indicated that all three variants were deleterious affecting cell survival and chromosome stability with FANCM:p.Arg658* causing more severe phenotypes. In conclusion, we confirmed that the two rare FANCM deleterious variants p.Arg658* and p.Arg1931* are risk factors for ER-negative and TNBC subtypes. Overall our data suggest that the effect of truncating variants on breast cancer risk may depend on their position in the gene. Cell sensitivity to olaparib exposure, identifies a possible therapeutic option to treat FANCM-associated tumors

The subjective experience of patients suffering from a rare genetic pathology: Rendu-Osler-Weber disease

info:eu-repo/semantics/nonPublishe

Growing up with a rare genetic disease: an interpretative phenomenological analysis of living with Holt-Oram syndrome

info:eu-repo/semantics/publishe

The Subjective Experience of Patients Diagnosed with Hereditary Hemorrhagic Telangiectasia: a Qualitative Study

The aim of the present study was to understand the context and psychological impact for patients diagnosed with hereditary hemorrhagic telangiectasia (HHT). Semi-structured interviews were conducted with 9 patients affected by HHT, and the transcripts were analyzed using interpretative phenomenological analysis. The results of this study allowed us to propose a new hypothesis to explain the delay in diagnosis: the trivialization of symptoms associated with HHT. Moreover, the results showed that a genetic diagnosis of HHT results in emotional shock, uncertainty about the future, and worry about one’s children in parents who are confronted with the dilemma of facing the reality of the diagnosis or delaying dealing with the diagnosis until disease onset. Family and personal perceptions of the disease influenced not only the delay in diagnosis but also the emotional and behavioral reactions of patients following a genetic diagnosis.SCOPUS: ar.jinfo:eu-repo/semantics/publishe

Thermally superactive artificial kagome spin ice structures obtained with the interfacial Dzyaloshinskii-Moriya interaction

Artificial kagome spin ice exhibits exotic magnetic correlations driven by a combination of geometric frustration and dipolar interactions that, at low-enough temperature, can result in ordered phases. This order, whether it is the ground state of several kagome rings, or the theoretically predicted long-range order of an extended array, has yet to be experimentally observed. By introducing an interfacial Dzyaloshinskii-Moriya interaction, we are able to reduce the blocking temperature of the individual nanomagnets, allowing a system of 30 kagome nanomagnets to explore its vast manifold of microstates and find its ground state. Furthermore, the extracted magnetic correlations in an extended artificial kagome spin ice are found to exhibit quantitative signatures of long-range charge order, providing evidence of the theoretically predicted continuous phase transition to the charge-ordered state. The significant lowering of the blocking temperature in nanomagnets is important for the exploitation of superparamagnetism in artificial spin systems and devices