Contrastive Audio-Visual Masked Autoencoder

In this paper, we first extend the recent Masked Auto-Encoder (MAE) model from a single modality to audio-visual multi-modalities. Subsequently, we propose the Contrastive Audio-Visual Masked Auto-Encoder (CAV-MAE) by combining contrastive learning and masked data modeling, two major self-supervised learning frameworks, to learn a joint and coordinated audio-visual representation. Our experiments show that the contrastive audio-visual correspondence learning objective not only enables the model to perform audio-visual retrieval tasks, but also helps the model learn a better joint representation. As a result, our fully self-supervised pretrained CAV-MAE achieves a new SOTA accuracy of 65.9% on VGGSound, and is comparable with the previous best supervised pretrained model on AudioSet in the audio-visual event classification task. Code and pretrained models are at https://github.com/yuangongnd/cav-mae.Comment: Accepted at ICLR 2023 as a notable top 25% paper. Code and pretrained models are at https://github.com/yuangongnd/cav-ma

Linking Microscopic Spatial Patterns of Tissue Destruction in Emphysema to Macroscopic Decline in Stiffness Using a 3D Computational Model

Pulmonary emphysema is a connective tissue disease characterized by the progressive destruction of alveolar walls leading to airspace enlargement and decreased elastic recoil of the lung. However, the relationship between microscopic tissue structure and decline in stiffness of the lung is not well understood. In this study, we developed a 3D computational model of lung tissue in which a pre-strained cuboidal block of tissue was represented by a tessellation of space filling polyhedra, with each polyhedral unit-cell representing an alveolus. Destruction of alveolar walls was mimicked by eliminating faces that separate two polyhedral either randomly or in a spatially correlated manner, in which the highest force bearing walls were removed at each step. Simulations were carried out to establish a link between the geometries that emerged and the rate of decline in bulk modulus of the tissue block. The spatially correlated process set up by the force-based destruction lead to a significantly faster rate of decline in bulk modulus accompanied by highly heterogeneous structures than the random destruction pattern. Using the Karhunen-Loève transformation, an estimator of the change in bulk modulus from the first four moments of airspace cell volumes was setup. Simulations were then obtained for tissue destruction with different idealized alveolar geometry, levels of pre-strain, linear and nonlinear elasticity assumptions for alveolar walls and also mixed destruction patterns where both random and force-based destruction occurs simultaneously. In all these cases, the change in bulk modulus from cell volumes was accurately estimated. We conclude that microscopic structural changes in emphysema and the associated decline in tissue stiffness are linked by the spatial pattern of the destruction process

Extra-cellular matrix proteins induce matrix metalloproteinase-1 (MMP-1) activity and increase airway smooth muscle contraction in asthma

Airway remodelling describes the histopathological changes leading to fixed airway obstruction in patients with asthma and includes extra-cellular matrix (ECM) deposition. Matrix metalloproteinase-1 (MMP-1) is present in remodelled airways but its relationship with ECM proteins and the resulting functional consequences are unknown. We used airway smooth muscle cells (ASM) and bronchial biopsies from control donors and patients with asthma to examine the regulation of MMP-1 by ECM in ASM cells and the effect of MMP-1 on ASM contraction. Collagen-I and tenascin-C induced MMP-1 protein expression, which for tenascin-C, was greater in asthma derived ASM cells. Tenascin-C induced MMP-1 expression was dependent on ERK1/2, JNK and p38 MAPK activation and attenuated by function blocking antibodies against the β1 and β3 integrin subunits. Tenascin-C and MMP-1 were not expressed in normal airways but co-localised in the ASM bundles and reticular basement membrane of patients with asthma. Further, ECM from asthma derived ASM cells stimulated MMP-1 expression to a greater degree than ECM from normal ASM. Bradykinin induced contraction of ASM cells seeded in 3D collagen gels was reduced by the MMP inhibitor ilomastat and by siRNA knockdown of MMP-1. In summary, the induction of MMP-1 in ASM cells by tenascin-C occurs in part via integrin mediated MAPK signalling. MMP-1 and tenascin-C are co-localised in the smooth muscle bundles of patients with asthma where this interaction may contribute to enhanced airway contraction. Our findings suggest that ECM changes in airway remodelling via MMP-1 could contribute to an environment promoting greater airway narrowing in response to broncho-constrictor stimuli and worsening asthma symptoms