AV-SUPERB: A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models

Audio-visual representation learning aims to develop systems with human-like perception by utilizing correlation between auditory and visual information. However, current models often focus on a limited set of tasks, and generalization abilities of learned representations are unclear. To this end, we propose the AV-SUPERB benchmark that enables general-purpose evaluation of unimodal audio/visual and bimodal fusion representations on 7 datasets covering 5 audio-visual tasks in speech and audio processing. We evaluate 5 recent self-supervised models and show that none of these models generalize to all tasks, emphasizing the need for future study on improving universal model performance. In addition, we show that representations may be improved with intermediate-task fine-tuning and audio event classification with AudioSet serves as a strong intermediate task. We release our benchmark with evaluation code and a model submission platform to encourage further research in audio-visual learning.Comment: Submitted to ICASSP 2024; Evaluation Code: https://github.com/roger-tseng/av-superb Submission Platform: https://av.superbbenchmark.or

High-Molecular-Weight Hyaluronic Acid Inhibits IL-1β-Induced Synovial Inflammation and Macrophage Polarization through the GRP78-NF-κB Signaling Pathway

Recent evidence has suggested that synovial inflammation and macrophage polarization were involved in the pathogenesis of osteoarthritis (OA). Additionally, high-molecular-weight hyaluronic acid (HMW-HA) was often used clinically to treat OA. GRP78, an endoplasmic reticulum (ER) stress chaperone, was suggested to contribute to the hyperplasia of synovial cells in OA. However, it was still unclear whether HMW-HA affected macrophage polarization through GRP78. Therefore, we aimed to identify the effect of HMW-HA in primary synovial cells and macrophage polarization and to investigate the role of GRP78 signaling. We used IL-1β to treat primary synoviocytes to mimic OA, and then treated them with HMW-HA. We also collected conditioned medium (CM) to culture THP-1 macrophages and examine the changes in the phenotype. IL-1β increased the expression of GRP78, NF-κB (p65 phosphorylation), IL-6, and PGE2 in primary synoviocytes, accompanied by an increased macrophage M1/M2 polarization. GRP78 knockdown significantly reversed the expression of IL-1β-induced GRP78-related downstream molecules and macrophage polarization. HMW-HA with GRP78 knockdown had additive effects in an IL-1β culture. Finally, the synovial fluid from OA patients revealed significantly decreased IL-6 and PGE2 levels after the HMW-HA treatment. Our study elucidated a new form of signal transduction for HMW-HA-mediated protection against synovial inflammation and macrophage polarization and highlighted the involvement of the GRP78-NF-κB signaling pathway

Novel Autoantibodies in Idiopathic Small Fiber Neuropathy.

OBJECTIVE Small fiber neuropathy (SFN) is clinically and etiologically heterogeneous. Although autoimmunity has been postulated to be pathophysiologically important in SFN, few autoantibodies have been described. We aimed to identify autoantibodies associated with idiopathic SFN (iSFN) by a novel high-throughput protein microarray platform that captures autoantibodies expressed in the native conformational state. METHODS Sera from 58 SFN patients and 20 age- and gender-matched healthy controls (HCs) were screened against >1,600 immune-related antigens. Fluorescent unit readout and postassay imaging were performed, followed by composite data normalization and protein fold change (pFC) analysis. Analysis of an independent validation cohort of 33 SFN patients against the same 20 HCs was conducted to identify reproducible proteins in both cohorts. RESULTS Nine autoantibodies were screened with statistical significance and pFC criteria in both cohorts, with at least 50% change in serum levels. Three proteins showed consistently high fold changes in main and validation cohorts: MX1 (FC = 2.99 and 3.07, respectively, p = 0.003, q = 0.076), DBNL (FC = 2.11 and 2.16, respectively, p = 0.009, q < 0.003), and KRT8 (FC = 1.65 and 1.70, respectively, p = 0.043, q < 0.003). Further subgroup analysis into iSFN and SFN by secondary causes (secondary SFN) in the main cohort showed that MX1 is higher in iSFN compared to secondary SFN (FC = 1.61 vs 0.106, p = 0.009). INTERPRETATION Novel autoantibodies MX1, DBNL, and KRT8 are found in iSFN. MX1 may allow diagnostic subtyping of iSFN patients. ANN NEUROL 2021

Factors of fracture surgery、inpatient、all-caused mortality stratified by variables listed in the table by using Cox regression.

Factors of fracture surgery、inpatient、all-caused mortality stratified by variables listed in the table by using Cox regression.</p

Kaplan-Meier for cumulative risk of inpatient among patients of diabetes with osteoporosis aged 18 and over stratified by TCM with log-rank test.

Kaplan-Meier for cumulative risk of inpatient among patients of diabetes with osteoporosis aged 18 and over stratified by TCM with log-rank test.</p

Characteristics of study in the baseline.

BackgroundStudies have confirmed that osteoporosis has been considered as one of the complications of diabetes, and the health hazards to patients are more obvious. This study is mainly based on the Taiwan National Health Insurance Database (TNHID). Through the analysis of TNHID, it is shown that the combined treatment of traditional Chinese medicine (TCM) medicine in patients of diabetes with osteoporosis (T2DOP) with lower related risks.MethodsAccording to the study design, 3131 patients selected from TNHID who received TCM treatment were matched by 1-fold propensity score according to gender, age, and inclusion date as the control group. Cox proportional hazards analyzes were performed to compare fracture surgery, hospitalization, and all-cause mortality during a mean follow-up from 2000 to 2015.ResultsA total of 1055/1469/715 subjects (16.85%/23.46%/11.42%) had fracture surgery/inpatient/all-cause mortality of which 433/624/318 (13.83%/19.93%/10.16%) were in the TCM group) and 622/845/397 (19.87%/26.99%/12.68%) in the control group. Cox proportional hazards regression analysis showed that subjects in the TCM group had lower rates of fracture surgery, inpatient and all-cause mortality (adjusted HR = 0.467; 95% CI = 0.225–0.680, PConclusionThis study provides longitudinal evidence through a cohort study of the value of integrated TCM for T2DOP. More research is needed to fully understand the clinical significance of these results.</div

Factors of prognosis among different TCM subgroups by using Cox regression.

Factors of prognosis among different TCM subgroups by using Cox regression.</p

Abbreviation, ICD-9-CM, and definition.

BackgroundStudies have confirmed that osteoporosis has been considered as one of the complications of diabetes, and the health hazards to patients are more obvious. This study is mainly based on the Taiwan National Health Insurance Database (TNHID). Through the analysis of TNHID, it is shown that the combined treatment of traditional Chinese medicine (TCM) medicine in patients of diabetes with osteoporosis (T2DOP) with lower related risks.MethodsAccording to the study design, 3131 patients selected from TNHID who received TCM treatment were matched by 1-fold propensity score according to gender, age, and inclusion date as the control group. Cox proportional hazards analyzes were performed to compare fracture surgery, hospitalization, and all-cause mortality during a mean follow-up from 2000 to 2015.ResultsA total of 1055/1469/715 subjects (16.85%/23.46%/11.42%) had fracture surgery/inpatient/all-cause mortality of which 433/624/318 (13.83%/19.93%/10.16%) were in the TCM group) and 622/845/397 (19.87%/26.99%/12.68%) in the control group. Cox proportional hazards regression analysis showed that subjects in the TCM group had lower rates of fracture surgery, inpatient and all-cause mortality (adjusted HR = 0.467; 95% CI = 0.225–0.680, PConclusionThis study provides longitudinal evidence through a cohort study of the value of integrated TCM for T2DOP. More research is needed to fully understand the clinical significance of these results.</div

S3 Table -

1. Years of follow-up. 2. Years to prognosis. (DOCX)</p