Zero- and Few-shot Sound Event Localization and Detection

Sound event localization and detection (SELD) systems estimate direction-of-arrival (DOA) and temporal activation for sets of target classes. Neural network (NN)-based SELD systems have performed well in various sets of target classes, but they only output the DOA and temporal activation of preset classes that are trained before inference. To customize target classes after training, we tackle zero- and few-shot SELD tasks, in which we set new classes with a text sample or a few audio samples. While zero-shot sound classification tasks are achievable by embedding from contrastive language-audio pretraining (CLAP), zero-shot SELD tasks require assigning an activity and a DOA to each embedding, especially in overlapping cases. To tackle the assignment problem in overlapping cases, we propose an embed-ACCDOA model, which is trained to output track-wise CLAP embedding and corresponding activity-coupled Cartesian direction-of-arrival (ACCDOA). In our experimental evaluations on zero- and few-shot SELD tasks, the embed-ACCDOA model showed a better location-dependent scores than a straightforward combination of the CLAP audio encoder and a DOA estimation model. Moreover, the proposed combination of the embed-ACCDOA model and CLAP audio encoder with zero- or few-shot samples performed comparably to an official baseline system trained with complete train data in an evaluation dataset.Comment: 5 pages, 4 figure

STARSS23: An Audio-Visual Dataset of Spatial Recordings of Real Scenes with Spatiotemporal Annotations of Sound Events

While direction of arrival (DOA) of sound events is generally estimated from multichannel audio data recorded in a microphone array, sound events usually derive from visually perceptible source objects, e.g., sounds of footsteps come from the feet of a walker. This paper proposes an audio-visual sound event localization and detection (SELD) task, which uses multichannel audio and video information to estimate the temporal activation and DOA of target sound events. Audio-visual SELD systems can detect and localize sound events using signals from a microphone array and audio-visual correspondence. We also introduce an audio-visual dataset, Sony-TAu Realistic Spatial Soundscapes 2023 (STARSS23), which consists of multichannel audio data recorded with a microphone array, video data, and spatiotemporal annotation of sound events. Sound scenes in STARSS23 are recorded with instructions, which guide recording participants to ensure adequate activity and occurrences of sound events. STARSS23 also serves human-annotated temporal activation labels and human-confirmed DOA labels, which are based on tracking results of a motion capture system. Our benchmark results demonstrate the benefits of using visual object positions in audio-visual SELD tasks. The data is available at https://zenodo.org/record/7880637.Comment: 27 pages, 9 figures, accepted for publication in NeurIPS 2023 Track on Datasets and Benchmark

Optimized protocol for the extraction of RNA and DNA from frozen whole blood sample stored in a single EDTA tube

Cryopreservation of whole blood is useful for DNA collection, and clinical and basic research. Blood samples in ethylenediaminetetraacetic acid disodium salt (EDTA) tubes stored at − 80 °C are suitable for DNA extraction, but not for high-quality RNA extraction. Herein, a new methodology for high-quality RNA extraction from human blood samples is described. Quickly thawing frozen whole blood on aluminum blocks at room temperature could minimize RNA degradation, and improve RNA yield and quality compared with thawing the samples in a 37 °C water bath. Furthermore, the use of the NucleoSpin RNA kit increased RNA yield by fivefold compared with the PAXgene Blood RNA Kit. Thawing blood samples on aluminum blocks significantly increased the DNA yield by ~ 20% compared with thawing in a 37 °C water bath or on ice. Moreover, by thawing on aluminum blocks and using the NucleoSpin RNA and QIAamp DNA Blood kits, the extraction of RNA and DNA of sufficient quality and quantity was achieved from frozen EDTA whole blood samples that were stored for up to 8.5 years. Thus, extracting RNA from frozen whole blood in EDTA tubes after long-term storage is feasible. These findings may help advance gene expression analysis, as well as biomarker research for various diseases

Interferon signaling and hypercytokinemia-related gene expression in the blood of antidepressant non-responders

Only 50% of patients with depression respond to the first antidepressant drug administered. Thus, biomarkers for prediction of antidepressant responses are needed, as predicting which patients will not respond to antidepressants can optimize selection of alternative therapies. We aimed to identify biomarkers that could predict antidepressant responsiveness using a novel data-driven approach based on statistical pattern recognition. We retrospectively divided patients with major depressive disorder into antidepressant responder and non-responder groups. Comprehensive gene expression analysis was performed using peripheral blood without narrowing the genes. We designed a classifier according to our own discrete Bayes decision rule that can handle categorical data. Nineteen genes showed differential expression in the antidepressant non-responder group (n = 15) compared to the antidepressant responder group (n = 15). In the training sample of 30 individuals, eight candidate genes had significantly altered expression according to quantitative real-time polymerase chain reaction. The expression of these genes was examined in an independent test sample of antidepressant responders (n = 22) and non-responders (n = 12). Using the discrete Bayes classifier with the HERC5, IFI6, and IFI44 genes identified in the training set yielded 85% discrimination accuracy for antidepressant responsiveness in the 34 test samples. Pathway analysis of the RNA sequencing data for antidepressant responsiveness identified that hypercytokinemia- and interferon-related genes were increased in non-responders. Disease and biofunction analysis identified changes in genes related to inflammatory and infectious diseases, including coronavirus disease. These results strongly suggest an association between antidepressant responsiveness and inflammation, which may be useful for future treatment strategies for depression

Malignant Melanoma on a Thermal Burn Scar with an Interval of More Than 70 Years

Cases of malignant melanoma on thermal burn scars have occasionally been reported. We report a 78-year-old Japanese female with malignant melanoma on a thermal burn scar with an interval of more than 70 years. Our case reemphasizes the importance of regular examinations in persons with thermal burn scars

Protein oxidation mediated by heme-induced active site conversion specific for heme-regulated transcription factor, iron response regulator

The Bradyrhizobium japonicum transcriptional regulator Irr (iron response regulator) is a key regulator of the iron homeostasis, which is degraded in response to heme binding via a mechanism that involves oxidative modification of the protein. Here, we show that heme-bound Irr activates O-2 to form highly reactive oxygen species (ROS) with the "active site conversion" from heme iron to non-heme iron to degrade itself. In the presence of heme and reductant, the ROS scavenging experiments show that Irr generates H2O2 from O-2 as found for other hemoproteins, but H2O2 is less effective in oxidizing the peptide, and further activation of H2O2 is suggested. Interestingly, we find a time-dependent decrease of the intensity of the Soret band and appearance of the characteristic EPR signal at g = 4.3 during the oxidation, showing the heme degradation and the successive formation of a non-heme iron site. Together with the mutational studies, we here propose a novel "two-step self-oxidative modification" mechanism, during which O-2 is activated to form H2O2 at the heme regulatory motif (HRM) site and the generated H2O2 is further converted into more reactive species such as OH at the non-heme iron site in the His-cluster region formed by the active site conversion

Cellulitis with Leukocytopenia as an Initial Sign of Acute Promyelocytic Leukemia

Patients with hematologic malignancies are immunosuppressive and may develop cutaneous or invasive infections as a primary sign of immune suppression. Acute promyelocytic leukemia (acute myeloid leukemia M3) is caused by translocation of reciprocal chromosomal rearrangement t(15;17), which produces an oncogenic protein. We herein describe a 71-year-old man having cellulitis with leukocytopenia as a first sign of acute promyelocytic leukemia. Dermatologists and hematologists should keep in mind that patients with a hematologic malignancy, such as acute promyelocytic leukemia, can develop cellulitis with leukocytopenia