Toward Leveraging Pre-Trained Self-Supervised Frontends for Automatic Singing Voice Understanding Tasks: Three Case Studies

Automatic singing voice understanding tasks, such as singer identification, singing voice transcription, and singing technique classification, benefit from data-driven approaches that utilize deep learning techniques. These approaches work well even under the rich diversity of vocal and noisy samples owing to their representation ability. However, the limited availability of labeled data remains a significant obstacle to achieving satisfactory performance. In recent years, self-supervised learning models (SSL models) have been trained using large amounts of unlabeled data in the field of speech processing and music classification. By fine-tuning these models for the target tasks, comparable performance to conventional supervised learning can be achieved with limited training data. Therefore, in this paper, we investigate the effectiveness of SSL models for various singing voice recognition tasks. We report the results of experiments comparing SSL models for three different tasks (i.e., singer identification, singing voice transcription, and singing technique classification) as initial exploration and aim to discuss these findings. Experimental results show that each SSL model achieves comparable performance and sometimes outperforms compared to state-of-the-art methods on each task. We also conducted a layer-wise analysis to further understand the behavior of the SSL models.Comment: Submitted to APSIPA 202

A new determination method of interatomic potential for sodium silicate glass simulations

An interatomic potential for the classical molecular dynamics (MD) simulation of sodium silicate glasses was proposed. The ionic charges for this interatomic potential were determined by Mulliken population analysis via the density functional theory (DFT) calculation of alkali silicate crystals. The Si-O interatomic potential energy curve was determined by molecular orbital (MO) calculation of SiO2 +. The results of classical MD simulations using the new interatomic potential were consistent with the experimental trends in interatomic distance, thermal expansion coefficient, molar volume, Si-O-Si bond angle distribution, and Qn ratio with respect to the sodium composition of the silicate glass. The proposed interatomic potential improves the reproducibility of the ring size distribution in silicate glasses compared to conventional potentials

Adsorption of rare earth ions onto the cell walls of wild-type and lipoteichoic acid-defective strains of Bacillus subtilis

The aim of this study is to investigate the potential of cell walls of wild-type and lipoteichoic acid-defective strains of Bacillus subtilis 168 to adsorb rare earth ions. Freeze-dried cell powders prepared from both strains were used for the evaluation of adsorption ability for the rare earth ions, namely, La(III), Eu(III), and Tm(III). The rare earth ions were efficiently adsorbed onto powders of both wild-type strain (WT powder) and lipoteichoic acid-defective strain (a dagger LTA powder) at pH 3. The maximum adsorption capacities for Tm(III) by WT and a dagger LTA powders were 43 and 37 mg g(-1), respectively. Removal (in percent) of Tm(III), La(III), and Eu(III) from aqueous solution by WT powder was greater than by a dagger LTA powder. These results indicate that rare earth ions are adsorbed to functional groups, such as phosphate and carboxyl groups, of lipoteichoic acid. We observed coagulated a dagger LTA powder in the removal of rare earth ions (1-20 mg L-1) from aqueous solution. In contrast, sedimentation of WT powder did not occur under the same conditions. This unique feature of a dagger LTA powder may be caused by the difference of the distribution between lipoteichoic acid and wall teichoic acid. It appears that a dagger LTA powder is useful for removal of rare earth ions by adsorption, because aggregation allows for rapid separation of the adsorbent by filtration.ArticleAPPLIED MICROBIOLOGY AND BIOTECHNOLOGY. 97(8):3721-3728 (2013)journal articl

Platform based screening strategies that deliver reliable and high quality continous biomanufacturing processes

The challenge during mammalian cell line and upstream process development is to identify and isolate stable, high expressing cell lines producing product with the appropriate critical product quality attributes rapidly, reproducibly and with relative ease. Current platform processes are based on a defined set of hierarchical screening strategies utilised to identify key cellular performance criteria required for fed-batch culture (Porter et al 2010a,b). The application of continuous biomanufacturing principles has introduced a paradigm shift, due to their inherent advantage of higher productivity which can facilitate the implementation of smaller process equipment and result in cost-effective, lean and agile manufacturing facilities. However, as we move from fed-batch to continuous manufacturing we must re-evaluate and leverage the correct platform technologies (host cell line, expression vector, cell line development process, cell culture media/feed, process control) to rapidly identify the correct cellular performance criteria that are important for continuous biomanufacturing processes. Furthermore, whereas the adoption of robust and reproducible platform processes have been widely adopted for fed-batch processes, optimal upstream continuous processes performance still largely relies on the optimisation of key bioprocess parameters which are optimised in an ad-hoc manner during process development. To increase speed-to-clinic we show the application of both a new cell line development and continuous upstream production platform methodology which has been successfully utilised to establish reliable and high quality continuous upstream biomanufacturing processes for multiple CHO-DG44 derived cell lines and recombinant monoclonal antibody products. References Porter AJ, Dickson AJ, Racher AJ. (2010a) Strategies for selecting recombinant CHO cell lines for cGMP manufacturing: Realising the potential in bioreactors. Biotechnol Prog 26(5):1446-54 Porter AJ, Racher AJ, Preziosi R, Dickson AJ (2010b) Strategies for selecting recombinant CHO cell lines for cGMP manufacturing: Improving the efficiency of cell line generation. Biotechnol Prog 26(5): 1455-64

Microfluidic cell engineering on high-density microelectrode arrays for assessing structure-function relationships in living neuronal networks

Neuronal networks in dissociated culture combined with cell engineering technology offer a pivotal platform to constructively explore the relationship between structure and function in living neuronal networks. Here, we fabricated defined neuronal networks possessing a modular architecture on high-density microelectrode arrays (HD-MEAs), a state-of-the-art electrophysiological tool for recording neural activity with high spatial and temporal resolutions. We first established a surface coating protocol using a cell-permissive hydrogel to stably attach polydimethylsiloxane microfluidic film on the HD-MEA. We then recorded the spontaneous neural activity of the engineered neuronal network, which revealed an important portrait of the engineered neuronal network--modular architecture enhances functional complexity by reducing the excessive neural correlation between spatially segregated modules. The results of this study highlight the impact of HD-MEA recordings combined with cell engineering technologies as a novel tool in neuroscience to constructively assess the structure-function relationships in neuronal networks.Comment: 18 pages, 5 figure