Prompt Tuning of Deep Neural Networks for Speaker-adaptive Visual Speech Recognition

Visual Speech Recognition (VSR) aims to infer speech into text depending on lip movements alone. As it focuses on visual information to model the speech, its performance is inherently sensitive to personal lip appearances and movements, and this makes the VSR models show degraded performance when they are applied to unseen speakers. In this paper, to remedy the performance degradation of the VSR model on unseen speakers, we propose prompt tuning methods of Deep Neural Networks (DNNs) for speaker-adaptive VSR. Specifically, motivated by recent advances in Natural Language Processing (NLP), we finetune prompts on adaptation data of target speakers instead of modifying the pre-trained model parameters. Different from the previous prompt tuning methods mainly limited to Transformer variant architecture, we explore different types of prompts, the addition, the padding, and the concatenation form prompts that can be applied to the VSR model which is composed of CNN and Transformer in general. With the proposed prompt tuning, we show that the performance of the pre-trained VSR model on unseen speakers can be largely improved by using a small amount of adaptation data (e.g., less than 5 minutes), even if the pre-trained model is already developed with large speaker variations. Moreover, by analyzing the performance and parameters of different types of prompts, we investigate when the prompt tuning is preferred over the finetuning methods. The effectiveness of the proposed method is evaluated on both word- and sentence-level VSR databases, LRW-ID and GRID

The basic study on measuring method of contamination of the ground and the effective porosity by using dielectric constant measuring system

For evaluating subsurface contamination, sampling method (boring) is commonly used, but this method cannot monitor the change of in-situ contamination and concentration with respect to time. The purpose of this study is to develop a measuring system for subsurface contamination in which a so-called FDR (Frequency Domain Refiectometry) and FDR-V (with Vector network analyzer) system was employed to measure the salinity and oil contaminant. This FDR and FDR-V method is a coaxial probe method, which allows the measurement of the dielectric. The experimental study indicates the possibility in measuring both the contaminant concentration and volumetric moisture content. In addition, the method for obtaining the effective porosity using this equipment was shown. Concretely, the sensor was inserted in the ground, and the liquid in which the dielectric constant differed on the water in the circumference was injected, and the method for obtaining the effective porosity from the change of the dielectric constant was proposed

Efficient and effective human action recognition in video through motion boundary description with a compact set of trajectories

Human action recognition (HAR) is at the core of human-computer interaction and video scene understanding. However, achieving effective HAR in an unconstrained environment is still a challenging task. To that end, trajectory-based video representations are currently widely used. Despite the promising levels of effectiveness achieved by these approaches, problems regarding computational complexity and the presence of redundant trajectories still need to be addressed in a satisfactory way. In this paper, we propose a method for trajectory rejection, reducing the number of redundant trajectories without degrading the effectiveness of HAR. Furthermore, to realize efficient optical flow estimation prior to trajectory extraction, we integrate a method for dynamic frame skipping. Experiments with four publicly available human action datasets show that the proposed approach outperforms state-of-the-art HAR approaches in terms of effectiveness, while simultaneously mitigating the computational complexity

RNAase III-Type Enzyme Dicer Regulates Mitochondrial Fatty Acid Oxidative Metabolism in Cardiac Mesenchymal Stem Cells

Cardiac mesenchymal stem cells (C-MSC) play a key role in maintaining normal cardiac function under physiological and pathological conditions. Glycolysis and mitochondrial oxidative phosphorylation predominately account for energy production in C-MSC. Dicer, a ribonuclease III endoribonuclease, plays a critical role in the control of microRNA maturation in C-MSC, but its role in regulating C-MSC energy metabolism is largely unknown. In this study, we found that Dicer knockout led to concurrent increase in both cell proliferation and apoptosis in C-MSC compared to Dicer floxed C-MSC. We analyzed mitochondrial oxidative phosphorylation by quantifying cellular oxygen consumption rate (OCR), and glycolysis by quantifying the extracellular acidification rate (ECAR), in C-MSC with/without Dicer gene deletion. Dicer gene deletion significantly reduced mitochondrial oxidative phosphorylation while increasing glycolysis in C-MSC. Additionally, Dicer gene deletion selectively reduced the expression of β-oxidation genes without affecting the expression of genes involved in the tricarboxylic acid (TCA) cycle or electron transport chain (ETC). Finally, Dicer gene deletion reduced the copy number of mitochondrially encoded 1,4-Dihydronicotinamide adenine dinucleotide (NADH): ubiquinone oxidoreductase core subunit 6 (MT-ND6), a mitochondrial-encoded gene, in C-MSC. In conclusion, Dicer gene deletion induced a metabolic shift from oxidative metabolism to aerobic glycolysis in C-MSC, suggesting that Dicer functions as a metabolic switch in C-MSC, which in turn may regulate proliferation and environmental adaptation

Temperature-dependent evolutions of excitonic superfluid plasma frequency in a srong excitonic insulator candidate, Ta2_2NiSe5_5

We investigate an interesting anisotropic van der Waals material, Ta$_{2}$NiSe$_{5}$, using optical spectroscopy. Ta$_{2}$NiSe$_{5}$ has been known as one of the few excitonic insulators proposed over 50 years ago. Ta$_{2}$NiSe$_{5}$ has quasi-one dimensional chains along the $a$-axis. We have obtained anisotropic optical properties of a single crystal Ta$_{2}$NiSe$_{5}$ along the $a$- and $c$-axes. The measured $a$- and $c$-axis optical conductivities exhibit large anisotropic electronic and phononic properties. With regard to the $a$-axis optical conductivity, a sharp peak near 3050 cm$^{-1}$ at 9 K, with a well-defined optical gap ($\Delta^{EI} \simeq$ 1800 cm$^{-1}$) and a strong temperature-dependence, is observed. With an increase in temperature, this peak broadens and the optical energy gap closes around $\sim$325 K($T_c^{EI}$). The spectral weight redistribution with respect to the frequency and temperature indicates that the normalized optical energy gap ($\Delta^{EI}(T)/\Delta^{EI}(0)$) is $1-(T/T_c^{EI})^2$. The temperature-dependent superfluid plasma frequency of the excitonic condensation in Ta$_{2}$NiSe$_{5}$ has been determined from measured optical data. Our findings may be useful for future research on excitonic insulators.Comment: 17 pages, 5 figure

Leisure sedentary time is differentially associated with hypertension, diabetes mellitus, and hyperlipidemia depending on occupation

Abstract Background Sedentary behavior is considered an independent cause of cardio-metabolic diseases, regardless of physical activity level and obesity. Few studies have reported the association between leisure sedentary time and cardio-vascular diseases in terms of occupation. Methods We performed a cross-sectional study using data from the Korean Community Health Survey (KCHS) for 240,086 participants assessed in 2011 and 2013. Occupation was categorized into four groups: farmer or fisherman, laborer, and soldier (Group I); service worker, salesperson, technician, mechanic, production worker, and engineer (Group II); manager, expert, specialist, and clerk (Group III); and unemployed (Group IV). Leisure sedentary time was divided into five groups: 0 h, 1 h, 2 h, 3 h, and 4+ h. The association between leisure sedentary time on weekdays and hypertension/diabetes mellitus/hyperlipidemia for different occupations was analyzed using simple and multiple logistic regression analyses with complex sampling. Results In Groups I, II and III, no length of sedentary time was associated with hypertension, and only 3 h or 4+ h of sedentary time was associated with diabetes mellitus and hyperlipidemia. Group IV showed a significant association with hypertension and diabetes mellitus for the 2 h, 3 h, and 4+ h sedentary times. Conclusions The unemployed are more susceptible than other occupation groups to cardio-metabolic diseases when leisure time is sedentary