Prompt Tuning of Deep Neural Networks for Speaker-adaptive Visual Speech Recognition

Visual Speech Recognition (VSR) aims to infer speech into text depending on lip movements alone. As it focuses on visual information to model the speech, its performance is inherently sensitive to personal lip appearances and movements, and this makes the VSR models show degraded performance when they are applied to unseen speakers. In this paper, to remedy the performance degradation of the VSR model on unseen speakers, we propose prompt tuning methods of Deep Neural Networks (DNNs) for speaker-adaptive VSR. Specifically, motivated by recent advances in Natural Language Processing (NLP), we finetune prompts on adaptation data of target speakers instead of modifying the pre-trained model parameters. Different from the previous prompt tuning methods mainly limited to Transformer variant architecture, we explore different types of prompts, the addition, the padding, and the concatenation form prompts that can be applied to the VSR model which is composed of CNN and Transformer in general. With the proposed prompt tuning, we show that the performance of the pre-trained VSR model on unseen speakers can be largely improved by using a small amount of adaptation data (e.g., less than 5 minutes), even if the pre-trained model is already developed with large speaker variations. Moreover, by analyzing the performance and parameters of different types of prompts, we investigate when the prompt tuning is preferred over the finetuning methods. The effectiveness of the proposed method is evaluated on both word- and sentence-level VSR databases, LRW-ID and GRID

Skills Beyond School

This report provides an overview of the findings from the country-based case study of Korean post-secondary VET as part of the “Programme of Work and Budget 2011-12” under the OECD Skills Beyond School (SBS) project carried in 2010. It was a collaborative effort between the OECD and KRIVET, which recognize the growing importance of skills for economic and social development. Both organizations have been interested in examining the role of post-secondary vocational education and training (VET) in skills development. Thus, this project studies Korean post-secondary VET in general based on the pilot research carried out by OECD-KRIVET. The overall aim has been to develop an analytical framework and case study of Korea’s post-secondary VET with two objectives in mind, as part of the OECD’s country review. The first objective was to analyze and diagnose the issues and challenges faced by Korean post-secondary VET, and to suggest policy remedies to address them. The findings of the research study are presented as part of the OECD SBS project. Moreover, it is hoped that the study can also present an alternative view on the linkage between post-secondary VET and the labour market. This is guided by the recognition that Korean post-secondary VET can play a positive role in economic and social development. The second objective is to support the efforts of the OECD to present policy recommends on post-secondary VET based on a study of Korea’s post-secondary VET and the labour market. It is hoped that the policy implications of the research study can assist Korean policymakers in formulating policies on Korea’s post-secondary VET. ...Executive Summary… ⅴ Ⅰ. Introduction … p1 1. Background … p1 2. Objectives and Research Themes… p2 3. Research Approach and Methodology… p3 4. Structure of the Report … p4 Ⅱ. Post-secondary VET in Korea … p7 1. Korean Education System… p7 2. Definition and Scope of Post-secondary VET … p8 3. Topology of Post-secondary VET… p10 4. History of Korean Post-secondary VET… p12 Ⅲ. Structure of Post-secondary VET … p17 1. Features of Korean Post-secondary VET… p17 2. Programme Feature… p22 3. Excess and Completion … p27 4. Employment Rate and Entry into the Labour Market… p32 Ⅳ. Operation of Post-secondary VET … p41 1. Governance … p41 2. Funding and incentive … p48 3. Quality Assurance … p60 4. Partnership and Collaboration… p63 Ⅴ. The Linkage between VET and Labour Market needs … p71 1. Information … p71 2. Qualification … p79 3. Skills Delivery System … p86 4. Career Guidance … p90 Ⅵ. Challenges and Policy … p97 1. Economic and Social Changes… p97 2. Findings from Study on Post-secondary VET… p98 3. Policy Issues and Recommendations… p101 Reference … p109 Annex 1. 2010 OECD-KRIVET Joint Research Outline… p113 Annex 2. Guidance and plan of OECD SBS project … p123 Annex 3. Seminars and interview with OECD Experts … p14

Efficient and effective human action recognition in video through motion boundary description with a compact set of trajectories

Human action recognition (HAR) is at the core of human-computer interaction and video scene understanding. However, achieving effective HAR in an unconstrained environment is still a challenging task. To that end, trajectory-based video representations are currently widely used. Despite the promising levels of effectiveness achieved by these approaches, problems regarding computational complexity and the presence of redundant trajectories still need to be addressed in a satisfactory way. In this paper, we propose a method for trajectory rejection, reducing the number of redundant trajectories without degrading the effectiveness of HAR. Furthermore, to realize efficient optical flow estimation prior to trajectory extraction, we integrate a method for dynamic frame skipping. Experiments with four publicly available human action datasets show that the proposed approach outperforms state-of-the-art HAR approaches in terms of effectiveness, while simultaneously mitigating the computational complexity

Highly Active Ni–Fe Based Oxide Oxygen Evolution Reaction Electrocatalysts for Alkaline Anion Exchange Membrane Electrolyser

Oxygen evolution reaction (OER) electrocatalysts are pivotal for sustainable hydrogen production through anion exchange membrane electrolysis. Cost-effective transition metals such as nickel and iron-based oxides (Ni–Fe–Ox) have been recognized as viable catalysts for the oxygen evolution process in alkaline media. In this work, we study the electrochemical characterization and stability of the Ni–Fe–Ox to find the suitability for AEM electrolysis. The results indicate that Ni–Fe–Ox has 5 times higher activity than pure Ni. The Ni–Fe–Ox electrodes exhibit an exceptionally high catalytic activity of 22 mA cm−2 at 1.55 V vs. RHE, and a Tafel value as low as 97 dec−1, for OER to occur. These findings imply that OER occurs at similar places along the Ni–Fe–Ox interface and that the Ni—Fe2O3 contact plays a significant role as the OER active site. Furthermore, it is also worth noting that the presence of metallic Ni allows for fast electron transit within the interface, which is necessary for successful electrocatalysis. Aside from the excellent OER performance, the exfoliated Ni–Fe–Ox demonstrated great stability with almost constant potential after 10 h of electrolysis at a current density of 10 mA cm−2. This work confirms Ni–Fe–Ox is a promising, highly efficient and cost-effective OER catalyst for AEM electrolysis.This research was funded by Foundation of Korea (NRF) grant number 2019H1D3A2A02102994. And the APC was funded by 2019R1I1A3A030504411

Perceptions of health status, physical fitness, and participation in physical activity among adolescents before and after COVID-19: analysis of 2019‑2021 data from the Republic of Korea national sports survey

Research has examined the detrimental effects of the coronavirus disease (COVID-19) pandemic on health and physical fitness in adolescents; however, studies comparing these parameters before and after the COVID-19 outbreak have been scarce. Therefore, this study investigated differences in perceived health status, perceived physical fitness, and participation in physical activity among adolescents in the Republic of Korea before and after the COVID-19 outbreak. We chose a sample of data from 2102 adolescents aged 14–19, collected as part of a national survey by the Republic of Korea Ministry of Culture, Sports, and Tourism from 2019 to 2021. We focused on five items from the survey related to health awareness and physical activity. Although perceived health status was lower in 2021 than in 2019 or 2020, there were no differences in perceived physical fitness during the three years of the study. Regular participation in physical activity was less common in 2020 than in 2019 or 2021. The proportion of adolescents reporting sufficient rest and sleep was lower in 2021 than in 2020. In addition, fewer adolescents reported eating regular meals and engaging in nutritional supplementation in 2021 than in 2019 and 2020. Rates of abstinence from alcohol and smoking cessation were higher in 2021 than in 2019 or 2020. For all three years, adolescents reported the following as the primary reasons for engaging in regular physical activity (in order): “maintenance of mental health”, “maintenance of physical health”, “help in daily life”, and “reduction of medical expenses”. In preparation for the post-COVID-19 era, these results highlight the need to prepare measures and countermeasures to promote health and physical activity among adolescents in the Republic of Korea

Indoor formaldehyde removal over CMK-3

The removal of formaldehyde at low concentrations is important in indoor air pollution research. In this study, mesoporous carbon with a large specific surface area was used for the adsorption of low-concentration indoor formaldehyde. A mesoporous carbon material, CMK-3, was synthesized using the nano-replication method. SBA-15 was used as a mesoporous template. The surface of CMK-3 was activated using a 2N H2SO4 solution and NH3 gas to prepare CMK-3-H2SO4 and CMK-3-NH3, respectively. The activated samples were characterized by N2 adsorption-desorption, X-ray diffraction, and X-ray photoelectron spectroscopy. The formaldehyde adsorption performance of the mesoporous carbons was in the order of CMK-3-NH3 > CMK-3-H2SO4 > CMK-3. The difference in the adsorption performance was explained by oxygen and nitrogen functional groups formed during the activation process and by the specific surface area and pore structure of mesoporous carbon

Synthesis of Porous Silica with Hierarchical Structure Directed by a Silica Precursor Carrying a Pore-Generating Cage

We have obtained a new class of porous silica with good structural order and additional corrugated nanopores clustered around the primary mesopores from the co-condensation of TEOS and adamantylphenol-grafted trimethoxysilane (adam-graft SQ) using a triblock Pluronic P123 (EO20PO70EO20,Mw = 5800) copolymer as a structure-directing agent. Thermally activated removal of pore-generating moieties (i.e., adamantylphenol groups) in adam-graft SQ involves the generation of secondary micro-to-small mesopores, while the block copolymer template generates 2D-hexagonal mesopores. We found that the mesostructural characteristics and the generation of secondary indented pores right next to the mesopores can be tailored by the addition order of the two silica precursors (TEOS and adam-graft SQ), varying the molar ratio between TEOS and adam-graft SQ in the starting sol mixture, and the degree of silica polymerization. The increase in the hexagonal unit cell parameters is attributed to the increment of pore size originating from the removal of adamantylphenol moieties. It is believed that the hydrophobicity of adamantylphenol groups plays a key role in its selective incorporation into the region near the PPO core blocks and the subsequent generation of corrugated pores along the silica channels resulting in the increase of pore diameter.This work was financially supported by the Korea Science and Engineering Foundation (KOSEF) grant through the Acceleration Research Program (R17-2007-059-01000-0) and the NANO Systems Institute – National Core Research Center (R15-2003-032-02002-0) funded by the Ministry of Education, Science and Technology (MEST) and the Brain Korea 21 Program endorsed by the MEST. Financial support from the Korean Collaborative Project for Excellence in Basic System IC Technology (System IC 2010) is also greatly acknowledged

The Clinical Usefulness of 18F-FDG PET/CT for the Evaluation of Lymph Node Metastasis in Periorbital Malignancies

PURPOSE: Surgical treatment of malignancies in the oral cavity and subsequent radiotherapy often result in an oral condition unfavorable for prosthodontic rehabilitation. This study assessed the quality of life related to oral function in edentulous head and neck cancer patients following oncology treatment of malignancies in the lower region of the oral cavity. MATERIALS AND METHODS: Patients treated between 1990 and 2000 with surgery and radiotherapy for a squamous cell carcinoma in the oral cavity who were edentulous in the mandible and had been treated with a conventional, non-implant-retained denture received an invitation for a clinical check-up (clinical assessment, questionnaires regarding oral function and quality of life). RESULTS: Sixty-seven of the 84 patients who fulfilled the inclusion criteria were willing to participate in the study. The mean irradiation dosage that these patients had received in the oral region was 61.8 +/- 5.4 Gy. Half of the patients (n=33) were not very satisfied with their prostheses; they wore their mandibular prostheses at most a few hours per day. It was concluded from the clinical assessment that two thirds of the patients (n 4) could benefit from an implant-retained mandibular denture. Analyses of the questionnaires revealed no significant associations between functional assessments, quality of life, and parameters such as size of the primary tumor, location of the primary tumor, and different treatment regimes. Despite cancer treatment, the patients reported a rather good general quality of life. CONCLUSIONS: Sequelae resulting from radiotherapy probably dominate oral function and quality of life after oncology treatment. In two thirds of the patients, improvement of oral function and related quality of life would be expected with the use of an implant-retained mandibular denture

Antiatherosclerotic Effect of Korean Red Ginseng Extract Involves Regulator of G-Protein Signaling 5

Regulator of G-protein signaling 5 (RGS5), an inhibitor of Gα(q) and Gα(i) activation, has been reported to have antiatherosclerosis. Previous studies showed antiatherosclerotic effect of Korean red ginseng water extract (KRGE) via multiple signaling pathways. However, potential protective effect of KRGE through RGS5 expression has not been elucidated. Here, we investigated the antiatherosclerotic effect of KRGE in vivo and in vitro and its role on RGS5 mRNA expression. Elevated levels of total cholesterol, lactate dehydrogenase (LDH), and triglyceride (TG) in western diet groups of low-density lipoprotein receptor deficient LDLr−/− mice were reversed by oral administration of KRGE. KRGE suppressed transcriptional activity of tumor necrotic factor alpha (TNF-α), interleukin-6 (IL-6), and leptin in adipose tissue. It also potently repressed western diet-induced atheroma formation in aortic sinus. While KRGE showed reduced mRNA expression of inducible nitric oxide synthase (iNOS), cyclooxygenase-2 (COX-2), IL-1β, IL-6, and TNF-α in LPS-stimulated RAW264.7 cells, it enhanced mRNA expression of RGS5. Moreover, RGS5 siRNA transfection of microglia cells pretreated with KRGE reversed its inhibitory effect on the expression of iNOS, COX-2, and IL-1β mRNA. In conclusion, KRGE showed antiatherosclerotic and anti-inflammatory effects in western diet fed LDLr−/− mice and this effect could partly be mediated by RGS5 expression