YATO: Yet Another deep learning based Text analysis Open toolkit

We introduce YATO, an open-source, easy-to-use toolkit for text analysis with deep learning. Different from existing heavily engineered toolkits and platforms, YATO is lightweight and user-friendly for researchers from cross-disciplinary areas. Designed in a hierarchical structure, YATO supports free combinations of three types of widely used features including 1) traditional neural networks (CNN, RNN, etc.); 2) pre-trained language models (BERT, RoBERTa, ELECTRA, etc.); and 3) user-customized neural features via a simple configurable file. Benefiting from the advantages of flexibility and ease of use, YATO can facilitate fast reproduction and refinement of state-of-the-art NLP models, and promote the cross-disciplinary applications of NLP techniques. The code, examples, and documentation are publicly available at https://github.com/jiesutd/YATO. A demo video is also available at https://youtu.be/tSjjf5BzfQg

Generative Speech Recognition Error Correction with Large Language Models and Task-Activating Prompting

We explore the ability of large language models (LLMs) to act as speech recognition post-processors that perform rescoring and error correction. Our first focus is on instruction prompting to let LLMs perform these task without fine-tuning, for which we evaluate different prompting schemes, both zero- and few-shot in-context learning, and a novel task activation prompting method that combines causal instructions and demonstration to increase its context windows. Next, we show that rescoring only by in-context learning with frozen LLMs achieves results that are competitive with rescoring by domain-tuned LMs, using a pretrained first-pass recognition system and rescoring output on two out-of-domain tasks (ATIS and WSJ). By combining prompting techniques with fine-tuning we achieve error rates below the N-best oracle level, showcasing the generalization power of the LLMs.Comment: Accepted to IEEE Automatic Speech Recognition and Understanding (ASRU) 2023. 8 pages. 2nd version revised from Sep 29th's versio

Psychometric properties of the Chinese version of the preoperative assessment of readiness tool among surgical patients

BackgroundThe evaluation of the surgical readiness of patients plays an important role in clinical care. Preoperative readiness assessment is needed to identify the inadequacy among surgical patients, which provides guide for interventions to improve patients’ preoperative readiness. However, there is a paucity of high-level, quality tool that evaluate surgical readiness of patients in China. The purpose of this study is to translate the Preoperative Assessment of Readiness Tool (PART) into Chinese and determine the reliability and validity of the Chinese version in the population of surgical patients.MethodsUsing a standard translation-backward method, the original English version of PART was translated into Chinese. A convenient sampling of 210 surgical patients was recruited from 6 hospitals in Zhejiang Province to test the psychometric properties of this scale including internal consistency, split-half reliability, content validity, structure validity, and floor/ceiling effect.ResultsA total of 194 patients (92%) completed questionnaires. The Chinese version of PART achieved Cronbach’s alphas 0.948 and McDonald’s omega coefficient 0.947, respectively, for the full scale. The estimated odd-even split-half reliability was 0.959. The scale-level content validity index was 0.867, and the items content validity index ranged from 0.83 to 1.0.The output of confirmatory factor analysis (CFA) revealed a two-factor model (χ2 = 510.96; df = 86; p < 0.001; root mean square error approximation = 0.08) with no floor/ceiling effect.ConclusionThe Chinese version of PART demonstrated acceptable reliability and validity among surgical patients. It can be used to evaluate patients’ preoperative preparation and help health professionals provide proper preoperative support

Media use degree and depression: A latent profile analysis from Chinese residents

BackgroundPrevious studies have emphasized the media as an essential channel for understanding information about depression. However, they have not divided groups according to the degree of media use to study their differences in depression. Therefore, this study aims to explore the influence of media use on depression and the influencing factors of depression in people with different media use degrees.MethodsBased on seven items related to media use, a total of 11, 031 respondents were categorized by the frequency of media use using latent profile analysis (LPA). Secondly, multiple linear regression analyzes were conducted to analyze the effects of depression in people with different degrees of media use. Finally, factors influencing depression among people with different degrees of media use were explored separately.ResultsAll respondents were classified into three groups: media use low-frequency (9.7%), media use general (67.1%), and media use high-frequency (23.2%). Compared with media use general group, media use low-frequency (β = 0.019, p = 0.044) and media use high-frequency (β = 0.238, p < 0.001) groups are significantly associated with depression. The factors influencing depression in the population differed between media use low-frequency, media use general, and media use high-frequency groups.ConclusionThe government and the appropriate departments should develop targeted strategies for improving the overall health status of people with different media use degrees

Media use degree and depression: A latent profile analysis from Chinese residents

Background: Previous studies have emphasized the media as an essential channel for understanding information about depression. However, they have not divided groups according to the degree of media use to study their differences in depression. Therefore, this study aims to explore the influence of media use on depression and the influencing factors of depression in people with different media use degrees. Methods: Based on seven items related to media use, a total of 11, 031 respondents were categorized by the frequency of media use using latent profile analysis (LPA). Secondly, multiple linear regression analyzes were conducted to analyze the effects of depression in people with different degrees of media use. Finally, factors influencing depression among people with different degrees of media use were explored separately. Results: All respondents were classified into three groups: media use low-frequency (9.7%), media use general (67.1%), and media use high-frequency (23.2%). Compared with media use general group, media use low-frequency (β = 0.019, p = 0.044) and media use high-frequency (β = 0.238, p < 0.001) groups are significantly associated with depression. The factors influencing depression in the population differed between media use low-frequency, media use general, and media use high-frequency groups. Conclusion: The government and the appropriate departments should develop targeted strategies for improving the overall health status of people with different media use degrees

Research progress of 3D printed poly (ether ether ketone) in the reconstruction of craniomaxillofacial bone defects

The clinical challenge of bone defects in the craniomaxillofacial region, which can lead to significant physiological dysfunction and psychological distress, persists due to the complex and unique anatomy of craniomaxillofacial bones. These critical-sized defects require the use of bone grafts or substitutes for effective reconstruction. However, current biomaterials and methods have specific limitations in meeting the clinical demands for structural reinforcement, mechanical support, exceptional biological performance, and aesthetically pleasing reconstruction of the facial structure. These drawbacks have led to a growing need for novel materials and technologies. The growing development of 3D printing can offer significant advantages to address these issues, as demonstrated by the fabrication of patient-specific bioactive constructs with controlled structural design for complex bone defects in medical applications using this technology. Poly (ether ether ketone) (PEEK), among a number of materials used, is gaining recognition as a feasible substitute for a customized structure that closely resembles natural bone. It has proven to be an excellent, conformable, and 3D-printable material with the potential to replace traditional autografts and titanium implants. However, its biological inertness poses certain limitations. Therefore, this review summarizes the distinctive features of craniomaxillofacial bones and current methods for bone reconstruction, and then focuses on the increasingly applied 3D printed PEEK constructs in this field and an update on the advanced modifications for improved mechanical properties, biological performance, and antibacterial capacity. Exploring the potential of 3D printed PEEK is expected to lead to more cost-effective, biocompatible, and personalized treatment of craniomaxillofacial bone defects in clinical applications

Low-rank Adaptation of Large Language Model Rescoring for Parameter-Efficient Speech Recognition

We propose a neural language modeling system based on low-rank adaptation (LoRA) for speech recognition output rescoring. Although pretrained language models (LMs) like BERT have shown superior performance in second-pass rescoring, the high computational cost of scaling up the pretraining stage and adapting the pretrained models to specific domains limit their practical use in rescoring. Here we present a method based on low-rank decomposition to train a rescoring BERT model and adapt it to new domains using only a fraction (0.08%) of the pretrained parameters. These inserted matrices are optimized through a discriminative training objective along with a correlation-based regularization loss. The proposed low-rank adaptation Rescore-BERT (LoRB) architecture is evaluated on LibriSpeech and internal datasets with decreased training times by factors between 5.4 and 3.6.Comment: Accepted to IEEE ASRU 2023. Internal Review Approved. Revised 2nd version with Andreas and Huck. The first version is in Sep 29th. 8 page

Financing Laws of China's Big Health Industry PPP Projects: A Discussion Paper

At present, China's big health industry is developing rapidly, but due to its characteristics of heavy assets, slow returns and public welfare attributes, the further development of the big health industry is mostly restricted by factors such as policy supervision, capital reserves, technology and technology [iResearch, 2019]. The introduction of the PPP model into the field of general health is conducive to the formation of benefit sharing, risk sharing and long-term cooperative relations between the government and the market [Ding C et al.,2019]. This article analyzes the legal concerns of the PPP project financing process in the big health industry, discusses the design of appropriate system construction, legalizes the space for the legalization of financing rules at the legal level, and then straightens out the system and conditions for the realization of PPP project financing in the big health industry in China so that The health industry will become a new growth point for China's economic development in the future

Noncooperative information diffusion in online social networks

Information diffusion in online social networks has received attention in both research and actual applications. The prevalence of online social networking sites offers the possibility of mining for necessary information. However, existing influence maximization algorithms and newly proposed influence diffusion models do not distinguish between seed nodes (or pilot users) and nonseed nodes and assume all nodes are cooperative in propagating influence. This thesis investigates models and heuristics for noncooperative information diffusion in online social networks. It consists of three parts: tragedy of the commons in online social search (OSS), influence maximization in noncooperative social networks under the linear threshold model (LTM), and influence maximization in noncooperative social networks under the independent cascade model (ICM). Firstly, the tragedy of the commons problem in OSS is considered. I propose an analytical model that captures the behavior of OSS nodes, and, from a gaming-strategy point of view, analyze various strategies an individual node can utilize to allocate its awareness capacity. Based on this I derive the Pareto inefficiency in terms of the system cost. An incentive scheme which can lead selfish nodes to the “social optimal” state of the whole system is also proposed. Extensive simulations show that the strategy with our proposed incentive mechanism outperforms other strategies in terms of the system cost and the search success rate. The second part of the thesis presents the first detailed analysis of influence maximization in noncooperative social networks under the LTM. The influence propagation process is structured into two stages, namely, seed node selection and influence diffusion. In the former, I introduce a generalized maximum-flow-based analytical framework to model the noncooperative behavior of individual users and develop a new seed node selection strategy. In the latter, I propose a game-theoretic model to characterize the behavior of noncooperative nodes and design a Vickrey-Clarke-Groves-like (VCG-like) scheme to incentivise cooperation. Then I study the budget allocation problem between the two stages, and show that a marketer can utilize the two proposed strategies to tackle noncooperation intelligently. The proposed schemes are evaluated on large coauthorship networks, and the results show that the proposed seed node selection scheme is very robust to noncooperation and the VCG-like scheme can effectively stimulate a node to become cooperative. Finally, I study the influence maximization problem in noncooperative social networks under the ICM using the same two-stage framework originally proposed for LTM. For the seed selection stage, a modified hierarchy-based seed node selection strategy which can take node noncooperation into consideration is introduced. The VCG-like incentive scheme designed for the influence diffusion stage under LTM can also be utilized for ICM in a similar manner. Then I also study the budget allocation problem between the two stages. The evaluation results show that the performance of the hierarchy-based seed node selection scheme is satisfactory in a noncooperative social network and the VCG-like scheme can effectively encourage node cooperation.published_or_final_versionElectrical and Electronic EngineeringDoctoralDoctor of Philosoph