PLM-ICD: Automatic ICD Coding with Pretrained Language Models

Automatically classifying electronic health records (EHRs) into diagnostic codes has been challenging to the NLP community. State-of-the-art methods treated this problem as a multilabel classification problem and proposed various architectures to model this problem. However, these systems did not leverage the superb performance of pretrained language models, which achieved superb performance on natural language understanding tasks. Prior work has shown that pretrained language models underperformed on this task with the regular finetuning scheme. Therefore, this paper aims at analyzing the causes of the underperformance and developing a framework for automatic ICD coding with pretrained language models. We spotted three main issues through the experiments: 1) large label space, 2) long input sequences, and 3) domain mismatch between pretraining and fine-tuning. We propose PLMICD, a framework that tackles the challenges with various strategies. The experimental results show that our proposed framework can overcome the challenges and achieves state-of-the-art performance in terms of multiple metrics on the benchmark MIMIC data. The source code is available at https://github.com/MiuLab/PLM-ICDComment: Accepted to the ClinicalNLP 2022 worksho

Comparison and prediction of pullout strength of conical and cylindrical pedicle screws within synthetic bone

<p>Abstract</p> <p>Background</p> <p>This study was designed to derive the theoretical formulae to predict the pullout strength of pedicle screws with an inconstant outer and/or inner diameter distribution (conical screws). For the transpedicular fixation, one of the failure modes is the screw loosening from the vertebral bone. Hence, various kinds of pedicle screws have been evaluated to measure the pullout strength using synthetic and cadaveric bone as specimens. In the literature, the Chapman's formula has been widely proposed to predict the pullout strength of screws with constant outer and inner diameters (cylindrical screws).</p> <p>Methods</p> <p>This study formulated the pullout strength of the conical and cylindrical screws as the functions of material, screw, and surgery factors. The predicted pullout strength of each screw was compared to the experimentally measured data. Synthetic bones were used to standardize the material properties of the specimen and provide observation of the loosening mechanism of the bone/screw construct.</p> <p>Results</p> <p>The predicted data from the new formulae were better correlated with the mean pullout strength of both the cylindrical and conical screws within an average error of 5.0% and <it>R</it>²= 0.93. On the other hand, the average error and <it>R</it>²value of the literature formula were as high as -32.3% and -0.26, respectively.</p> <p>Conclusion</p> <p>The pullout strength of the pedicle screws was the functions of bone strength, screw design, and pilot hole. The close correlation between the measured and predicted pullout strength validated the value of the new formulae, so as avoid repeating experimental tests.</p

Metabolism and Pharmacokinetics of San-Huang-Xie-Xin-Tang, a Polyphenol-Rich Chinese Medicine Formula, in Rats and Ex-Vivo Antioxidant Activity

San-Huang-Xie-Xin-Tang (SHXXT), a widely used Chinese herbal formula, consists of rhizomes of Rheum officinale, roots of Scutellaria baicalensis and rhizomes of Coptis chinesis. This study investigated the metabolism and pharmacokinetics of polyphenols in SHXXT, including baicalin, baicalein, wogonin, emodin, aloe-emodin, rhein and chrysophanol. The quantitation methods of SHXXT decoction and rat serum using high performance liquid chromatography were developed and validated in this study. After oral administration of SHXXT decoction to rats, the parent forms of various constituents and their conjugated metabolites in serum were determined before and after hydrolysis with β-glucuronidase and sulfatase. The results showed that only free form of rhein can be quantitated, whereas the parent forms of coptisine, palmatine, berberine, baicalein, wogonin, emodin, aloe-emodin and chrysophanol were not detected in serum. The glucuronides of baicalein, wogonin, emodin, aloe-emodin, rhein and chrysophanol were the predominant forms in bloodstream. In order to evaluate the in vivo antioxidant activity of SHXXT, the serum metabolite of SHXXT was prepared, characterized and followed by evaluation of the effect on AAPH-induced hemolysis. The results indicated that metabolites of SHXXT exhibited significant free radical scavenging activity. We suggest that biologists redirect their focus to the bioactivity of the conjugated metabolites of these polyphenols

Metabolism and Pharmacokinetics of San-Huang-Xie-Xin-Tang, a Polyphenol-Rich Chinese Medicine Formula, in Rats and Ex-Vivo Antioxidant Activity

San-Huang-Xie-Xin-Tang (SHXXT), a widely used Chinese herbal formula, consists of rhizomes of Rheum officinale, roots of Scutellaria baicalensis and rhizomes of Coptis chinesis. This study investigated the metabolism and pharmacokinetics of polyphenols in SHXXT, including baicalin, baicalein, wogonin, emodin, aloe-emodin, rhein and chrysophanol. The quantitation methods of SHXXT decoction and rat serum using high performance liquid chromatography were developed and validated in this study. After oral administration of SHXXT decoction to rats, the parent forms of various constituents and their conjugated metabolites in serum were determined before and after hydrolysis with β-glucuronidase and sulfatase. The results showed that only free form of rhein can be quantitated, whereas the parent forms of coptisine, palmatine, berberine, baicalein, wogonin, emodin, aloe-emodin and chrysophanol were not detected in serum. The glucuronides of baicalein, wogonin, emodin, aloe-emodin, rhein and chrysophanol were the predominant forms in bloodstream. In order to evaluate the in vivo antioxidant activity of SHXXT, the serum metabolite of SHXXT was prepared, characterized and followed by evaluation of the effect on AAPH-induced hemolysis. The results indicated that metabolites of SHXXT exhibited significant free radical scavenging activity. We suggest that biologists redirect their focus to the bioactivity of the conjugated metabolites of these polyphenols

Different Influences on Tacrolimus Pharmacokinetics by Coadministrations of Zhi Ke and Zhi Shi in Rats

Tacrolimus, an immunosuppressant with narrow therapeutic window, has been used widely in transplant patients. Grapefruit juice and pomelo have been reported to increase the blood levels of tacrolimus. Zhi Ke and Zhi Shi, the ripe peels and unripe fruits of Citrus aurantium which is chemotaxonomically related to grapefruit and pomelo, are in wide use in clinical Chinese medicine. To investigate the possible interaction of these two Citrus herbs with tacrolimus, male Sprague-Dawley rats were orally given tacrolimus (1.5 mg/kg) with and without Zhi Ke and Zhi Shi decoctions in a cross-over design. Blood samples were withdrawn via cardiopuncture at specific time and quantitated by a microparticle enzyme immunoassay. In addition, to explore the mechanism of interaction, LS 180 cell line was used for the transport study of rhodamine 123, a typical substrate of P-glycoprotein (P-gp). The results showed that Zhi Shi significantly decreased the Cmax and AUC0−t of tacrolimus by 72.4% and 72.0%, respectively, whereas Zhi Ke did not affect tacrolimus pharmacokinetics. LS 180 cell line study indicated that Zhi Shi increased the efflux activity of P-gp, enabling us to explain the decreased oral bioavailability of tacrolimus caused by Zhi Shi. Hence, we suggest that Zhi Shi be contraindicated for transplant patients treated with tacrolimus to reduce the risk of allograft rejection

Differential change in cortical and hippocampal monoamines, and behavioral patterns in streptozotocin-induced type 1 diabetes rats

Objective(s): Diabetes mellitus (DM) is a widespread metabolic disorder worldwide. Clinical physicians have found diabetic patients have mild to middle cognitive dysfunction and an alteration of brain monoaminergic function. This study explored the change in various patterns of behavioral models and brain monoamine function under streptozotocin (STZ)-induced type 1 diabetes.Materials and Methods: We established a type 1 DM model via intravenous injection with STZ (65 mg/kg) in rats. Three weeks after the STZ injection, various behavioral measurements including the inhibitory avoidance test, active avoidance test and Morris water maze were conducted. Finally, all rats were dissected and the concentrations of monoamines and their metabolites in cortex and hippocampus were measured by high performance liquid chromatography with electrochemical detection.Results: We found that STZ induced type 1 diabetes (hyperglycemia and lack of insulin) in rats. STZ-induced diabetic rats had cognitive impairment in acquisition sessions and long-term retention of the active avoidance test. STZ-induced diabetic rats also had cognitive impairment in spatial learning, reference and working memory of the Morris water maze. STZ significantly reduced concentrations of norepinephrine (NE) in the cortex and dopamine (DA) in the hippocampus, but increased concentrations of DA and serotonin (5-HT) in the cortex 35 days after injection. The concentration of 5-HT in the hippocampus was also significantly increased.Conclusion: The data suggested that this cognitive impairment after a short-term period of STZ injection might be related to cortical NE dysfunction, differential alteration of cortical and hippocampal DA function, and brain 5-HT hyperfunction

Prognostic factors associated with the survival of oral and pharyngeal carcinoma in Taiwan

<p>Abstract</p> <p>Background</p> <p>In Taiwan, a distinct ethnic group variation in incidence and mortality rates has been suggested for most carcinomas. Our aim is to identify the role of prognostic factors associated with the survival of oral and pharyngeal carcinoma in Taiwan.</p> <p>Methods</p> <p>Taiwan Cancer Registry records of 9039 subjects diagnosed with oral and pharyngeal carcinoma were analyzed. The population was divided into three ethnic groups by residence, which were Taiwanese aborigines, Hakka and Hokkien communities. Five-year survival rates were estimated by Kaplan-Meier methods. Ethnic curves differed significantly by log-rank test; therefore separate models for Taiwanese aborigines, Hakka and Hokkien were carried out. The Cox multivariate proportional hazards model was used to examine the role of prognostic factors on ethnic survival.</p> <p>Results</p> <p>The five-year survival rates of oral and pharyngeal carcinoma were significantly poorer for Hokkien community (53.9%) and Taiwanese aborigines community (58.1%) compared with Hakka community (60.5%). The adjusted hazard ratio of Taiwanese aborigines versus Hakka was 1.07 (95%CI, 0.86–1.33) for oral and pharyngeal carcinoma mortality, and 1.16 (95%CI, 1.01–1.33) for Hokkien versus Hakka. Males had significantly poor prognosis than females. Subjects with tongue and/or mouth carcinoma presented the worst prognosis, whereas lip carcinoma had the best prognosis. Subjects with verrucous carcinoma had better survival than squamous cell carcinoma. Prognosis was the worst in elderly subjects, and subjects who underwent surgery had the highest survival rate.</p> <p>Conclusion</p> <p>Our study presented that predictive variables in oral and pharyngeal carcinoma survival have been: ethnic groups, period of diagnosis, gender, diagnostic age, anatomic site, morphologic type, and therapy.</p

Hypokalemia, Its Contributing Factors and Renal Outcomes in Patients with Chronic Kidney Disease

Background: In the chronic kidney disease (CKD) population, the impact of serum potassium (sK) on renal outcomes has been controversial. Moreover, the reasons for the potential prognostic value of hypokalemia have not been elucidated. Design, Participants & Measurements 2500 participants with CKD stage 1–4 in the Integrated CKD care program Kaohsiung for delaying Dialysis (ICKD) prospective observational study were analyzed and followed up for 2.7 years. Generalized additive model was fitted to determine the cutpoints and the U-shape association between sK and end-stage renal disease (ESRD). sK was classified into five groups with the cutpoints of 3.5, 4, 4.5 and 5 mEq/L. Cox proportional hazard regression models predicting the outcomes were used. Results: The mean age was 62.4 years, mean sK level was 4.2±0.5 mEq/L and average eGFR was 40.6 ml/min per 1.73 m2. Female vs male, diuretic use vs. non-use, hypertension, higher eGFR, bicarbonate, CRP and hemoglobin levels significantly correlated with hypokalemia. In patients with lower sK, nephrotic range proteinuria, and hypoalbuminemia were more prevalent but the use of RAS (renin-angiotensin system) inhibitors was less frequent. Hypokalemia was significantly associated with ESRD with hazard ratios (HRs) of 1.82 (95% CI, 1.03–3.22) in sK 5 mEq/L conferred 1.6-fold (95% CI,1.09–2.34) increased risk of ESRD compared with sK = 4.5–5 mEq/L. Hypokalemia was also associated with rapid decline of renal function defined as eGFR slope below 20% of the distribution range. Conclusion: In conclusion, both hypokalemia and hyperkalemia are associated with increased risk of ESRD in CKD population. Hypokalemia is related to increased use of diuretics, decreased use of RAS blockade and malnutrition, all of which may impose additive deleterious effects on renal outcomes