5,287 research outputs found

    Rule-based Approach to Korean Morphological Disambiguation Supported by Statistical Method

    Get PDF

    Scarred Resonances and Steady Probability Distribution in a Chaotic Microcavity

    Full text link
    We investigate scarred resonances of a stadium-shaped chaotic microcavity. It is shown that two components with different chirality of the scarring pattern are slightly rotated in opposite ways from the underlying unstable periodic orbit, when the incident angles of the scarring pattern are close to the critical angle for total internal reflection. In addition, the correspondence of emission pattern with the scarring pattern disappears when the incident angles are much larger than the critical angle. The steady probability distribution gives a consistent explanation about these interesting phenomena and makes it possible to expect the emission pattern in the latter case.Comment: 4 pages, 5 figure

    Abducens Nerve Palsy Complicated by Inferior Petrosal Sinus Septic Thrombosis Due to Mastoiditis

    Get PDF
    We present a very rare case of a 29-month-old boy with acute onset right abducens nerve palsy complicated by inferior petrosal sinus septic thrombosis due to mastoiditis without petrous apicitis. Four months after mastoidectomy, the patient fully recovered from an esotropia of 30 prism diopters and an abduction limitation (-4) in his right eye

    Memory-Efficient Fine-Tuning of Compressed Large Language Models via sub-4-bit Integer Quantization

    Full text link
    Large language models (LLMs) face the challenges in fine-tuning and deployment due to their high memory demands and computational costs. While parameter-efficient fine-tuning (PEFT) methods aim to reduce the memory usage of the optimizer state during fine-tuning, the inherent size of pre-trained LLM weights continues to be a pressing concern. Even though quantization techniques are widely proposed to ease memory demands and accelerate LLM inference, most of these techniques are geared towards the deployment phase. To bridge this gap, this paper presents Parameter-Efficient and Quantization-aware Adaptation (PEQA) - a simple yet effective method that combines the advantages of PEFT with quantized LLMs. By updating solely the quantization scales, PEQA can be directly applied to quantized LLMs, ensuring seamless task transitions. Parallel to existing PEFT methods, PEQA significantly reduces the memory overhead associated with the optimizer state. Furthermore, it leverages the advantages of quantization to substantially reduce model sizes. Even after fine-tuning, the quantization structure of a PEQA-tuned LLM remains intact, allowing for accelerated inference on the deployment stage. We employ PEQA-tuning for task-specific adaptation on LLMs with up to 65 billion parameters. To assess the logical reasoning and language comprehension of PEQA-tuned LLMs, we fine-tune low-bit quantized LLMs using a instruction dataset. Our results show that even when LLMs are quantized to below 4-bit precision, their capabilities in language modeling, few-shot in-context learning, and comprehension can be resiliently restored to (or even improved over) their full-precision original performances with PEQA.Comment: Published at NeurIPS 2023. Camera-ready versio

    Onion peel extracts ameliorate hyperglycemia and insulin resistance in high fat diet/streptozotocin-induced diabetic rats

    Get PDF
    <p>Abstract</p> <p>Background</p> <p>Quercetin derivatives in onions have been regarded as the most important flavonoids to improve diabetic status in cells and animal models. The present study was aimed to examine the hypoglycemic and insulin-sensitizing capacity of onion peel extract (OPE) containing high quercetin in high fat diet/streptozotocin-induced diabetic rats and to elucidate the mechanism of its insulin-sensitizing effect.</p> <p>Methods</p> <p>Male Sprague-Dawley rats were fed the AIN-93G diet modified to contain 41.2% fat and intraperitoneally injected with a single dose of streptozotocin (40 mg/kg body weight). One week after injection, the rats with fasting blood glucose levels above 126 mg/dL were randomly divided into 4 groups to treat with high fat diet containing 0 (diabetic control), 0.5, or 1% of OPE or 0.1% quercetin (quercetin equivalent to 1% of OPE) for 8 weeks. To investigate the mechanism for the effects of OPE, we examined biochemical parameters (insulin sensitivity and oxidative stresses) and protein and gene expressions (pro-inflammatory cytokines and receptors).</p> <p>Results</p> <p>Compared to the diabetic control, hypoglycemic and insulin-sensitizing capability of 1% OPE were demonstrated by significant improvement of glucose tolerance as expressed in incremental area under the curve (<it>P </it>= 0.0148). The insulin-sensitizing effect of OPE was further supported by increased glycogen levels in liver and skeletal muscle (<it>P </it>< 0.0001 and <it>P </it>= 0.0089, respectively). Quantitative RT-PCR analysis showed increased expression of insulin receptor (<it>P </it>= 0.0408) and GLUT4 (<it>P </it>= 0.0346) in muscle tissues. The oxidative stress, as assessed by superoxide dismutase activity and malondialdehyde formation, plasma free fatty acids, and hepatic protein expressions of IL-6 were significantly reduced by 1% OPE administration (<it>P </it>= 0.0393, 0.0237, 0.0148 and 0.0025, respectively).</p> <p>Conclusion</p> <p>OPE might improve glucose response and insulin resistance associated with type 2 diabetes by alleviating metabolic dysregulation of free fatty acids, suppressing oxidative stress, up-regulating glucose uptake at peripheral tissues, and/or down-regulating inflammatory gene expression in liver. Moreover, in most cases, OPE showed greater potency than pure quercetin equivalent. These findings provide a basis for the use of onion peel to improve insulin insensitivity in type 2 diabetes.</p

    Calibration of Built-in Accelerometer Using a Commercially Available Smartphone

    Get PDF
    Wearable trackers that detect sleep offer users a way to track their sleep quality and patterns without the use of expensive equipment. Few studies have tested the validity of these trackers on sleep measure. PURPOSE: To examine the validity of the Actigraph GT9X (AG), SenseWear Mini Armband (SW), Basis Peak (BP), Fitbit Charge HR (FB), Jawbone UP3 (JU), and Garmin Vivosmart (GV) for estimating sleep variables as compared with a sleep diary. METHODS: 78 healthy individuals participated in the study. Group 1 (n= 38) and wore the AG, SW, BP, and FB or Group 2 (n = 40) and wore the AG, JU, and GV. Monitors were worn on the non-dominant arm for 3 nights and a sleep log was completed. Sleep variables were total sleep time (TST), time in bed (TIB), sleep efficiency (SE), and wake after sleep onset (WASO). Pearson correlation, mean absolute percentage errors (MAPE), equivalence testing, Bland-Altman plots, and ANOVA were used to assess validity compared with the diary. RESULTS: Overall, monitors that showed the greatest correlation with the sleep diary for TST were the JU and FB (effect size= 0.09 and 0.23, respectively). The greatest correlation with the sleep diary for TIB was seen with the SW, GV, and JU (effect size= 0.09, 0.16, and 0.07, respectively). SE and WASO showed very poor correlation with the log. Measures for equivalence testing confirmed the success of the JU, SW, FB, and GV for measureing TIB and TST. CONCLUSION: The FB, SW, JU, and GV could be valid measure of TST and TIB. The monitors are not valid regarding wake times during sleep. Further research is needed to validate these monitors with polysomnography

    Co-occurrence matrix analysis-based semi-supervised training for object detection

    Full text link
    One of the most important factors in training object recognition networks using convolutional neural networks (CNNs) is the provision of annotated data accompanying human judgment. Particularly, in object detection or semantic segmentation, the annotation process requires considerable human effort. In this paper, we propose a semi-supervised learning (SSL)-based training methodology for object detection, which makes use of automatic labeling of un-annotated data by applying a network previously trained from an annotated dataset. Because an inferred label by the trained network is dependent on the learned parameters, it is often meaningless for re-training the network. To transfer a valuable inferred label to the unlabeled data, we propose a re-alignment method based on co-occurrence matrix analysis that takes into account one-hot-vector encoding of the estimated label and the correlation between the objects in the image. We used an MS-COCO detection dataset to verify the performance of the proposed SSL method and deformable neural networks (D-ConvNets) as an object detector for basic training. The performance of the existing state-of-the-art detectors (DConvNets, YOLO v2, and single shot multi-box detector (SSD)) can be improved by the proposed SSL method without using the additional model parameter or modifying the network architecture.Comment: Submitted to International Conference on Image Processing (ICIP) 201
    corecore