Feature Structure Distillation for BERT Transferring

Knowledge distillation is an approach to transfer information on representations from a teacher to a student by reducing their difference. A challenge of this approach is to reduce the flexibility of the student's representations inducing inaccurate learning of the teacher's knowledge. To resolve it in BERT transferring, we investigate distillation of structures of representations specified to three types: intra-feature, local inter-feature, global inter-feature structures. To transfer them, we introduce \textit{feature structure distillation} methods based on the Centered Kernel Alignment, which assigns a consistent value to similar features structures and reveals more informative relations. In particular, a memory-augmented transfer method with clustering is implemented for the global structures. In the experiments on the nine tasks for language understanding of the GLUE dataset, the proposed methods effectively transfer the three types of structures and improve performance compared to state-of-the-art distillation methods. Indeed, the code for the methods is available in https://github.com/maroo-sky/FSDComment: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessibl

Clonazepam-induced lichenoid drug eruption: a case report

Background Lichenoid drug eruption is rare and can mimic idiopathic lichen planus and other dermatoses. Clonazepam, a commonly used drug for the treatment of anxiety-related disorders and seizures, is known to be an unlikely cause of cutaneous adverse effects. Only one case report of LDE due to clonazepam has been reported. Case presentation A 81-year-old male patient with Alzheimers disease developed a lichenoid eruption after taking clonazepam. He developed a violaceous scaly patch on his lower extremities, from both buttocks to the feet. The cutaneous eruption resolved 2 months after cessation of clonazepam and with initiation of corticosteroid therapy. Conclusion A skin eruption that develops after clonazepam administration can be a lichenoid drug eruption, which is less likely to resolve spontaneously and requires discontinuation of clonazepam administration

Unilateral Psoriasis in a Woman with Ipsilateral Post-Mastectomy Lymphedema

Psoriasis is a multi-factorial disease with various clinical manifestations. We present a case of unilateral psoriasis associated with ipsilateral lymphedema that developed after mastectomy for breast cancer. A 42-year-old Korean woman was referred to our clinic with a 1-month history of multiple erythematous scaly patches on the right arm, back, and breast and was diagnosed with psoriasis by a skin biopsy. Three years previously, she had been diagnosed with breast cancer (T1N2), underwent a right quadrantectomy and axillary lymph node dissection, and completed adjuvant chemotherapy followed by high-dose adjuvant radiotherapy. She had started rehabilitation therapy on the right arm for secondary lymphedema 30 months previously. Because of the long interval between radiation and psoriasis, we speculated that changes in the local milieu caused by the lymphedema might be a causative factor. We hereby report a rare case of unilateral psoriasis following post-mastectomy lymphedema

Epinephrine-Induced Polymorphic Ventricular Tachycardia in a Patient With Congenital Long QT Syndrome

A 24-year-old woman presented to the department of plastic surgery for surgical excision of a nevus on her nose. Although her history failed to reveal any cardiac disease, her pre-operative electrocardiogram (ECG) showed an extremely prolonged QT interval of up to 528 msec. Repeated history-taking after admission revealed three syncopal episodes associated with both physical and emotional stress, and because the two-dimensional echocardiography and exercise ECG test were normal except for the prolonged QT interval, an epinephrine test was done to assess QT interval changes after an epinephrine infusion. Immediately after a bolus injection of epinephrine (0.1 µg/kg), marked prolongation of the QT interval developed, followed by polymorphic ventricular tachycardia which was immediately terminated with direct current shock, resulting in the diagnosis of a long QT syndrome (LQTS), probably type 1. Gene studies were recommended, but declined by the patient and her family. She was instructed to avoid competitive sports, and a β-blocker was prescribed after which she remained symptom-free