ABKD: Graph Neural Network Compression with Attention-Based Knowledge Distillation

Graph Neural Networks (GNNs) have proven to be quite versatile for a variety of applications, including recommendation systems, fake news detection, drug discovery, and even computer vision. Due to the expanding size of graph-structured data, GNN models have also increased in complexity, leading to substantial latency issues. This is primarily attributed to the irregular structure of graph data and its access pattern into memory. The natural solution to reduce latency is to compress large GNNs into small GNNs. One way to do this is via knowledge distillation (KD). However, most KD approaches for GNNs only consider the outputs of the last layers and do not consider the outputs of the intermediate layers of the GNNs; these layers may contain important inductive biases indicated by the graph structure. To address this shortcoming, we propose a novel KD approach to GNN compression that we call Attention-Based Knowledge Distillation (ABKD). ABKD is a KD approach that uses attention to identify important intermediate teacher-student layer pairs and focuses on aligning their outputs. ABKD enables higher compression of GNNs with a smaller accuracy dropoff compared to existing KD approaches. On average, we achieve a 1.79% increase in accuracy with a 32.3x compression ratio on OGBN-Mag, a large graph dataset, compared to state-of-the-art approaches

Hospitalization rates from radiotherapy complications in the United States

Hospitalizations due to radiotherapy (RT) complications result in significant healthcare expenditures and adversely affect the quality of life of cancer patients. Using a nationally representative dataset, the objective of this study is to identify trends in the incidence of these hospitalizations, their causes, and the resulting financial burden. Data from the National Inpatient Sample was retrospectively analyzed from 2005 to 2016. RT complications were identified using ICD-9 and ICD-10 external cause-of-injury codes. The hospitalization rate was the primary endpoint, with cost and in-hospital death as secondary outcomes. 443,222,223 weighted hospitalizations occurred during the study period, of which 482,525 (0.11%) were attributed to RT. The 3 most common reasons for RT-related hospitalization were cystitis (4.8%, standard error [SE] = 0.09), gastroenteritis/colitis (3.7%, SE = 0.07), and esophagitis (3.5%, SE = 0.07). Aspiration pneumonitis (1.4-fold) and mucositis (1.3-fold) had the highest relative increases among these hospitalizations from 2005 to 2016, while esophagitis (0.58-fold) and disorders of the rectum and anus were the lowest (0.67-fold). The median length of stay of patient for hospitalization for RT complications was 4.1 (IQR, 2.2–7.5) days and the median charge per patient was $10,097 (IQR, 5755–18,891) and the total cost during the study period was$4.9 billion. Hospitalization for RT-related complications is relatively rare, but those that are admitted incur a substantial cost. Use of advanced RT techniques should be employed whenever possible to mitigate the risk of severe toxicity and therefore reduce the need to admit patients

High Cervical Partial Posterior Cord Cleft in a Case of Klippel-Feil Syndrome

Posterior high cervical spinal cord cleft has been rarely reported in association with Klippel - Feil syndrome (KFS). Its presence may have prognostic value in long term neurological outcome. If there is segmentation anomaly of two or more vertebrae during embryonic life mainly involving the cervical vertebrae, it can result in Klippel - Feil syndrome. It is a rare anomaly and is present with the incidence of 1 : 42000 births.1 During 2nd to 8th week of embryonic life, the segmentation of the mesodermal somites of the spine in the cervical region fails and leads to cervical spine synostosis which is also known as KFS. Although most commonly the KFS patients present with the symptoms of short length of the neck, hairline posteriorly is low and the mobility in the upper part of the spine is restricted. It is also sometimes associated with other congenital anomalies like Sprengel’s deformity, hemivertebra, basilar impression, cleft palate, and many more rare anomalies.2 Most commonly the patients having this syndrome show restriction of the motion in the neck region.3</jats:p

Role of MRI in Differentiating Benign from Malignant Breast Lesions Using Dynamic Contrast Enhanced MRI and Diffusion Weighted MRI

BACKGROUND Breast cancer is the second most common cancer in Indian women. Dynamic contrast enhanced MRI (DCE-MRI) has improved specificity in characterising breast lesions. Diffusion weighted imaging can improve the sensitivity and specificity of MRI in the evaluation of breast lesions thus differentiating between benign and malignant breast lesions. The purpose of the study was to evaluate the role of diffusion weighted MRI and dynamic contrast enhanced MRI in differentiating benign from malignant breast lesions and to compare its findings with histopathological or fine needle aspiration cytology (FNAC) findings. METHODS A descriptive diagnostic study enrolled 30 female patients of palpable breast lumps with positive findings either on mammography or ultrasound. Ultrasonography was done on HD 15 (Philips Medical Systems, USA). This was followed by MRI which was done on MULTIVA 1.5 T using a dedicated breast array coil. RESULTS Fibroadenoma accounted for majority of benign lesions (4 / 10) while invasive ductal carcinoma (IDC) accounted for majority of malignant lesions (15 / 20). 7 / 10 benign lesions showed type I curve, while majority (15 / 20) of the malignant lesions showed type III curve. 8 / 10 benign breast lesions did not show restricted diffusion on diffusion weighted imaging (DWI) while all malignant lesions showed restricted diffusion on DWI. In our study, the mean apparent diffusion coefficient (ADC) value for benign and malignant lesions was 1.59 x 10-3 mm2 / s and 0.88 x 10- 3 mm2 / s respectively. CONCLUSIONS MR morphology, DCE-MRI and DWI are useful to characterise various breast lesions. MRI features of signal intensity of hypointensity on T2WI with other associated features of irregular shape, spiculate margins, heterogeneous enhancement on DCEMRI, type III dynamic curve and reduced ADC value are strong predictors of malignancy. KEY WORDS Breast MRI, DCE-MRI, DWI, Breast Carcinoma</jats:p

Evaluating the Diagnostic Performance of Leptomeningeal Diagnosis with CNSide™ Compared to Standard Cytology

https://scholarlycommons.baptisthealth.net/bhsf-academic-week-2022/1021/thumbnail.jp

Hospitalization rates from radiotherapy complications in the United States

Hospitalizations due to radiotherapy (RT) complications result in significant healthcare expenditures and adversely affect the quality of life of cancer patients. Using a nationally representative dataset, the objective of this study is to identify trends in the incidence of these hospitalizations, their causes, and the resulting financial burden. Data from the National Inpatient Sample was retrospectively analyzed from 2005 to 2016. RT complications were identified using ICD-9 and ICD-10 external cause-of-injury codes. The hospitalization rate was the primary endpoint, with cost and in-hospital death as secondary outcomes. 443,222,223 weighted hospitalizations occurred during the study period, of which 482,525 (0.11%) were attributed to RT. The 3 most common reasons for RT-related hospitalization were cystitis (4.8%, standard error [SE] = 0.09), gastroenteritis/colitis (3.7%, SE = 0.07), and esophagitis (3.5%, SE = 0.07). Aspiration pneumonitis (1.4-fold) and mucositis (1.3-fold) had the highest relative increases among these hospitalizations from 2005 to 2016, while esophagitis (0.58-fold) and disorders of the rectum and anus were the lowest (0.67-fold). The median length of stay of patient for hospitalization for RT complications was 4.1 (IQR, 2.2–7.5) days and the median charge per patient was $10,097 (IQR, 5755–18,891) and the total cost during the study period was$4.9 billion. Hospitalization for RT-related complications is relatively rare, but those that are admitted incur a substantial cost. Use of advanced RT techniques should be employed whenever possible to mitigate the risk of severe toxicity and therefore reduce the need to admit patients