GPT-NAS: Neural Architecture Search with the Generative Pre-Trained Model

Neural Architecture Search (NAS) has emerged as one of the effective methods to design the optimal neural network architecture automatically. Although neural architectures have achieved human-level performances in several tasks, few of them are obtained from the NAS method. The main reason is the huge search space of neural architectures, making NAS algorithms inefficient. This work presents a novel architecture search algorithm, called GPT-NAS, that optimizes neural architectures by Generative Pre-Trained (GPT) model. In GPT-NAS, we assume that a generative model pre-trained on a large-scale corpus could learn the fundamental law of building neural architectures. Therefore, GPT-NAS leverages the generative pre-trained (GPT) model to propose reasonable architecture components given the basic one. Such an approach can largely reduce the search space by introducing prior knowledge in the search process. Extensive experimental results show that our GPT-NAS method significantly outperforms seven manually designed neural architectures and thirteen architectures provided by competing NAS methods. In addition, our ablation study indicates that the proposed algorithm improves the performance of finely tuned neural architectures by up to about 12% compared to those without GPT, further demonstrating its effectiveness in searching neural architectures

The association between air pollutant exposure and cerebral small vessel disease imaging markers with modifying effects of PRS-defined genetic susceptibility

Studies have highlighted a possible link between air pollution and cerebral small vessel disease (CSVD) imaging markers. However, the exact association and effects of polygenic risk score (PRS) defined genetic susceptibility remains unclear. This cross-sectional study used data from the UK Biobank. Participants aged 40–69 years were recruited between the year 2006 and 2010. The annual average concentrations of NOX, NO2, PM2.5, PM2.5–10, PM2.5 absorbance, and PM10, were estimated, and joint exposure to multiple air pollutants was reflected in the air pollution index (APEX). Air pollutant exposure was classified into the low (T1), intermediate (T2), and high (T3) tertiles. Three CSVD markers were used: white matter hyper-intensity (WMH), mean diffusivity (MD), and fractional anisotropy (FA). The first principal components of the MD and FA measures in the 48 white matter tracts were analysed. The sample consisted of 44,470 participants from the UK Biobank. The median (T1–T3) concentrations of pollutants were as follows: NO2, 25.5 (22.4–28.7) μg/m3; NOx, 41.3 (36.2–46.7) μg/m3; PM10, 15.9 (15.4–16.4) μg/m3; PM2.5, 9.9 (9.5–10.3) μg/m3; PM2.5 absorbance, 1.1 (1.0–1.2) per metre; and PM2.5–10, 6.1 (5.9–6.3) μg/m3. Compared with the low group, the high group's APEX, NOX, and PM2.5 levels were associated with increased WMH volumes, and the estimates (95 %CI) were 0.024 (0.003, 0.044), 0.030 (0.010, 0.050), and 0.032 (0.011, 0.053), respectively, after adjusting for potential confounders. APEX, PM10, PM2.5 absorbance, and PM2.5–10 exposure in the high group were associated with increased FA values compared to that in the low group. Sex-specific analyses revealed associations only in females. Regarding the combined associations of air pollutant exposure and PRS-defined genetic susceptibility with CSVD markers, the associations of NO2, NOX, PM2.5, and PM2.5–10 with WMH were more profound in females with low PRS-defined genetic susceptibility, and the associations of PM10, PM2.5, and PM2.5 absorbance with FA were more profound in females with higher PRS-defined genetic susceptibility. Our study demonstrated that air pollutant exposure may be associated with CSVD imaging markers, with females being more susceptible, and that PRS-defined genetic susceptibility may modify the associations of air pollutants

Polymyositis as a paraneoplastic syndrome of a patient with primary pulmonary lymphoepithelioma-like carcinoma: a case report and literature review

Abstract Background Pulmonary lymphoepithelioma-like carcinoma (LELC) is a rare type of non-small cell lung cancer, which mostly occurred in non-smoking Asian populations. The prognosis of this tumor is better than other lung cancers. Polymyositis, a kind of idiopathic inflammatory myopathies, may negatively affect the prognosis of patients with lung cancer as a paraneoplastic syndrome (PNPS). LELC is seldomly accompanied by PNPS, thus the treatment strategy and prognosis should be discussed. Case presentation We report a 49-year-old female patient who was hospitalized for “symmetric limb weakness and pain for more than 2 months”. Glucocorticoid-based anti-inflammatory therapy had been performed for over 3 weeks before the patient was hospitalized, however, in vain. The result of serum autoimmune antibody showed Anti-nRNP/Sm ( +). The serum level of myoglobin, lactate dehydrogenase and creatine kinase elevated significantly. An electromyogram revealed peripheral nerves injury and myogenic damages. Imaging showed a mass in the posterior basal segment of the left lung. A percutaneous transthoracic needle biopsy was performed and the pathological result was LELC. The patient was diagnosed with pulmonary LELC accompanied by polymyositis. Positron emission tomography-computed tomography (PET-CT) showed only ipsilateral hilar and mediastinal lymph nodes metastasis. Video-assisted thoracoscopic left lower lobectomy and systematic mediastinal lymphadenectomy were performed. The postoperative pathological stage was T2N2M0, IIIA (UICC 8th), and the patient received adjuvant chemotherapy and subsequent radiotherapy. The patient was followed up for 5 months with no recurrence of tumor and the limb weakness and pain were relieved apparently after the successful comprehensive treatment of her primary tumor. Conclusion Pulmonary LELC is a rare subtype of non-small cell lung cancer seldomly accompanied by PNPS. Though polymyositis is associated with lung cancer, it is easy to ignore this relationship when a patient is diagnosed with LELC in the clinic. Surgery based comprehensive treatment of primary tumor can lead to a prospective prognosis in pulmonary LELC patients with PNPS. And successful treatment of pulmonary LELC can also improve symptoms of PNPS. </jats:sec