Enhancing Few-shot Image Classification with Cosine Transformer

This paper addresses the few-shot image classification problem, where the classification task is performed on unlabeled query samples given a small amount of labeled support samples only. One major challenge of the few-shot learning problem is the large variety of object visual appearances that prevents the support samples to represent that object comprehensively. This might result in a significant difference between support and query samples, therefore undermining the performance of few-shot algorithms. In this paper, we tackle the problem by proposing Few-shot Cosine Transformer (FS-CT), where the relational map between supports and queries is effectively obtained for the few-shot tasks. The FS-CT consists of two parts, a learnable prototypical embedding network to obtain categorical representations from support samples with hard cases, and a transformer encoder to effectively achieve the relational map from two different support and query samples. We introduce Cosine Attention, a more robust and stable attention module that enhances the transformer module significantly and therefore improves FS-CT performance from 5% to over 20% in accuracy compared to the default scaled dot-product mechanism. Our method performs competitive results in mini-ImageNet, CUB-200, and CIFAR-FS on 1-shot learning and 5-shot learning tasks across backbones and few-shot configurations. We also developed a custom few-shot dataset for Yoga pose recognition to demonstrate the potential of our algorithm for practical application. Our FS-CT with cosine attention is a lightweight, simple few-shot algorithm that can be applied for a wide range of applications, such as healthcare, medical, and security surveillance. The official implementation code of our Few-shot Cosine Transformer is available at https://github.com/vinuni-vishc/Few-Shot-Cosine-Transforme

Predicting Outcomes of Hormone and Chemotherapy in the Molecular Taxonomy of Breast Cancer International Consortium (METABRIC) Study by Biochemically-inspired Machine Learning

Genomic aberrations and gene expression-defined subtypes in the large METABRIC patient cohort have been used to stratify and predict survival. The present study used normalized gene expression signatures of paclitaxel drug response to predict outcome for different survival times in METABRIC patients receiving hormone (HT) and, in some cases, chemotherapy (CT) agents. This machine learning method, which distinguishes sensitivity vs. resistance in breast cancer cell lines and validates predictions in patients; was also used to derive gene signatures of other HT (tamoxifen) and CT agents (methotrexate, epirubicin, doxorubicin, and 5-fluorouracil) used in METABRIC. Paclitaxel gene signatures exhibited the best performance, however the other agents also predicted survival with acceptable accuracies. A support vector machine (SVM) model of paclitaxel response containing genes ABCB1, ABCB11, ABCC1, ABCC10, BAD, BBC3, BCL2, BCL2L1, BMF, CYP2C8, CYP3A4, MAP2, MAP4, MAPT, NR1I2, SLCO1B3, TUBB1, TUBB4A, and TUBB4B was 78.6% accurate in predicting survival of 84 patients treated with both HT and CT (median survival ≥ 4.4 yr). Accuracy was lower (73.4%) in 304 untreated patients. The performance of other machine learning approaches was also evaluated at different survival thresholds. Minimum redundancy maximum relevance feature selection of a paclitaxel-based SVM classifier based on expression of genes BCL2L1, BBC3, FGF2, FN1, and TWIST1 was 81.1% accurate in 53 CT patients. In addition, a random forest (RF) classifier using a gene signature ( ABCB1, ABCB11, ABCC1, ABCC10, BAD, BBC3, BCL2, BCL2L1, BMF, CYP2C8, CYP3A4, MAP2, MAP4, MAPT, NR1I2,SLCO1B3, TUBB1, TUBB4A, and TUBB4B) predicted \u3e3-year survival with 85.5% accuracy in 420 HT patients. A similar RF gene signature showed 82.7% accuracy in 504 patients treated with CT and/or HT. These results suggest that tumor gene expression signatures refined by machine learning techniques can be useful for predicting survival after drug therapies

Long-term outcomes of primary cardiac malignant tumors: Difference between African American and Caucasian population

BACKGROUND: The survival outcome for primary cardiac malignant tumors (PMCTs) based on race has yet to be fully elucidated in previously published literature. This study aimed to address the general long-term outcome and survival rate differences in PMCTs among African Americans and Caucasian populations. METHODS: The 18 cancer registries database from the Surveillance, Epidemiology, and End Results (SEER) Program from 1975 to 2016 were utilized. Ninety-four African American (AA) and 647 Caucasian (CAU) patients from the SEER registry were available for survival analysis. The log-rank test was used to compare the difference in mortality between two populations and presented by the Kaplan-Meier curves. A multivariate Cox proportional hazards regression was used to determine the independent predictors of all-cause mortality. RESULTS: The overall 30-day, 1-year, and 5-year survival rates were 74%, 44.3%, and 16.6%, respectively, with a median survival of 10 months. There was no significant difference in survival rate between the two races (p-value = 0.55). The 1-year survival rate improved significantly during the study timeline in the AA population (13.3% during 1975-1998, 40.9% during 1999-2004, 50% during 2005-2010, and 59.7% during 2011-2016, p-value = 0.0064). Age of diagnosis, type of tumor, disease stage, and chemotherapy administration are the main factors that predict survival outcomes of PMCT patients. Interactive nomogram was developed based on significant predictors. CONCLUSIONS: PMCTs have remained one of the most lethal diseases with poor survival outcome. Survival rate improved during the timeline in AA patients, but in general, racial differences in survival outcome were not observed

Secular trend, seasonality and effects of a community-based intervention on neonatal mortality: follow-up of a cluster-randomised trial in Quang Ninh province, Vietnam.

BACKGROUND: Little is know about whether the effects of community engagement interventions for child survival in low-income and middle-income settings are sustained. Seasonal variation and secular trend may blur the data. Neonatal mortality was reduced in a cluster-randomised trial in Vietnam where laywomen facilitated groups composed of local stakeholders employing a problem-solving approach for 3 years. In this analysis, we aim at disentangling the secular trend, the seasonal variation and the effect of the intervention on neonatal mortality during and after the trial. METHODS: In Quang Ninh province, 44 communes were allocated to intervention and 46 to control. Births and neonatal deaths were assessed in a baseline survey in 2005, monitored during the trial in 2008-2011 and followed up by a survey in 2014. Time series analyses were performed on monthly neonatal mortality data. RESULTS: There were 30 187 live births and 480 neonatal deaths. The intervention reduced the neonatal mortality from 19.1 to 11.6 per 1000 live births. The reduction was sustained 3 years after the trial. The control areas reached a similar level at the time of follow-up. Time series decomposition analysis revealed a downward trend in the intervention areas during the trial that was not found in the control areas. Neonatal mortality peaked in the hot and wet summers. CONCLUSIONS: A community engagement intervention resulted in a lower neonatal mortality rate that was sustained but not further reduced after the end of the trial. When decomposing time series of neonatal mortality, a clear downward trend was demonstrated in intervention but not in control areas. TRIAL REGISTRATION NUMBER: ISRCTN44599712, Post-results

Quantum Criticality in Heavy Fermion Metals

Quantum criticality describes the collective fluctuations of matter undergoing a second-order phase transition at zero temperature. Heavy fermion metals have in recent years emerged as prototypical systems to study quantum critical points. There have been considerable efforts, both experimental and theoretical, which use these magnetic systems to address problems that are central to the broad understanding of strongly correlated quantum matter. Here, we summarize some of the basic issues, including i) the extent to which the quantum criticality in heavy fermion metals goes beyond the standard theory of order-parameter fluctuations, ii) the nature of the Kondo effect in the quantum critical regime, iii) the non-Fermi liquid phenomena that accompany quantum criticality, and iv) the interplay between quantum criticality and unconventional superconductivity.Comment: (v2) 39 pages, 8 figures; shortened per the editorial mandate; to appear in Nature Physics. (v1) 43 pages, 8 figures; Non-technical review article, intended for general readers; the discussion part contains more specialized topic

Micronutrient Deficits Are Still Public Health Issues among Women and Young Children in Vietnam

Background: The 2000 Vietnamese National Nutrition Survey showed that the population’s dietary intake had improved since 1987. However, inequalities were found in food consumption between socioeconomic groups. As no national data exist on the prevalence of micronutrient deficiencies, a survey was conducted in 2010 to assess the micronutrient status of randomly selected 1526 women of reproductive age and 586 children aged 6–75 mo. Principal Findings: In women, according to international thresholds, prevalence of zinc deficiency (ZnD, 67.262.6%) and vitamin B12 deficiency (11.761.7%) represented public health problems, whereas prevalence of anemia (11.661.0%) and iron deficiency (ID, 13.761.1%) were considered low, and folate (,3%) and vitamin A (VAD,,2%) deficiencies were considered negligible. However, many women had marginal folate (25.1%) and vitamin A status (13.6%). Moreover, overweight (BMI$23 kg/m 2 for Asian population) or underweight occurred in 20 % of women respectively highlighting the double burden of malnutrition. In children, a similar pattern was observed for ZnD (51.963.5%), anemia (9.161.4%) and ID (12.961.5%) whereas prevalence of marginal vitamin A status was also high (47.362.2%). There was a significant effect of age on anemia and ID prevalence, with the youngest age group (6–17 mo) having the highest risk for anemia, ID, ZnD and marginal vitamin A status as compared to other groups. Moreover, the poorest groups of population had a higher risk for zinc, anemia and ID

Global age-sex-specific mortality, life expectancy, and population estimates in 204 countries and territories and 811 subnational locations, 1950–2021, and the impact of the COVID-19 pandemic: a comprehensive demographic analysis for the Global Burden of Disease Study 2021

Background Estimates of demographic metrics are crucial to assess levels and trends of population health outcomes. The profound impact of the COVID-19 pandemic on populations worldwide has underscored the need for timely estimates to understand this unprecedented event within the context of long-term population health trends. The Global Burden of Diseases, Injuries, and Risk Factors Study (GBD) 2021 provides new demographic estimates for 204 countries and territories and 811 additional subnational locations from 1950 to 2021, with a particular emphasis on changes in mortality and life expectancy that occurred during the 2020–21 COVID-19 pandemic period. Methods 22 223 data sources from vital registration, sample registration, surveys, censuses, and other sources were used to estimate mortality, with a subset of these sources used exclusively to estimate excess mortality due to the COVID-19 pandemic. 2026 data sources were used for population estimation. Additional sources were used to estimate migration; the effects of the HIV epidemic; and demographic discontinuities due to conflicts, famines, natural disasters, and pandemics, which are used as inputs for estimating mortality and population. Spatiotemporal Gaussian process regression (ST-GPR) was used to generate under-5 mortality rates, which synthesised 30 763 location-years of vital registration and sample registration data, 1365 surveys and censuses, and 80 other sources. ST-GPR was also used to estimate adult mortality (between ages 15 and 59 years) based on information from 31 642 location-years of vital registration and sample registration data, 355 surveys and censuses, and 24 other sources. Estimates of child and adult mortality rates were then used to generate life tables with a relational model life table system. For countries with large HIV epidemics, life tables were adjusted using independent estimates of HIV-specific mortality generated via an epidemiological analysis of HIV prevalence surveys, antenatal clinic serosurveillance, and other data sources. Excess mortality due to the COVID-19 pandemic in 2020 and 2021 was determined by subtracting observed all-cause mortality (adjusted for late registration and mortality anomalies) from the mortality expected in the absence of the pandemic. Expected mortality was calculated based on historical trends using an ensemble of models. In location-years where all-cause mortality data were unavailable, we estimated excess mortality rates using a regression model with covariates pertaining to the pandemic. Population size was computed using a Bayesian hierarchical cohort component model. Life expectancy was calculated using age-specific mortality rates and standard demographic methods. Uncertainty intervals (UIs) were calculated for every metric using the 25th and 975th ordered values from a 1000-draw posterior distribution. Findings Global all-cause mortality followed two distinct patterns over the study period: age-standardised mortality rates declined between 1950 and 2019 (a 62·8% [95% UI 60·5–65·1] decline), and increased during the COVID-19 pandemic period (2020–21; 5·1% [0·9–9·6] increase). In contrast with the overall reverse in mortality trends during the pandemic period, child mortality continued to decline, with 4·66 million (3·98–5·50) global deaths in children younger than 5 years in 2021 compared with 5·21 million (4·50–6·01) in 2019. An estimated 131 million (126–137) people died globally from all causes in 2020 and 2021 combined, of which 15·9 million (14·7–17·2) were due to the COVID-19 pandemic (measured by excess mortality, which includes deaths directly due to SARS-CoV-2 infection and those indirectly due to other social, economic, or behavioural changes associated with the pandemic). Excess mortality rates exceeded 150 deaths per 100 000 population during at least one year of the pandemic in 80 countries and territories, whereas 20 nations had a negative excess mortality rate in 2020 or 2021, indicating that all-cause mortality in these countries was lower during the pandemic than expected based on historical trends. Between 1950 and 2021, global life expectancy at birth increased by 22·7 years (20·8–24·8), from 49·0 years (46·7–51·3) to 71·7 years (70·9–72·5). Global life expectancy at birth declined by 1·6 years (1·0–2·2) between 2019 and 2021, reversing historical trends. An increase in life expectancy was only observed in 32 (15·7%) of 204 countries and territories between 2019 and 2021. The global population reached 7·89 billion (7·67–8·13) people in 2021, by which time 56 of 204 countries and territories had peaked and subsequently populations have declined. The largest proportion of population growth between 2020 and 2021 was in sub-Saharan Africa (39·5% [28·4–52·7]) and south Asia (26·3% [9·0–44·7]). From 2000 to 2021, the ratio of the population aged 65 years and older to the population aged younger than 15 years increased in 188 (92·2%) of 204 nations. Interpretation Global adult mortality rates markedly increased during the COVID-19 pandemic in 2020 and 2021, reversing past decreasing trends, while child mortality rates continued to decline, albeit more slowly than in earlier years. Although COVID-19 had a substantial impact on many demographic indicators during the first 2 years of the pandemic, overall global health progress over the 72 years evaluated has been profound, with considerable improvements in mortality and life expectancy. Additionally, we observed a deceleration of global population growth since 2017, despite steady or increasing growth in lower-income countries, combined with a continued global shift of population age structures towards older ages. These demographic changes will likely present future challenges to health systems, economies, and societies. The comprehensive demographic estimates reported here will enable researchers, policy makers, health practitioners, and other key stakeholders to better understand and address the profound changes that have occurred in the global health landscape following the first 2 years of the COVID-19 pandemic, and longer-term trends beyond the pandemic

Transformer vibration and noise monitoring system using internet of things

Abstract During continuous operation, transformer problems can occur due to various reasons. In reality, the operating parameters of the transformer have been collected and monitored through the supervisory control and data acquisition (SCADA) systems. However, these systems face many challenges when applied to no‐human substations. Currently, noise signals have been used to detect transformer errors. Abnormal noise recognition and vibration monitoring can recognize the transformer's potential defects and errors. In this study, the authors built an internet of things (IoT) system that allows remote control centres to monitor the condition of transformers through noise and vibration at non‐human substations. The proposed model was equipped with a wireless sensor network node consisting of vibration sensors, audio collectors, Arduino modules, and Lora modules. The authors set up two schemes for the IoT network: one sensor node for a 220‐kV transformer and three sensor nodes for all three phases of the 500‐kV transformer. The data obtained from the sensor node were sent to LoRa Gateway and displayed on the computer through LabVIEW. The study also enabled monitoring of parameters through IoT devices such as Desktops, Laptops, Smartphones from LabVIEW NXG Web VI platform, ThingSpeak, and Amazon S3 storage cloud. In addition, a Model Predictive Control (MPC) algorithm was applied to predict the deterioration of transformer health to maintain the system stability and, hence, prolong the transformer life and operability

Efficacy of phytotherapy as nutritional supplements in patients with refractory immune thrombocytopenia

Introduction: The management of refractory immune thrombocytopenia (ITP) is challenging and difficult. The treatment was mainly comprised of cytotoxic and immunosuppressed drugs that rarely lead to long-term remission but potentially cause severe and dangerous side effects. Our current study is a retrospective clinical analysis of refractory ITP patients who underwent phytotherapy as nutritional supplements. Methods: A retrospective clinical analysis of 15 refractory immune thrombocytopenia (ITP) patients aged 12–64 with ITP history for more than 24 months before the enrollments. All patients presented with low platelet count (< 30  ×  109/L) and moderate to severe bleeding symptoms such as extensive petechiae, bruising, epistaxis, prolonged menses, rectal bleeding, and hematuria. The patients underwent supportive phytotherapy as nutritional supplements using herbal extracts with hemostatic, immunomodulating, and platelet function augmenting functions Results: The 6-month retrospective clinical evaluation indicated that phytotherapy might offer an effective and safe solution for controlling bleeding symptoms and improving platelet counts for refractory ITP patients. Moreover, phytotherapy also significantly improved patients' red cell count, hemoglobulin, and liver enzyme levels compared to baseline data. Conclusions: In individual cases and economically disadvantaged regions, investigating and applying an appropriate combination of phytotherapy based on scientific knowledge and traditional folk medical experiences might offer an effective, inexpensive, and safe solution for refractory ITP and other bleeding disorders