Perspective: new insights from loss function landscapes of neural networks

Abstract: We investigate the structure of the loss function landscape for neural networks subject to dataset mislabelling, increased training set diversity, and reduced node connectivity, using various techniques developed for energy landscape exploration. The benchmarking models are classification problems for atomic geometry optimisation and hand-written digit prediction. We consider the effect of varying the size of the atomic configuration space used to generate initial geometries and find that the number of stationary points increases rapidly with the size of the training configuration space. We introduce a measure of node locality to limit network connectivity and perturb permutational weight symmetry, and examine how this parameter affects the resulting landscapes. We find that highly-reduced systems have low capacity and exhibit landscapes with very few minima. On the other hand, small amounts of reduced connectivity can enhance network expressibility and can yield more complex landscapes. Investigating the effect of deliberate classification errors in the training data, we find that the variance in testing AUC, computed over a sample of minima, grows significantly with the training error, providing new insight into the role of the variance-bias trade-off when training under noise. Finally, we illustrate how the number of local minima for networks with two and three hidden layers, but a comparable number of variable edge weights, increases significantly with the number of layers, and as the number of training data decreases. This work helps shed further light on neural network loss landscapes and provides guidance for future work on neural network training and optimisation

Thrips Settling, Oviposition and IYSV Distribution on Onion Foliage

Thrips tabaci Lindeman (Thysanoptera: Thripidae) adult and larval settling and oviposition on onion (Allium cepa L.) foliage were investigated in relation to leaf position and leaf length at prebulb plant growth stages under controlled conditions. In the laboratory, four and six adult females of T. tabaci were released on onion plants at three-leaf stage and six- to eight-leaf stage, respectively, and thrips egg, nymph, and adult count data were collected on each of the three inner most leaves at every 2-cm leaf segment. Thrips settling and oviposition parameters were quantified during the light period on the above ground portion of onion plants from the distal end of the bulb or leaf sheath “neck” through the tips of the foliage. Results from studies confirmed that distribution of thrips adults, nymphs, and eggs were skewed toward the base of the plant. The settling distributions of thrips adults and nymphs differed slightly from the egg distribution in that oviposition occurred all the way to the tip of the leaf while adults and nymphs were typically not observed near the tip. In a field study, the foliage was divided into three equal partitions, i.e., top, middle, basal thirds, and thrips adults by species, primarily Frankliniella fusca (Hinds) and T. tabaci, were collected from each partition to determine if there was a similar bias of all adult thrips toward the base of the plant. The results suggested that adults of different species appear to segregate along leaf length. Finally, thrips oviposition on 2-cm segments and Iris yellow spot virus positive leaf segments were quantified in the field, irrespective of thrips species. Both variables demonstrated a very similar pattern of bias toward the base of the plant and were significantly correlated

Machine learning enabled experimental design and parameter estimation for ultrafast spin dynamics

Advanced experimental measurements are crucial for driving theoretical developments and unveiling novel phenomena in condensed matter and material physics, which often suffer from the scarcity of facility resources and increasing complexities. To address the limitations, we introduce a methodology that combines machine learning with Bayesian optimal experimental design (BOED), exemplified with x-ray photon fluctuation spectroscopy (XPFS) measurements for spin fluctuations. Our method employs a neural network model for large-scale spin dynamics simulations for precise distribution and utility calculations in BOED. The capability of automatic differentiation from the neural network model is further leveraged for more robust and accurate parameter estimation. Our numerical benchmarks demonstrate the superior performance of our method in guiding XPFS experiments, predicting model parameters, and yielding more informative measurements within limited experimental time. Although focusing on XPFS and spin fluctuations, our method can be adapted to other experiments, facilitating more efficient data collection and accelerating scientific discoveries

Sustainability effects of next-generation intersection control for autonomous vehicles

Transportation sustainability is adversely affected by recurring traffic congestions, especially at urban intersections. Frequent vehicle deceleration and acceleration caused by stop-and-go behaviours at intersections due to congestion adversely impacts energy consumption and ambient air quality. Availability of the maturing vehicle technologies such as autonomous vehicles and Vehicle-To-Vehicle (V2V) / Vehicle-To-Infrastructure (V2I) communications provides technical feasibility to develop solutions that can reduce vehicle stops at intersections, hence enhance the sustainability of intersections. This paper presents a next-generation intersection control system for autonomous vehicles, which is named ACUTA. ACUTA employs an enhanced reservation-based control algorithm that controls autonomous vehicles’ passing sequence at an intersection. Particularly, the intersection is divided into n-by-n tiles. An intersection controller reserves certain time-space for each vehicle, and assures no conflict exists between reservations. The algorithm was modelled in microscopic traffic simulation platform VISSIM. ACUTA algorithm modelling as well as enhancement strategies to minimize vehicle intersection stops and eventually emission and energy consumption were discussed in the paper. Sustainability benefits offered by this next-generation intersection were evaluated and compared with traditional intersection control strategies. The evaluation reveals that multi-tile ACUTA reduces carbon monoxide (CO) and Particulate Matter (PM) 2.5 emissions by about 5% under low to moderate volume conditions and by about 3% under high volume condition. Meanwhile, energy consumption is reduced by about 4% under low to moderate volume conditions and by about 12% under high volume condition. Compared with four-way stop control, single-tile ACUTA reduces CO and PM 2.5 emissions as well as energy consumption by about 15% under any prevailing volume conditions. These findings validated the sustainability benefits of employing next-generation vehicle technologies in intersection traffic control. In addition, extending the ACUTA to corridor level was explored in the paper

Machine learning for cardiac ultrasound time series data

We consider the problem of identifying frames in a cardiac ultrasound video associated with left ventricular chamber end-systolic (ES, contraction) and end-diastolic (ED, expansion) phases of the cardiac cycle. Our procedure involves a simple application of non-negative matrix factorization (NMF) to a series of frames of a video from a single patient. Rank-2 NMF is performed to compute two end-members. The end members are shown to be close representations of the actual heart morphology at the end of each phase of the heart function. Moreover, the entire time series can be represented as a linear combination of these two end-member states thus providing a very low dimensional representation of the time dynamics of the heart. Unlike previous work, our methods do not require any electrocardiogram (ECG) information in order to select the end-diastolic frame. Results are presented for a data set of 99 patients including both healthy and diseased examples.UCLA through the Physical Sciences Division; Entrepreneurship and Innovation Fund; Department of Mathematics; NSF [DMS-1045536, DMS-1417674]; ONR [N00014-16-1-2119]; Cross-disciplinary Scholars in Science and Technology (CSST) program at UCLACPCI-S(ISTP)1013

Serum procalcitonin and CRP levels in non-alcoholic fatty liver disease: a case control study

<p>Abstract</p> <p>Background</p> <p>Both C reactive protein (CRP) and procalcitonin (PCT) are well known acute phase reactant proteins. CRP was reported to increase in metabolic syndrome and type-2 diabetes. Similarly altered level of serum PCT was found in chronic liver diseases and cirrhosis. The liver is considered the main source of CRP and a source of PCT, however, the serum PCT and CRP levels in non-alcoholic fatty liver disease (NAFLD) were not compared previously. Therefore we aimed to study the diagnostic and discriminative role of serum PCT and CRP in NAFLD.</p> <p>Methods</p> <p>Fifty NAFLD cases and 50 healthy controls were included to the study. Liver function tests were measured, body mass index was calculated, and insulin resistance was determined by using a homeostasis model assessment (HOMA-IR). Ultrasound evaluation was performed for each subject. Serum CRP was measured with nephalometric method. Serum PCT was measured with Kryptor based system.</p> <p>Results</p> <p>Serum PCT levels were similar in steatohepatitis (n 20) and simple steatosis (n 27) patients, and were not different than the control group (0.06 ± 0.01, 0.04 ± 0.01 versus 0.06 ± 0.01 ng/ml respectively). Serum CRP levels were significantly higher in simple steatosis, and steatohepatitis groups compared to healthy controls (7.5 ± 1.6 and 5.2 ± 2.5 versus 2.9 ± 0.5 mg/dl respectively p < 0.01). CRP could not differentiate steatohepatitis from simple steatosis. Beside, three patients with focal fatty liver disease had normal serum CRP levels.</p> <p>Conclusion</p> <p>Serum PCT was within normal ranges in patients with simple steatosis or steatohepatitis and has no diagnostic value. Serum CRP level was increased in NAFLD compared to controls. CRP can be used as an additional marker for diagnosis of NAFLD but it has no value in discrimination of steatohepatitis from simple steatosis.</p

Adipose Tissue Dysfunction Signals Progression of Hepatic Steatosis Towards Nonalcoholic Steatohepatitis in C57Bl/6 Mice

OBJECTIVE - Nonalcoholic fatty liver disease (NAFLD) is linked to obesity and diabetes, suggesting an important role of adipose tissue in the pathogenesis of NAFLD. Here, we aimed to investigate the interaction between adipose tissue and liver in NAFLD and identify potential early plasma markers that predict nonalcoholic steatohepatitis (NASH). RESEARCH DESIGN AND METHODS - C57Bl/6 mice were chronically fed a high-fat diet to induce NAFLD and compared with mice fed a low-fat diet. Extensive histological and phenotypical analyses coupled with a time course study of plasma proteins using multiplex assay were performed. RESULTS - Mice exhibited pronounced heterogeneity in liver histological scoring, leading to classification into four subgroups: low-fat low (LFL) responders displaying normal liver morphology, low-fat high (LFH) responders showing benign hepatic steatosis, high-fat low (HFL) responders displaying pre-NASH with macrovesicular lipid droplets, and high fat high (HFH) responders exhibiting overt NASH characterized by ballooning of hepatocytes, presence of Mallory bodies, and activated inflammatory cells. Compared with HFL responders, HFH mice gained weight more rapidly and exhibited adipose tissue dysfunction characterized by decreased final fat mass, enhanced macrophage infiltration and inflammation, and adipose tissue remodeling. Plasma haptoglobin, IL-1β, TIMP-1, adiponectin, and leptin were significantly changed in HFH mice. Multivariate analysis indicated that in addition to leptin, plasma CRP, haptoglobin, eotaxin, and MIP-1α early in the intervention were positively associated with liver triglycerides. Intermediate prognostic markers of liver triglycerides included IL-18, IL-1β, MIP-1γ, and MIP-2, whereas insulin, TIMP-1, granulocyte chemotactic protein 2, and myeloperoxidase emerged as late markers. CONCLUSIONS - Our data support the existence of a tight relationship between adipose tissue dysfunction and NASH pathogenesis and point to several novel potential predictive biomarkers for NASH

Testing the data framework for an AI algorithm in preparation for high data rate X-ray facilities

The advent of next-generation X-ray free electron lasers will be capable of delivering X-rays at a repetition rate approaching 1 MHz continuously. This will require the development of data systems to handle experiments at these type of facilities, especially for high throughput applications, such as femtosecond X-ray crystallography and X-ray photon fluctuation spectroscopy. Here, we demonstrate a framework which captures single shot X-ray data at the LCLS and implements a machine-learning algorithm to automatically extract the contrast parameter from the collected data. We measure the time required to return the results and assess the feasibility of using this framework at high data volume. We use this experiment to determine the feasibility of solutions for `live' data analysis at the MHz repetition rate

Consumers of natural health products: natural-born pharmacovigilantes?

<p>Abstract</p> <p>Background</p> <p>Natural health products (NHPs), such as herbal medicines and vitamins, are widely available over-the-counter and are often purchased by consumers without advice from a healthcare provider. This study examined how consumers respond when they believe they have experienced NHP-related adverse drug reactions (ADRs) in order to determine how to improve current safety monitoring strategies.</p> <p>Methods</p> <p>Qualitative semi-structured interviews were conducted with twelve consumers who had experienced a self-identified NHP-related ADR. Key emergent themes were identified and coded using content analysis techniques.</p> <p>Results</p> <p>Consumers were generally not comfortable enough with their conventional health care providers to discuss their NHP-related ADRs. Consumers reported being more comfortable discussing NHP-related ADRs with personnel from health food stores, friends or family with whom they had developed trusted relationships. No one reported their suspected ADR to Health Canada and most did not know this was possible.</p> <p>Conclusion</p> <p>Consumers generally did not report their suspected NHP-related ADRs to healthcare providers or to Health Canada. Passive reporting systems for collecting information on NHP-related ADRs cannot be effective if consumers who experience NHP-related ADRs do not report their experiences. Healthcare providers, health food store personnel, manufacturers and other stakeholders also need to take responsibility for reporting ADRs in order to improve current pharmacovigilance of NHPs.</p

A Cohort Study of Serum Bilirubin Levels and Incident Non-Alcoholic Fatty Liver Disease in Middle Aged Korean Workers

BACKGROUND: Serum bilirubin may have potent antioxidant and cytoprotective effects. Serum bilirubin levels are inversely associated with several cardiovascular and metabolic endpoints, but their association with nonalcoholic fatty liver disease (NAFLD) has not been investigated except for a single cross-sectional study in a pediatric population. We assessed the prospective association between serum bilirubin concentrations (total, direct, and indirect) and the risk for NAFLD. METHODS AND FINDINGS: We performed a cohort study in 5,900 Korean men, 30 to 59 years of age, with no evidence of liver disease and no major risk factors for liver disease at baseline. Study participants were followed in annual or biennial health examinations between 2002 and 2009. The presence of fatty liver was determined at each visit by ultrasonography. We observed 1,938 incident cases of NAFLD during 28,101.8 person-years of follow-up. Increasing levels of serum direct bilirubin were progressively associated with a decreasing incidence of NAFLD. In age-adjusted models, the hazard ratio for NAFLD comparing the highest to the lowest quartile of serum direct bilirubin levels was 0.61 (95% CI 0.54-0.68). The association persisted after adjusting for multiple metabolic parameters (hazard ratio comparing the highest to the lowest quartile 0.86, 95% CI 0.76-0.98; P trend = 0.039). Neither serum total nor indirect bilirubin levels were significantly associated with the incidence of NAFLD. CONCLUSIONS: In this large prospective study, higher serum direct bilirubin levels were significantly associated with a lower risk of developing NAFLD, even adjusting for a variety of metabolic parameters. Further research is needed to elucidate the mechanisms underlying this association and to establish the role of serum direct bilirubin as a marker for NAFLD risk