Collaborative Layer-wise Discriminative Learning in Deep Neural Networks

Intermediate features at different layers of a deep neural network are known to be discriminative for visual patterns of different complexities. However, most existing works ignore such cross-layer heterogeneities when classifying samples of different complexities. For example, if a training sample has already been correctly classified at a specific layer with high confidence, we argue that it is unnecessary to enforce rest layers to classify this sample correctly and a better strategy is to encourage those layers to focus on other samples. In this paper, we propose a layer-wise discriminative learning method to enhance the discriminative capability of a deep network by allowing its layers to work collaboratively for classification. Towards this target, we introduce multiple classifiers on top of multiple layers. Each classifier not only tries to correctly classify the features from its input layer, but also coordinates with other classifiers to jointly maximize the final classification performance. Guided by the other companion classifiers, each classifier learns to concentrate on certain training examples and boosts the overall performance. Allowing for end-to-end training, our method can be conveniently embedded into state-of-the-art deep networks. Experiments with multiple popular deep networks, including Network in Network, GoogLeNet and VGGNet, on scale-various object classification benchmarks, including CIFAR100, MNIST and ImageNet, and scene classification benchmarks, including MIT67, SUN397 and Places205, demonstrate the effectiveness of our method. In addition, we also analyze the relationship between the proposed method and classical conditional random fields models.Comment: To appear in ECCV 2016. Maybe subject to minor changes before camera-ready versio

The demand for sports and exercise: Results from an illustrative survey

Funding from the Department of Health policy research programme was used in this study.There is a paucity of empirical evidence on the extent to which price and perceived benefits affect the level of participation in sports and exercise. Using an illustrative sample of 60 adults at Brunel University, West London, we investigate the determinants of demand for sports and exercise. The data were collected through face-to-face interviews that covered indicators of sports and exercise behaviour; money/time price and perceived benefits of participation; and socio- economic/demographic details. Count, linear and probit regression models were fitted as appropriate. Seventy eight per cent of the sample participated in sports and exercise and spent an average of £27 per month and an average of 20 min travelling per occasion of sports and exercise. The demand for sport and exercise was negatively associated with time (travel or access time) and ‘variable’ price and positively correlated with ‘fixed’ price. Demand was price inelastic, except in the case of meeting the UK government’s recommended level of participation, which is time price elastic (elasticity = −2.2). The implications of data from a larger nationally representative sample as well as the role of economic incentives in influencing uptake of sports and exercise are discussed.This article is available through the Brunel Open Access Publishing Fund

Emplacement of inflated Pāhoehoe flows in the Naude’s Nek Pass, Lesotho remnant, Karoo continental flood basalt province: use of flow-lobe tumuli in understanding flood basalt emplacement

Physical volcanological features are presented for a 710-m-thick section, of the Naude’s Nek Pass, within the lower part of the Lesotho remnant of the Karoo Large Igneous Province. The section consists of inflated pāhoehoe lava with thin, impersistent sedimentary interbeds towards the base. There are seven discreet packages of compound and hummocky pāhoehoe lobes containing flow-lobe tumuli, making up approximately 50% of the section. Approximately 45% of the sequence consists of 14 sheet lobes, between 10 and 52-m-thick. The majority of the sheet lobes are in two packages indicating prolonged periods of lava supply capable of producing thick sheet lobes. The other sheet lobes are as individual lobes or pairs, within compound flows, suggesting brief increases in lava supply rate. We suggest, contrary to current belief, that there is no evidence that compound flows are proximal to source and sheet lobes (simple flows) are distal to source and we propose that the presence of flow-lobe tumuli in compound flows could be an indicator that a flow is distal to source. We use detailed, previously published, studies of the Thakurvadi Formation (Deccan Traps) as an example. We show that the length of a lobe and therefore the sections that are ‘medial or distal to source’ are specific to each individual lobe and are dependent on the lava supply of each eruptive event, and as such flow lobe tumuli can be used as an indicator of relative distance from source

Challenges of Profile Likelihood Evaluation in Multi-Dimensional SUSY Scans

Statistical inference of the fundamental parameters of supersymmetric theories is a challenging and active endeavor. Several sophisticated algorithms have been employed to this end. While Markov-Chain Monte Carlo (MCMC) and nested sampling techniques are geared towards Bayesian inference, they have also been used to estimate frequentist confidence intervals based on the profile likelihood ratio. We investigate the performance and appropriate configuration of MultiNest, a nested sampling based algorithm, when used for profile likelihood-based analyses both on toy models and on the parameter space of the Constrained MSSM. We find that while the standard configuration is appropriate for an accurate reconstruction of the Bayesian posterior, the profile likelihood is poorly approximated. We identify a more appropriate MultiNest configuration for profile likelihood analyses, which gives an excellent exploration of the profile likelihood (albeit at a larger computational cost), including the identification of the global maximum likelihood value. We conclude that with the appropriate configuration MultiNest is a suitable tool for profile likelihood studies, indicating previous claims to the contrary are not well founded.Comment: 21 pages, 9 figures, 1 table; minor changes following referee report. Matches version accepted by JHE

The Hydration Structure at Yttria-Stabilized Cubic Zirconia (110)-Water Interface with Sub-Angstrom Resolution

The interfacial hydration structure of yttria-stabilized cubic zirconia (110) surface in contact with water was determined with ~0.5 Å resolution by high-resolution X-ray reflectivity measurement. The terminal layer shows a reduced electron density compared to the following substrate lattice layers, which indicates there are additional defects generated by metal depletion as well as intrinsic oxygen vacancies, both of which are apparently filled by water species. Above this top surface layer, two additional adsorbed layers are observed forming a characteristic interfacial hydration structure. The first adsorbed layer shows abnormally high density as pure water and likely includes metal species, whereas the second layer consists of pure water. The observed interfacial hydration structure seems responsible for local equilibration of the defective surface in water and eventually regulating the long-term degradation processes. The multitude of water interactions with the zirconia surface results in the complex but highly ordered interfacial structure constituting the reaction front.ope

Exposure to bisphosphonates and risk of common non-gastrointestinal cancers: series of nested case–control studies using two primary-care databases

Background: Bisphosphonates are the most commonly prescribed osteoporosis drugs but long-term effects are unclear, although antitumour properties are known from preclinical studies. Methods: Nested case–control studies were conducted to investigate bisphosphonate use and risks of common nongastrointestinal cancers (breast, prostate, lung, bladder, melanoma, ovarian, pancreas, uterus and cervical). Patients 50 years and older, diagnosed with primary cancers between 1997 and 2011, were matched to five controls using the UK practice-based QResearch and Clinical Practice Research Datalink (CPRD) databases. The databases were analysed separately and the results combined. Results: A total of 91 556 and 88 845 cases were identified from QResearch and CPRD, respectively. Bisphosphonate use was associated with reduced risks of breast (odds ratio (OR): 0.92, 95% confidence interval (CI): 0.87–0.97), prostate (OR: 0.87, 95% CI: 0.79–0.96) and pancreatic (OR: 0.79, 95% CI: 0.68–0.93) cancers in the combined analyses, but no significant trends with duration. For alendronate, reduced risk associations were found for prostate cancer in the QResearch (OR: 0.81, 95% CI: 0.70–0.93) and combined (OR: 0.84, 95% CI: 0.75–0.93) analyses (trend with duration P-values 0.009 and 0.001). There were no significant associations from any of the other analyses. Conclusion: In this series of large population-based case–control studies, bisphosphonate use was not associated with increased risks for any common non-gastrointestinal cancers

Risk factors associated with default from multi- and extensively drug-resistant tuberculosis treatment, uzbekistan: a retrospective cohort analysis.

The Médecins Sans Frontières project of Uzbekistan has provided multidrug-resistant tuberculosis treatment in the Karakalpakstan region since 2003. Rates of default from treatment have been high, despite psychosocial support, increasing particularly since programme scale-up in 2007. We aimed to determine factors associated with default in multi- and extensively drug-resistant tuberculosis patients who started treatment between 2003 and 2008 and thus had finished approximately 2 years of treatment by the end of 2010

Protocol for the 'e-Nudge trial' : a randomised controlled trial of electronic feedback to reduce the cardiovascular risk of individuals in general practice [ISRCTN64828380]

Background: Cardiovascular disease (including coronary heart disease and stroke) is a major cause of death and disability in the United Kingdom, and is to a large extent preventable, by lifestyle modification and drug therapy. The recent standardisation of electronic codes for cardiovascular risk variables through the United Kingdom's new General Practice contract provides an opportunity for the application of risk algorithms to identify high risk individuals. This randomised controlled trial will test the benefits of an automated system of alert messages and practice searches to identify those at highest risk of cardiovascular disease in primary care databases. Design: Patients over 50 years old in practice databases will be randomised to the intervention group that will receive the alert messages and searches, and a control group who will continue to receive usual care. In addition to those at high estimated risk, potentially high risk patients will be identified who have insufficient data to allow a risk estimate to be made. Further groups identified will be those with possible undiagnosed diabetes, based either on elevated past recorded blood glucose measurements, or an absence of recent blood glucose measurement in those with established cardiovascular disease. Outcome measures: The intervention will be applied for two years, and outcome data will be collected for a further year. The primary outcome measure will be the annual rate of cardiovascular events in the intervention and control arms of the study. Secondary measures include the proportion of patients at high estimated cardiovascular risk, the proportion of patients with missing data for a risk estimate, and the proportion with undefined diabetes status at the end of the trial

Stringy Stability of Charged Dilaton Black Holes with Flat Event Horizon

Electrically charged black holes with flat event horizon in anti-de Sitter space have received much attention due to various applications in Anti-de Sitter/Conformal Field Theory (AdS/CFT) correspondence, from modeling the behavior of quark-gluon plasma to superconductor. Crucial to the physics on the dual field theory is the fact that when embedded in string theory, black holes in the bulk may become vulnerable to instability caused by brane pair-production. Since dilaton arises naturally in the context of string theory, we study the effect of coupling dilaton to Maxwell field on the stability of flat charged AdS black holes. In particular, we study the stability of Gao-Zhang black holes, which are locally asymptotically anti-de Sitter. We find that for dilaton coupling parameter $\alpha$ > 1, flat black holes are stable against brane pair production, however for 0 < $\alpha$ < 1, the black holes eventually become unstable as the amount of electrical charges is increased. Such instability however, behaves somewhat differently from that of flat Reissner-Nordstr\"om black holes. In addition, we prove that the Seiberg-Witten action of charged dilaton AdS black hole of Gao-Zhang type with flat event horizon (at least in 5-dimension) is always logarithmically divergent at infinity for finite values of $\alpha$, and is finite and positive in the case $\alpha$ tends to infinity . We also comment on the robustness of our result for other charged dilaton black holes that are not of Gao-Zhang type.Comment: Fixed some confusions regarding whether part of the discussions concern electrically charged hole or magnetically charged one. No changes to the result