Avoiding overfitting of multilayer perceptrons by training derivatives

Resistance to overfitting is observed for neural networks trained with extended backpropagation algorithm. In addition to target values, its cost function uses derivatives of those up to the $4^{\mathrm{th}}$ order. For common applications of neural networks, high order derivatives are not readily available, so simpler cases are considered: training network to approximate analytical function inside 2D and 5D domains and solving Poisson equation inside a 2D circle. For function approximation, the cost is a sum of squared differences between output and target as well as their derivatives with respect to the input. Differential equations are usually solved by putting a multilayer perceptron in place of unknown function and training its weights, so that equation holds within some margin of error. Commonly used cost is the equation's residual squared. Added terms are squared derivatives of said residual with respect to the independent variables. To investigate overfitting, the cost is minimized for points of regular grids with various spacing, and its root mean is compared with its value on much denser test set. Fully connected perceptrons with six hidden layers and $2\cdot10^{4}$, $1\cdot10^{6}$ and $5\cdot10^{6}$ weights in total are trained with Rprop until cost changes by less than 10% for last 1000 epochs, or when the $10000^{\mathrm{th}}$ epoch is reached. Training the network with $5\cdot10^{6}$ weights to represent simple 2D function using 10 points with 8 extra derivatives in each produces cost test to train ratio of $1.5$, whereas for classical backpropagation in comparable conditions this ratio is $2\cdot10^{4}$

Modulation of Sn concentration in ZnO nanorod array: intensification on the conductivity and humidity sensing properties

Tin (Sn)-doped zinc oxide (ZnO) nanorod arrays (TZO) were synthesized onto aluminum-doped ZnO-coated glass substrate via a facile sonicated sol–gel immersion method for humidity sensor applications. These nanorod arrays were grown at different Sn concentrations ranging from 0.6 to 3 at.%. X-ray diffraction patterns showed that the deposited TZO arrays exhibited a wurtzite structure. The stress/strain condition of the ZnO film metamorphosed from tensile strain/compressive stress to compressive strain/tensile stress when the Sn concentrations increased. Results indicated that 1 at.% Sn doping of TZO, which has the lowest tensile stress of 0.14 GPa, generated the highest conductivity of 1.31 S cm− 1. In addition, 1 at.% Sn doping of TZO possessed superior sensitivity to a humidity of 3.36. These results revealed that the optimum performance of a humidity-sensing device can be obtained mainly by controlling the amount of extrinsic element in a ZnO film

Left-sided appendicitis in a patient with congenital gastrointestinal malrotation: a case report

<p>Abstract</p> <p>Background</p> <p>While appendicitis is the most common abdominal disease requiring surgical intervention seen in the emergency room setting, intestinal malrotation is relatively uncommon. When patients with asymptomatic undiagnosed gastrointestinal malrotation clinically present with abdominal pain, accurate diagnosis and definitive therapy may be delayed, possibly increasing the risk of morbidity and mortality. We present a case where CT was crucial diagnostically and helpful for pre-surgical planning in a patient presenting with an acute abdomen superimposed on complete congenital gastrointestinal malrotation.</p> <p>Case presentation</p> <p>A 46-year-old previously healthy male with four days of primarily left-sided abdominal pain, low-grade fevers, nausea and anorexia presented to the Emergency Department. His medical history was significant for poorly controlled diabetes and dyslipidemia. His white blood count at that time was elevated. Initial abdominal plain films suggested small bowel obstruction. A CT scan of the abdomen and pelvis was performed with oral and IV contrast to exclude diverticulitis, revealing acute appendicitis superimposed on congenital intestinal malrotation. Following consultation with the surgical team for surgical planning, the patient went on to laparoscopic appendectomy and did well postoperatively.</p> <p>Conclusion</p> <p>Atypical presentations of acute abdominal conditions superimposed on asymptomatic gastrointestinal malrotation can result in delays in delivery of definitive therapy and potentially increase morbidity and mortality if not diagnosed in a timely manner. Appropriate imaging can be helpful in hastening diagnosis and guiding intervention.</p

Clinical characteristics, etiology and antimicrobial susceptibility among overweight and obese individuals with diarrhea: observed at a large diarrheal disease hospital, Bangladesh

Background:The present study aimed to determine the clinical characteristics and etiology of overweight and obese (OO) individuals with diarrhea attending an urban Dhaka Hospital, International Centre for Diarrheal Disease Research (icddr,b), Bangladesh.Methods:Total of 508 under-5 children, 96 individuals of 5-19 years and 1331 of >19 years were identified as OO from the Diarrheal Disease Surveillance System (DDSS) between 1993-2011. Two comparison groups such as well-nourished and malnourished individuals from respective age stratums were selected.Results:Isolation rate of rotavirus was higher among OO under-5 children compared to malnourished group (46% vs. 28%). Rotavirus infection among OO individuals aged 5-19 years (9% vs. 3%) (9% vs. 3%) and >19 years (6% vs. 4%) (6% vs. 3%) was higher compared to well-nourished and malnourished children. Conversely, Vibrio cholerae was lower among all OO age groups compared to well-nourished and malnourished ones. Shigella (4% vs. 6%) (4% vs. 8%), and Campylobacter (3% vs. 5%) (3% vs. 5%) were lower only among OO in >19 years individuals compared to their counterparts of the same age stratum. Salmonella was similarly isolated in all age strata and nutritional groups. In multinomial logistic regression among under-5 children, significant association was observed only with use of antimicrobials at home [OR-1.97] and duration of hospital stay [OR-0.68]. For individuals aged 5-19 years, use of antimicrobials at home (OR-1.83), some or severe dehydration (OR-3.12), having received intravenous saline (OR-0.46) and rotavirus diarrhea (OR-2.96) were found to be associated with OO respectively. Moreover, significant associations were also found for duration of diarrhea before coming to hospital (>24 hours) (OR-1.24), Shigella (OR-0.46), and Campylobacter (OR-0.58) among >19 years OO individuals along with other associated co-variates in 5-19 years group (all

Measurement of the inclusive and dijet cross-sections of b-jets in pp collisions at sqrt(s) = 7 TeV with the ATLAS detector

The inclusive and dijet production cross-sections have been measured for jets containing b-hadrons (b-jets) in proton-proton collisions at a centre-of-mass energy of sqrt(s) = 7 TeV, using the ATLAS detector at the LHC. The measurements use data corresponding to an integrated luminosity of 34 pb^-1. The b-jets are identified using either a lifetime-based method, where secondary decay vertices of b-hadrons in jets are reconstructed using information from the tracking detectors, or a muon-based method where the presence of a muon is used to identify semileptonic decays of b-hadrons inside jets. The inclusive b-jet cross-section is measured as a function of transverse momentum in the range 20 < pT < 400 GeV and rapidity in the range |y| < 2.1. The bbbar-dijet cross-section is measured as a function of the dijet invariant mass in the range 110 < m_jj < 760 GeV, the azimuthal angle difference between the two jets and the angular variable chi in two dijet mass regions. The results are compared with next-to-leading-order QCD predictions. Good agreement is observed between the measured cross-sections and the predictions obtained using POWHEG + Pythia. MC@NLO + Herwig shows good agreement with the measured bbbar-dijet cross-section. However, it does not reproduce the measured inclusive cross-section well, particularly for central b-jets with large transverse momenta.Comment: 10 pages plus author list (21 pages total), 8 figures, 1 table, final version published in European Physical Journal

Jet energy measurement with the ATLAS detector in proton-proton collisions at root s=7 TeV

The jet energy scale and its systematic uncertainty are determined for jets measured with the ATLAS detector at the LHC in proton-proton collision data at a centre-of-mass energy of √s = 7TeV corresponding to an integrated luminosity of 38 pb-1. Jets are reconstructed with the anti-kt algorithm with distance parameters R=0. 4 or R=0. 6. Jet energy and angle corrections are determined from Monte Carlo simulations to calibrate jets with transverse momenta pT≥20 GeV and pseudorapidities {pipe}η{pipe}<4. 5. The jet energy systematic uncertainty is estimated using the single isolated hadron response measured in situ and in test-beams, exploiting the transverse momentum balance between central and forward jets in events with dijet topologies and studying systematic variations in Monte Carlo simulations. The jet energy uncertainty is less than 2. 5 % in the central calorimeter region ({pipe}η{pipe}<0. 8) for jets with 60≤pT<800 GeV, and is maximally 14 % for pT<30 GeV in the most forward region 3. 2≤{pipe}η{pipe}<4. 5. The jet energy is validated for jet transverse momenta up to 1 TeV to the level of a few percent using several in situ techniques by comparing a well-known reference such as the recoiling photon pT, the sum of the transverse momenta of tracks associated to the jet, or a system of low-pT jets recoiling against a high-pT jet. More sophisticated jet calibration schemes are presented based on calorimeter cell energy density weighting or hadronic properties of jets, aiming for an improved jet energy resolution and a reduced flavour dependence of the jet response. The systematic uncertainty of the jet energy determined from a combination of in situ techniques is consistent with the one derived from single hadron response measurements over a wide kinematic range. The nominal corrections and uncertainties are derived for isolated jets in an inclusive sample of high-pT jets. Special cases such as event topologies with close-by jets, or selections of samples with an enhanced content of jets originating from light quarks, heavy quarks or gluons are also discussed and the corresponding uncertainties are determined. © 2013 CERN for the benefit of the ATLAS collaboration

Observation of associated near-side and away-side long-range correlations in √sNN=5.02 TeV proton-lead collisions with the ATLAS detector

Two-particle correlations in relative azimuthal angle (Δϕ) and pseudorapidity (Δη) are measured in √sNN=5.02  TeV p+Pb collisions using the ATLAS detector at the LHC. The measurements are performed using approximately 1  μb-1 of data as a function of transverse momentum (pT) and the transverse energy (ΣETPb) summed over 3.1<η<4.9 in the direction of the Pb beam. The correlation function, constructed from charged particles, exhibits a long-range (2<|Δη|<5) “near-side” (Δϕ∼0) correlation that grows rapidly with increasing ΣETPb. A long-range “away-side” (Δϕ∼π) correlation, obtained by subtracting the expected contributions from recoiling dijets and other sources estimated using events with small ΣETPb, is found to match the near-side correlation in magnitude, shape (in Δη and Δϕ) and ΣETPb dependence. The resultant Δϕ correlation is approximately symmetric about π/2, and is consistent with a dominant cos⁡2Δϕ modulation for all ΣETPb ranges and particle pT

Performance of CMS muon reconstruction in pp collision events at sqrt(s) = 7 TeV

The performance of muon reconstruction, identification, and triggering in CMS has been studied using 40 inverse picobarns of data collected in pp collisions at sqrt(s) = 7 TeV at the LHC in 2010. A few benchmark sets of selection criteria covering a wide range of physics analysis needs have been examined. For all considered selections, the efficiency to reconstruct and identify a muon with a transverse momentum pT larger than a few GeV is above 95% over the whole region of pseudorapidity covered by the CMS muon system, abs(eta) < 2.4, while the probability to misidentify a hadron as a muon is well below 1%. The efficiency to trigger on single muons with pT above a few GeV is higher than 90% over the full eta range, and typically substantially better. The overall momentum scale is measured to a precision of 0.2% with muons from Z decays. The transverse momentum resolution varies from 1% to 6% depending on pseudorapidity for muons with pT below 100 GeV and, using cosmic rays, it is shown to be better than 10% in the central region up to pT = 1 TeV. Observed distributions of all quantities are well reproduced by the Monte Carlo simulation.Comment: Replaced with published version. Added journal reference and DO

Search for the neutral Higgs bosons of the minimal supersymmetric standard model in pp collisions at root s=7 TeV with the ATLAS detector

A search for neutral Higgs bosons of the Minimal Supersymmetric Standard Model (MSSM) is reported. The analysis is based on a sample of proton-proton collisions at a centre-of-mass energy of 7TeV recorded with the ATLAS detector at the Large Hadron Collider. The data were recorded in 2011 and correspond to an integrated luminosity of 4.7 fb-1 to 4.8 fb-1. Higgs boson decays into oppositely-charged muon or τ lepton pairs are considered for final states requiring either the presence or absence of b-jets. No statistically significant excess over the expected background is observed and exclusion limits at the 95% confidence level are derived. The exclusion limits are for the production cross-section of a generic neutral Higgs boson, φ, as a function of the Higgs boson mass and for h/A/H production in the MSSM as a function of the parameters mA and tan β in the mhmax scenario for mA in the range of 90GeV to 500 GeV. Copyright CERN