Unifying and Merging Well-trained Deep Neural Networks for Inference Stage

We propose a novel method to merge convolutional neural-nets for the inference stage. Given two well-trained networks that may have different architectures that handle different tasks, our method aligns the layers of the original networks and merges them into a unified model by sharing the representative codes of weights. The shared weights are further re-trained to fine-tune the performance of the merged model. The proposed method effectively produces a compact model that may run original tasks simultaneously on resource-limited devices. As it preserves the general architectures and leverages the co-used weights of well-trained networks, a substantial training overhead can be reduced to shorten the system development time. Experimental results demonstrate a satisfactory performance and validate the effectiveness of the method.Comment: To appear in the 27th International Joint Conference on Artificial Intelligence and the 23rd European Conference on Artificial Intelligence, 2018. (IJCAI-ECAI 2018

Clonal dissemination of the multi-drug resistant Salmonella enterica serovar Braenderup, but not the serovar Bareilly, of prevalent serogroup C1 Salmonella from Taiwan

<p>Abstract</p> <p>Background</p> <p>Nontyphoidal <it>Salmonella </it>is the main cause of human salmonellosis. In order to study the prevalent serogroups and serovars of clinical isolates in Taiwan, 8931 <it>Salmonellae </it>isolates were collected from 19 medical centers and district hospitals throughout the country from 2004 to 2007. The pulsed-field eletrophoresis types (PFGE) and antibiotic resistance profiles of <it>Salmonella enterica </it>serovars Bareilly (<it>S</it>. Bareilly) and Braenderup (<it>S</it>. Braenderup) were compared, and multi-drug resistance (MDR) plasmids were characterized.</p> <p>Results</p> <p>Over 95% of human salmonellosis in Taiwan was caused by five <it>Salmonella </it>serogroups: B, C1, C2-C3, D1, and E1. <it>S</it>. Typhymurium, <it>S</it>. Enteritidis, <it>S</it>. Stanley and <it>S</it>. Newport were the four most prevalent serovars, accounting for about 64% of isolates. While only one or two major serovars from four of the most prevalent serogroups were represented, four predominant serovars were found in serogroup C1 <it>Salmonellae</it>. The prevalence was decreasing for <it>S</it>. Choleraeuis and <it>S</it>. Braenderup, and S. Virchow and increasing for <it>S</it>. Bareilly. <it>S</it>. Braenderup mainly caused gastroenteritis in children; in contrast, <it>S</it>. Bareiley infected children and elderly people. Both serovars differed by <it>Xba</it>I-PFGE patterns. Almost all <it>S</it>. Bareilly isolates were susceptible to antibiotics of interest, while all lacked plasmids and belonged to one clone. Two distinct major clones in <it>S</it>. Braenderup were cluster A, mainly including MDR isolates with large MDR plasmid from North Taiwan, and cluster B, mainly containing susceptible isolates without R plasmid from South Taiwan. In cluster A, there were two types of conjugative R plasmids with sizes ranging from 75 to 130 kb. Type 1 plasmids consisted of replicons F1A/F1B, <it>bla</it>_TEM, IS<it>26</it>, and a class 1 integron with the genes <it>dfrA12</it>-<it>orfF</it>-<it>aadA2-qacE</it>Δ1-<it>sulI</it>. Type 2 plasmids belonged to incompatibility group Inc<it>I</it>, contained <it>tnpA</it>-<it>bla</it>_CMY-2-<it>blc</it>-<it>sugE </it>genetic structures and lacked both IS<it>26 </it>and class 1 integrons. Although type 2 plasmids showed higher conjugation capability, type 1 plasmids were the predominant plasmid.</p> <p>Conclusions</p> <p>Serogroups B, C1, C2-C3, D1, and E1 of <it>Salmonella </it>caused over 95% of human salmonellosis. Two prevalent serovars within serogroup C1, <it>S</it>. Bareilly and cluster B of S. Braenderup, were clonal and drug-susceptible. However, cluster A of <it>S</it>. Braenderup was MDR and probably derived from susceptible isolates by acquiring one of two distinct conjugative R plasmids.</p

High-Frequency Sea Level Variations Observed by GPS Buoys Using Precise Point Positioning Technique

In this study, sea level variation observed by a 1-Hz Global Positioning System (GPS) buoy system is verified by comparing with tide gauge records and is decomposed to reveal high-frequency signals that cannot be detected from 6-minute tide gauge records. Compared to tide gauges traditionally used to monitor sea level changes and affected by land motion, GPS buoys provide high-frequency geocentric measurements of sea level variations. Data from five GPS buoy campaigns near a tide gauge at Anping, Tainan, Taiwan, were processed using the Precise Point Positioning (PPP) technique with four different satellite orbit products from the International GNSS Service (IGS). The GPS buoy data were also processed by a differential GPS (DGPS) method that needs an additional GPS receiver as a reference station and the accuracy of the solution depends on the baseline length. The computation shows the average Root Mean Square Error (RMSE) difference of the GPS buoy using DGPS and tide gauge records is around 3 - 5 cm. When using the aforementioned IGS orbit products for the buoy derived by PPP, its average RMSE differences are 5 - 8 cm, 8 - 13 cm, decimeter level, and decimeter-meter level, respectively, so the accuracy of the solution derived by PPP highly depends on the accuracy of IGS orbit products. Therefore, the result indicates that the accuracy of a GPS buoy using PPP has the potential to measure the sea surface variations to several cm. Finally, high-frequency sea level signals with periods of a few seconds to a day can be successfully detected in GPS buoy observations using the Ensemble Empirical Mode Decomposition (EMD) method and are identified as waves, meteotsunamis, and tides

The combined role of MRI prostate and prostate health index in improving detection of significant prostate cancer in a screening population of Chinese men

Using prostate-specific antigen (PSA) for prostate cancer (PCa) screening led to overinvestigation and overdiagnosis of indolent PCa. We aimed to investigate the value of prostate health index (PHI) and magnetic resonance imaging (MRI) prostate in an Asian PCa screening program. Men aged 50-75 years were prospectively recruited from a community-based PSA screening program. Men with PSA 4.0-10.0 ng ml -1 had PHI result analyzed. MRI prostate was offered to men with PSA 4.0-50.0 ng ml -1. A systematic prostate biopsy was offered to men with PSA 4.0-9.9 ng ml -1 and PHI ≥35, or PSA 10.0-50.0 ng ml -1. Additional targeted prostate biopsy was offered if they had PI-RADS score ≥3. Clinically significant PCa (csPCa) was defined as the International Society of Urological Pathology (ISUP) grade group (GG) ≥2 or ISUP GG 1 with involvement of ≥30% of total systematic cores. In total, 12.8% (196/1536) men had PSA ≥4.0 ng ml -1. Among 194 men with PSA 4.0-50.0 ng ml -1, 187 (96.4%) received MRI prostate. Among them, 28.3% (53/187) had PI-RADS ≥3 lesions. Moreover, 7.0% (107/1536) men were indicated for biopsy and 94.4% (101/107) men received biopsy. Among the men received biopsy, PCa, ISUP GG ≥2 PCa, and csPCa was diagnosed in 42 (41.6%), 24 (23.8%), and 34 (33.7%) men, respectively. Compared with PSA/PHI pathway in men with PSA 4.0-50.0 ng ml -1, additional MRI increased diagnoses of PCa, ISUP GG ≥2 PCa, and csPCa by 21.2% (from 33 to 40), 22.2% (from 18 to 22), and 18.5% (from 27 to 32), respectively. The benefit of additional MRI was only observed in PSA 4.0-10.0 ng ml -1, and the number of MRI needed to diagnose one additional ISUP GG ≥2 PCa was 20 in PHI ≥35 and 94 in PHI &lt;35. Among them, 45.4% (89/196) men with PSA ≥4.0 ng ml -1 avoided unnecessary biopsy with the use of PHI and MRI. A screening algorithm with PSA, PHI, and MRI could effectively diagnose csPCa while reducing unnecessary biopsies. The benefit of MRI prostate was mainly observed in PSA 4.0-9.9 ng ml -1 and PHI ≥35 group. PHI was an important risk stratification step for PCa screening.</p

Quantitative Analysis and Diagnostic Significance of Methylated SLC19A3 DNA in the Plasma of Breast and Gastric Cancer Patients

Background: Previously, we have examined the methylation status of SLC19A3 (solute carrier family 19, member 3) promoter and found that SLC19A3 was epigenetically down-regulated in gastric cancer. Here, we aim to develop a new biomarker for cancer diagnosis using methylated SLC19A3 DNA in plasma. Methodology/Principal Findings: SLC19A3 gene expression was examined by RT-qPCR. Methylation status of SLC19A3 promoter was evaluated by methylation-specific qPCR. SLC19A3 expression was significantly down-regulated in 80% (12/15) of breast tumors (P<0.005). Breast tumors had significant increase in methylation percentage when compared to adjacent non-tumor tissues (P<0.005). A robust and simple methylation-sensitive restriction enzyme digestion and real-time quantitative PCR (MSRED-qPCR) was developed to quantify SLC19A3 DNA methylation in plasma. We validated this biomarker in an independent validation cohort of 165 case-control plasma including 60 breast cancer, 45 gastric cancer patients and 60 healthy subjects. Plasma SLC19A3 methylated DNA level was effective in differentiating both breast and gastric cancer from healthy subjects. We further validated this biomarker in another independent blinded cohort of 78 plasma including 38 breast cancer, 20 gastric cancer patients and 20 healthy subjects. The positive predictive values for breast and gastric cancer were 90% and 85%, respectively. The negative predictive value of this biomarker was 85%. Elevated level in plasma has been detected not only in advanced stages but also early stages of tumors. The positive predictive value for ductal carcinoma in situ (DCIS) cases was 100%. Conclusions: These results suggested that aberrant SLC19A3 promoter hypermethylation in plasma may be a novel biomarker for breast and gastric cancer diagnosis. © 2011 Ng et al.published_or_final_versio

Theta dependence of SU(N) gauge theories in the presence of a topological term

We review results concerning the theta dependence of 4D SU(N) gauge theories and QCD, where theta is the coefficient of the CP-violating topological term in the Lagrangian. In particular, we discuss theta dependence in the large-N limit. Most results have been obtained within the lattice formulation of the theory via numerical simulations, which allow to investigate the theta dependence of the ground-state energy and the spectrum around theta=0 by determining the moments of the topological charge distribution, and their correlations with other observables. We discuss the various methods which have been employed to determine the topological susceptibility, and higher-order terms of the theta expansion. We review results at zero and finite temperature. We show that the results support the scenario obtained by general large-N scaling arguments, and in particular the Witten-Veneziano mechanism to explain the U(1)_A problem. We also compare with results obtained by other approaches, especially in the large-N limit, where the issue has been also addressed using, for example, the AdS/CFT correspondence. We discuss issues related to theta dependence in full QCD: the neutron electric dipole moment, the dependence of the topological susceptibility on the quark masses, the U(1)_A symmetry breaking at finite temperature. We also consider the 2D CP(N) model, which is an interesting theoretical laboratory to study issues related to topology. We review analytical results in the large-N limit, and numerical results within its lattice formulation. Finally, we discuss the main features of the two-point correlation function of the topological charge density.Comment: A typo in Eq. (3.9) has been corrected. An additional subsection (5.2) has been inserted to demonstrate the nonrenormalizability of the relevant theta parameter in the presence of massive fermions, which implies that the continuum (a -> 0) limit must be taken keeping theta fixe

DeepDyve: Dynamic Verification for Deep Neural Networks

Deep neural networks (DNNs) have become one of the enabling technologies in many safety-critical applications, e.g., autonomous driving and medical image analysis. DNN systems, however, suffer from various kinds of threats, such as adversarial example attacks and fault injection attacks. While there are many defense methods proposed against maliciously crafted inputs, solutions against faults presented in the DNN system itself (e.g., parameters and calculations) are far less explored. In this paper, we develop a novel lightweight fault-tolerant solution for DNN-based systems, namely DeepDyve, which employs pre-trained neural networks that are far simpler and smaller than the original DNN for dynamic verification. The key to enabling such lightweight checking is that the smaller neural network only needs to produce approximate results for the initial task without sacrificing fault coverage much. We develop efficient and effective architecture and task exploration techniques to achieve optimized risk/overhead trade-off in DeepDyve. Experimental results show that DeepDyve can reduce 90% of the risks at around 10% overhead

High Photoelectric Conversion Efficiency of Metal Phthalocyanine/Fullerene Heterojunction Photovoltaic Device

This paper introduces the fundamental physical characteristics of organic photovoltaic (OPV) devices. Photoelectric conversion efficiency is crucial to the evaluation of quality in OPV devices, and enhancing efficiency has been spurring on researchers to seek alternatives to this problem. In this paper, we focus on organic photovoltaic (OPV) devices and review several approaches to enhance the energy conversion efficiency of small molecular heterojunction OPV devices based on an optimal metal-phthalocyanine/fullerene (C60) planar heterojunction thin film structure. For the sake of discussion, these mechanisms have been divided into electrical and optical sections: (1) Electrical: Modification on electrodes or active regions to benefit carrier injection, charge transport and exciton dissociation; (2) Optical: Optional architectures or infilling to promote photon confinement and enhance absorption

Rapid Eocene erosion, sedimentation and burial in the eastern Himalayan syntaxis and its geodynamic significance

The lower Bomi Group of the eastern Himalayan syntaxis comprises a lithological package of sedimentary and igneous rocks that have been metamorphosed to upper amphibolite-facies conditions. The lower Bomi Group is bounded to the south by the Indus–Yarlung Suture and to the north by unmetamorphosed Paleozoic sediments of the Lhasa terrane. We report U–Pb zircon dating, geochemistry and petrography of gneiss, migmatite, mica schist and marble from the lower Bomi Group and explore their geological implications for the tectonic evolution of the eastern Himalaya. Zircons from the lower Bomi Group are composite. The inherited magmatic zircon cores display 206Pb/238U ages from ~ 74 Ma to ~ 41.5 Ma, indicating a probable source from the Gangdese magmatic arc. The metamorphic overgrowth zircons yielded 206Pb/238U ages ranging from ~ 38 Ma to ~ 23 Ma, that overlap the anatexis time (~ 37 Ma) recorded in the leucosome of the migmatites. Our data indicate that the lower Bomi Group do not represent Precambrian basement of the Lhasa terrane. Instead, the lower Bomi Group may represent sedimentary and igneous rocks of the residual forearc basin, similar to the Tsojiangding Group in the Xigaze area, derived from denudation of the hanging wall rocks during the India–Asia continental collision. We propose that following the Indian–Asian collision, the forearc basin was subducted, together with Himalayan lithologies from the Indian continental slab. The minimum age of detrital magmatic zircons from the supracrustal rocks is ~ 41.5 Ma and their metamorphism had happened at ~ 37 Ma. The short time interval (< 5 Ma) suggests that the tectonic processes associated with the eastern Himalayan syntaxis, encompassing uplift and erosion of the Gangdese terrane, followed by deposition, imbrication and subduction of the forearc basin, were extremely rapid during the Late Eocene

Salmonella paratyphi C: Genetic Divergence from Salmonella choleraesuis and Pathogenic Convergence with Salmonella typhi

BACKGROUND: Although over 1400 Salmonella serovars cause usually self-limited gastroenteritis in humans, a few, e.g., Salmonella typhi and S. paratyphi C, cause typhoid, a potentially fatal systemic infection. It is not known whether the typhoid agents have evolved from a common ancestor (by divergent processes) or acquired similar pathogenic traits independently (by convergent processes). Comparison of different typhoid agents with non-typhoidal Salmonella lineages will provide excellent models for studies on how similar pathogens might have evolved. METHODOLOGIES/PRINCIPAL FINDINGS: We sequenced a strain of S. paratyphi C, RKS4594, and compared it with previously sequenced Salmonella strains. RKS4594 contains a chromosome of 4,833,080 bp and a plasmid of 55,414 bp. We predicted 4,640 intact coding sequences (4,578 in the chromosome and 62 in the plasmid) and 152 pseudogenes (149 in the chromosome and 3 in the plasmid). RKS4594 shares as many as 4346 of the 4,640 genes with a strain of S. choleraesuis, which is primarily a swine pathogen, but only 4008 genes with another human-adapted typhoid agent, S. typhi. Comparison of 3691 genes shared by all six sequenced Salmonella strains placed S. paratyphi C and S. choleraesuis together at one end, and S. typhi at the opposite end, of the phylogenetic tree, demonstrating separate ancestries of the human-adapted typhoid agents. S. paratyphi C seemed to have suffered enormous selection pressures during its adaptation to man as suggested by the differential nucleotide substitutions and different sets of pseudogenes, between S. paratyphi C and S. choleraesuis. CONCLUSIONS: S. paratyphi C does not share a common ancestor with other human-adapted typhoid agents, supporting the convergent evolution model of the typhoid agents. S. paratyphi C has diverged from a common ancestor with S. choleraesuis by accumulating genomic novelty during adaptation to man