Deep roots: Improving CNN efficiency with hierarchical filter groups

We propose a new method for creating computationally efficient and compact convolutional neural networks (CNNs) using a novel sparse connection structure that resembles a tree root. This allows a significant reduction in computational cost and number of parameters compared to state-of-the-art deep CNNs, without compromising accuracy, by exploiting the sparsity of inter-layer filter dependencies. We validate our approach by using it to train more efficient variants of state-of-the-art CNN architectures, evaluated on the CIFAR10 and ILSVRC datasets. Our results show similar or higher accuracy than the baseline architectures with much less computation, as measured by CPU and GPU timings. For example, for ResNet 50, our model has 40% fewer parameters, 45% fewer floating point operations, and is 31% (12%) faster on a CPU (GPU). For the deeper ResNet 200 our model has 25% fewer floating point operations and 44% fewer parameters, while maintaining state-of-the-art accuracy. For GoogLeNet, our model has 7% fewer parameters and is 21% (16%) faster on a CPU (GPU).Microsoft Research PhD Scholarshi

Metastatic seeding of colon adenocarcinoma manifesting as synchronous breast and chest wall localization: report of a case.

Colon carcinoma rarely metastasizes to the breast and it is usually associated with a poor prognosis. Even rarer is metastatic seeding of colon cancer cells in an intramammary location after surgery. Including a primary breast malignancy in the differential diagnosis of such cases is mandatory. We report a rare case of double seeding implantation of colon adenocarcinoma inside the breast parenchyma and intercostal muscles 6 years after resection of a pulmonary metastasis from colon adenocarcinoma. The metastasis was revealed by the presence of bone metaplasia in the intercostal muscles. We discuss how negative immunostaining for estrogen receptors, progesterone receptors, and HER-2, along with the immunohistochemical pattern of cytokeratin (CK) 20+/7-/5- and CDX2-positive immunostaining, excludes a primary breast malignancy, namely, a "matrix-producing" carcinoma, from the differential diagnosis. We also present the hypothesis of a paracrine pathogenetic mechanism to explain the bone metaplasia

Rainfall depth-duration-frequency curves for short-duration precipitation events in Sicily (Italy)

The design criteria of the hydraulic infrastructures, including, for instance, those for flood defense, urban drainage systems, reservoirs spillways and bridges, are based on the coupled analysis of the magnitude of rainfall events for a fixed duration and their estimated annual exceedance probability. The well-known rainfall depth-duration-frequency (DDF) curves, typically derived from the analysis of long historical annual maxima data series, synthesize the relationships between rainfall depth, duration and exceedance probability which is usually expressed as a return period. The time-resolution of rainfall data typically available for the construction of DDF curves and provided by gauges having large sample size, is hourly or coarser; this has allowed the definition of statistically consistent and reliable curves, suitable for rainfall duration hourly or longer, while, for shorter duration, empirical relationships with a high degree of approximation are generally used. Small river basins and plot-size areas with short response time, as well as urban drainage systems, are expected to be particularly vulnerable to sub-hourly intense rainfall events. Many practical applications, design procedures and mathematical models indeed require a finer time-resolution (i.e. sub - hourly). Moreover, in many regions of the world, such as the Sicily (Italy), an intensification of short-duration rainfall events is observed probably in response to the ongoing climate changes. This work proposes an approach for estimating the distribution of sub-hourly extreme rainfalls and extending depth–duration–frequency (DDF) curves derived for duration over the hourly also to sub-hourly durations. The approach is applied in Sicily starting from the coupled analysis of two different databases. The former (OA-ARRA database) contains long series of annual maxima for the fixed duration of 1, 3, 6, 12 and 24 hours for about 250 gauges, while the latter (SIAS database), include 10-minutes rainfall data series for about 100 gauges collected during the last 15 years (from 2003 to now), form which annual maxima time-series for fixed sub-hourly duration are derived. The approach includes a procedure for pairing raingauges, provided from the two databases, according to a distance- and elevation-based criterion and consolidated inference statistical techniques for the coupled analysis of the data-series from the two gauges

TTF-1/p63-positive poorly differentiated NSCLC: A histogenetic hypothesis from the basal reserve cell of the terminal respiratory unit

TTF-1 is expressed in the alveolar epithelium and in the basal cells of distal terminal bronchioles. It is considered the most sensitive and specific marker to define the adenocarcinoma arising from the terminal respiratory unit (TRU). TTF-1, CK7, CK5/6, p63 and p40 are useful for typifying the majority of non-small-cell lung cancers, with TTF and CK7 being typically expressed in adenocarcinomas and the latter three being expressed in squamous cell carcinoma. As tumors with coexpression of both TTF-1 and p63 in the same cells are rare, we describe different cases that coexpress them, suggesting a histogenetic hypothesis of their origin. We report 10 cases of poorly differentiated non-small-cell lung carcinoma (PD-NSCLC). Immunohistochemistry was performed by using TTF-1, p63, p40 (∆Np63), CK5/6 and CK7. EGFR and BRAF gene mutational analysis was performed by using real-time PCR. All the cases showed coexpression of p63 and TTF-1. Six of them showing CK7+ and CK5/6− immunostaining were diagnosed as “TTF-1+ p63+ adenocarcinoma”. The other cases of PD-NSCLC, despite the positivity for CK5/6, were diagnosed as “adenocarcinoma, solid variant”, in keeping with the presence of TTF-1 expression and p40 negativity. A “wild type” genotype of EGFR was evidenced in all cases. TTF1 stained positively the alveolar epithelium and the basal reserve cells of TRU, with the latter also being positive for p63. The coexpression of p63 and TTF-1 could suggest the origin from the basal reserve cells of TRU and represent the capability to differentiate towards different histogenetic lines. More aggressive clinical and morphological features could characterize these “basal-type tumors” like those in the better known “basal-like” cancer of the breast

Refining Architectures of Deep Convolutional Neural Networks

© 2016 IEEE. Deep Convolutional Neural Networks (CNNs) have recently evinced immense success for various image recognition tasks [11, 27]. However, a question of paramount importance is somewhat unanswered in deep learning research - is the selected CNN optimal for the dataset in terms of accuracy and model size? In this paper, we intend to answer this question and introduce a novel strategy that alters the architecture of a given CNN for a specified dataset, to potentially enhance the original accuracy while possibly reducing the model size. We use two operations for architecture refinement, viz. stretching and symmetrical splitting. Stretching increases the number of hidden units (nodes) in a given CNN layer, while a symmetrical split of say K between two layers separates the input and output channels into K equal groups, and connects only the corresponding input-output channel groups. Our procedure starts with a pre-trained CNN for a given dataset, and optimally decides the stretch and split factors across the network to refine the architecture. We empirically demonstrate the necessity of the two operations. We evaluate our approach on two natural scenes attributes datasets, SUN Attributes [16] and CAMIT-NSAD [20], with architectures of GoogleNet and VGG-11, that are quite contrasting in their construction. We justify our choice of datasets, and show that they are interestingly distinct from each other, and together pose a challenge to our architectural refinement algorithm. Our results substantiate the usefulness of the proposed method

Adopting the IS 2009 Model Curriculum: Apanel Session to Address the Challenges for Program Implementation

This panel session is designed to initiate an open forum and frank discussion of the IS 2009 Model Curriculum proposed by the Joint IS 2009 Curriculum Task Force and developed as a cooperative effort by the Association for Computing Machinery (ACM) and the Association for Information Systems (AIS). Following an introduction to the new model curriculum, a summary and overview of the changes from IS 97/2002 to the IS 2009 recommended core and elective courses will be presented and a panel representing academia and business will address possible issues, challenges, and implications of implementing the suggested curriculum changes on the major stakeholders that include students, faculty, administration, infrastructure resources, and the business community. Concluding the session will be an open forum to allow audience participation in the discussion for the purpose of exchanging ideas on the implementation of the new model curriculum

Inhaled Liposomal Ciprofloxacin Nanoparticles Control the Release of Antibiotic at the Bronchial Epithelia

The cycle of respiratory tract infection (RTI) and inflammation in patients with chronic obstructive lung diseases, such as cystic fibrosis (CF), periodically develops into exacerbations, where chronic colonization of the airway by bacteria causes severe decline in lung function, leading to increased hospitalization and high mortality rates (1, 2). Current antibiotic inhalation treatments approved for the management of chronic airway infections in cystic fibrosis are limited to tobramycin (TOBI®) and more recently, aztreonam (Cayston®). A major drawback to these localized treatments of RTIs is the rapid absorption and clearance of antibiotics from the lungs requiring multiple daily inhalations of high concentration antibiotic solutions. Hence, liposomal ciprofloxacin nanoparticles were developed to prolong lung residence time of the antibiotics, with the view to enhance antimicrobial activity and reduce the burden of therapy for the patients and their relatives who often have to assist them. Although in vivo studies with aerosolized delivery of liposomal ciprofloxacin have previously been performed on human and animal subjects, in vitro cell models may be better suited to study the transport, interactions of drugs and carrier systems, and drug localization within and on the airway cell epithelium at a molecular level. Therefore, the aim of this study was to investigate the newly developed system allowing nebulized liposomal ciprofloxacin to be delivered directly to the bronchial epithelial surface in an established air interface Calu-3 cell model

PRELIMINARY TAKE-OFF ANALYSIS AND SIMULATION FOR A PRANDTLPLANE COMMERCIAL AIRCRAFT

The paper describes the take-off performances and characteristics of an unconventional aircraft, called PrandtlPlane. The PrandtlPlane has a box-wing architecture, founded on the “Best Wing System” concept due to L. Prandtl, that minimizes the induced drag once wingspan and lift are given. This configuration has the potential to be a more efficient alternative to conventional tube-and-wing aircraft, and it is under investigation in the framework of the PARSIFAL project, funded by the European Union in the Horizon 2020 program. A numerical simulation tool for the take-off dynamics of the aircraft, based on the non-linear equations of motion, has been developed in order to evaluate the performance of the aircraft in take-off condition. The VLM solver has been integrated into this tool in order to evaluate the aerodynamic performance of the aircraft in ground effect at each moment of the manoeuvre. The same assessments have been made for a conventional tube-and-wing reference aircraft, with the aim of conducting a performance comparison with the reference PrandtlPlane. The preliminary results obtained show the aerodynamic and aeromechanical advantages of the reference PrandtlPlane, in terms of runway length and passenger comfort