How deep is deep enough? -- Quantifying class separability in the hidden layers of deep neural networks

Deep neural networks typically outperform more traditional machine learning models in their ability to classify complex data, and yet is not clear how the individual hidden layers of a deep network contribute to the overall classification performance. We thus introduce a Generalized Discrimination Value (GDV) that measures, in a non-invasive manner, how well different data classes separate in each given network layer. The GDV can be used for the automatic tuning of hyper-parameters, such as the width profile and the total depth of a network. Moreover, the layer-dependent GDV(L) provides new insights into the data transformations that self-organize during training: In the case of multi-layer perceptrons trained with error backpropagation, we find that classification of highly complex data sets requires a temporal {\em reduction} of class separability, marked by a characteristic 'energy barrier' in the initial part of the GDV(L) curve. Even more surprisingly, for a given data set, the GDV(L) is running through a fixed 'master curve', independently from the total number of network layers. Furthermore, applying the GDV to Deep Belief Networks reveals that also unsupervised training with the Contrastive Divergence method can systematically increase class separability over tens of layers, even though the system does not 'know' the desired class labels. These results indicate that the GDV may become a useful tool to open the black box of deep learning

The incidence of public transit subsidy: a case study.

Massachusetts Institute of Technology. Dept. of Urban Studies and Planning. Thesis. 1970. M.C.P.Bibliography: leaves 119-124.M.C.P

Über logische und mengentheoretische Aspekte von Mochizukis Beweis der abc-Vermutung

Diese Arbeit beschäftigt sich mit der Speziestheorie aus Mochizukis Beweis(versuch) der abc-Vermutung. Es wird ein Standpunkt eingeführt, der Parallelen zwischen der Kategorientheorie und der Speziestheorie aufzeigt und es werden so die Besonderheiten der Speziestheorie herausgearbeitet. In der Speziestheorie möchte man Konstruktionen ausführen, welche von keinen Auswahlen abhängen. Dieses Problem wird in einem allgemeinen Kontext für universelle Morphismen gelöst. An Beispielen wird die in der Arbeit behandelte Theorie erklärt

Exploring the agency consequences of ownership dispersion among the directors of private family firms

International audienceUsing an agency-theoretic lens and insights drawn from the behavioral economics and family business literatures, this study developed hypotheses concerning the effect of dispersion of ownership on the use of debt by private family-owned and family-managed firms. A field study of 1,464 family firms was conducted. Results suggest that, during periods of market growth, the relationship between the use of debt and the dispersion of ownership among directors at family firms can be graphed as a U-shaped curve. The nonlinear relationship suggests that family firms are most vulnerable to conflict, and least willing to bear added risk, when ownership is split in relatively equal proportions. Interestingly, the fact that this distribution appeared in only 22% of the sample firms suggests that most family firm owners may take such risk into consideration when making their estate plans<br/

Synthesis of N-arylpyridinium salts bearing a nitrone spin trap as potential mitochondria-targeted antioxidants

The generation of excess reactive oxygen species (ROS) in mitochondria is responsible for much of the oxidative stress associated with ageing (aging), and mitochondrial dysfunction is part of the pathology of neurodegeneration and type 2 diabetes. Lipophilic pyridinium ions are known to accumulate in mitochondria and this paper describes a general route for the preparation of nitrone-containing N-arylpyridinium salts having a range of lipophilicities, as potential therapeutic antioxidants. The compatibility of nitrones with the Zincke reaction is the key to their synthesis. Their trapping of carbon-centred radicals and the EPR spectra of the resulting nitroxides are reported

NLO and off-shell effects in top quark mass determinations

We study the impact of different theoretical descriptions of top quark pair production on top quark mass measurements in the di-lepton channel. To this aim, the full NLO corrections to pp→W+W−bb¯¯→(e+νe)(μ−ν¯¯¯μ)bb¯¯ production are compared to calculations in the narrow width approximation, where the production of a top quark pair is calculated at NLO and combined with three different descriptions of the top quark decay: leading order, next-to-leading order and via a parton shower. The different theory predictions then enter the calibration of template fit functions, which are used for a fit to pseudo-data. The offsets in the top quark mass resulting from the fits based on the various theoretical descriptions are determined

Application of Profile Prediction for Proactive Scheduling

Today, cloud environments are widely used as execution platforms for most applications. In these environments, virtualized applications often share computing resources. Although this increases hardware utilization, resources competition can cause performance degradation, and knowing which applications can run on the same host without causing too much interference is key to a better scheduling and performance. Therefore, it is important to predict the resource consumption profile of applications in their subsequent iterations. This work evaluates the use of machine learning techniques to predict the increase or decrease in computational resources consumption. The prediction models are evaluated through experiments using real and benchmark applications. Finally, we conclude that some models offer significantly better performance when compared to the current trend of resource usage. These models averaged up to 94% on the F1 metric for this task

CIV emission line properties and uncertainties in black hole mass estimates of z ~ 3.5 quasars

Using a high luminosity ($L_{\rm bol} \sim 10^{47.5} - 10^{48.3}$ erg s$^{-1}$), high redshift ($3.2 < z < 3.8$) quasar sample of 19 quasars with optical and near-infrared spectroscopy, we investigate the reliability of the CIV-based black hole mass estimates ($M_{\rm BH}$). The median logarithm of the CIV- and H$\beta$-based $M_{\rm BH}$ ratios is 0.110 dex with the scatter of 0.647 dex. The CIV-to-H$\beta$ BH mass differences are significantly correlated with the CIV FWHMs, blueshifts and asymmetries. Corrections of the CIV FWHM using the blueshift and asymmetry reduce the scatter of the mass differences by $\sim$ 0.04-0.2 dex. Quasars in our sample accrete at the Eddington ratio $R_{\rm EDD}>0.3$ and cover a considerable range of blueshifts, with 18/19 of the quasars showing CIV blueshifts (with the median value of 1126 km s$^{-1}$) and 14/19 of the quasars showing CIV blueshifts larger than 500 km s$^{-1}$. It suggests that not all quasars with high Eddington ratios show large blueshifts. The Baldwin effect between the CIV rest-frame equivalent width (REW) and the continuum luminosity at 1350 \overset{\lower.5em\circ}{\mathrm{A}} is not seen, likely due to the limited luminosity range of our sample. We find a lack of flux in the red wing of the composite spectrum with larger CIV blueshift, and detect a higher ratio of [OIII] quasars with REW$_{\rm [OIII]}>5$ \overset{\lower.5em\circ}{\mathrm{A}} in the subsample with lower CIV blueshift. It is more likely that they are caused by the combination of the Eddington ratio and the orientation effect.Comment: 17 pages, 12 figures with additional 6 pages and 2 figures in the appendix. Accepted for publication in Ap