Modular Networks: Learning to Decompose Neural Computation

Scaling model capacity has been vital in the success of deep learning. For a typical network, necessary compute resources and training time grow dramatically with model size. Conditional computation is a promising way to increase the number of parameters with a relatively small increase in resources. We propose a training algorithm that flexibly chooses neural modules based on the data to be processed. Both the decomposition and modules are learned end-to-end. In contrast to existing approaches, training does not rely on regularization to enforce diversity in module use. We apply modular networks both to image recognition and language modeling tasks, where we achieve superior performance compared to several baselines. Introspection reveals that modules specialize in interpretable contexts.Comment: NIPS 201

Optimisation algorithms for the charge dispatch of plug-in vehicles based on variable tariffs

Plug-in vehicles powered by renewable energies are a viable way to reduce local and total emissions and could also support a highly efficient grid operation. Indirect control by variable tariffs is one option to link charging or even discharging time with the grid load and the renewable energy production. Algorithms are required to develop tariffs and evaluate grid impacts of variable tariffs for electric vehicles (BEV) as well as to schedule the charging process optimisation. Therefore a combinatorial optimisation algorithm is developed and an algorithm based on graph search is used and customised. Both algorithms are explained and compared by performance and adequate applications. The developing approach and the correctness of the quick combinatorial algorithm are proved within this paper. For vehicle to grid (V2G) concepts, battery degradation costs have to be considered. Therefore, common life cycle assumptions based on the battery state of charge (SoC) have been used to include degradation costs for different Li-Ion batteries into the graph search algorithm. An application of these optimisation algorithms, like the onboard dispatcher, which is used in the German fleet test "Flottenversuch Elektromobiliät". Grid impact calculations based on the optimisation algorithm are shown. --BEV,V2G,Plug-In-Vehicles (PHEV),optimisation,mobile dispatcher,demand side management,charging,combinatorial algorithm,graph search algorithm,indirect control by variable tariffs

A Comprehensive Analysis of Swarming-based Live Streaming to Leverage Client Heterogeneity

Due to missing IP multicast support on an Internet scale, over-the-top media streams are delivered with the help of overlays as used by content delivery networks and their peer-to-peer (P2P) extensions. In this context, mesh/pull-based swarming plays an important role either as pure streaming approach or in combination with tree/push mechanisms. However, the impact of realistic client populations with heterogeneous resources is not yet fully understood. In this technical report, we contribute to closing this gap by mathematically analysing the most basic scheduling mechanisms latest deadline first (LDF) and earliest deadline first (EDF) in a continuous time Markov chain framework and combining them into a simple, yet powerful, mixed strategy to leverage inherent differences in client resources. The main contributions are twofold: (1) a mathematical framework for swarming on random graphs is proposed with a focus on LDF and EDF strategies in heterogeneous scenarios; (2) a mixed strategy, named SchedMix, is proposed that leverages peer heterogeneity. The proposed strategy, SchedMix is shown to outperform the other two strategies using different abstractions: a mean-field theoretic analysis of buffer probabilities, simulations of a stochastic model on random graphs, and a full-stack implementation of a P2P streaming system.Comment: Technical report and supplementary material to http://ieeexplore.ieee.org/document/7497234

Mindfulness: A foothold for Rogers's humanistic person-centred approach

This article probed and contextualised the strong parallels between meditation derived mindfulness and Rogers's humanistic person-centred (PC) approach. This was done through a conceptual and evaluative literature review of the PC framework in relation to definitive descriptions of mindfulness. Elements of mindfulness within the core conditions of PC therapy were explored and verified. Quotations, pragmatic, behavioural descriptions and explications provided evidence of a shared ideology inherent in both concepts via “way of being”. The findings suggested that mindfulness cultivates, harmonises and deepens essential therapist qualities in PC therapy. This review article could supply a rationale for significant inferences in the implementation of meditation-inspired activities in the practical preparation of trainee therapists as well as optimising proficiency and refinement in professional practice

A Grounded Theory of the College Experiences of African American Males in Black Greek-Letter Organizations

Studies have shown that involvement in a student organization can improve the academic and psychosocial outcomes of African American male students (Harper, 2006b; Robertson & Mason, 2008; Williams & Justice, 2010). Further, Harper, Byars, and Jelke (2005) stated that African American fraternities and sororities (i.e., Black Greek-letter organizations [BGLOs]) are the primary venues by which African American students become involved on campus. This grounded theory study examined the relationship between membership in a BOLO and the overall college experiences of African American male college students at a Predominantly White Institution (PWI). Eleven themes were identified in the study indicating that membership had a positive impact on the college experiences of African American male college students at a PWI. The study also examined the perceptions of counselors and other college student personnel regarding their role in improving the academic and psychosocial outcomes of African American male college students. Participants indicated that their role is to provide academic and psychosocial support for these students; they offered strategies for PWIs to improve the persistence and success of these students. Implications for counseling, higher education, and Black Greek life are provided