673 research outputs found

    Cross Entropy in Deep Learning of Classifiers Is Unnecessary -- ISBE Error is All You Need

    Full text link
    In deep learning classifiers, the cost function usually takes the form of a combination of SoftMax and CrossEntropy functions. The SoftMax unit transforms the scores predicted by the model network into assessments of the degree (probabilities) of an object's membership to a given class. On the other hand, CrossEntropy measures the divergence of this prediction from the distribution of target scores. This work introduces the ISBE functionality, justifying the thesis about the redundancy of cross entropy computation in deep learning of classifiers. Not only can we omit the calculation of entropy, but also, during back-propagation, there is no need to direct the error to the normalization unit for its backward transformation. Instead, the error is sent directly to the model's network. Using examples of perceptron and convolutional networks as classifiers of images from the MNIST collection, it is observed for ISBE that results are not degraded with SoftMax only, but also with other activation functions such as Sigmoid, Tanh, or their hard variants HardSigmoid and HardTanh. Moreover, up to three percent of time is saved within the total time of forward and backward stages. The article is addressed mainly to programmers and students interested in deep model learning. For example, it illustrates in code snippets possible ways to implement ISBE units, but also formally proves that the softmax trick only applies to the class of softmax functions with relocations.Comment: 18 pages, 4 figure

    Greek Good Hermes and Vedic Goddess Saramā in Comparative Aspect

    Get PDF
    Following the suggestions of nineteenth-century linguists (Max Müller, 1838, Monier-Williams, 1898) the author, basing on the linguistic and mythological comparative analysis, shows that the Greek good Hermes can be related to the Vedic goddess Sarama. The article firstly gives on overview of the different conceptions regarding the etymology of the theonym “Hermes”. The most popular and probable of them is the one proposed by Martin P. Nilsson (1949), who connects it with the greek noun ἕρμα ‘prop, support, reef, rock under water’. Some difficulties, which this hypothesis has given rise to, show that the problem of etymology of the name Hermes is long standing and unsolved. Thereafter, the author proves that etymologies of Hermes and Sarama can connect to the same Indo-European root *ser-. Also the oldest Greek and Vedic literature, primarily Homer’s poems, Homeric Hymn to Hermes and Rigvedic Hymn X. 108, demonstrates numerous similarities between both deities

    A Review of Endemic Species in the Eastern Arc Afromontane Region: Importance, Inferences, and Conservation

    Get PDF
    The Eastern Arc mountain region has been identified as one of the top 25 biodiversity “hotspots” worldwide, and contains a large proportion of endemic species. The endemic species are invaluable resources. This review paper will explore and discuss the possible theories behind the high rate of endemism. The importance of these endemics to local peoples and to the greater global community has been studied thoroughly, and these results are presented in further detail in this paper. The Eastern Arc is also facing many problems that are threatening the biodiversity and rare endemic species of this region. Human expansion into natural habitat, as well as deforestation and forest fragmentation are among the most pressing issues. The causes and impacts of these issues will be explored and suggestions for the protection and conservation of endemic species and biodiversity will be discussed

    Hydraulic system analysis by the method of characteristics.

    Get PDF
    SIGLEAvailable from British Library Document Supply Centre- DSC:D38814/82 / BLDSC - British Library Document Supply CentreGBUnited Kingdo

    NOSTALGIA, EXPULSION AND THE POETIC I: THE POETICS OF DIASPORA IN THE CORPUS THEOGNIDEUM

    Get PDF
    In the anthology of archaic elegiac poetry called the Corpus Theognideum, the poetic I often eludes traditional approaches to the ‘poetic authority’. Instead of presenting itself as a citizen of a particular ‘city-state’ or at least a prominent member of an elitist circle who came to have a position of authority, the persona loquens situates himself as removed from the community: as impoverished, expelled from his polis, despised, embittered and thirsting for revenge. The purpose of my paper is to consider how the tension between the alienation of the poetic I and the unity of the audience might function during the act of (re)performance. Applying considerations of Edward W Said on ‘diasporic temporality’ to the political and economic conflict between the ideologies of polis and anti-polis in archaic and classical Greece, I show that the poetic I in the Theognidean tradition, by presenting itself as an exile and a victim of the democratic movement, expresses the temporally distant position of the so far privileged aristocracy, situated in dialectical opposition to the democratic institutions of polis

    Anarchy, Groups, and Conflict: An Experiment on the Emergence of Protective Associations

    Get PDF
    In this paper, we investigate the implications of the philosophical considerations presented in Nozick’s Anarchy, State, and Utopia, by examining group formation in a laboratory setting where subjects engage in both cooperative and conflictual interactions. We endow participants with a commodity used to generate earnings, plunder others, or protect against plunder. In our primary treatment, we allow participants to form groups to pool their resources. We conduct a baseline comparison treatment that does not allow group formation. We find that allowing subjects to organize themselves into groups does not lead to more cooperation and may in fact exacerbate tendencies for conflict.Nozickian protective associations, Conflict, Anarchy, Experimental economics

    When inmates make the rules (and enforce them): democracy in self-governing prisons

    Get PDF
    What happens when a state fails to run its prisons? David Skarbek and Courtney Michaluk examine the phenomenon of prison self-governance – when inmates are locked up but left to their own devices. In some jails in Latin America, prisoners establish their own governing bodies to keep order, sometimes even setting up extralegal courts of their own. Even in California, understaffing means that gangs determine much of everyday prison life
    corecore