948 research outputs found

    The Development And Cytology Of The Epibiotic Phase Of Physoderma Pulposum

    Full text link
    Peer Reviewedhttps://deepblue.lib.umich.edu/bitstream/2027.42/141147/1/ajb206996.pd

    Methods of Training Task Decompositions in Gated Modular Neural Networks

    Get PDF
    Mixture of experts (MoE), introduced over 20 years ago, is the simplest gated modular neural network architecture. The gate in the MoE architecture learns task decompositions and individual experts (modules) learn simpler functions appropriate to the gate’s task decomposition. This could inherently make MoE interpretable as errors can be attributed either to gating or to individual experts thereby providing either a gate or expert level diagnosis. Due to the specialization of experts they could modularly be transfered to other tasks. However, our initial experiments showed that the original MoE architecture and its end-to-end expert and gate training method does not guarantee intuitive task decompositions and expert utilization, indeed it can fail spectacularly even for simple data such as MNIST. This thesis therefore explores task decompositions among experts by the gate in existing MoE architectures and training methods and demonstrates how they can fail for even simple datasets without additional regularizations. We then propose five novel MoE training algorithms and MoE architectures: (1) Dual temperature gate and expert training that uses a softer gate distribution for training experts and a harder gate distribution to train the gate; (2) Two no- gate expert training algorithms where the experts are trained without a gate: (a) loudest expert method which selects the expert with the lowest estimate of its own loss for the sample both during training and inference; and (b) peeking expert algorithm that selects and trains the expert with the best prediction probability for the target class of a sample during training. A gate is then reverse distilled from the pre-trained experts for conditional computation during inference; (3) Attentive gating MoE architecture that computes the gate probabilities by attending to the expert outputs with additional attention weights during training. We then distill the trained attentive gate model to a simpler original MoE model for conditional computation during inference; and (4) Expert loss gating MoE architecture where the gate output is not the expert distribution but the expert log loss.We also propose a novel flexible data driven soft constraint, Ls, that uses similarity between samples to regulate the gate’s expert distribution. We empirically validate our methods on MNIST, FashionMNIST and CIFAR-10 datasets. The empirical results show that our novel training and regularization algorithms outperform benchmark MoE training methods

    ZAKAT: Government Fiscal Policy Instruments in the Covid-19 Pandemic

    Get PDF
    This study is a literature research that uses qualitative methods, the data is presented in a narrative and focuses on the direction of the description. Sources of data come from primary and secondary data sources. This study focuses on an overview of zakat in Islamic economics and zakat in Indonesian legal policy in order to find out zakat from the perspective of Islamic economics and law in Indonesia. Instruments of fiscal policy in Indonesia to determine the fiscal policy of the Indonesian government. The relevance of zakat as an instrument of fiscal policy in Indonesia during the covid-19 pandemic to find out the potential of zakat as a government policy instrument in the covid-19 pandemic. The results of the study are zakat in Islamic economics including:  source of state revenue while in Indonesian law it is not included in the state budget. The reflection of the Indonesian government's fiscal policy is the APBN. Zakat has great potential, role and benefits as an instrument of government fiscal policy in dealing with the Covid-19 pandemic. Modern management and laws are still needed to maximize zakat collection

    ZAKAT: Government Fiscal Policy Instruments in the Covid-19 Pandemic

    Get PDF
    This study is a literature research that uses qualitative methods, the data is presented in a narrative and focuses on the direction of the description. Sources of data come from primary and secondary data sources. This study focuses on an overview of zakat in Islamic economics and zakat in Indonesian legal policy in order to find out zakat from the perspective of Islamic economics and law in Indonesia. Instruments of fiscal policy in Indonesia to determine the fiscal policy of the Indonesian government. The relevance of zakat as an instrument of fiscal policy in Indonesia during the covid-19 pandemic to find out the potential of zakat as a government policy instrument in the covid-19 pandemic. The results of the study are zakat in Islamic economics including:  source of state revenue while in Indonesian law it is not included in the state budget. The reflection of the Indonesian government's fiscal policy is the APBN. Zakat has great potential, role and benefits as an instrument of government fiscal policy in dealing with the Covid-19 pandemic. Modern management and laws are still needed to maximize zakat collection

    Determinants of profitability in the banking sector : a study with special reference to private commercial banks in Sri Lanka

    Get PDF
    Profitability of the bank has become vital for financial stability. In this study, internal variables namely capital ratio, activity mix, size, overheads and liquidity are considered as variables which have impact on banks’ profitability. The results reveal capital ratio, size and liquidity have positive impact on banks’ profitability whereas activity mix and overheads have negative impact. Our results shows that the banks’ profitability can be increased by increasing banks’ asset base, and size of the banks, and by managing the overhead efficiently to promote financial stability in Sri Lank
    corecore