Visual Rationalizations in Deep Reinforcement Learning for Atari Games

Due to the capability of deep learning to perform well in high dimensional problems, deep reinforcement learning agents perform well in challenging tasks such as Atari 2600 games. However, clearly explaining why a certain action is taken by the agent can be as important as the decision itself. Deep reinforcement learning models, as other deep learning models, tend to be opaque in their decision-making process. In this work, we propose to make deep reinforcement learning more transparent by visualizing the evidence on which the agent bases its decision. In this work, we emphasize the importance of producing a justification for an observed action, which could be applied to a black-box decision agent.Comment: presented as oral talk at BNAIC 201

Skin Lesion Analyser: An Efficient Seven-Way Multi-Class Skin Cancer Classification Using MobileNet

Skin cancer, a major form of cancer, is a critical public health problem with 123,000 newly diagnosed melanoma cases and between 2 and 3 million non-melanoma cases worldwide each year. The leading cause of skin cancer is high exposure of skin cells to UV radiation, which can damage the DNA inside skin cells leading to uncontrolled growth of skin cells. Skin cancer is primarily diagnosed visually employing clinical screening, a biopsy, dermoscopic analysis, and histopathological examination. It has been demonstrated that the dermoscopic analysis in the hands of inexperienced dermatologists may cause a reduction in diagnostic accuracy. Early detection and screening of skin cancer have the potential to reduce mortality and morbidity. Previous studies have shown Deep Learning ability to perform better than human experts in several visual recognition tasks. In this paper, we propose an efficient seven-way automated multi-class skin cancer classification system having performance comparable with expert dermatologists. We used a pretrained MobileNet model to train over HAM10000 dataset using transfer learning. The model classifies skin lesion image with a categorical accuracy of 83.1 percent, top2 accuracy of 91.36 percent and top3 accuracy of 95.34 percent. The weighted average of precision, recall, and f1-score were found to be 0.89, 0.83, and 0.83 respectively. The model has been deployed as a web application for public use at (https://saketchaturvedi.github.io). This fast, expansible method holds the potential for substantial clinical impact, including broadening the scope of primary care practice and augmenting clinical decision-making for dermatology specialists.Comment: This is a pre-copyedited version of a contribution published in Advances in Intelligent Systems and Computing, Hassanien A., Bhatnagar R., Darwish A. (eds) published by Chaturvedi S.S., Gupta K., Prasad P.S. The definitive authentication version is available online via https://doi.org/10.1007/978-981-15-3383-9_1

Bounded Rational Decision-Making with Adaptive Neural Network Priors

Bounded rationality investigates utility-optimizing decision-makers with limited information-processing power. In particular, information theoretic bounded rationality models formalize resource constraints abstractly in terms of relative Shannon information, namely the Kullback-Leibler Divergence between the agents' prior and posterior policy. Between prior and posterior lies an anytime deliberation process that can be instantiated by sample-based evaluations of the utility function through Markov Chain Monte Carlo (MCMC) optimization. The most simple model assumes a fixed prior and can relate abstract information-theoretic processing costs to the number of sample evaluations. However, more advanced models would also address the question of learning, that is how the prior is adapted over time such that generated prior proposals become more efficient. In this work we investigate generative neural networks as priors that are optimized concurrently with anytime sample-based decision-making processes such as MCMC. We evaluate this approach on toy examples.Comment: Published in ANNPR 2018: Artificial Neural Networks in Pattern Recognitio

Are tutor behaviors in problem-based learning stable? A generalizability study of social congruence, expertise and cognitive congruence

The purpose of this study was to investigate the stability of three distinct tutor behaviors (1) use of subject-matter expertise, (2) social congruence and (3) cognitive congruence, in a problem-based learning (PBL) environment. The data comprised the input from 16,047 different students to a survey of 762 tutors administered in three consecutive semesters. Over the three semesters each tutor taught two of the same course and one different course. A generalizability study was conducted to determine whether the tutor behaviors were generalizable across the three measurement occasions. The results indicate that three semesters are sufficient to make generalizations about all three tutor behaviors. In addition the results show that individual differences between tutors account for the greatest differences in levels of expertise, social congruence and cognitive congruence. The study concludes that tutor behaviors are fairly consistent in PBL and somewhat impervious to change. Implications of these findings for tutor training are discussed

"I am your mother and your father!": In vitro derived gametes and the ethics of solo reproduction

In this paper, we will discuss the prospect of human reproduction achieved with gametes originating from only one person. According to statements by a minority of scientists working on the generation of gametes in vitro, it may become possible to create eggs from men’s non-reproductive cells and sperm from women’s. This would enable, at least in principle, the creation of an embryo from cells obtained from only one individual: ‘solo reproduction’. We will consider what might motivate people to reproduce in this way, and the implications that solo reproduction might have for ethics and policy. We suggest that such an innovation is unlikely to revolutionise reproduction and parenting. Indeed, in some respects it is less revolutionary than in vitro fertilisation as a whole. Furthermore, we show that solo reproduction with in vitro created gametes is not necessarily any more ethically problematic than gamete donation—and probably less so. Where appropriate, we draw parallels with the debate surrounding reproductive cloning. We note that solo reproduction may serve to perpetuate reductive geneticised accounts of reproduction, and that this may indeed be ethically questionable. However, in this it is not unique among other technologies of assisted reproduction, many of which focus on genetic transmission. It is for this reason that a ban on solo reproduction might be inconsistent with continuing to permit other kinds of reproduction that also bear the potential to strengthen attachment to a geneticised account of reproduction. Our claim is that there are at least as good reasons to pursue research towards enabling solo reproduction, and eventually to introduce solo reproduction as an option for fertility treatment, as there are to do so for other infertility related purposes

Circulating microRNAs Reveal Time Course of Organ Injury in a Porcine Model of Acetaminophen-Induced Acute Liver Failure

Acute liver failure is a rare but catastrophic condition which can progress rapidly to multi-organ failure. Studies investigating the onset of individual organ injury such as the liver, kidneys and brain during the evolution of acute liver failure, are lacking. MicroRNAs are short, non-coding strands of RNA that are released into the circulation following tissue injury. In this study, we have characterised the release of both global microRNA and specific microRNA species into the plasma using a porcine model of acetaminophen-induced acute liver failure. Pigs were induced to acute liver failure with oral acetaminophen over 19h±2h and death occurred 13h±3h thereafter. Global microRNA concentrations increased 4h prior to acute liver failure in plasma (P<0.0001) but not in isolated exosomes, and were associated with increasing plasma levels of the damage-associated molecular pattern molecule, genomic DNA (P<0.0001). MiR122 increased around the time of onset of acute liver failure (P<0.0001) and was associated with increasing international normalised ratio (P<0.0001). MiR192 increased 8h after acute liver failure (P<0.0001) and was associated with increasing creatinine (P<0.0001). The increase in miR124-1 occurred concurrent with the pre-terminal increase in intracranial pressure (P<0.0001) and was associated with decreasing cerebral perfusion pressure (P<0.002)

Nasal Chemosensory-Stimulation Evoked Activity Patterns in the Rat Trigeminal Ganglion Visualized by In Vivo Voltage-Sensitive Dye Imaging

Mammalian nasal chemosensation is predominantly mediated by two independent neuronal pathways, the olfactory and the trigeminal system. Within the early olfactory system, spatiotemporal responses of the olfactory bulb to various odorants have been mapped in great detail. In contrast, far less is known about the representation of volatile chemical stimuli at an early stage in the trigeminal system, the trigeminal ganglion (TG), which contains neurons directly projecting to the nasal cavity. We have established an in vivo preparation that allows high-resolution imaging of neuronal population activity from a large region of the rat TG using voltage-sensitive dyes (VSDs). Application of different chemical stimuli to the nasal cavity elicited distinct, stimulus-category specific, spatiotemporal activation patterns that comprised activated as well as suppressed areas. Thus, our results provide the first direct insights into the spatial representation of nasal chemosensory information within the trigeminal ganglion imaged at high temporal resolution

The clinical features of the piriformis syndrome: a systematic review

Piriformis syndrome, sciatica caused by compression of the sciatic nerve by the piriformis muscle, has been described for over 70 years; yet, it remains controversial. The literature consists mainly of case series and narrative reviews. The objectives of the study were: first, to make the best use of existing evidence to estimate the frequencies of clinical features in patients reported to have PS; second, to identify future research questions. A systematic review was conducted of any study type that reported extractable data relevant to diagnosis. The search included all studies up to 1 March 2008 in four databases: AMED, CINAHL, Embase and Medline. Screening, data extraction and analysis were all performed independently by two reviewers. A total of 55 studies were included: 51 individual and 3 aggregated data studies, and 1 combined study. The most common features found were: buttock pain, external tenderness over the greater sciatic notch, aggravation of the pain through sitting and augmentation of the pain with manoeuvres that increase piriformis muscle tension. Future research could start with comparing the frequencies of these features in sciatica patients with and without disc herniation or spinal stenosis

No difference in stroke knowledge between Korean adherents to traditional and western medicine – the AGE study: an epidemiological study

BACKGROUND: Effective stroke intervention and risk reduction depend on the general public's awareness and knowledge of stroke. In Korea, where both traditional Oriental medicine and Western medicine are practiced, estimates of the general public's awareness and knowledge of stroke are poor. The present study sought to describe the inception cohort of the Ansan Geriatric Study (AGE study) and to determine baseline stroke awareness and preferred medical treatment for stroke in this Korean sample. METHODS: A total of 2,767 subjects selected randomly from the Ansan Geriatric Study in South Korea were questioned about stroke. Their answers were compared with their sociodemographic data and other variables. RESULTS: Only 44.8% of participants correctly identified stroke as a vascular disease in the human brain. Sudden numbness or weakness was the most frequently identified stroke warning sign (60.2%). Hypertension (66.7%) and mental stress (62.2%) were most frequently identified as stroke risk factors. The contributions of diabetes mellitus and cardiovascular disease to stroke were underestimated; they were identified as risk factors by 28.3% and 18.6% of participants, respectively. The predictors for poor knowledge of stroke warning signs and risk factors were similar irrespective of preference for Western or Oriental medical treatment, and included those with lower levels of education and inaccurate definition of stroke. Television and radio (40.3%) were the most frequent sources of stroke information for both groups. CONCLUSION: This study shows that knowledge of stroke is similar among Koreans with preferences for either Western or Oriental medical treatment and that misunderstandings about stroke are common among the Korean elderly. In order to prevent and manage stroke effectively, public health education regarding basic concepts of stroke is necessary. This should target those with a lower level of education and a misunderstanding of the definition of stroke