Adaptive Structural Learning of Deep Belief Network for Medical Examination Data and Its Knowledge Extraction by using C4.5

Deep Learning has a hierarchical network architecture to represent the complicated feature of input patterns. The adaptive structural learning method of Deep Belief Network (DBN) has been developed. The method can discover an optimal number of hidden neurons for given input data in a Restricted Boltzmann Machine (RBM) by neuron generation-annihilation algorithm, and generate a new hidden layer in DBN by the extension of the algorithm. In this paper, the proposed adaptive structural learning of DBN was applied to the comprehensive medical examination data for the cancer prediction. The prediction system shows higher classification accuracy (99.8% for training and 95.5% for test) than the traditional DBN. Moreover, the explicit knowledge with respect to the relation between input and output patterns was extracted from the trained DBN network by C4.5. Some characteristics extracted in the form of IF-THEN rules to find an initial cancer at the early stage were reported in this paper.Comment: 8 pages, 7 figures, The First IEEE International Conference on Artificial Intelligence and Knowledge Engineering (AIKE2018

What Is Cognitive Psychology?

What Is Cognitive Psychology? identifies the theoretical foundations of cognitive psychology—foundations which have received very little attention in modern textbooks. Beginning with the basics of information processing, Michael R. W. Dawson explores what experimental psychologists infer about these processes and considers what scientific explanations are required when we assume cognition is rule-governed symbol manipulation. From these foundations, psychologists can identify the architecture of cognition and better understand its role in debates about its true nature. This volume offers a deeper understanding of cognitive psychology and presents ideas for integrating traditional cognitive psychology with more modern fields like cognitive neuroscience.Publishe

Evolution of Natural Language Processing Technology: Not Just Language Processing Towards General Purpose AI

Since the invention of computers, communication through natural language (actual human language) has been a dream technology. However, natural language is extremely difficult to mathematically formulate, making it difficult to realize as an algorithm without considering programming. While there have been numerous technological developments, one cannot say that any results allowing free utilization have been achieved thus far. In the case of language learning in humans, for instance when learning one's mother tongue or foreign language, one must admit that this process is similar to the adage "practice makes perfect" in principle, even though the learning method is significant up to a point. Deep learning has played a central role in contemporary AI technology in recent years. When applied to natural language processing (NLP), this produced unprecedented results. Achievements exceeding the initial predictions have been reported from the results of learning vast amounts of textual data using deep learning. For instance, four arithmetic operations could be performed without explicit learning, thereby enabling the explanation of complex images and the generation of images from corresponding explanatory texts. It is an accurate example of the learner embodying the concept of "practice makes perfect" by using vast amounts of textual data. This report provides a technological explanation of how cutting-edge NLP has made it possible to realize the "practice makes perfect" principle. Additionally, examples of how this can be applied to business are provided. We reported in June 2022 in Japanese on the NLP movement from late 2021 to early 2022. We would like to summarize this as a memorandum since this is just the initial movement leading to the current large language models (LLMs).Comment: 40 page

STRUCTURAL AND FUNCTIONAL ALTERATIONS IN NEOCORTICAL CIRCUITS AFTER MILD TRAUMATIC BRAIN INJURY

National concern over traumatic brain injury (TBI) is growing rapidly. Recent focus is on mild TBI (mTBI), which is the most prevalent injury level in both civilian and military demographics. A preeminent sequelae of mTBI is cognitive network disruption. Advanced neuroimaging of mTBI victims supports this premise, revealing alterations in activation and structure-function of excitatory and inhibitory neuronal systems, which are essential for network processing. However, clinical neuroimaging cannot resolve the cellular and molecular substrates underlying such changes. Therefore, to understand the full scope of mTBI-induced alterations it is necessary to study cortical networks on the microscopic level, where neurons form local networks that are the fundamental computational modules supporting cognition. Recently, in a well-controlled animal model of mTBI, we demonstrated in the excitatory pyramidal neuron system, isolated diffuse axonal injury (DAI), in concert with electrophysiological abnormalities in nearby intact (non-DAI) neurons. These findings were consistent with altered axon initial segment (AIS) intrinsic activity functionally associated with structural plasticity, and/or disturbances in extrinsic systems related to parvalbumin (PV)-expressing interneurons that form GABAergic synapses along the pyramidal neuron perisomatic/AIS domains. The AIS and perisomatic GABAergic synapses are domains critical for regulating neuronal activity and E-I balance. In this dissertation, we focus on the neocortical excitatory pyramidal neuron/inhibitory PV+ interneuron local network following mTBI. Our central hypothesis is that mTBI disrupts neuronal network structure and function causing imbalance of excitatory and inhibitory systems. To address this hypothesis we exploited transgenic and cre/lox mouse models of mTBI, employing approaches that couple state-of-the-art bioimaging with electrophysiology to determine the structural- functional alterations of excitatory and inhibitory systems in the neocortex

The role of glutamatergic inferior olivary teaching signals in the acquisition of conditioned eyeblinks

The cerebellar learning hypothesis postulates that the inferior olive provides the cerebellum with a teaching signal that is required for acquisition and maintenance of conditioned eyeblinks. This dissertation addresses the effects of blocking inferior olivary glutamate neurotransmission on acquisition of conditioned responses