20,655 research outputs found

    Binding and Normalization of Binary Sparse Distributed Representations by Context-Dependent Thinning

    Get PDF
    Distributed representations were often criticized as inappropriate for encoding of data with a complex structure. However Plate's Holographic Reduced Representations and Kanerva's Binary Spatter Codes are recent schemes that allow on-the-fly encoding of nested compositional structures by real-valued or dense binary vectors of fixed dimensionality. In this paper we consider procedures of the Context-Dependent Thinning which were developed for representation of complex hierarchical items in the architecture of Associative-Projective Neural Networks. These procedures provide binding of items represented by sparse binary codevectors (with low probability of 1s). Such an encoding is biologically plausible and allows a high storage capacity of distributed associative memory where the codevectors may be stored. In contrast to known binding procedures, Context-Dependent Thinning preserves the same low density (or sparseness) of the bound codevector for varied number of component codevectors. Besides, a bound codevector is not only similar to another one with similar component codevectors (as in other schemes), but it is also similar to the component codevectors themselves. This allows the similarity of structures to be estimated just by the overlap of their codevectors, without retrieval of the component codevectors. This also allows an easy retrieval of the component codevectors. Examples of algorithmic and neural-network implementations of the thinning procedures are considered. We also present representation examples for various types of nested structured data (propositions using role-filler and predicate-arguments representation schemes, trees, directed acyclic graphs) using sparse codevectors of fixed dimension. Such representations may provide a fruitful alternative to the symbolic representations of traditional AI, as well as to the localist and microfeature-based connectionist representations

    Survey of data mining approaches to user modeling for adaptive hypermedia

    Get PDF
    The ability of an adaptive hypermedia system to create tailored environments depends mainly on the amount and accuracy of information stored in each user model. Some of the difficulties that user modeling faces are the amount of data available to create user models, the adequacy of the data, the noise within that data, and the necessity of capturing the imprecise nature of human behavior. Data mining and machine learning techniques have the ability to handle large amounts of data and to process uncertainty. These characteristics make these techniques suitable for automatic generation of user models that simulate human decision making. This paper surveys different data mining techniques that can be used to efficiently and accurately capture user behavior. The paper also presents guidelines that show which techniques may be used more efficiently according to the task implemented by the applicatio

    Functional network changes and cognitive control in schizophrenia

    Get PDF
    Cognitive control is a cognitive and neural mechanism that contributes to managing the complex demands of day-to-day life. Studies have suggested that functional impairments in cognitive control associated brain circuitry contribute to a broad range of higher cognitive deficits in schizophrenia. To examine this issue, we assessed functional connectivity networks in healthy adults and individuals with schizophrenia performing tasks from two distinct cognitive domains that varied in demands for cognitive control, the RiSE episodic memory task and DPX goal maintenance task. We characterized general and cognitive control-specific effects of schizophrenia on functional connectivity within an expanded frontal parietal network (FPN) and quantified network topology properties using graph analysis. Using the network based statistic (NBS), we observed greater network functional connectivity in cognitive control demanding conditions during both tasks in both groups in the FPN, and demonstrated cognitive control FPN specificity against a task independent auditory network. NBS analyses also revealed widespread connectivity deficits in schizophrenia patients across all tasks. Furthermore, quantitative changes in network topology associated with diagnostic status and task demand were observed. The present findings, in an analysis that was limited to correct trials only, ensuring that subjects are on task, provide critical insights into network connections crucial for cognitive control and the manner in which brain networks reorganize to support such control. Impairments in this mechanism are present in schizophrenia and these results highlight how cognitive control deficits contribute to the pathophysiology of this illness
    corecore