Skip to main content
Article thumbnail
Location of Repository

The Missing Link between Morphemic Assemblies and Behavioral Responses:a Bayesian Information-Theoretical model of lexical processing

By Dr Fermin Moscoso del Prado Martin, Prof Aleksandar Kostic and Dusica Filipovic-Djurdjevic


We present the Bayesian Information-Theoretical (BIT) model of lexical processing: A mathematical model illustrating a novel approach to the modelling of language processes. The model shows how a neurophysiological theory of lexical processing relying on Hebbian association and neural assemblies can directly account for a variety of effects previously observed in behavioural experiments. We develop two information-theoretical measures of the distribution of usages of a morpheme or word, and use them to predict responses in three visual lexical decision datasets investigating inflectional morphology and polysemy. Our model offers a neurophysiological basis for the effects of morpho-semantic neighbourhoods. These results demonstrate how distributed patterns of activation naturally result in the arisal of symbolic structures. We conclude by arguing that the modelling framework exemplified here, is a powerful tool for integrating behavioural and neurophysiological results

Topics: Neurolinguistics, Statistical Models, Language, Neural Modelling, Computational Linguistics, Computational Neuroscience, Semantics, Morphology, Machine Learning, Psycholinguistics, Cognitive Psychology, Neural Nets, Artificial Intelligence
Year: 2006
OAI identifier:

Suggested articles


  1. (1997). A cooccurrence-based thesaurus and two applications to information retrieval', doi
  2. (2005). A roommate in cream: morphological family size eects on interlingual homograph recog51 nition',
  3. (1959). Applications of information theory to psychology: a summary of basic concepts, methods, and results,
  4. (2004). Bayesian integration in sensorimotor learning',
  5. (1991). Bayesian mixture modeling by Montecarlo simulation,
  6. (2005). Breaking the tyranny of learning: a broad-coverage distributed connectionist model of visual word recognition', Manuscript, MRC{Cognition and Brain Sciences Unit.
  7. (2005). Changing places: A cross-language perspective on frequency and family size in Hebrew and Dutch',
  8. (1988). Connectionism and cognitive architecture: a critical analysis',
  9. (1991). Corticostriatal cell assemblies in selective attention and in representation of predictable and controllable events: a general statement of corticostriatal interplay and the role of striatal dopamine',
  10. (1992). Dimensions of meaning,
  11. (1995). Distributional part-of-speech tagging,
  12. (1989). Fast learning in networks of locally tuned processing units',
  13. (1989). Frequency and neighborhood size eects on lexical access: Activation or search?',
  14. (1992). Frequency and neighborhood size eects on lexical access: Similarity or orthographic redundancy?',
  15. (1997). How complex simplex words can be', doi
  16. (1964). Information capacity of discrete motor responses',
  17. (2003). Information Theory, Inference, and Learning Algorithms,
  18. (1997). Integrating form and meaning: A distributed model of speech perception',
  19. (2001). Knowledge free induction of in morphologies,
  20. (2002). Making sense of semantic ambiguity: semantic competition and lexical access', doi
  21. (1977). Maximum likelihood from incomplete data via the EM algorithm',
  22. (2000). Modelling clarity of change in spontaneous speech,
  23. (2004). Modelling the eects of semantic ambiguity in word recognition', doi
  24. (2005). Morphological family size in a morphologically rich language: The case of Finnish compared to Dutch and Hebrew',
  25. (2003). Morphological resonance in the mental lexicon, in
  26. (1990). Neighborhood frequency eects in visual word recognition: A comparison of lexical decision and masked identi latencies', Perception and psychophysics 47,
  27. (1996). Orthographic processing in visual word recognition: A multiple read-out model',
  28. (1989). Priming lexical neighbors of spoken words: Eects of competition and inhibition',
  29. (1996). Producing high-dimensional semantic spaces from lexical cooccurrence',
  30. (2004). Putting the bits together: An information theoretical perspective on morphological processing',
  31. (2001). Rethinking the word frequency eect: The neglected role of distributional information in lexical processing',
  32. (1995). Semantic and associative priming in highdimensional semantic space,
  33. (1949). Statistical behavioristics and sequences of responses',
  34. (2001). Testing the distributional hypothesis: The in of context judgements of semantic similarity,
  35. (2001). The computational neuroscience of vision, doi
  36. (1997). The eects of orthographic similarity on lexical retrieval: Resolving neighborhood con
  37. (1954). The information capacity of the human motor system in controlling the amplitude of movement',
  38. (1956). The magical number seven, plus or minus two: Some limits on our capacity for processing information',
  39. (1994). Towards connectionist lexical semantics, in
  40. (1982). Vision: A computational investigation into the human representation and processing of visual information, Freeman & Co.,
  41. (1944). What is Life?,

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.