823 research outputs found

    Self-, other-, and joint monitoring using forward models

    Get PDF
    In the psychology of language, most accounts of self-monitoring assume that it is based on comprehension. Here we outline and develop the alternative account proposed by Pickering and Garrod (2013), in which speakers construct forward models of their upcoming utterances and compare them with the utterance as they produce them. We propose that speakers compute inverse models derived from the discrepancy (error) between the utterance and the predicted utterance and use that to modify their production command or (occasionally) begin anew. We then propose that comprehenders monitor other people’s speech by simulating their utterances using covert imitation and forward models, and then comparing those forward models with what they hear. They use the discrepancy to compute inverse models and modify their representation of the speaker’s production command, or realize that their representation is incorrect and may develop a new production command. We then discuss monitoring in dialogue, paying attention to sequential contributions, concurrent feedback, and the relationship between monitoring and alignment

    To Whom are You Talking? A Deep Learning Model to Endow Social Robots with Addressee Estimation Skills

    Full text link
    Communicating shapes our social word. For a robot to be considered social and being consequently integrated in our social environment it is fundamental to understand some of the dynamics that rule human-human communication. In this work, we tackle the problem of Addressee Estimation, the ability to understand an utterance's addressee, by interpreting and exploiting non-verbal bodily cues from the speaker. We do so by implementing an hybrid deep learning model composed of convolutional layers and LSTM cells taking as input images portraying the face of the speaker and 2D vectors of the speaker's body posture. Our implementation choices were guided by the aim to develop a model that could be deployed on social robots and be efficient in ecological scenarios. We demonstrate that our model is able to solve the Addressee Estimation problem in terms of addressee localisation in space, from a robot ego-centric point of view.Comment: Accepted version of a paper published at 2023 International Joint Conference on Neural Networks (IJCNN). Please find the published version and info to cite the paper at https://doi.org/10.1109/IJCNN54540.2023.10191452 . 10 pages, 8 Figures, 3 Table

    Disentangling meaning in the brain: Left temporal involvement in agreement processing

    Get PDF
    Published online 18 November 2016Sentence comprehension is successfully accomplished by means of a form-to-meaning mapping procedure that relies on the extraction of morphosyntactic information from the input and its mapping to higher-level semantic–discourse representations. In this study, we sought to determine whether neuroanatomically distinct brain regions are involved in the processing of different types of information contained in the propositional meaning of a sentence, namely person and number. While person information indexes the role that an individual has in discourse (i.e., the speaker, the addressee or the entity being talked about by speaker and addressee), number indicates its cardinality (i.e., a single entity vs a multitude of entities). An event-related functional magnetic resonance imaging (fMRI) experiment was run using agreement-Correct and Person- and Number-violated sentences in Spanish, to disentangle the processing mechanisms and neural substrates associated with the building of discourse and cardinality representations. The contrast between Person and Number Violations showed qualitative and quantitative differences. A greater response for person compared to number was found in the left middle temporal gyrus (LMTG). However, critically, a posterior-to-anterior functional gradient emerged within this region. While the posterior portion of the LMTG was sensitive to both Person and Number Violations, the anterior portion of this region showed selective response for Person Violations. These results confirm that the comprehension of the propositional meaning of a sentence results from a composite, feature-sensitive mechanism of form-to-meaning mapping in which the nodes of the language network are differentially involved.BCBL acknowledges funding from Ayuda Centro de Excelencia Severo Ochoa SEV-2015-0490. S.M. acknowledges funding from the Gipuzkoako Foru Aldundia Fellowship Program and from grant PI_2014_38 from the Basque Government. N.M. was funded by grant PSI2012- 32350 and PSI2015-65694-P from the Spanish Ministry of Economy and Competitiveness. M.C was funded by grant PSI2012-31448 from the Spanish Ministry of Science and Innovation and ERC-2011-ADG-295362 from the European Research Council

    Towards a complete multiple-mechanism account of predictive language processing [Commentary on Pickering & Garrod]

    Get PDF
    Although we agree with Pickering & Garrod (P&G) that prediction-by-simulation and prediction-by-association are important mechanisms of anticipatory language processing, this commentary suggests that they: (1) overlook other potential mechanisms that might underlie prediction in language processing, (2) overestimate the importance of prediction-by-association in early childhood, and (3) underestimate the complexity and significance of several factors that might mediate prediction during language processing

    An integrated theory of language production and comprehension

    Get PDF
    Currently, production and comprehension are regarded as quite distinct in accounts of language processing. In rejecting this dichotomy, we instead assert that producing and understanding are interwoven, and that this interweaving is what enables people to predict themselves and each other. We start by noting that production and comprehension are forms of action and action perception. We then consider the evidence for interweaving in action, action perception, and joint action, and explain such evidence in terms of prediction. Specifically, we assume that actors construct forward models of their actions before they execute those actions, and that perceivers of others' actions covertly imitate those actions, then construct forward models of those actions. We use these accounts of action, action perception, and joint action to develop accounts of production, comprehension, and interactive language. Importantly, they incorporate well-defined levels of linguistic representation (such as semantics, syntax, and phonology). We show (a) how speakers and comprehenders use covert imitation and forward modeling to make predictions at these levels of representation, (b) how they interweave production and comprehension processes, and (c) how they use these predictions to monitor the upcoming utterances. We show how these accounts explain a range of behavioral and neuroscientific data on language processing and discuss some of the implications of our proposal
    • …
    corecore