Quick linguistic representations and precise perceptual representations: Language statistics and perceptual simulations under time constraints

Many studies have argued that language comprehension requires perceptual simulation. In previous work we have demonstrated that because language encodes perceptual relations, comprehenders can also rely on language statistics to bootstrap meaning through limited grounding. The extent comprehenders do this depends on the nature of the cognitive task, the stimulus, the individual, as well as the speed of processing, with linguistic representations preceding perceptual simulation. In the current study we report results that investigated whether time constraints impacted the use of perceptual and linguistic factors during language processing. Participants made fast or slow speeded judgments about whether pairs of words were semantically related. Subjects were also instructed to either respond as quickly as possible to the words they were presented, or respond as accurately as possible. The perceptual factor was operationalized as an iconicity rating of the stimulus pairs occurring in a particular orientation in the real world and the linguistic factor was operationalized as the frequency of the stimulus pairs in language. The linguistic factor best explained the RTs when subjects had to respond quickly. On the other hand, when given more time to respond, both linguistic and perceptual factors explained response times. These findings support the view that language processing is both linguistic and embodied, with linguistic representations being relevant for quick good-enough representations and perceptual simulations being important for more precise information

Effect Size Matters: The Role of Language Statistics and Perceptual Simulation in Conceptual Processing

The cognitive science literature increasingly demonstrates that perceptual representations are activated during conceptual processing. Such findings suggest that the debate on whether conceptual processing is predominantly symbolic or perceptual has been resolved. However, studies too frequently provide evidence for perceptual simulations without addressing whether other factors explain dependent variables as well, and if so, to what extent. The current paper examines effect sizes computed from 137 experiments in 52 published embodied cognition studies to clarify the conditions under which perceptual simulations are most important. Results showed that effects of perceptual simulation tend to be as large as those of language statistics. Moreover, factors that can be associated with immediate processing (button press, word processing) tend to reduce the effect size of perceptual simulation. These findings are considered in respect to the Symbol Interdependency Hypothesis, which argues that language encodes perceptual information, with language statistics explaining quick, good-enough representations and perceptual simulation explaining more effortful, detailed representations