Applying the summation model in audiovisual speech perception

Peer reviewe

Negative affordance effect : automatic response inhibition triggered by handle orientation of non-target object

Habituated response tendency associated with affordance of an object is automatically inhibited if this affordance cue is extracted from a non-target object. This study presents two go/no-go experiments investigating whether this response control operates in response selection processes and whether it is linked to conflict-monitoring mechanisms. In the first experiment, the participants performed responses with one hand, and in the second experiment, with two hands. In addition, both experiments consisted of two blocks with varying frequency of go conditions (25%-go vs. 75%-go). The non-target-related response inhibition effect was only observed in Experiment 2 when the task required selecting between two hands. Additionally, the results did not reveal patterns typically related to conflict monitoring when go-frequency is manipulated and when a stimulus-response compatibility effect is examined relative to congruency condition of the previous trial. The study shows that the non-target-related response inhibition assists hand selection and is relatively resistant to conflict-monitoring processes.Peer reviewe

Visual features underlying perceived brightness as revealed by classification images

Along with physical luminance, the perceived brightness is known to depend on the spatial structure of the stimulus. Often it is assumed that neural computation of the brightness is based on the analysis of luminance borders of the stimulus. However, this has not been tested directly. We introduce a new variant of the psychophysical reverse-correlation or classification image method to estimate and localize the physical features of the stimuli which correlate with the perceived brightness, using a brightness-matching task. We derive classification images for the illusory Craik-O'Brien-Cornsweet stimulus and a "real" uniform step stimulus. For both stimuli, classification images reveal a positive peak at the stimulus border, along with a negative peak at the background, but are flat at the center of the stimulus, suggesting that brightness is determined solely by the border information. Features in the perceptually completed area in the Craik-O'Brien-Cornsweet do not contribute to its brightness, nor could we see low-frequency boosting, which has been offered as an explanation for the illusion. Tuning of the classification image profiles changes remarkably little with stimulus size. This supports the idea that only certain spatial scales are used for computing the brightness of a surface.Peer reviewe

Selective Influences of Precision and Power Grips on Speech Categorization

Peer reviewe

Red color facilitates the detection of facial anger — But how much?

The color red seems to be consistently associated with the concept of anger. Beyond semantic associations, it has been suggested that the color red enhances our ability to perceive anger in faces. However, previous studies often lack proper color control or the results are confounded by the presence of several emotions. Moreover, the magnitude of the (potential) effect of red has not been quantified. To address these caveats, we quantified the effect of facial color and background color on anger with psychometric functions measured with the method-of-constant-stimuli while facial hue or surround hue was varied in CIELAB color space. Stimulus sequences were generated by morphing between neutral and angry faces. For the facial color, the average chromaticity of the faces was shifted byΔE 12/20 in red, yellow, green and blue directions. For the background color, the hue was either neutral or saturated red, green or blue. Both facial redness and surround redness enhanced perceived anger slightly, by 3–4 morph-%. Other colors did not affect perceived anger. As the magnitude of the enhancement is generally small and the effect is robust only in a small subset of the participants, we question the practical significance of red in anger recognition

Separation of edge detection and brightness perception

AbstractWhen a low spatial frequency noise mask is superimposed onto a luminance staircase, the perceived brightness pattern is dramatically altered although the edges remain visible. We measured contrast thresholds for the edges and for the illusory scalloping (Chevreul-illusion), as a function of noise center spatial frequency. The masking tuning functions overlapped, but peaked at different spatial frequencies and contrast levels. The results suggest that perceived brightness is triggered only by the low spatial frequency components of the edges––the high spatial frequency components are not able to produce a brightness pattern

Investigation of Cross-Language and Stimulus-Dependent Effects on the McGurk Effect with Finnish and Japanese Speakers and Listeners

In the McGurk effect, perception of a spoken consonant is altered when an auditory (A) syllable is presented with an incongruent visual (V) syllable (e.g., A/pa/V/ka/ is often heard as /ka/ or /ta/). The McGurk effect provides a measure for visual influence on speech perception, becoming stronger the lower the proportion of auditory correct responses. Cross-language effects are studied to understand processing differences between one’s own and foreign languages. Regarding the McGurk effect, it has sometimes been found to be stronger with foreign speakers. However, other studies have shown the opposite, or no difference between languages. Most studies have compared English with other languages. We investigated cross-language effects with native Finnish and Japanese speakers and listeners. Both groups of listeners had 49 participants. The stimuli (/ka/, /pa/, /ta/) were uttered by two female and male Finnish and Japanese speakers and presented in A, V and AV modality, including a McGurk stimulus A/pa/V/ka/. The McGurk effect was stronger with Japanese stimuli in both groups. Differences in speech perception were prominent between individual speakers but less so between native languages. Unisensory perception correlated with McGurk perception. These findings suggest that stimulus-dependent features contribute to the McGurk effect. This may have a stronger influence on syllable perception than cross-language factors

Normalized classification images for step edge: comparison of different target sizes.

<p>Blue curve: 1.33 deg target, green curve: 0.66 deg, red curve: 0.33 deg target. Tuning of the classification image profile is almost invariant to the target size.</p

Classification images: step edge.

<p>The black line shows the target profile. The blue curve is the “raw” classification image and the red curve the spatially normalized classification image. Classification image profiles peak inside the stimulus, at the location of the border. In most cases, there is also a negative peak at the background next to the border. The relative extent of the classification image profile compared to the target size is dependent on the size: with small 0.33 degree stimulus it encompasses the entire stimulus, but with large 1.33 degree stimulus, it covers just the border.</p

Classification images: Craik-O'Brien-Cornsweet stimulus for three subjects.

<p>The black line shows the target profile. The blue curve is “raw” classification image and the red curve the spatially normalized classification images divided by the area of the stimulus rings. The classification image profile reveals a positive peak at the location of the border. The amplitude is nonzero just at the border, while the illusory area is almost flat. This implies that subjects rely on the stimulus information at the border when assessing the brightness of the surface. The Error bars: 1 standard error of the mean.</p