How do you say ‘hello’? Personality impressions from brief novel voices

On hearing a novel voice, listeners readily form personality impressions of that speaker. Accurate or not, these impressions are known to affect subsequent interactions; yet the underlying psychological and acoustical bases remain poorly understood. Furthermore, hitherto studies have focussed on extended speech as opposed to analysing the instantaneous impressions we obtain from first experience. In this paper, through a mass online rating experiment, 320 participants rated 64 sub-second vocal utterances of the word ‘hello’ on one of 10 personality traits. We show that: (1) personality judgements of brief utterances from unfamiliar speakers are consistent across listeners; (2) a two-dimensional ‘social voice space’ with axes mapping Valence (Trust, Likeability) and Dominance, each driven by differing combinations of vocal acoustics, adequately summarises ratings in both male and female voices; and (3) a positive combination of Valence and Dominance results in increased perceived male vocal Attractiveness, whereas perceived female vocal Attractiveness is largely controlled by increasing Valence. Results are discussed in relation to the rapid evaluation of personality and, in turn, the intent of others, as being driven by survival mechanisms via approach or avoidance behaviours. These findings provide empirical bases for predicting personality impressions from acoustical analyses of short utterances and for generating desired personality impressions in artificial voices

Judgements of a speaker’s personality are correlated across differing content and stimulus type

It has previously been shown that first impressions of a speaker’s personality, whether accurate or not, can be judged from short utterances of vowels and greetings, as well as from prolonged sentences and readings of complex paragraphs. From these studies, it is established that listeners’ judgements are highly consistent with one another, suggesting that different people judge personality traits in a similar fashion, with three key personality traits being related to measures of valence (associated with trustworthiness), dominance, and attractiveness. Yet, particularly in voice perception, limited research has established the reliability of such personality judgements across stimulus types of varying lengths. Here we investigate whether first impressions of trustworthiness, dominance, and attractiveness of novel speakers are related when a judgement is made on hearing both one word and one sentence from the same speaker. Secondly, we test whether what is said, thus adjusting content, influences the stability of personality ratings. 60 Scottish voices (30 females) were recorded reading two texts: one of ambiguous content and one with socially-relevant content. One word (~500 ms) and one sentence (~3000 ms) were extracted from each recording for each speaker. 181 participants (138 females) rated either male or female voices across both content conditions (ambiguous, socially-relevant) and both stimulus types (word, sentence) for one of the three personality traits (trustworthiness, dominance, attractiveness). Pearson correlations showed personality ratings between words and sentences were strongly correlated, with no significant influence of content. In short, when establishing an impression of a novel speaker, judgments of three key personality traits are highly related whether you hear one word or one sentence, irrespective of what they are saying. This finding is consistent with initial personality judgments serving as elucidators of approach or avoidance behaviour, without modulation by time or content. All data and sounds are available on OSF (osf.io/s3cxy)

Feature Learning from Spectrograms for Assessment of Personality Traits

Several methods have recently been proposed to analyze speech and automatically infer the personality of the speaker. These methods often rely on prosodic and other hand crafted speech processing features extracted with off-the-shelf toolboxes. To achieve high accuracy, numerous features are typically extracted using complex and highly parameterized algorithms. In this paper, a new method based on feature learning and spectrogram analysis is proposed to simplify the feature extraction process while maintaining a high level of accuracy. The proposed method learns a dictionary of discriminant features from patches extracted in the spectrogram representations of training speech segments. Each speech segment is then encoded using the dictionary, and the resulting feature set is used to perform classification of personality traits. Experiments indicate that the proposed method achieves state-of-the-art results with a significant reduction in complexity when compared to the most recent reference methods. The number of features, and difficulties linked to the feature extraction process are greatly reduced as only one type of descriptors is used, for which the 6 parameters can be tuned automatically. In contrast, the simplest reference method uses 4 types of descriptors to which 6 functionals are applied, resulting in over 20 parameters to be tuned.Comment: 12 pages, 3 figure

Talking the Talk: The Effect of Vocalics in an Interview

Our voices carry more than just content. People continuously make assumptions of one’s intelligence, credibility, personality, and other characteristics merely based on the way we talk. As the diversity of individuals in the workplace increases, so too do the differences in how those individuals talk. It is important that we understand how these different ways of speaking are being perceived in the workplace. More specifically, how are individuals being perceived prior to being hired via the interview process? This Honors Capstone project aims to understand the impact that vocal characteristics in an individual have on the interviewer’s perception of the interviewee, and how that impacts the hiring process. This project will offer professionals of all ages tangible advice on ways to increase one’s chances of receiving a job just by altering aspects of one’s voice

The Impact of Rhythmic Distortions in Speech on Personality Assessment

The perennial question as to how perceived otherness in speech projects into listener assessment of one’s personality has been systematically investigated within the field of foreign accentedness, vocal communication of affective states and vocal stereotyping. In the present study, we aimed at exploring non-native listeners’ capacity to respond to differences in natural and modified native speech, particularly whether the manipulation of temporal structure in both stressed and unstressed syllables gives rise to any changes in the perception of the speaker’s personality. The respondents’ intuitive judgements were captured in the domain of the ‘nervousness category’ taken from the five-factor model of personality. Our results indicate an effect of temporal modifications on the listeners’ judgements. Analysis of variance for repeated measures confirmed a highly significant shift of personality evaluations towards the undesired traits (e.g., nervousness, anxiety, querulousness). Several interesting interactions with the semantic contents of the utterances and with the intrinsic qualities of the speakers’ voices were also found. We argue that the effects of accented speech go beyond conscious willingness to accept “otherness” and suggest a method for studying them

Cracking the social code of speech prosody using reverse correlation

Human listeners excel at forming high-level social representations about each other, even from the briefest of utterances. In particular, pitch is widely recognized as the auditory dimension that conveys most of the information about a speaker's traits, emotional states, and attitudes. While past research has primarily looked at the influence of mean pitch, almost nothing is known about how intonation patterns, i.e., finely tuned pitch trajectories around the mean, may determine social judgments in speech. Here, we introduce an experimental paradigm that combines state-of-the-art voice transformation algorithms with psychophysical reverse correlation and show that two of the most important dimensions of social judgments, a speaker's perceived dominance and trustworthiness, are driven by robust and distinguishing pitch trajectories in short utterances like the word "Hello," which remained remarkably stable whether male or female listeners judged male or female speakers. These findings reveal a unique communicative adaptation that enables listeners to infer social traits regardless of speakers' physical characteristics, such as sex and mean pitch. By characterizing how any given individual's mental representations may differ from this generic code, the method introduced here opens avenues to explore dysprosody and social-cognitive deficits in disorders like autism spectrum and schizophrenia. In addition, once derived experimentally, these prototypes can be applied to novel utterances, thus providing a principled way to modulate personality impressions in arbitrary speech signals

It’s the way he tells them (and who is listening):men’s dominance is positively correlated with their preference for jokes told by dominant-sounding men

While much research has explored humorous exchange in relation to mate choice, recent perspectives have emphasized the importance of humor for monitoring interest within social partnerships more generally. Indeed, given that similarity is thought to be important in the maintenance of social partnerships, we may expect humor appreciation to vary according to the degree of similarity between humor producers and recipients. In the current study we report evidence for such variation that is specific to men’s judgments of other men’s humor. Here we manipulated voice pitch in a set of ‘one-liner’ jokes to create low-pitched and high-pitched versions of men and women telling jokes. A composite measure of men’s own dominance was positively correlated with their preference for jokes told by other men with lowered voice pitch (a vocal cue to dominance). A follow-up study demonstrated that self-reported dominance was positively related to men’s choice of low-pitch men as friends when judging humorous audio clips but not when judging neutral control audio clips, suggesting that humor may be important in mediating the effect of dominance on friendship choice. These studies indicate systematic variation in humor appreciation related to friendship choices which may function to promote cohesion within male partnerships based on status