Investigating effects of emoji on neutral narrative text: evidence from eye movements and perceived emotional valence

Digital images of faces such as emoji in virtual communication have become increasingly popular, but current research findings are inconsistent regarding their emotional effects on perceptions of text. Similarly, emoji effects on reading behaviours are largely unknown and require further examination. The present study (N = 41) investigated how the position and emotional valence of emoji in neutral narrative sentences influenced eye movements during reading and perceptions of sentence valence. Participants read neutral narrative sentences containing smiling or frowning emoji in sentence-initial or sentence-final positions and rated the perceived emotional valence of the sentence. Results from linear mixed-effects models demonstrated significantly longer fixations on sentence-final emoji and longer sentence reading times when emoji were in sentence-final positions. These findings are comparable to sentence ‘wrap-up’ effects witnessed in the processing of lexical units during sentence reading, providing new evidence towards the way readers integrate emoji into contextual processing. However, no impact of emoji valence or position on first-pass target word processing or sentence-valence ratings were found. This would refute previous suggestions that digital faces influence text valence, raising questions about reader preference for emoji or sentence sentiment, the influence of sentence formatting, and delivery/display mechanism on these effects

Recovering faces from memory: the distracting influence of external facial features.

Recognition memory for unfamiliar faces is facilitated when contextual cues (e.g. head pose, background environment, hair and clothing) are consistent between study and test. By contrast, inconsistencies in external features, especially hair, promote errors in unfamiliar face-matching tasks. For the construction of facial composites, as carried out by witnesses and victims of crime, the role of external features (hair, ears and neck) is less clear, although research does suggest their involvement. Here, over three experiments, we investigate the impact of external features for recovering facial memories using a modern, recognition-based composite system, EvoFIT. Participant-constructors inspected an unfamiliar target face and, one day later, repeatedly selected items from arrays of whole faces, with ‘breeding’, to ‘evolve’ a composite with EvoFIT; further participants (evaluators) named the resulting composites. In Experiment 1, the important internal-features (eyes, brows, nose and mouth) were constructed more identifiably when the visual presence of external features was decreased by Gaussian blur during construction: higher blur yielded more identifiable internal-features. In Experiment 2, increasing the visible extent of external features (to match the target’s) in the presented face-arrays also improved internal-features quality, although less so than when external features were masked throughout construction. Experiment 3 demonstrated that masking external-features promoted substantially more identifiable images than using the previous method of blurring external-features. Overall, the research indicates that external features are a distractive rather than a beneficial cue for face construction; the results also provide a much better method to construct composites, one that should dramatically increase identification of offenders

Understanding the multiframe caricature advantage for recognizing facial composites.

Eyewitnesses often construct a ‘composite’ face of a person they saw commit a crime, a picture that police use to identify suspects. We described a technique (Frowd et al., 2007, Visual Cognition, 15, 1-31) based on facial caricature to facilitate recognition of these images: correct naming substantially improves when composites are seen with progressive positive caricature, where distinctive information is enhanced, and then with progressive negative caricature, the opposite. Over the course of four experiments, the underpinnings of this mechanism are explored. Positive-caricature levels were found to be largely responsible for improving naming of composites, with some benefit from negative-caricature levels. Also, different frame-presentation orders (forward, reverse, random, repeated) facilitated equivalent naming benefit relative to static composites. Overall, the data indicate that composites are usually constructed as negative caricatures

Catching more offenders with EvoFIT facial composites: Lab research and Police field trials.

Often, the only evidence of an offender’s identity comes from the memory of an eyewitness. For over 12 years, we have been developing software called EvoFIT to help eyewitnesses recover their memories of offenders’ faces, to assist police investigations. EvoFIT requires eyewitnesses to repeatedly select from arrays of faces, with ‘breeding’, to ‘evolve’ a face. Recently, police forces have been formally evaluating EvoFIT in criminal cases. The current paper describes four such police audits. It is reported that EvoFIT composites directly led to an arrest in 25.4% of cases overall; the arrest rate was 38.5% for forces that used a newer, less detailed face-recall interview. These results are similar to those found in the laboratory using simulated procedures. Here, we also evaluate the impact of interviewing techniques and outline further work that has improved system performance

Slower is not always better: Response-time evidence clarifies the limited role of miserly information processing in the Cognitive Reflection Test

We report a study examining the role of `cognitive miserliness' as a determinant of poor performance on the standard three-item Cognitive Reflection Test (CRT). The cognitive miserliness hypothesis proposes that people often respond incorrectly on CRT items because of an unwillingness to go beyond default, heuristic processing and invest time and effort in analytic, reflective processing. Our analysis (N = 391) focused on people's response times to CRT items to determine whether predicted associations are evident between miserly thinking and the generation of incorrect, intuitive answers. Evidence indicated only a weak correlation between CRT response times and accuracy. Item-level analyses also failed to demonstrate predicted response time differences between correct analytic and incorrect intuitive answers for two of the three CRT items. We question whether participants who give incorrect intuitive answers on the CRT can legitimately be termed cognitive misers and whether the three CRT items measure the same general construct

The impact of misleading information on the identifiability of feature-based facial composites

The misinformation effect demonstrates that when eyewitnesses are exposed to details of a crime that are incorrect, they are less accurate in their later recall of those details. Research has also shown that misinformation has a measurable effect on recall and construction of a target face using a mechanical but now-outdated feature-based composite system. In a laboratory-based psychology experiment, we demonstrate that misinformation has a detrimental effect on the construction of a facial composite produced by a modern, computerized feature-based system. Participants were shown a target face and constructed a composite of it the following day using PRO-fit software. Composites were less identifiable when, prior to face construction, participants were exposed to misinformation-in this case, by reading a description of an inaccurate identity: a face that was different to theirs (relative to participants who read a description of the same identity, or did not read a description at all). This is important for criminal justice systems and security services as facial composites constructed under such circumstances would appear to be less identifiable, thus limiting the effectiveness of this type of forensic evidence

A single incident of "revenge porn"? The prevalence of image based sexual abuse in a course of conduct amounting to stalking and consideration of the harms caused

The file attached to this record is the author's final peer reviewed version. The Publisher's final version can be found by following the DOI link.The distribution of private sexual images without the individual’s consent is a pernicious form of sexual abuse. Image based sexual abuse (IBSA), sometimes known as Revenge Porn (RP), refers to images of a sexual nature generally distributed across social networks and the internet with the intent to cause distress. It is a criminal offence under the Criminal Justice and Courts Act 2015 [CJCA] . This article presents findings which indicate the prevalence of IBSA in a conduct amounting to stalking, alongside data which demonstrates the severity of its impact on victims

Emoji identification and emoji effects on sentence emotionality in ASD-diagnosed adults and neurotypical controls

We investigated ASD-diagnosed adults’ and neurotypical (NT) controls’ processing of emoji and emoji influence on the emotionality of otherwise-neutral sentences. Study 1 participants categorised emoji representing the six basic emotions using a fixed-set of emotional adjectives. Results showed that ASD-diagnosed participants’ classifications of fearful, sad, and surprised emoji were more diverse and less ‘typical’ than NT controls’ responses. Study 2 participants read emotionally-neutral sentences; half paired with sentence-final happy emoji, half with sad emoji. Participants rated sentence + emoji stimuli for emotional valence. ASD-diagnosed and NT participants rated sentences + happy emoji as equally-positive, however, ASD-diagnosed participants rated sentences + sad emoji as more-negative than NT participants. We must acknowledge differential perceptions and effects of emoji, and emoji-text inter-relationships, when working with neurodiverse stakeholders