Deep Learning Architectures and Strategies for Early Detection of Self-harm and Depression Level Prediction

[EN] This paper summarizes the contributions of the PRHLT- UPV team as a participant in the eRisk 2020 tasks on self-harm detection and prediction of depression levels from social media. Computational methods based on machine learning and natural language processing have a great potential to assist with early detection of mental disorders of social media users, based on their online activity.We use multi-dimensional representations of language, and compare various deep learning models' performance, exploring rarely approached avenues in previous research, including hierarchical deep learning architectures and pre-trained transformers and language models.The work of Paolo Rosso was in the framework of the research project PROMETEO/2019/121 (DeepPattern) by the Generalitat Valenciana.Uban, A.; Rosso, P. (2020). Deep Learning Architectures and Strategies for Early Detection of Self-harm and Depression Level Prediction. CEUR Workshop Proceedings. 2696:1-12. http://hdl.handle.net/10251/166536S112269

UPV-Symanto at eRisk 2021: Mental Health Author Profiling for Early Risk Prediction on the Internet

[EN] This paper presents the contributions of the UPV-Symanto team, a collaboration between Symanto Research and the PRHLT Center, in the eRisk 2021 shared tasks on gambling addiction, self-harm detection and prediction of depression levels. We have used a variety of models and techniques, including Transformers, hierarchical attention networks with multiple linguistic features, a dedicated early alert decision mechanism, and temporal modelling of emotions. We trained the models using additional training data that we collected and annotated thanks to expert psychologists. Our emotions-over-time model obtained the best results for the depression severity task in terms of ACR (and second best according to ADODL). For the self-harm detection task, our Transformer-based model obtained the best absolute result in terms of ERDE5 and we ranked equal first in terms of speed and latency.The authors from Universitat Politècnica de València thank the EU-FEDER Comunitat Valenciana 2014-2020 grant IDIFEDER/2018/025. The work of Paolo Rosso was in the framework of the research project PROMETEO/2019/121 (DeepPattern) by the Generalitat Valenciana. We would like to thank the two anonymous reviewers who helped us improve this paper.Basile, A.; Chinea-Ríos, M.; Uban, A.; Müller, T.; Rössler, L.; Yenikent, S.; Chulvi-Ferriols, MA.... (2021). UPV-Symanto at eRisk 2021: Mental Health Author Profiling for Early Risk Prediction on the Internet. CEUR. 908-927. http://hdl.handle.net/10251/19067090892

An emotion and cognitive based analysis of mental health disorders from social media data

[EN] Mental disorders can severely affect quality of life, constitute a major predictive factor of suicide, and are usually underdiagnosed and undertreated. Early detection of signs of mental health problems is particularly important, since unattended, they can be life-threatening. This is why a deep understanding of the complex manifestations of mental disorder development is important. We present a study of mental disorders in social media, from different perspectives. We are interested in understanding whether monitoring language in social media could help with early detection of mental disorders, using computational methods. We developed deep learning models to learn linguistic markers of disorders, at different levels of the language (content, style, emotions), and further try to interpret the behavior of our models for a deeper understanding of mental disorder signs. We complement our prediction models with computational analyses grounded in theories from psychology related to cognitive styles and emotions, in order to understand to what extent it is possible to connect cognitive styles with the communication of emotions over time. The final goal is to distinguish between users diagnosed with a mental disorder and healthy users, in order to assist clinicians in diagnosing patients. We consider three different mental disorders, which we analyze separately and comparatively: depression, anorexia, and self-harm tendencies.The authors thank the EU-FEDER Comunitat Valenciana 2014- 2020 grant IDIFEDER/2018/025. The work of Paolo Rosso was in the framework of the research project PROMETEO/2019/121 (DeepPattern) by the Generalitat Valenciana.Uban, A.; Chulvi-Ferriols, MA.; Rosso, P. (2021). An emotion and cognitive based analysis of mental health disorders from social media data. Future Generation Computer Systems. 124:480-494. https://doi.org/10.1016/j.future.2021.05.032S48049412

Strategies to Harness the Transformers' Potential: UNSL at eRisk 2023

The CLEF eRisk Laboratory explores solutions to different tasks related to risk detection on the Internet. In the 2023 edition, Task 1 consisted of searching for symptoms of depression, the objective of which was to extract user writings according to their relevance to the BDI Questionnaire symptoms. Task 2 was related to the problem of early detection of pathological gambling risks, where the participants had to detect users at risk as quickly as possible. Finally, Task 3 consisted of estimating the severity levels of signs of eating disorders. Our research group participated in the first two tasks, proposing solutions based on Transformers. For Task 1, we applied different approaches that can be interesting in information retrieval tasks. Two proposals were based on the similarity of contextualized embedding vectors, and the other one was based on prompting, an attractive current technique of machine learning. For Task 2, we proposed three fine-tuned models followed by decision policy according to criteria defined by an early detection framework. One model presented extended vocabulary with important words to the addressed domain. In the last task, we obtained good performances considering the decision-based metrics, ranking-based metrics, and runtime. In this work, we explore different ways to deploy the predictive potential of Transformers in eRisk tasks.Comment: In Conference and Labs of the Evaluation Forum (CLEF 2023), Thessaloniki, Greec

Leveraging ChatGPT to optimize depression intervention through explainable deep learning

IntroductionMental health issues bring a heavy burden to individuals and societies around the world. Recently, the large language model ChatGPT has demonstrated potential in depression intervention. The primary objective of this study was to ascertain the viability of ChatGPT as a tool for aiding counselors in their interactions with patients while concurrently evaluating its comparability to human-generated content (HGC). MethodsWe propose a novel framework that integrates state-of-the-art AI technologies, including ChatGPT, BERT, and SHAP, to enhance the accuracy and effectiveness of mental health interventions. ChatGPT generates responses to user inquiries, which are then classified using BERT to ensure the reliability of the content. SHAP is subsequently employed to provide insights into the underlying semantic constructs of the AI-generated recommendations, enhancing the interpretability of the intervention. ResultsRemarkably, our proposed methodology consistently achieved an impressive accuracy rate of 93.76%. We discerned that ChatGPT always employs a polite and considerate tone in its responses. It refrains from using intricate or unconventional vocabulary and maintains an impersonal demeanor. These findings underscore the potential significance of AIGC as an invaluable complementary component in enhancing conventional intervention strategies.DiscussionThis study illuminates the considerable promise offered by the utilization of large language models in the realm of healthcare. It represents a pivotal step toward advancing the development of sophisticated healthcare systems capable of augmenting patient care and counseling practices

Mental health handbook for schools

As the government strives for a more inclusive education policy, more and more teachers find themselves in the frontline when dealing with children with mental health problems. Many have not had training in such matters and so feel unprepared and uncertain when faced with difficult situations. The Mental Health Handbook for Schools provides valuable information on a comprehensive range of mental health problems with which teachers are often confronted. Drawing on up-to-date research and practice in these areas the book considers what schools can do, within the special needs framework, to help pupils with these problems. It usefully reflects on the role of the mental health services in relation to schools and how schools can adopt a whole-school preventative approach to mental health problems. The authors address an extensive range of mental health problems including Attention Deficit/Hyperactivity Disorder, eating disorders, substance abuse, obsessive-compulsive disorders and schizophrenia. They also cover situations that can often lead to the development of mental health problems including bullying, divorce and marital conflict, bereavement and physical, sexual and emotional abuse

Exploring experiences of externalising and the anorexic voice

Part A This review synthesised literature exploring people with anorexia nervosa’s (PwAN's), carers' and clinicians' experiences of therapeutic externalisation. Relevant literature was discovered using a systematic search of online databases which found 18 papers that met inclusion criteria. Meta-ethnography was used to synthesise the literature. Findings highlighted stakeholders' contradictory views on the impact of externalisation on PwAN's relationships and sense of identity, indicating that this technique has the potential to help or harm PwAN's recovery. Ways of understanding these contradictory views and the need for clinicians to adapt externalising techniques were emphasised. Review limitations, clinical implications and future research needs are outlined. Part B This qualitative study explored carers’ perceptions of the anorexic voice (ANV). Thirteen participants were interviewed, and their transcripts interpreted using Reflexive Thematic Analysis. Findings revealed that the ANV holds many meanings, and the construct attracted advocates and critics among carers. Advocates recognised the ANV as a powerful bully and found they could bring positive changes by altering their relationship with it. Carers outlined benefits, shortcomings and criticisms of the ANV, which under scrutiny, revealed significant overlap with perspectives on externalising. These findings are outlined in the context of existing literature, and the limitations, clinical implications and future directions are illustrated

Attention and Social Cognition in Virtual Reality:The effect of engagement mode and character eye-gaze

Technical developments in virtual humans are manifest in modern character design. Specifically, eye gaze offers a significant aspect of such design. There is need to consider the contribution of participant control of engagement. In the current study, we manipulated participants’ engagement with an interactive virtual reality narrative called Coffee without Words. Participants sat over coffee opposite a character in a virtual café, where they waited for their bus to be repaired. We manipulated character eye-contact with the participant. For half the participants in each condition, the character made no eye-contact for the duration of the story. For the other half, the character responded to participant eye-gaze by making and holding eye contact in return. To explore how participant engagement interacted with this manipulation, half the participants in each condition were instructed to appraise their experience as an artefact (i.e., drawing attention to technical features), while the other half were introduced to the fictional character, the narrative, and the setting as though they were real. This study allowed us to explore the contributions of character features (interactivity through eye-gaze) and cognition (attention/engagement) to the participants’ perception of realism, feelings of presence, time duration, and the extent to which they engaged with the character and represented their mental states (Theory of Mind). Importantly it does so using a highly controlled yet ecologically valid virtual experience