Evaluation of large language models using an Indian language LGBTI+ lexicon

Large language models (LLMs) are typically evaluated on the basis of task-based benchmarks such as MMLU. Such benchmarks do not examine responsible behaviour of LLMs in specific contexts. This is particularly true in the LGBTI+ context where social stereotypes may result in variation in LGBTI+ terminology. Therefore, domain-specific lexicons or dictionaries may be useful as a representative list of words against which the LLM's behaviour needs to be evaluated. This paper presents a methodology for evaluation of LLMs using an LGBTI+ lexicon in Indian languages. The methodology consists of four steps: formulating NLP tasks relevant to the expected behaviour, creating prompts that test LLMs, using the LLMs to obtain the output and, finally, manually evaluating the results. Our qualitative analysis shows that the three LLMs we experiment on are unable to detect underlying hateful content. Similarly, we observe limitations in using machine translation as means to evaluate natural language understanding in languages other than English. The methodology presented in this paper can be useful for LGBTI+ lexicons in other languages as well as other domain-specific lexicons. The work done in this paper opens avenues for responsible behaviour of LLMs, as demonstrated in the context of prevalent social perception of the LGBTI+ community.Comment: Selected for publication in the AI Ethics Journal published by the Artificial Intelligence Robotics Ethics Society (AIRES

Social support relationships for sexual minority women in Mumbai, India: a photo elicitation interview study

Little research exists on women who do not identify as heterosexual in India. Social support for sexual minority women may protect against the effects of discrimination. An examination of significant social relationships may point to both strengths and weaknesses in this support. We aimed to understand relationship prioritisation and communication patterns associated with the social support of sexual minority women in Mumbai. In partnership with the Humsafar Trust, India’s oldest and largest sexual and gender minority-advocacy organisation, we conducted photo-elicitation interviews with 18 sexual minority women, using participants’ photographs to prompt dialogue about their social support. Intimate partners were a source of dependable support and many of those without relationships were seeking them. Participants’ extended networks included friends and family as well as less formal relationships of social support. Participants mediated their communication with particular social network members, which involved filtering information sexual identity, romantic interests, and personal aspirations, among others. The diverse relationships that sexual minority women have in their social support networks may be used to guide programmes to improve health outcomes

A multi-method study of health behaviours and perceived concerns of sexual minority females in Mumbai, India

Background: This multi-method study explores the perceived health status and health behaviours of sexual minority (i.e. self-identifying with a sexual identity label other than heterosexual) females (i.e. those assigned female at birth who may or may not identify as women) in Mumbai, India, a population whose health has been generally absent in scientific literature. Methods: Using community-based participatory research approaches, this study is a partnership with The Humsafar Trust (HST). HST is India’s oldest and largest LGBT-advocacy organisation. An online survey targeted towards sexual minority females was conducted (n = 49), with questions about sexual identity, perceived health and wellbeing, physical and mental healthcare access and experiences, and health behaviours (including substance use). Additionally, photo-elicitation interviews in which participants’ photos prompt interview discussion were conducted with 18 sexual minority females. Results: Sexual minority females face obstacles in health care, mostly related to acceptability and quality of care. Their use of preventative health screenings is low. Perceived mental health and experiences with care were less positive than that for physical health. Participants in photo-elicitation interviews described bodyweight issues and caretaking of family members in relation to physical health. Substance use functioned as both a protective and a risk factor for their health. Conclusion: Our findings point to a need for more resources for sexual minority females. Education on screening guidelines and screening access for sexual minority females would also assist these individuals in increasing their rates of preventative health

Geographic and behavioral differences associated with sexually transmitted infection prevalence among Indian men who have sex with men in Chennai and Mumbai

BACKGROUND: India has one of the largest numbers of men who have sex with men (MSM) globally, however, geographic data on sexually transmitted infection (STI) prevalence and associations with sexual behavior are limited. METHODS: Six-hundred-eight MSM in Chennai and Mumbai screening in for a behavioral trial and assessed bacterial STI (syphilis, chlamydia, gonorrhea), HIV, and past-month self-reported condomless anal sex (CAS). RESULTS: Mumbai (37.8%) had a greater prevalence of any STIs than Chennai (27.6%) (est=1.37, 95% CI:1.09,1.73). This pattern also emerged for gonorrhea and chlamydia separately but not syphilis. Conversely, Mumbai had lower CAS (M=2.2) compared to Chennai (M=14.0) (est=−11.8, 95% CI:−14.6,−9.1). The interaction of city by CAS on any STI prevalence (PR=2.09, 95% CI:1.45,3.01, p<.0001) revealed that in Chennai, higher CAS was not associated with STI prevalence, but in Mumbai it was (PR=2.49, 95% CI:1.65,3.76, p<.0001). DISCUSSION: Higher bacterial STIs but lower CAS in Mumbai versus Chennai, and the significant interaction of CAS with city on STIs suggests that either differences in disease burden or differences by city with respect to self-reported assessment of CAS. Regardless, the high prevalence rates of untreated STI and condomless sex among MSM suggests the need for additional prevention intervention efforts for MSM in urban India

Mental health, economic well-being and health care access amid the COVID-19 pandemic: a mixed methods study among urban men who have sex with men in India

Scant empirical research from Asia has addressed the impact of COVID-19 on sexual minority health. We aimed to explore and understand the impact of COVID-19 on income security, mental health, HIV risk and access to health services among men who have sex with men (MSM) in India. We conducted a concurrent mixed methods study from April to June 2020, including a cross-sectional survey and in-depth semi-structured interviews with MSM recruited from three non-governmental organisations providing HIV prevention services in Chandigarh, India. We examined the associations of sexual minority stressors (sexual stigma, internalised homonegativity), economic stressors, and stress due to social distancing, with depression and anxiety, HIV risk, and access to health services. Survey findings (n = 132) indicated that internalised homonegativity and stress related to social distancing were significantly associated with depressive and anxiety symptoms. Results also showed reduced access to condoms, HIV testing and counselling services. Qualitative findings (n = 10) highlighted adverse economic impacts of COVID-19, including loss of employment/wages and engaging in survival sex work, which contributed to psychological distress and HIV risk. The COVID-19 pandemic has resulted in considerable psychological and financial distress among low socioeconomic status MSM in India, including those involved in sex work – communities already marginalised in economic, family and healthcare sectors. Structural interventions to improve access to mental health and HIV services and decrease financial burden are critical to mitigate the impact of COVID-19

A scoping review of lesbian, gay, bisexual, transgender, queer, and intersex (LGBTQI+) people’s health in India

Amid incremental progress in establishing an enabling legal and policy environment for lesbian, gay, bisexual, transgender and queer-identified people, and people with intersex variations (LGBTQI+) in India, evidence gaps on LGBTQI+ health are of increasing concern. To that end, we conducted a scoping review to map and synthesize the current evidence base, identify research gaps, and provide recommendations for future research. We conducted a scoping review using the Joanna Briggs Institute methodology. We systematically searched 14 databases to identify peer-reviewed journal articles published in English language between January 1, 2010 and November 20, 2021, that reported empirical qualitative, quantitative or mixed methods data on LGBTQI+ people’s health in India. Out of 3,003 results in total, we identified 177 eligible articles; 62% used quantitative, 31% qualitative, and 7% mixed methods. The majority (55%) focused on gay and other men who have sex with men (MSM), 16% transgender women, and 14% both of these populations; 4% focused on lesbian and bisexual women, and 2% on transmasculine people. Overall, studies reported high prevalence of HIV and sexually transmitted infections; multilevel risk factors for HIV; high levels of mental health burden linked to stigma, discrimination, and violence victimization; and non-availability of gender-affirmative medical care in government hospitals. Few longitudinal studies and intervention studies were identified. Findings suggest that LGBTQI+ health research in India needs to move beyond the predominant focus on HIV, and gay men/MSM and transgender women, to include mental health and non-communicable diseases, and individuals across the LGBTQI+ spectrum. Future research should build on largely descriptive studies to include explanatory and intervention studies, beyond urban to rural sites, and examine healthcare and service needs among LGBTQI+ people across the life course. Increased Indian government funding for LGBTQI+ health research, including dedicated support and training for early career researchers, is crucial to building a comprehensive and sustainable evidence base to inform targeted health policies and programs moving forward

A scoping review of lesbian, gay, bisexual, transgender, queer, and intersex (LGBTQI+) people's health in India.

Amid incremental progress in establishing an enabling legal and policy environment for lesbian, gay, bisexual, transgender and queer-identified people, and people with intersex variations (LGBTQI+) in India, evidence gaps on LGBTQI+ health are of increasing concern. To that end, we conducted a scoping review to map and synthesize the current evidence base, identify research gaps, and provide recommendations for future research. We conducted a scoping review using the Joanna Briggs Institute methodology. We systematically searched 14 databases to identify peer-reviewed journal articles published in English language between January 1, 2010 and November 20, 2021, that reported empirical qualitative, quantitative or mixed methods data on LGBTQI+ people's health in India. Out of 3,003 results in total, we identified 177 eligible articles; 62% used quantitative, 31% qualitative, and 7% mixed methods. The majority (55%) focused on gay and other men who have sex with men (MSM), 16% transgender women, and 14% both of these populations; 4% focused on lesbian and bisexual women, and 2% on transmasculine people. Overall, studies reported high prevalence of HIV and sexually transmitted infections; multilevel risk factors for HIV; high levels of mental health burden linked to stigma, discrimination, and violence victimization; and non-availability of gender-affirmative medical care in government hospitals. Few longitudinal studies and intervention studies were identified. Findings suggest that LGBTQI+ health research in India needs to move beyond the predominant focus on HIV, and gay men/MSM and transgender women, to include mental health and non-communicable diseases, and individuals across the LGBTQI+ spectrum. Future research should build on largely descriptive studies to include explanatory and intervention studies, beyond urban to rural sites, and examine healthcare and service needs among LGBTQI+ people across the life course. Increased Indian government funding for LGBTQI+ health research, including dedicated support and training for early career researchers, is crucial to building a comprehensive and sustainable evidence base to inform targeted health policies and programs moving forward

Substance Use, Mental Health, HIV Testing, and Sexual Risk Behavior Among Men Who Have Sex With Men in the State of Maharashtra, India.

Among 433 men who have sex with men in Maharashtra, India who completed an online survey, 23% reported hazardous drinking, 12% illicit substance, and 9% polysubstance use. The overall prevalence of depression and intimate partner violence (IPV) were 58% and 56%, respectively. Participants engaging in hazardous drinking had more sexual partners and were less likely to be married to women. Participants reporting illicit substance use or polysubstance use were more likely to have been out, had more sexual partners, or experienced IPV. Those reporting illicit substance use were more likely to engage in condomless anal sex. Based on our findings, we suggest that public health interventions integrate HIV, substance use, and mental health services

Sexual identity and behavior in an online sample of Indian men who have sex with men

Indian men who have sex with men are disproportionately impacted by HIV. While prevention efforts to date have focused on men who visit drop-in centers or physical cruising sites, little is known about men who are meeting sexual partners on virtual platforms. This paper explores issues related to sexual identity and sexual behaviors in an online sample of men who identified as gay (n = 279) or bisexual (n = 123). There were significant differences in outedness between the two groups, with 48% of bisexually identified men reporting that they were out to "no one" and 82% stating that they present themselves as heterosexual to family and friends. Corresponding rates for gay-identified men were 15% and 41%, respectively (both p &lt; .001). Twenty-nine percent of bisexually identified men reported being married, compared to only 3% of the gay-identified men (p &lt; .001). Bisexually identified men were also more likely to report having exclusively insertive anal sex (49% vs 30% p &lt; .001), while gay-identified men were more likely to report exclusively receptive anal sex (41% vs 13% p &lt; .0001). Rates of unprotected anal sex (UAS) in the two groups were similar; however, married men were significantly more likely to report unprotected vaginal sex (76% vs 35%, p &lt; .012). Positive attitudes toward UAS and lower self-efficacy were associated with sexual risk in both groups; however, substance use was associated with sexual risk only among bisexually identified men. These findings show that a large proportion of Indian bisexually identified men lead closeted lives, especially in their interactions with friends and family, with the vast majority presenting as heterosexual. The lower condom use with wives may be due to societal pressures to have children. The results suggest that bisexually identified men may benefit from targeted programs and non-directive, non-judgmental individual or couples counseling which emphasizes condom use with both male and female partners

Harassment and Violence Among Men Who Have Sex with Men (MSM) and Hijras After Reinstatement of India’s “Sodomy Law”

On December 11, 2013, the Indian Supreme Court recriminalized non-peno-vaginal sex under Sec. 377 of the Indian Penal Code (IPC), overturning a 2009 ruling that deemed IPC Sec. 377 unconstitutional. Similar "sodomy laws" in other countries have been associated with increased violence, harassment, and other discrimination against men who have sex with men (MSM) and transgender women. However, few studies have looked at the effects of such a law in an Indian context. This study examined experiences of victimization among MSM and hijra/transgender women (MSM-H) in the State of Maharashtra using a mixed-method approach. Data came from a quantitative survey and qualitative focus groups and interviews from an HIV prevention study as well as qualitative media and case reports from a local MSM-H-serving community-based organization. MSM-H in Maharashtra reported experiencing a high frequency of harassment, violence, and extortion, particularly from male sex partners met online and police. IPC Sec. 377 was implicated across qualitative sources as creating a culture of protection for harassment against MSM-H by being used directly as a tool for harassment, hindering victims of harassment from seeking legal recourse, and adversely impacting HIV and healthcare services. The reinstated IPC Sec. 377 may directly and indirectly facilitate negative health outcomes among MSM-H. Health agencies and advocates should continue to monitor the impact of IPC Sec. 377, incorporate rights-based approaches to protect MSM-H identities while addressing their health and well-being, and explore avenues to initiate discussions with the government to work toward repealing the law