Embedding structure matters: Comparing methods to adapt multilingual vocabularies to new languages

Pre-trained multilingual language models underpin a large portion of modern NLP tools outside of English. A strong baseline for specializing these models for specific languages is Language-Adaptive Pre-Training (LAPT). However, retaining a large cross-lingual vocabulary and embedding matrix comes at considerable excess computational cost during adaptation. In this study, we propose several simple techniques to replace a cross-lingual vocabulary with a compact, language-specific one. Namely, we address strategies for re-initializing the token embedding matrix after vocabulary specialization. We then provide a systematic experimental comparison of our techniques, in addition to the recently-proposed Focus method. We demonstrate that: 1) Embedding-replacement techniques in the monolingual transfer literature are inadequate for adapting multilingual models. 2) Replacing cross-lingual vocabularies with smaller specialized ones provides an efficient method to improve performance in low-resource languages. 3) Simple embedding re-initialization techniques based on script-wise sub-distributions rival techniques such as Focus, which rely on similarity scores obtained from an auxiliary model

Learning to translate by learning to communicate

We formulate and test a technique to use Emergent Communication (EC) with a pretrained multilingual model to improve on modern Unsupervised NMT systems, especially for low-resource languages. It has been argued that the currently dominant paradigm in NLP of pretraining on text-only corpora will not yield robust natural language understanding systems, and the need for grounded, goal-oriented, and interactive language learning has been highlighted. In our approach, we embed a modern multilingual model (mBART, Liu et. al. 2020) into an EC image-reference game, in which the model is incentivized to use multilingual generations to accomplish a vision-grounded task, with the hypothesis that this will align multiple languages to a shared task space. We present two variants of EC Fine-Tuning (Steinert-Threlkeld et. al. 2022), one of which outperforms a backtranslation-based baseline in 6/8 translation settings, and proves especially beneficial for the very low-resource languages of Nepali and Sinhala

Understanding the Political Ideology of Legislators from Social Media Images

In this paper, we seek to understand how politicians use images to express ideological rhetoric through Facebook images posted by members of the U.S. House and Senate. In the era of social media, politics has become saturated with imagery, a potent and emotionally salient form of political rhetoric which has been used by politicians and political organizations to influence public sentiment and voting behavior for well over a century. To date, however, little is known about how images are used as political rhetoric. Using deep learning techniques to automatically predict Republican or Democratic party affiliation solely from the Facebook photographs of the members of the 114th U.S. Congress, we demonstrate that predicted class probabilities from our model function as an accurate proxy of the political ideology of images along a left-right (liberal-conservative) dimension. After controlling for the gender and race of politicians, our method achieves an accuracy of 59.28% from single photographs and 82.35% when aggregating scores from multiple photographs (up to 150) of the same person. To better understand image content distinguishing liberal from conservative images, we also perform in-depth content analyses of the photographs. Our findings suggest that conservatives tend to use more images supporting status quo political institutions and hierarchy maintenance, featuring individuals from dominant social groups, and displaying greater happiness than liberals.Comment: To appear in the Proceedings of International AAAI Conference on Web and Social Media (ICWSM 2020

Developmental learning impairments in a rodent model of nodular heterotopia

Developmental malformations of neocortex—including microgyria, ectopias, and periventricular nodular heterotopia (PNH)—have been associated with language learning impairments in humans. Studies also show that developmental language impairments are frequently associated with deficits in processing rapid acoustic stimuli, and rodent models have linked cortical developmental disruption (microgyria, ectopia) with rapid auditory processing deficits. We sought to extend this neurodevelopmental model to evaluate the effects of embryonic (E) day 15 exposure to the anti-mitotic teratogen methylazoxymethanol acetate (MAM) on auditory processing and maze learning in rats. Extensive cortical anomalies were confirmed in MAM-treated rats post mortem. These included evidence of laminar disruption, PNH, and hippocampal dysplasia. Juvenile auditory testing (P21–42) revealed comparable silent gap detection performance for MAM-treated and control subjects, indicating normal hearing and basic auditory temporal processing in MAM subjects. Juvenile testing on a more complex two-tone oddball task, however, revealed a significant impairment in MAM-treated as compared to control subjects. Post hoc analysis also revealed a significant effect of PNH severity for MAM subjects, with more severe disruption associated with greater processing impairments. In adulthood (P60–100), only MAM subjects with the most severe PNH condition showed deficits in oddball two-tone processing as compared to controls. However, when presented with a more complex and novel FM sweep detection task, all MAM subjects showed significant processing deficits as compared to controls. Moreover, post hoc analysis revealed a significant effect of PNH severity on FM sweep processing. Water Maze testing results also showed a significant impairment for spatial but not non-spatial learning in MAM rats as compared to controls. Results lend further support to the notions that: (1) generalized cortical developmental disruption (stemming from injury, genetic or teratogenic insults) leads to auditory processing deficits, which in turn have been suggested to play a causal role in language impairment; (2) severity of cortical disruption is related to the severity of processing impairments; (3) juvenile auditory processing deficits appear to ameliorate with maturation, but can still be elicited in adulthood using increasingly complex acoustic stimuli; and (4) malformations induced with MAM are also associated with generalized spatial learning deficits. These cumulative findings contribute to our understanding of the behavioral consequences of cortical developmental pathology, which may in turn elucidate mechanisms contributing to developmental language learning impairment in humans

Multi-level evidence of an allelic hierarchy of USH2A variants in hearing, auditory processing and speech/language outcomes.

Language development builds upon a complex network of interacting subservient systems. It therefore follows that variations in, and subclinical disruptions of, these systems may have secondary effects on emergent language. In this paper, we consider the relationship between genetic variants, hearing, auditory processing and language development. We employ whole genome sequencing in a discovery family to target association and gene x environment interaction analyses in two large population cohorts; the Avon Longitudinal Study of Parents and Children (ALSPAC) and UK10K. These investigations indicate that USH2A variants are associated with altered low-frequency sound perception which, in turn, increases the risk of developmental language disorder. We further show that Ush2a heterozygote mice have low-level hearing impairments, persistent higher-order acoustic processing deficits and altered vocalizations. These findings provide new insights into the complexity of genetic mechanisms serving language development and disorders and the relationships between developmental auditory and neural systems

‘This restless enemy of all fertility’: exploring paradigms of coastal dune management in Western Europe over the last 700 years

Drifting sand has inundated settlements and damaged agricultural land along the coasts of Western Europe for the last 700 years. The need to control sand migration has been an important driver of the management of coastal sand dunes and here we analyse original archival materials to provide new insights into historically changing coastal dune management practices. Records of coastal sand movement in Denmark, The Netherlands, Britain, Ireland and France were reviewed and three distinct management approaches were identified. The ways in which these approaches have played out in space and time were examined with particular reference to records from landed estates in Britain and Ireland. We demonstrate how historical evidence can be used to inform contemporary debates on dune management strategy and practice. We propose a new place-based approach to the future management of coastal dunes that can incorporate both expert and locally produced ‘knowledges’ and that is underpinned by an understanding of how both natural forces and human interventions have shaped these dune landscapes over time

Backward walking training improves balance in school-aged boys

<p>Abstract</p> <p>Background</p> <p>Falls remain a major cause of childhood morbidity and mortality. It is suggested that backward walking (BW) may offer some benefits especially in balance and motor control ability beyond those experienced through forward walking (FW), and may be a potential intervention for prevention of falls. The objective of this study was to investigate the effects of BW on balance in boys.</p> <p>Methods</p> <p>Sixteen healthy boys (age: 7.19 ± 0.40 y) were randomly assigned to either an experimental or a control group. The experimental group participated in a BW training program (12-week, 2 times weekly, and 25-min each time) but not the control group. Both groups had five dynamic balance assessments with a Biodex Stability System (anterior/posterior, medial/lateral, and overall balance index) before, during and after the training (week- 0, 4, 8, 12, 24). Six control and six experimental boys participated in a study comparing kinematics of lower limbs between FW and BW after the training (week-12).</p> <p>Results</p> <p>The balance of experimental group was better than that of control group after 8 weeks of training (<it>P </it>< 0.01), and was still better than that of control group (<it>P </it>< 0.05), when the BW training program had finished for 12 weeks. The kinematic analysis indicated that there was no difference between control and experimental groups in the kinematics of both FW and BW gaits after the BW training (<it>P </it>> 0.05). Compared to FW, the duration of stance phase of BW tended to be longer, while the swing phase, stride length, walking speed, and moving ranges of the thigh, calf and foot of BW decreased (<it>P </it>< 0.01).</p> <p>Conclusion</p> <p>Backward walking training in school-aged boys can improve balance.</p

Overthrowing the dictator: a game-theoretic approach to revolutions and media

A distinctive feature of recent revolutions was the key role of social media (e.g. Facebook, Twitter and YouTube). In this paper, we study its role in mobilization. We assume that social media allow potential participants to observe the individual participation decisions of others, while traditional mass media allow potential participants to see only the total number of people who participated before them. We show that when individuals’ willingness to revolt is publicly known, then both sorts of media foster a successful revolution. However, when willingness to revolt is private information, only social media ensure that a revolt succeeds, with mass media multiple outcomes are possible, one of which has individuals not participating in the revolt. This suggests that social media enhance the likelihood that a revolution triumphs more than traditional mass media