Intriguing Properties of Compression on Multilingual Models

Multilingual models are often particularly dependent on scaling to generalize to a growing number of languages. Compression techniques are widely relied upon to reconcile the growth in model size with real world resource constraints, but compression can have a disparate effect on model performance for low-resource languages. It is thus crucial to understand the trade-offs between scale, multilingualism, and compression. In this work, we propose an experimental framework to characterize the impact of sparsifying multilingual pre-trained language models during fine-tuning. Applying this framework to mBERT named entity recognition models across 40 languages, we find that compression confers several intriguing and previously unknown generalization properties. In contrast to prior findings, we find that compression may improve model robustness over dense models. We additionally observe that under certain sparsification regimes compression may aid, rather than disproportionately impact the performance of low-resource languages.Comment: Accepted to EMNLP 202

Pupil shape as viewed along the horizontal visual field

All articles in this issue are also free to read on the journal website. Purpose: Changes in pupil size and shape are relevant for peripheral imagery by affecting aberrations and how much light enters and/or exits the eye. The purpose of this study is to model the pattern of pupil shape across the complete horizontal visual field and to show how the pattern is influenced by refractive error. Methods: Right eyes of thirty participants were dilated with 1% cyclopentolate and images were captured using a modified COAS-HD aberrometer alignment camera along the horizontal visual field to ±90°. A two lens relay system enabled fixation at targets mounted on the wall 3m from the eye. Participants placed their heads on a rotatable chin rest and eye rotations were kept to less than 30°. Best-fit elliptical dimensions of pupils were determined. Ratios of minimum to maximum axis diameters were plotted against visual field angle. Results: Participants’ data were well fitted by cosine functions, with maxima at (–)1° to (–)9° in the temporal visual field and widths 9% to 15% greater than predicted by the cosine of the field angle . Mean functions were 0.99cos[( + 5.3)/1.121], R2 0.99 for the whole group and 0.99cos[( + 6.2)/1.126], R2 0.99 for the 13 emmetropes. The function peak became less temporal, and the width became smaller, with increase in myopia. Conclusion: Off-axis pupil shape changes are well described by a cosine function which is both decentered by a few degrees and flatter by about 12% than the cosine of the viewing angle, with minor influences of refraction

Influences of luminance and accommodation stimuli on pupil size and pupil center location

PURPOSE. \ud To investigate effects of luminance and accommodation stimuli on pupil size and pupil center location and their implications for progressive addition lens wear.\ud \ud METHODS. \ud Participants were young and older adult groups (n=20, 22±2 years, age range 18-25 years; n=19, 49±4 years, 45-58 years). A wave aberrometer included a relay system to allow a 12.5°x11° background for the internal fixation target. Participants viewed the target under a matrix of conditions with luminance levels 0.01, 3.7, 120 and 6100 cd/m² and with accommodation stimuli up to 6 diopters in 2 diopter steps. Pupil sizes and their centers, relative to limbus centers, were determined from anterior eye images.\ud \ud RESULTS. \ud With luminance increase, reduction in pupil size was accentuated by increase in accommodation stimulus in the young, but not in the older, group. As luminance increased, pupil center location altered. This was nasally in both groups with an average shift of approximately 0.12mm. Relative to the lowest stimulus condition, the mean of the maximum absolute pupil center shifts was 0.26±0.08mm for both groups with individual shifts up to 0.5mm, findings consistent with previous studies. There was no significant effect of accommodation on pupil center locations for either age group, or evidence that location was influenced by the combination of luminance and accommodation stimulus that resulted in any particular pupil size.\ud \ud CONCLUSIONS. \ud Variations in luminance and accommodation influence pupil size, but only the former affects pupil center location significantly. Pupil center shifts are too small to be of concern in fitting progressive addition lenses

Of two minds or one? A registered replication of Rydell et al. (2006)

Evaluative conditioning (EC) is proposed as a mechanism of automatic preference acquisition in dual-process theories of attitudes (Gawronski, B., & Bodenhausen, G. V. (2006). Associative and propositional processes in evaluation: An integrative review of implicit and explicit attitude change. Psychological Bulletin, 132(5), 692-731. doi:). Evidence for the automaticity of EC comes from studies claiming EC effects for subliminally presented stimuli. An impression-formation study showed a selective influence of briefly presented primes on implicitly measured attitudes, whereas supraliminally presented behavioural information about the target person was reflected in explicit ratings (Rydell, R. J., McConnell, A. R., Mackie, D. M., & Strain, L. M. (2006). Of two minds forming and changing valence-inconsistent implicit and explicit attitudes. Psychological Science, 17(11), 954-958. doi:10.1111/j.1467-9280.2006.01811.x) This finding is considered one of the strongest pieces of evidence for dual process theories (Sweldens, S., Corneille, O., & Yzerbyt, V. (2014). The role of awareness in attitude formation through evaluative conditioning. Personality and Social Psychology Review, 18(2), 187-209. doi:), and it is therefore crucial to assess its reliability and robustness. The present study presents two registered replications of the Rydell et al. (2006) study. In contrast to the original findings, the implicit measures did not reflect the valence of the subliminal primes in both studies

Migrationspolitik im Bundestagswahlkampf 2017 – die Kluft zwischen Entscheidungs- und Darstellungspolitik

MIGRATIONSPOLITIK IM BUNDESTAGSWAHLKAMPF 2017 – DIE KLUFT ZWISCHEN ENTSCHEIDUNGS- UND DARSTELLUNGSPOLITIK Migrationspolitik im Bundestagswahlkampf 2017 – die Kluft zwischen Entscheidungs- und Darstellungspolitik / Blätte, Andreas (Rights reserved) ( -