SASSL: Enhancing Self-Supervised Learning via Neural Style Transfer

Existing data augmentation in self-supervised learning, while diverse, fails to preserve the inherent structure of natural images. This results in distorted augmented samples with compromised semantic information, ultimately impacting downstream performance. To overcome this, we propose SASSL: Style Augmentations for Self Supervised Learning, a novel augmentation technique based on Neural Style Transfer. SASSL decouples semantic and stylistic attributes in images and applies transformations exclusively to the style while preserving content, generating diverse samples that better retain semantics. Our technique boosts top-1 classification accuracy on ImageNet by up to 2$\%$ compared to established self-supervised methods like MoCo, SimCLR, and BYOL, while achieving superior transfer learning performance across various datasets

Augmentations vs Algorithms: What Works in Self-Supervised Learning

We study the relative effects of data augmentations, pretraining algorithms, and model architectures in Self-Supervised Learning (SSL). While the recent literature in this space leaves the impression that the pretraining algorithm is of critical importance to performance, understanding its effect is complicated by the difficulty in making objective and direct comparisons between methods. We propose a new framework which unifies many seemingly disparate SSL methods into a single shared template. Using this framework, we identify aspects in which methods differ and observe that in addition to changing the pretraining algorithm, many works also use new data augmentations or more powerful model architectures. We compare several popular SSL methods using our framework and find that many algorithmic additions, such as prediction networks or new losses, have a minor impact on downstream task performance (often less than $1\%$), while enhanced augmentation techniques offer more significant performance improvements ($2-4\%$). Our findings challenge the premise that SSL is being driven primarily by algorithmic improvements, and suggest instead a bitter lesson for SSL: that augmentation diversity and data / model scale are more critical contributors to recent advances in self-supervised learning.Comment: 18 pages, 1 figur

Moyo Vol. VIII N 2

Durica, Paul. Editor\u27s Letter . 4. Fisher, Dan. Heaven for Thunder (Thoughts on the Last Execution) . 5. Anshuman, Karan. Return to Sender (Mail-Order Brides Log-On Love) . 6. Grindstaff, Michelle. Madonna or Whore (Language Traps Female Sexuality) . 7. Thackeray, Alex. Strike Against the Right (Canada Collegians Take Action) . 8. Dotson, Dorothy. Tori Listening to Mullet Boy . 10. Stine, Alison. Tori Story (Secrets of a Toriphile: Good Girl Gets Plugged) . 11. Barret, Laura. Late Night Crush (Girl Crazy for Conan) . 15. Hankinson, Tom. Environmentally friendly, or Else (DURP tough on DU Junk) . 16. Bussan, David. Fantasy\u27s Island (Alums Find Paradise in Northern Cyprus) . 18. Burt, Kara. Innocents on Break (Students Exercise Alternatives in New York) . 21. Werne, Kirsten. Two Turntables and a Ten-Gallon Hat . 23. Million, Chris. Friendship a Modem Away, Sigh (AOL Alters Denison Social Scene) . 34

Sleep Apnea and Fetal Growth Restriction (SAFER) study: Protocol for a pragmatic randomised clinical trial of positive airway pressure as an antenatal therapy for fetal growth restriction in maternal obstructive sleep apnoea

INTRODUCTION: Fetal growth restriction (FGR) is a major contributor to fetal and neonatal morbidity and mortality with intrauterine, neonatal and lifelong complications. This study explores maternal obstructive sleep apnoea (OSA) as a potentially modifiable risk factor for FGR. We hypothesise that, in pregnancies complicated by FGR, treating mothers who have OSA using positive airway pressure (PAP) will improve birth weight and neonatal outcomes. METHODS AND ANALYSIS: The Sleep Apnea and Fetal Growth Restriction study is a prospective, block-randomised, single-blinded, multicentre, pragmatic controlled trial. We enrol pregnant women aged 18-50, between 22 and 31 weeks of gestation, with established FGR based on second trimester ultrasound, who do not have other prespecified known causes of FGR (such as congenital anomalies or intrauterine infection). In stage 1, participants are screened by questionnaire for OSA risk. If OSA risk is identified, participants proceed to stage 2, where they undergo home sleep apnoea testing. Participants are determined to have OSA if they have an apnoea-hypopnoea index (AHI) ≥5 (if the oxygen desaturation index (ODI) is also ≥5) or if they have an AHI ≥10 (even if the ODI is \u3c5). These participants proceed to stage 3, where they are randomised to nightly treatment with PAP or no PAP (standard care control), which is maintained until delivery. The primary outcome is unadjusted birth weight; secondary outcomes include fetal growth velocity on ultrasound, enrolment-to-delivery interval, gestational age at delivery, birth weight corrected for gestational age, stillbirth, Apgar score, rate of admission to higher levels of care (neonatal intensive care unit or special care nursery) and length of neonatal stay. These outcomes are compared between PAP and control using intention-to-treat analysis. ETHICS AND DISSEMINATION: This study has been approved by the Institutional Review Boards at Washington University in St Louis, Missouri; Hadassah Hebrew University Medical Center, Jerusalem; and the University of Rochester, New York. Recruitment began in Washington University in November 2019 but stopped from March to November 2020 due to COVID-19. Recruitment began in Hadassah Hebrew University in March 2021, and in the University of Rochester in May 2021. Dissemination plans include presentations at scientific conferences and scientific publications. TRIAL REGISTRATION NUMBER: NCT04084990

Mitochondrial Phenotypes in Purified Human Immune Cell Subtypes and Cell Mixtures

Using a high-throughput mitochondrial phenotyping platform to quantify multiple mitochondrial features among molecularly defined immune cell subtypes, we quantify the natural variation in mitochondrial DNA copy number (mtDNAcn), citrate synthase, and respiratory chain enzymatic activities in human neutrophils, monocytes, B cells, and naïve and memory T lymphocyte subtypes. In mixed peripheral blood mononuclear cells (PBMCs) from the same individuals, we show to what extent mitochondrial measures are confounded by both cell type distributions and contaminating platelets. Cell subtype-specific measures among women and men spanning four decades of life indicate potential age- and sex-related differences, including an age-related elevation in mtDNAcn, which are masked or blunted in mixed PBMCs. Finally, a proof-of-concept, repeated-measures study in a single individual validates cell type differences and also reveals week-to-week changes in mitochondrial activities. Larger studies are required to validate and mechanistically extend these findings. These mitochondrial phenotyping data build upon established immunometabolic differences among leukocyte subpopulations, and provide foundational quantitative knowledge to develop interpretable blood-based assays of mitochondrial health

Moyo Vol. VIII N 1

Durica, Paul Editor\u27s Letter . 4. Thackeray, Alex. Postcard from the sXe . 5. Ward, Luc. Gods & Monsters (Hook-Up at Church) . 6. Anshuman, Karan. The India Nobody Knows (Mysticism and Misconceptions Revealed) . 8. Clements, Nina and Betsy Falconer. God as One of Us: Diverse Faiths Thrive at Denison . 10. Million, Chris. Splendor in the Fall (First Year Love Bittersweet) . 16. Grindstaff, Michelle. Beer by Night, Bed by Morning . 17. Hart, Madeline and Meredith Newman. Smoke Alarm: Reading This may Cause Lung Cancer, Heart Disease, Emphysema, and Complicate Pregnancy . 21. Almirall, Sara and Kirsten Werne. 20 Best Spots to Smoke on Campus . 22. Werne, Kirsten. An Interview with Painted Thin . 23. Burt, Kara. All in All, We\u27re Just Paper o the Wall (Dorm Art Clue to Denison Identity) . 25. Levine, Robert. Less Talk, Moore Rock (Thurston\u27 Sound Uplifts Soul) . 30. Almirall, R.R. Turtles . 31. Almirall, RR. The Warthog Feels He Has Much in Common With Paul Newman, Others Don\u27t . 20

If, When, and How to Use Rifampin in Acute Staphylococcal Periprosthetic Joint Infections, a Multicentre Observational Study

Background: Rifampin is generally advised in the treatment of acute staphylococcal periprosthetic joint infections (PJI). However, if, when, and how to use rifampin remains a matter of debate. We evaluated the outcome of patients treated with and without rifampin, and analyzed the influence of timing, dose and co-antibiotic. Methods: Acute staphylococcal PJIs treated with surgical debridement between 1999 and 2017, and a minimal follow-up of 1 year were evaluated. Treatment failure was defined as the need for any further surgical procedure related to infection, PJI-related death or the need for suppressive antimicrobial treatment. Results: A total of 669 patients were analyzed. Treatment failure was 32.2% (131/407) in patients treated with rifampin and 54.2% (142/262) in whom rifampin was withheld (P < .001). The most prominent effect of rifampin was observed in knees (treatment failure 28.6% versus 63.9%, respectively, P < .001). The use of rifampin was an independent predictor of treatment success in the multi-variate analysis (OR 0.30, 95% CI 0.20 - 0.45). In the rifampin group, the use of a co-antibiotic other than a fluoroquinolone or clindamycin (OR 10.1, 95% CI 5.65 - 18.2) and the start of rifampin within 5 days after surgical debridement (OR 1.96, 95% CI 1.08 - 3.65) were predictors of treatment failure. The dosing of rifampin had no effect on outcome. Conclusions: Our data supports the use of rifampin in acute staphylococcal PJIs treated with surgical debridement, particularly in knees. Immediate start of rifampin after surgical debridement should probably be discouraged, but requires further investigation