The Zwicky Transient Facility Alert Distribution System

The Zwicky Transient Facility (ZTF) survey generates real-time alerts for optical transients, variables, and moving objects discovered in its wide-field survey. We describe the ZTF alert stream distribution and processing (filtering) system. The system uses existing open-source technologies developed in industry: Kafka, a real-time streaming platform, and Avro, a binary serialization format. The technologies used in this system provide a number of advantages for the ZTF use case, including (1) built-in replication, scalability, and stream rewind for the distribution mechanism; (2) structured messages with strictly enforced schemas and dynamic typing for fast parsing; and (3) a Python-based stream processing interface that is similar to batch for a familiar and user-friendly plug-in filter system, all in a modular, primarily containerized system. The production deployment has successfully supported streaming up to 1.2 million alerts or roughly 70 GB of data per night, with each alert available to a consumer within about 10 s of alert candidate production. Data transfer rates of about 80,000 alerts/minute have been observed. In this paper, we discuss this alert distribution and processing system, the design motivations for the technology choices for the framework, performance in production, and how this system may be generally suitable for other alert stream use cases, including the upcoming Large Synoptic Survey Telescope.Comment: Published in PASP Focus Issue on the Zwicky Transient Facility (doi: 10.1088/1538-3873/aae904). 9 Pages, 2 Figure

Cataclysmic Variables in the First Year of the Zwicky Transient Facility

Using selection criteria based on amplitude, time, and color, we have identified 329 objects as known or candidate cataclysmic variables (CVs) during the first year of testing and operation of the Zwicky Transient Facility. Of these, 90 are previously confirmed CVs, 218 are strong candidates based on the shape and color of their light curves obtained during 3–562 days of observation, and the remaining 21 are possible CVs but with too few data points to be listed as good candidates. Almost half of the strong candidates are within 10 deg of the galactic plane, in contrast to most other large surveys that have avoided crowded fields. The available Gaia parallaxes are consistent with sampling the low mass transfer CVs, as predicted by population models. Our follow-up spectra have confirmed Balmer/helium emission lines in 27 objects, with four showing high-excitation He ii emission, including candidates for an AM CVn, a polar, and an intermediate polar. Our results demonstrate that a complete survey of the Galactic plane is needed to accomplish an accurate determination of the number of CVs existing in the Milky Way

The Zwicky Transient Facility Alert Distribution System

The Zwicky Transient Facility (ZTF) survey generates real-time alerts for optical transients, variables, and moving objects discovered in its wide-field survey. We describe the ZTF alert stream distribution and processing (filtering) system. The system uses existing open-source technologies developed in industry: Kafka, a real-time streaming platform, and Avro, a binary serialization format. The technologies used in this system provide a number of advantages for the ZTF use case, including (1) built-in replication, scalability, and stream rewind for the distribution mechanism; (2) structured messages with strictly enforced schemas and dynamic typing for fast parsing; and (3) a Python-based stream processing interface that is similar to batch for a familiar and user-friendly plug-in filter system, all in a modular, primarily containerized system. The production deployment has successfully supported streaming up to 1.2 million alerts or roughly 70 GB of data per night, with each alert available to a consumer within about 10 s of alert candidate production. Data transfer rates of about 80,000 alerts/minute have been observed. In this paper, we discuss this alert distribution and processing system, the design motivations for the technology choices for the framework, performance in production, and how this system may be generally suitable for other alert stream use cases, including the upcoming Large Synoptic Survey Telescope

Cataclysmic Variables in the First Year of the Zwicky Transient Facility

Using selection criteria based on amplitude, time, and color, we have identified 329 objects as known or candidate cataclysmic variables (CVs) during the first year of testing and operation of the Zwicky Transient Facility. Of these, 90 are previously confirmed CVs, 218 are strong candidates based on the shape and color of their light curves obtained during 3–562 days of observation, and the remaining 21 are possible CVs but with too few data points to be listed as good candidates. Almost half of the strong candidates are within 10 deg of the galactic plane, in contrast to most other large surveys that have avoided crowded fields. The available Gaia parallaxes are consistent with sampling the low mass transfer CVs, as predicted by population models. Our follow-up spectra have confirmed Balmer/helium emission lines in 27 objects, with four showing high-excitation He ii emission, including candidates for an AM CVn, a polar, and an intermediate polar. Our results demonstrate that a complete survey of the Galactic plane is needed to accomplish an accurate determination of the number of CVs existing in the Milky Way

Impact of HIV on Cell Survival and Antiviral Activity of Plasmacytoid Dendritic Cells

Plasmacytoid dendritic cells (pDCs) are important mediators of innate immunity that act mainly through secretion of interferon (IFN)-α. Previous studies have found that these cells can suppress HIV in vitro; additionally, pDCs have been shown to be severely reduced in the peripheral blood of HIV-infected individuals. In the present study, we sought to determine the ability of pDCs to directly suppress viral replication ex vivo and to delineate the potential mechanisms whereby pDCs are depleted in HIV-infected individuals. We demonstrate that activated pDCs strongly suppress HIV replication in autologous CD4(+) T cells via a mechanism involving IFN-α as well as other antiviral factors. Of note, unstimulated pDCs from infected individuals who maintain low levels of plasma viremia without antiretroviral therapy were able to suppress HIV ex vivo via a mechanism requiring cell-to-cell contact. Our data also demonstrate that death of pDCs by both apoptosis and necrosis is induced by fusion of HIV with pDCs. Taken together, our data suggest that pDCs play an important role in the control of HIV replication and that high levels of viral replication in vivo are associated with pDC cell death via apoptosis and necrosis. Elucidation of the mechanism by which pDCs suppress HIV replication in vivo may have clinically relevant implications for future therapeutic strategies

Prospective functional classification of all possible missense variants in PPARG.

Clinical exome sequencing routinely identifies missense variants in disease-related genes, but functional characterization is rarely undertaken, leading to diagnostic uncertainty. For example, mutations in PPARG cause Mendelian lipodystrophy and increase risk of type 2 diabetes (T2D). Although approximately 1 in 500 people harbor missense variants in PPARG, most are of unknown consequence. To prospectively characterize PPARγ variants, we used highly parallel oligonucleotide synthesis to construct a library encoding all 9,595 possible single-amino acid substitutions. We developed a pooled functional assay in human macrophages, experimentally evaluated all protein variants, and used the experimental data to train a variant classifier by supervised machine learning. When applied to 55 new missense variants identified in population-based and clinical sequencing, the classifier annotated 6 variants as pathogenic; these were subsequently validated by single-variant assays. Saturation mutagenesis and prospective experimental characterization can support immediate diagnostic interpretation of newly discovered missense variants in disease-related genes.This work was supported by grants from the National Institute of Diabetes and Digestive and Kidney Diseases (1K08DK102877-01, to A.R.M.; 1R01DK097768-01, to D.A.), NIH/Harvard Catalyst (1KL2TR001100-01, to A.R.M.), the Broad Institute (SPARC award, to A.R.M. and T.M.), and the Wellcome Trust (095564, to K.C.; 107064, to D.B.S.).This is the author accepted manuscript. The final version is available from Nature Publishing Group via http://dx.doi.org/10.1038/ng.370

Family Influences on the Long Term Post-Disaster Recovery of Puerto Rican Youth

This study focused on characteristics of the family environment that may mediate the relationship between disaster exposure and the presence of symptoms that met DSM-IV diagnostic criteria for symptom count and duration for an internalizing disorder in children and youth. We also explored how parental history of mental health problems may moderate this meditational model. Approximately 18 months after Hurricane Georges hit Puerto Rico in 1998, participants were randomly selected based on a probability household sample using 1990 US Census block groups. Caregivers and children (N=1,886 dyads) were interviewed with the Diagnostic Interview Schedule for Children and other questionnaires in Spanish. Areas of the family environment assessed include parent-child relationship quality, parent-child involvement, parental monitoring, discipline, parents’ relationship quality and parental mental health. SEM models were estimated for parents and children, and by age group. For children (4–10 years old), parenting variables were related to internalizing psychopathology, but did not mediate the exposure-psychopathology relationship. Exposure had a direct relationship to internalizing psychopathology. For youth (11–17 years old), some parenting variables attenuated the relation between exposure and internalizing psychopathology. Family environment factors may play a mediational role in psychopathology post-disaster among youth, compared to an additive role for children. Hurricane exposure had a significant relation to family environment for families without parental history of mental health problems, but no influence for families with a parental history of mental health problems