Machine Learning Models that Remember Too Much

Machine learning (ML) is becoming a commodity. Numerous ML frameworks and services are available to data holders who are not ML experts but want to train predictive models on their data. It is important that ML models trained on sensitive inputs (e.g., personal images or documents) not leak too much information about the training data. We consider a malicious ML provider who supplies model-training code to the data holder, does not observe the training, but then obtains white- or black-box access to the resulting model. In this setting, we design and implement practical algorithms, some of them very similar to standard ML techniques such as regularization and data augmentation, that "memorize" information about the training dataset in the model yet the model is as accurate and predictive as a conventionally trained model. We then explain how the adversary can extract memorized information from the model. We evaluate our techniques on standard ML tasks for image classification (CIFAR10), face recognition (LFW and FaceScrub), and text analysis (20 Newsgroups and IMDB). In all cases, we show how our algorithms create models that have high predictive power yet allow accurate extraction of subsets of their training data

Advanced Technology Composite Fuselage: Program Overview

The Advanced Technology Composite Aircraft Structures (ATCAS) program has studied transport fuselage structure with a large potential reduction in the total direct operating costs for wide-body commercial transports. The baseline fuselage section was divided into four 'quadrants', crown, keel, and sides, gaining the manufacturing cost advantage possible with larger panels. Key processes found to have savings potential include (1) skins laminated by automatic fiber placement, (2) braided frames using resin transfer molding, and (3) panel bond technology that minimized mechanical fastening. The cost and weight of the baseline fuselage barrel was updated to complete Phase B of the program. An assessment of the former, which included labor, material, and tooling costs, was performed with the help of design cost models. Crown, keel, and side quadrant cost distributions illustrate the importance of panel design configuration, area, and other structural details. Composite sandwich panel designs were found to have the greatest cost savings potential for most quadrants. Key technical findings are summarized as an introduction to the other contractor reports documenting Phase A and B work completed in functional areas. The current program status in resolving critical technical issues is also highlighted

Association between amygdala reactivity and a dopamine transporter gene polymorphism

Essential for detection of relevant external stimuli and for fear processing, the amygdala is under modulatory influence of dopamine (DA). The DA transporter (DAT) is of fundamental importance for the regulation of DA transmission by mediating reuptake inactivation of extracellular DA. This study examined if a common functional variable number tandem repeat polymorphism in the 3′ untranslated region of the DAT gene (SLC6A3) influences amygdala function during the processing of aversive emotional stimuli. Amygdala reactivity was examined by comparing regional cerebral blood flow, measured with positron emission tomography and [15O]water, during exposure to angry and neutral faces, respectively, in a Swedish sample comprising 32 patients with social anxiety disorder and 17 healthy volunteers. In a separate US sample, comprising 85 healthy volunteers studied with blood oxygen level-dependent functional magnetic resonance imaging, amygdala reactivity was assessed by comparing the activity during exposure to threatening faces and neutral geometric shapes, respectively. In both the Swedish and the US sample, 9-repeat carriers displayed higher amygdala reactivity than 10-repeat homozygotes. The results suggest that this polymorphism contributes to individual variability in amygdala reactivity

Assessment of low-dose cisplatin as a model of nausea and emesis in beagle dogs, potential for repeated administration

Cisplatin is a highly emetogenic cancer chemotherapy agent, which is often used to induce nausea and emesis in animal models. The cytotoxic properties of cisplatin also cause adverse events that negatively impact on animal welfare preventing repeated administration of cisplatin. In this study, we assessed whether a low (subclinical) dose of cisplatin could be utilized as a model of nausea and emesis in the dog while decreasing the severity of adverse events to allow repeated administration. The emetic, nausea-like behavior and potential biomarker response to both the clinical dose (70 mg/m2) and low dose (15 mg/m2) of cisplatin was assessed. Plasma creatinine concentrations and granulocyte counts were used to assess adverse effects on the kidneys and bone marrow, respectively. Nausea-like behavior and emesis was induced by both doses of cisplatin, but the latency to onset was greater in the low-dose group. No significant change in plasma creatinine was detected for either dose groups. Granulocytes were significantly reduced compared with baseline (P = 0.000) following the clinical, but not the low-dose cisplatin group. Tolerability of repeated administration was assessed with 4 administrations of an 18 mg/m2 dose cisplatin. Plasma creatinine did not change significantly. Cumulative effects on the granulocytes occurred, they were significantly decreased (P = 0.03) from baseline at 3 weeks following cisplatin for the 4th administration only. Our results suggest that subclinical doses (15 and 18 mg/m2) of cisplatin induce nausea-like behavior and emesis but have reduced adverse effects compared with the clinical dose allowing for repeated administration in crossover studies

Elevated [11C]-D-Deprenyl Uptake in Chronic Whiplash Associated Disorder Suggests Persistent Musculoskeletal Inflammation

There are few diagnostic tools for chronic musculoskeletal pain as structural imaging methods seldom reveal pathological alterations. This is especially true for Whiplash Associated Disorder, for which physical signs of persistent injuries to the neck have yet to be established. Here, we sought to visualize inflammatory processes in the neck region by means Positron Emission Tomography using the tracer 11C-D-deprenyl, a potential marker for inflammation. Twenty-two patients with enduring pain after a rear impact car accident (Whiplash Associated Disorder grade II) and 14 healthy controls were investigated. Patients displayed significantly elevated tracer uptake in the neck, particularly in regions around the spineous process of the second cervical vertebra. This suggests that whiplash patients have signs of local persistent peripheral tissue inflammation, which may potentially serve as a diagnostic biomarker. The present investigation demonstrates that painful processes in the periphery can be objectively visualized and quantified with PET and that 11C-D-deprenyl is a promising tracer for these purposes

Neuroticism-related personality traits are related to symptom severity in patients with premenstrual dysphoric disorder and to the serotonin transporter gene-linked polymorphism 5-HTTPLPR

Neuroticism has been linked to a functional polymorphism in the serotonin transporter gene (5-HTTLPR), with short-allele carriers being overrepresented among high-scorers on neuroticism. Studies evaluating neuroticism-related personality traits in relation to the 5-HTTLPR polymorphism among patients with premenstrual dysphoric disorder (PMDD) and are lacking. The primary aim of this study was to evaluate the relationship between PMDD and neuroticism-related personality traits, and secondly, to relate the personality trait scores of PMDD patients to experienced symptom severity and to the 5-HTTLPR short allele. Thirty PMDD patients and 55 asymptomatic healthy controls were included in the study. The Swedish Universities Scale of Personality was used to evaluate personality traits. Genotype analyses were available in 27 PMDD patients and 18 healthy controls. Women with PMDD displayed higher levels of neuroticism-related personality traits (psychic trait anxiety, somatic trait anxiety, embitterment, stress susceptibility and mistrust) than healthy controls, and these effects were most prominent in women with more severe luteal phase symptoms. Furthermore, PMDD patients with at least one copy of the short allele of the 5-HTTLPR polymorphism scored higher on psychic trait anxiety and lack of assertiveness than PMDD patients who were homozygous for the long allele. PMDD patients who suffer from more severe luteal phase symptoms also display increased scores of neuroticism-related personality traits in comparison with healthy controls. Within the group of PMDD patients, differences in certain personality trait scores are associated with the short allele of the 5-HTTLPR polymorphism