Convolutions in Overdrive: Maliciously Secure Convolutions for MPC

Machine learning (ML) has seen a strong rise in popularity in recent years and has become an essential tool for research and industrial applications. Given the large amount of high quality data needed and the often sensitive nature of ML data, privacy-preserving collaborative ML is of increasing importance. In this paper, we introduce new actively secure multiparty computation (MPC) protocols which are specially optimized for privacy-preserving machine learning applications. We concentrate on the optimization of (tensor) convolutions which belong to the most commonly used components in ML architectures, especially in convolutional neural networks but also in recurrent neural networks or transformers, and therefore have a major impact on the overall performance. Our approach is based on a generalized form of structured randomness that speeds up convolutions in a fast online phase. The structured randomness is generated with homomorphic encryption using adapted and newly constructed packing methods for convolutions, which might be of independent interest. Overall our protocols extend the state-of-the-art Overdrive family of protocols (Keller et al., EUROCRYPT 2018). We implemented our protocols on-top of MP-SPDZ (Keller, CCS 2020) resulting in a full-featured implementation with support for faster convolutions. Our evaluation shows that our protocols outperform state-of-the-art actively secure MPC protocols on ML tasks like evaluating ResNet50 by a factor of 3 or more. Benchmarks for depthwise convolutions show order-of-magnitude speed-ups compared to existing approaches

Multipars: Reduced-Communication MPC over Z2k

In recent years, actively secure SPDZ-like protocols for dishonest majority, like SPD$\mathbb Z_{2^k}$, Overdrive2k, and MHz2k, over base rings $\mathbb Z_{2^k}$ have become more and more efficient. In this paper, we present a new actively secure MPC protocol Multipars that outperforms these state-of-the-art protocols over $\mathbb Z_{2^k}$ by more than a factor of 2 in the two-party setup in terms of communication. Multipars is the first actively secure N-party protocol over $\mathbb Z_{2^k}$ that is based on linear homomorphic encryption (LHE) in the offline phase (instead of oblivious transfer or somewhat homomorphic encryption in previous works). The strong performance of Multipars relies on a new adaptive packing for BGV ciphertexts that allows us to reduce the parameter size of the encryption scheme and the overall communication cost. Additionally, we use modulus switching for further size reduction, a new type of enhanced CPA security over $\mathbb Z_{2^k}$, a truncation protocol for Beaver triples, and a new LHE-based offline protocol without sacrificing over $\mathbb Z_{2^k}$. We have implemented Multipars and therewith provide the fastest preprocessing phase over $\mathbb Z_{2^k}$. Our evaluation shows that Multipars offers at least a factor of 8 lower communication costs and up to a factor of 15 faster runtime in the WAN setting compared to the currently best available actively secure MPC implementation over $\mathbb Z_{2^k}$

Overdrive LowGear 2.0: Reduced-Bandwidth MPC without Sacrifice

Some of the most efficient protocols for Multi-Party Computation (MPC) follow a two-phase approach where correlated randomness, in particular Beaver triples, is generated in the offline phase and then used to speed up the online phase. Recently, more complex correlations have been introduced to optimize certain operations even further, such as matrix triples for matrix multiplications. In this paper, our goal is to improve the efficiency of the triple generation in general and in particular for classical field values as well as matrix operations. To this end, we modify the Overdrive LowGear protocol to remove the costly sacrificing step and therewith reduce the round complexity and the bandwidth. We extend the state-of-the-art MP-SPDZ implementation with our new protocols and show that the new offline phase outperforms state-of-the-art protocols for the generation of Beaver triples and matrix triples. For example, we save 33 % in bandwidth compared to Overdrive LowGear

Compound-specific carbon and nitrogen isotopic compositions of chlorophyll a and its derivatives reveal the eutrophication history of Lake Zurich (Switzerland)

© 2016 Elsevier B.V. To reconstruct the impact of eutrophication on phototrophic communities and the biogeochemical cycling of carbon and nitrogen in the surface water, we investigated the distributions and carbon and nitrogen isotopic compositions (d13C and d15N values) of chlorins in the sediments of Lake Zurich. The chlorin distributions were dominated by chlorophyll a (Chl a) and its derivatives, which reflect rapid degradation to the pheopigments in the water column and sediments of the lake. The d13C values of these sedimentary chlorins followed the historical trends of eutrophication and reoligotrophication, except in the surface sediments, which were characterised by higher relative contributions of aged, redeposited organic matter (OM). The d13C values of the sedimentary chlorins together with bulk sediment d13C values and C/N ratios indicate that the phototrophic communities in the lake used a 13C-depleted carbon source, which is mainly of aquatic origin. The d15N values of chlorins reflect the predominance of nitrate assimilating phototrophs, especially the non-N2-fixing cyanobacterium Planktothrix rubescens prevalent during sediment deposition. Shifts in d15N values of Chl a followed mostly the trends in eutrophication and reoligotrophication, but were also affected by community assemblage shifts to diatoms and/or other cyanobacteria at the end of the 19th century and during the eutrophication maximum in the 1970s.The lower d15NChl-a values in the surface sediments coincide with increasing nitrogen to phosphorus ratios and reduced water column mixing that characterise the recent reoligotrophication period and may explain the predominance of P. rubescens in Lake Zurich. In contrast, the higher contributions of laterally transported OM explains the large offset of d15N values of the pheopigments relative to Chl a, which is supported by the high radiocarbon age of the surface sediments

The Orchestration Stack: The Impossible Task of Designing Software for Unknown Future Post-CMOS Hardware

Future systems based on post-CMOS technologies will be wildly heterogeneous, with properties largely unknown today. This paper presents our design of a new hardware/software stack to address the challenge of preparing software development for such systems. It combines well-understood technologies from different areas, e.g., network-on-chips, capability operating systems, flexible programming models and model checking. We describe our approach and provide details on key technologies

Racial differences in systemic sclerosis disease presentation: a European Scleroderma Trials and Research group study

Objectives. Racial factors play a significant role in SSc. We evaluated differences in SSc presentations between white patients (WP), Asian patients (AP) and black patients (BP) and analysed the effects of geographical locations.Methods. SSc characteristics of patients from the EUSTAR cohort were cross-sectionally compared across racial groups using survival and multiple logistic regression analyses.Results. The study included 9162 WP, 341 AP and 181 BP. AP developed the first non-RP feature faster than WP but slower than BP. AP were less frequently anti-centromere (ACA; odds ratio (OR) = 0.4, P < 0.001) and more frequently anti-topoisomerase-I autoantibodies (ATA) positive (OR = 1.2, P = 0.068), while BP were less likely to be ACA and ATA positive than were WP [OR(ACA) = 0.3, P < 0.001; OR(ATA) = 0.5, P = 0.020]. AP had less often (OR = 0.7, P = 0.06) and BP more often (OR = 2.7, P < 0.001) diffuse skin involvement than had WP.AP and BP were more likely to have pulmonary hypertension [OR(AP) = 2.6, P < 0.001; OR(BP) = 2.7, P = 0.03 vs WP] and a reduced forced vital capacity [OR(AP) = 2.5, P < 0.001; OR(BP) = 2.4, P < 0.004] than were WP. AP more often had an impaired diffusing capacity of the lung than had BP and WP [OR(AP vs BP) = 1.9, P = 0.038; OR(AP vs WP) = 2.4, P < 0.001]. After RP onset, AP and BP had a higher hazard to die than had WP [hazard ratio (HR) (AP) = 1.6, P = 0.011; HR(BP) = 2.1, P < 0.001].Conclusion. Compared with WP, and mostly independent of geographical location, AP have a faster and earlier disease onset with high prevalences of ATA, pulmonary hypertension and forced vital capacity impairment and higher mortality. BP had the fastest disease onset, a high prevalence of diffuse skin involvement and nominally the highest mortality

Large expert-curated database for benchmarking document similarity detection in biomedical literature search

Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical research.Peer reviewe