173 research outputs found

    MPCFormer: fast, performant and private Transformer inference with MPC

    Full text link
    Enabling private inference is crucial for many cloud inference services that are based on Transformer models. However, existing private inference solutions for Transformers can increase the inference latency by more than 60x or significantly compromise the quality of inference results. In this paper, we design the framework MPCFORMER using secure multi-party computation (MPC) and Knowledge Distillation (KD). It can be used in tandem with many specifically designed MPC-friendly approximations and trained Transformer models. MPCFORMER significantly speeds up Transformer model inference in MPC settings while achieving similar ML performance to the input model. We evaluate MPCFORMER with various settings in MPC. On the IMDb dataset, we achieve similar performance to BERTBASE, while being 5.3x faster. On the GLUE benchmark, we achieve 97% performance of BERTBASE with a 2.2x speedup. We show that MPCFORMER remains effective with different trained Transformer weights such as ROBERTABASE and larger models including BERTLarge. In particular, we achieve similar performance to BERTLARGE, while being 5.93x faster on the IMDb dataset

    Microstructural Evolution in Chroming Coatings Friction Pairs under Dry Sliding Test Conditions

    Get PDF
    The microstructures of subsurface layers of 20CrMnTi steel pins against chroming and nonchroming T10 under dry sliding tests were studied by means of OM (optical microscopy), XRD (X-ray diffraction), and SEM (scanning electron microscopy). Results showed that the chroming coating strengthened the disc surface and significantly affected microstructural evolution. Three layers—the matrix, deformation layer (DL), and surface layer (SL)—formed in 20CrMnTi for the chroming T10. The matrix and deformation layer (DL) formed in 20CrMnTi for the nonchroming T10. The formation of the microstructure was considered as a result of the shear deformation

    Horizontal animation deformity as unusual complication of neurotoxin modulation of the gummy smile

    Get PDF
    Injections  of  botulinum  toxin  type  A  represent  the  most    common    nonsurgical    cosmetic    treatment    worldwide.  The  authors  report  a  case  of  dynamic  horizontal  wrinkling  in  the  upper  lip  that  appeared  after   botulinum   toxin   type   A   injections   to   treat   gummy    smile    associated    with    nasal    alar    base    reduction,  in  a  28-year-old  woman.  The  anatomic  features and pathogenic mechanism underlying this unusual complication are analyzed and discussed.</p

    Masonry shell structures with discrete equivalence classes

    Get PDF
    This paper proposes a method to model masonry shell structures where the shell elements fall into a set of discrete equivalence classes. Such shell structure can reduce the fabrication cost and simplify the physical construction due to reuse of a few template shell elements. Given a freeform surface, our goal is to generate a small set of template shell elements that can be reused to produce a seamless and buildable structure that closely resembles the surface. The major technical challenge in this process is balancing the desire for high reusability of template elements with the need for a seamless and buildable final structure. To address the challenge, we define three error metrics to measure the seamlessness and buildability of shell structures made from discrete equivalence classes and develop a hierarchical cluster-and-optimize approach to generate a small set of template elements that produce a structure closely approximating the surface with low error metrics. We demonstrate the feasibility of our approach on various freeform surfaces and geometric patterns, and validate buildability of our results with four physical prototypes. Code and data of this paper are at https://github.com/Linsanity81/TileableShell
    corecore