FPGA-accelerated machine learning inference as a service for particle physics computing

New heterogeneous computing paradigms on dedicated hardware with increased parallelization, such as Field Programmable Gate Arrays (FPGAs), offer exciting solutions with large potential gains. The growing applications of machine learning algorithms in particle physics for simulation, reconstruction, and analysis are naturally deployed on such platforms. We demonstrate that the acceleration of machine learning inference as a web service represents a heterogeneous computing solution for particle physics experiments that potentially requires minimal modification to the current computing model. As examples, we retrain the ResNet-50 convolutional neural network to demonstrate state-of-the-art performance for top quark jet tagging at the LHC and apply a ResNet-50 model with transfer learning for neutrino event classification. Using Project Brainwave by Microsoft to accelerate the ResNet-50 image classification model, we achieve average inference times of 60 (10) milliseconds with our experimental physics software framework using Brainwave as a cloud (edge or on-premises) service, representing an improvement by a factor of approximately 30 (175) in model inference latency over traditional CPU inference in current experimental hardware. A single FPGA service accessed by many CPUs achieves a throughput of 600--700 inferences per second using an image batch of one, comparable to large batch-size GPU throughput and significantly better than small batch-size GPU throughput. Deployed as an edge or cloud service for the particle physics computing model, coprocessor accelerators can have a higher duty cycle and are potentially much more cost-effective.Comment: 16 pages, 14 figures, 2 table

Tuning of Kilopixel Transition Edge Sensor Bolometer Arrays with a Digital Frequency Multiplexed Readout System

A digital frequency multiplexing (DfMUX) system has been developed and used to tune large arrays of transition edge sensor (TES) bolometers read out with SQUID arrays for mm-wavelength cosmology telescopes. The DfMUX system multiplexes the input bias voltages and output currents for several bolometers on a single set of cryogenic wires. Multiplexing reduces the heat load on the camera's sub-Kelvin cryogenic detector stage. In this paper we describe the algorithms and software used to set up and optimize the operation of the bolometric camera. The algorithms are implemented on soft processors embedded within FPGA devices operating on each backend readout board. The result is a fully parallelized implementation for which the setup time is independent of the array size.Comment: 5 pages, 4 figure

Evaluation of Single-Chip, Real-Time Tomographic Data Processing on FPGA - SoC Devices

A novel approach to tomographic data processing has been developed and evaluated using the Jagiellonian PET (J-PET) scanner as an example. We propose a system in which there is no need for powerful, local to the scanner processing facility, capable to reconstruct images on the fly. Instead we introduce a Field Programmable Gate Array (FPGA) System-on-Chip (SoC) platform connected directly to data streams coming from the scanner, which can perform event building, filtering, coincidence search and Region-Of-Response (ROR) reconstruction by the programmable logic and visualization by the integrated processors. The platform significantly reduces data volume converting raw data to a list-mode representation, while generating visualization on the fly.Comment: IEEE Transactions on Medical Imaging, 17 May 201

E-Learning: Case Studies in Web-Controlled Devices and Remote Manipulation

Chances are that distance learning will transparently extend colleges and institutes of education and could plausibly overtake and turn into a preferred choice of higher education, especially for adult and working students. The main idea in e-learning is to build adequate solutions that can assure educational training over the Internet, without requiring a personal presence at the degree offering institution. The advantages are immediate and of unique importance, to enumerate a few: Education costs can be reduced dramatically, both from a student's perspective and the institution's (no need for room and board, for example); The tedious immigration and naturalization issues common with international students are eliminated; The limited campus facilities, faculty members and course schedules an institution can offer are no longer a boundary; Working adults can consider upgrading skills without changing their lifestyles We are presenting through this material a sequence of projects developed at University of Bridgeport and than can serve well in distance learning education ranging from simple "hobby" style training to professional guidance material. The projects have an engineering / laboratory flavor and are being presented in an arbitrary order, topics ranging from vision and sensing to engineering design, scheduling, remote control and operation

The STAR MAPS-based PiXeL detector

The PiXeL detector (PXL) for the Heavy Flavor Tracker (HFT) of the STAR experiment at RHIC is the first application of the state-of-the-art thin Monolithic Active Pixel Sensors (MAPS) technology in a collider environment. Custom built pixel sensors, their readout electronics and the detector mechanical structure are described in detail. Selected detector design aspects and production steps are presented. The detector operations during the three years of data taking (2014-2016) and the overall performance exceeding the design specifications are discussed in the conclusive sections of this paper

Digital filter implementation over FPGA platform with LINUX OS

AbstractThe embedded processors on FPGA's are a good tool to specific propose works. In this work we present how the FPGA is used to apply a Sobel filter to a set of images, also the step needed to set-up the entire system is described. An embedded processor, with a Linux distribution implemented is used to run a special compilation of C filter program, the filter is compared with the results obtained with a PC running the same filter, in the embedded system all the process runs in the FPGA and the exit file can be accessed by ftp or http server embedded into the Linux system

Case Studies in Web-Controlled Devices and Remote Manipulation

The concept of distance learning has been more and more articulated during the past few years and is expected to shortly turn into a practical education system within current high level learning institutions. The chances are that distance learning would transparently extend colleges and institutes of education, and could plausibly overtake and turn into a preferred choice of higher education, especially for adult and working students. The concept would be unachievable without the current technology, for example, the impressive worldwide accessibility of the Internet. The main idea in e-learning is to build adequate solutions that could assure educational training over the Internet, without requiring a personal presence at the degree offering institution. For example, being able to obtain a Bachelor’s degree in Computer Engineering from an accredited institution while residing thousands of miles away from it and actually never seeing it, except maybe for the graduation ceremony. The advantages are immediate and of unique importance, to enumerate a few: Scholarship / education costs can be reduced dramatically, both from a student’s perspective and the institution’s (no need for room and board, for example); The usually tedious immigration and naturalization issues that are common with international students are eliminated; The limited campus facilities, faculty members and course schedules an institution can offer are no longer a boundary; Working adults can consider upgrading skills without changing their lifestyle