Performance and quality of service of data and video movement over a 100 Gbps testbed

AbstractDigital instruments and simulations are creating an ever-increasing amount of data. The need for institutions to acquire these data and transfer them for analysis, visualization, and archiving is growing as well. In parallel, networking technology is evolving, but at a much slower rate than our ability to create and store data. Single fiber 100 Gbps networking solutions have recently been deployed as national infrastructure. This article describes our experiences with data movement and video conferencing across a networking testbed, using the first commercially available single fiber 100 Gbps technology. The testbed is unique in its ability to be configured for a total length of 60, 200, or 400 km, allowing for tests with varying network latency. We performed low-level TCP tests and were able to use more than 99.9% of the theoretical available bandwidth with minimal tuning efforts. We used the Lustre file system to simulate how end users would interact with a remote file system over such a high performance link. We were able to use 94.4% of the theoretical available bandwidth with a standard file system benchmark, essentially saturating the wide area network. Finally, we performed tests with H.323 video conferencing hardware and quality of service (QoS) settings, showing that the link can reliably carry a full high-definition stream. Overall, we demonstrated the practicality of 100 Gbps networking and Lustre as excellent tools for data management

2012 Annual Report - Advanced Biomedical Information Technology Core

This material is based upon work supported in part by the following funding agencies and grant awards: • Lilly Endowment, for its support of the Indiana Genomics Initiative (INGEN) – 2000; Indiana Metabolomics and Cytomics Initiative (METACyt); Indiana Pervasive Computing Research (IPCRES) initiative and Pervasive Technology Institute (1999 and 2008 respectively) • National Science Foundation under grants 01116050 MRI: Creation of the AVIDD Data Facility: A Distributed Facility for Managing, Analyzing and Visualizing Instrument-Driven Data (Michael A. McRobbie, PI); 0521433 MRI: Acquisition of a High-Speed, High Capacity Storage System to Support Scientific Computing: The Data Capacitor (Craig A. Stewart, PI); 0521433 ABI Development: National Center for Genome Analysis Support (Craig A. Stewart, PI) • National Institutes of Health NIAAA awards U24 AA014818-01 (Craig A. Stewart, PI) and U24 AA014818-04 (William K. Barnett, PI) Informatics Core for the Collaborative Initiative on Fetal Alcohol Spectrum Disorder • Subcontracts through the following NIH grant awards: 5P40RR024928 (Kenneth Cornetta, PI), 2U01AA014809 (Tatiana Foroud, PI), 1DP2OD007363-01 (Alexander Niculescu, PI), UL1RR025761-01 (Anantha Shekhar, PI), 3UL1RR025761-04S2 (Anantha Shekhar, PI), and 3UL1RR025761-04S3 (Anantha Shekhar, PI) • Funding from the general funds of Indiana University Any opinions expressed in this document are those of the authors and do not necessarily reflect the views of the funding agencies above