Science and Subpoenas: When do the Courts Become Instruments of Manipulation?

Fischer says he believes that the uneasy relationship between law and science is likely to continue regarding disclosure of scientific research materials

Controlling Network Latency in Mixed Hadoop Clusters: Do We Need Active Queue Management?

With the advent of big data, data center applications are processing vast amounts of unstructured and semi-structured data, in parallel on large clusters, across hundreds to thousands of nodes. The highest performance for these batch big data workloads is achieved using expensive network equipment with large buffers, which accommodate bursts in network traffic and allocate bandwidth fairly even when the network is congested. Throughput-sensitive big data applications are, however, often executed in the same data center as latency-sensitive workloads. For both workloads to be supported well, the network must provide both maximum throughput and low latency. Progress has been made in this direction, as modern network switches support Active Queue Management (AQM) and Explicit Congestion Notifications (ECN), both mechanisms to control the level of queue occupancy, reducing the total network latency. This paper is the first study of the effect of Active Queue Management on both throughput and latency, in the context of Hadoop and the MapReduce programming model. We give a quantitative comparison of four different approaches for controlling buffer occupancy and latency: RED and CoDel, both standalone and also combined with ECN and DCTCP network protocol, and identify the AQM configurations that maintain Hadoop execution time gains from larger buffers within 5%, while reducing network packet latency caused by bufferbloat by up to 85%. Finally, we provide recommendations to administrators of Hadoop clusters as to how to improve latency without degrading the throughput of batch big data workloads.The research leading to these results has received funding from the European Unions Seventh Framework Programme (FP7/2007–2013) under grant agreement number 610456 (Euroserver). The research was also supported by the Ministry of Economy and Competitiveness of Spain under the contracts TIN2012-34557 and TIN2015-65316-P, Generalitat de Catalunya (contracts 2014-SGR-1051 and 2014-SGR-1272), HiPEAC-3 Network of Excellence (ICT- 287759), and the Severo Ochoa Program (SEV-2011-00067) of the Spanish Government.Peer ReviewedPostprint (author's final draft

Interconnect Energy Savings and Lower Latency Networks in Hadoop Clusters: The Missing Link

An important challenge of modern data centres running Hadoop workloads is to minimise energy consumption, a significant proportion of which is due to the network. Significant network savings are already possible using Energy Efficient Ethernet, supported by a large number of NICs and switches, but recent work has demonstrated that the packet coalescing settings must be carefully configured to avoid a substantial loss in performance. Meanwhile, Hadoop is evolving from its original batch concept to become a more iterative type of framework. Other recent work attempts to reduce Hadoop's network latency using Explicit Congestion Notifications. Linking these studies reveals that, surprisingly, even when packet coalescing does not hurt performance, it can degrade network latency much more than previously thought. This paper is the first to analyze the impact of packet coalescing in the context of network latency. We investigate how to design and configure interconnects to provide the maximum energy savings without degrading cluster throughput performance or network latency.The research leading to these results has received funding from the European Unions Seventh Framework Programme (FP7/2007–2013) under grant agreement number 610456 (Euroserver). The research was also supported by the Ministry of Economy and Competitiveness of Spain under the contracts TIN2012-34557 and TIN2015-65316-P, Generalitat de Catalunya (contracts 2014-SGR-1051 and 2014-SGR-1272), HiPEAC-3 Network of Excellence (ICT- 287759), and the Severo Ochoa Program (SEV-2011-00067) of the Spanish Government.Peer ReviewedPostprint (author's final draft

Rayleigh-Benard Convection with a Radial Ramp in Plate Separation

Pattern formation in Rayleigh-Benard convection in a large-aspect-ratio cylinder with a radial ramp in the plate separation is studied analytically and numerically by performing numerical simulations of the Boussinesq equations. A horizontal mean flow and a vertical large scale counterflow are quantified and used to understand the pattern wavenumber. Our results suggest that the mean flow, generated by amplitude gradients, plays an important role in the roll compression observed as the control parameter is increased. Near threshold the mean flow has a quadrupole dependence with a single vortex in each quadrant while away from threshold the mean flow exhibits an octupole dependence with a counter-rotating pair of vortices in each quadrant. This is confirmed analytically using the amplitude equation and Cross-Newell mean flow equation. By performing numerical experiments the large scale counterflow is also found to aid in the roll compression away from threshold but to a much lesser degree. Our results yield an understanding of the pattern wavenumbers observed in experiment away from threshold and suggest that near threshold the mean flow and large scale counterflow are not responsible for the observed shift to smaller than critical wavenumbers.Comment: 10 pages, 13 figure

Extensive chaos in Rayleigh-Bénard convection

Using large-scale numerical calculations we explore spatiotemporal chaos in Rayleigh-Bénard convection for experimentally relevant conditions. We calculate the spectrum of Lyapunov exponents and the Lyapunov dimension describing the chaotic dynamics of the convective fluid layer at constant thermal driving over a range of finite system sizes. Our results reveal that the dynamics of fluid convection is truly chaotic for experimental conditions as illustrated by a positive leading-order Lyapunov exponent. We also find the chaos to be extensive over the range of finite-sized systems investigated as indicated by a linear scaling between the Lyapunov dimension of the chaotic attractor and the system size

Traveling waves in rotating Rayleigh-Bénard convection: Analysis of modes and mean flow

Numerical simulations of the Boussinesq equations with rotation for realistic no-slip boundary conditions and a finite annular domain are presented. These simulations reproduce traveling waves observed experimentally. Traveling waves are studied near threshhold by using the complex Ginzburg-Landau equation (CGLE): a mode analysis enables the CGLE coefficients to be determined. The CGLE coefficients are compared with previous experimental and theoretical results. Mean flows are also computed and found to be more significant as the Prandtl number decreases (from sigma=6.4 to sigma=1). In addition, the mean flow around the outer radius of the annulus appears to be correlated with the mean flow around the inner radius

Spectral element methods: Algorithms and architectures

Spectral element methods are high-order weighted residual techniques for partial differential equations that combine the geometric flexibility of finite element methods with the rapid convergence of spectral techniques. Spectral element methods are described for the simulation of incompressible fluid flows, with special emphasis on implementation of spectral element techniques on medium-grained parallel processors. Two parallel architectures are considered: the first, a commercially available message-passing hypercube system; the second, a developmental reconfigurable architecture based on Geometry-Defining Processors. High parallel efficiency is obtained in hypercube spectral element computations, indicating that load balancing and communication issues can be successfully addressed by a high-order technique/medium-grained processor algorithm-architecture coupling

Rayleigh-Benard Convection in Large-Aspect-Ratio Domains

The coarsening and wavenumber selection of striped states growing from random initial conditions are studied in a non-relaxational, spatially extended, and far-from-equilibrium system by performing large-scale numerical simulations of Rayleigh-B\'{e}nard convection in a large-aspect-ratio cylindrical domain with experimentally realistic boundaries. We find evidence that various measures of the coarsening dynamics scale in time with different power-law exponents, indicating that multiple length scales are required in describing the time dependent pattern evolution. The translational correlation length scales with time as $t^{0.12}$, the orientational correlation length scales as $t^{0.54}$, and the density of defects scale as $t^{-0.45}$. The final pattern evolves toward the wavenumber where isolated dislocations become motionless, suggesting a possible wavenumber selection mechanism for large-aspect-ratio convection.Comment: 5 pages, 6 figure