Towards Efficient Resource Provisioning in Hadoop

Considering recent exponential growth in the amount of information processed in Big Data, the high energy consumed by data processing engines in datacenters has become a major issue, underlining the need for efficient resource allocation for better energy-efficient computing. This thesis proposes the Best Trade-off Point (BToP) method which provides a general approach and techniques based on an algorithm with mathematical formulas to find the best trade-off point on an elbow curve of performance vs. resources for efficient resource provisioning in Hadoop MapReduce and Apache Spark. Our novel BToP method is expected to work for any applications and systems which rely on a tradeoff curve with an elbow shape, non-inverted or inverted, for making good decisions. This breakthrough method for optimal resource provisioning was not available before in the scientific, computing, and economic communities. To illustrate the effectiveness of the BToP method on the ubiquitous Hadoop MapReduce, our Terasort experiment shows that the number of task resources recommended by the BToP algorithm is always accurate and optimal when compared to the ones suggested by three popular rules of thumbs. We also test the BToP method on the emerging cluster computing framework Apache Spark running in YARN cluster mode. Despite the effectiveness of Spark’s robust and sophisticated built-in dynamic resource allocation mechanism, which is not available in MapReduce, the BToP method could still consistently outperform it according to our Spark-Bench Terasort test results. The performance efficiency gained from the BToP method not only leads to significant energy saving but also improves overall system throughput and prevents cluster underutilization in a multi-tenancy environment. In General, the BToP method is preferable for workloads with identical resource consumption signatures in production environment where job profiling for behavioral replication will lead to the most efficient resource provisioning

Procyon-A and Eta-Bootis: Observational Frequencies Analyzed by the Local-Wave Formalism

In the present analysis of Procyon-A and Eta-Bootis, we use the local-wave formalism which, despite its lack of precision inherent to any semi-analytical method, uses directly the model profile without any modification when calculating the acoustic mode eigenfrequencies. These two solar-like stars present steep variations toward the center due to the convective core stratification, and toward the surface due to the very thin convective zone. Based on different boundary conditions, the frequencies obtained with this formalism are different from that of the classical numerical calculation. We point out that (1) the frequencies calculated with the local-wave formalism seem to agree better with observational ones. All the frequencies detected with a good confident level including those classified as 'noise' find an identification, (2) some frequencies can be clearly identified here as indications of the core limit.Comment: SOHO 18 / GONG 2006 / HELAS I Meetin

A variational characterization of 2-soliton profiles for the KdV equation

We use profile decomposition to characterize 2-soliton solutions of the KdV equation as global minimizers to a constrained variational problem involving three of the polynomial conservation laws for the KdV equation

Phononic thermal resistance due to a finite periodic array of nano-scatterers

The wave property of phonons is employed to explore the thermal transport across a finite periodic array of nano-scatterers such as circular and triangular holes. As thermal phonons are generated in all directions, we study their transmission through a single array for both normal and oblique incidences, using a linear dispersionless time-dependent acoustic frame in a two-dimensional system. Roughness effects can be directly considered within the computations without relying on approximate analytical formulae. Analysis by spatio-temporal Fourier transform allows us to observe the diffraction effects and the conversion of polarization. Frequency-dependent energy transmission coefficients are computed for symmetric and asymmetric objects. We demonstrate that the phononic array acts as an efficient thermal barrier by applying the theory of thermal boundary (Kapitza) resistances to arrays of smooth scattering holes in silicon for an exemplifying periodicity of 10 nm in the [5-100 K] temperature range. It is observed that the associated thermal conductance has the same temperature dependence than that without phononic filtering

Platelet-activating Factor, a Molecular Sensor for Cellular Damage, Activates Systemic Immune Suppression

Ultraviolet (UV) radiation plays a critical role in the induction of nonmelanoma skin cancer. UV radiation is also immune suppressive, and the immune suppression induced by UV irradiation has been identified as a major risk factor for skin cancer induction. Previously, we showed that UV exposure activates a cytokine cascade involving prostaglandin (PG)E2, interleukin (IL)-4, and IL-10 that induces immune suppression. However, the earliest molecular events that occur immediately after UV exposure, especially those upstream of PGE2, are not well defined. UV-irradiated keratinocytes secrete the inflammatory phospholipid mediator, platelet-activating factor (PAF). Because PAF upregulates the production of immunomodulatory compounds, including PGE2, we tested the hypothesis that UV-induced PAF activates cytokine production and initiates UV-induced immune suppression. Both UV and PAF activated cyclooxygenase (COX)-2 and IL-10 reporter gene construct transcription. PAF mimicked the effects of UV in vivo and suppressed delayed-type hypersensitivity (DTH). Furthermore, immune suppression was blocked when UV-irradiated mice were injected with PAF receptor antagonists. In addition to the well-known role of PAF as a proinflammatory lipid mediator, we propose that the PAF receptor senses cellular damage through the recognition of PAF and/or PAF-like molecules, such as oxidized phosphatidylcholine, which activates cytokine transcription and induces systemic immune suppression

Membrane scaling and prevention techniques during seawater desalination by air gap membrane distillation

Membrane scaling and mitigation techniques during air gap membrane distillation (AGMD) of seawater were investigated. The results showed a strong influence of AGMD operating temperature on not only the process water flux but also membrane scaling and subsequent cleaning efficiency. Elevating feed/coolant temperature from 35/25 to 60/50 °C increased water flux, but also exacerbated membrane scaling of the AGMD process. Membrane scaling was more severe, and occurred at a lower water recovery (68%) when operating at 60/50 °C compared to 35/25 °C (78%) due to increased concentration polarisation effect. Operating temperature also affected the efficiency of the subsequent membrane cleaning. Membrane scaling that occurred at low temperature (i.e. 35/25 °C) was more efficiently cleaned than at high temperature (i.e. 60/50 °C). In addition, membrane cleaning using vinegar was much more efficient than fresh water. Nevertheless, vinegar cleaning could not completely restore the membrane surface to the original condition. Traces of residual scalants on the membrane surface accelerated scaling in the next operation cycle. On the other hand, anti-scalant addition could effectively control scaling. Membrane scaling during AGMD of seawater at 70% water recovery and 60/50 °C was effectively controlled by anti-scalant addition