Dynamic Scheduling of MapReduce Shuffle under Bandwidth Constraints

Whether it is for e-science or business, the amount of data produced every year is growing at a high rate. Managing and processing those data raises new challenges. MapReduce is one answer to the need for scalable tools able to handle the amount of data. It imposes a general structure of computation and let the implementation perform its optimizations. During the computation, there is a phase called Shuffle where every node sends a possibly large amount of data to every other node. This report proposes and evaluates six algorithms to improve data transfers during the Shuffle phase under bandwidth constraints.Que ce soit pour l’e-science ou pour les affaires, la quantité de données produites chaque année augmente à une vitesse vertigineuse. Gérer et traiter ces données soulève de nouveaux défis. MapReduce est l’une des réponses aux besoins d’outils qui passent à l’échelle et capables de gérer ces volumes de données. Il impose une structure générale de calcul et laisse l’implémentation effectuer ses optimisations. Durant l’une des phases du calcul appelée Shuffle, tous les nœuds envoient des données potentiellement grosses à tous les autres nœuds. Ce rapport propose et évalue six algorithmes pour améliorer le transfert des données durant cette phase de Shuffle sous des contraintes de bande passante

Scheduling/Data Management Heuristics

Deliverable D3.1 of MapReduce ANR projectData volume produced by scientific applications increase at a high speed. Some are expected to produce several petabyte per year. In order to process this amount of data, the computing power of several hundreds or thousands of machines have to be used at the same time. Regarding this, one of the biggest challenge is: how to program these machines in order to make them to collaborate for the same computation? One answer brought by Google is the MapReduce paradigm. MapReduce has the advantage of being quite simple to program for the user and handle on its own the repetitive or complex tasks like the data transfers between nodes, task scheduling or handling node failure. These automatic tasks have to be handled in an optimized way in order to make the framework fast and scalable. This report presents our first studies towards an efficient scheduling of MapReduce operations. More specifically, we focused on the scheduling of the data transfers together with the tasks. We present here an interesting work around this topic and our algorithm which improves their results

Transformation de phases induites par broyage dans un composé moléculaire : l'indométhacine

Le broyage est une étape fréquente dans l'élaboration des produits pharmaceutiques. Outre la réduction de la taille des particules,., ce type de perturbation peut induire de profondes transformations des matériaux, telles que l'amorphisation à l'état solide des phases cristallines ou des interconversions entre les différentes variétés po1ymorphiques; Dans cette thèse, nous avons mené une étude des transformations de phase induites par broyage dans le cas de l'indométhacine, composé moléculaire à inte rêt pharmaceutique. Nous avons réalisé des expériences de broyage sur les phases cristallines et vitreuse, en faisant varier l'intensité de la sollicitation mécanique. Ces investigations montrent que pour des temps de broyage suffisamments longs, l'état final obtenu est indépendant de la forme physique de départ. En confrontant ces résultats avec des données expérimentales issues de la littérature et obtenues à différentes températures, nous avons observé que diminuer la température équivaut à augmenter l'intensité de la sollicitationmécanique. Ce comportement peut être rationalisé dans le cadre de la théorie des alliages forcés qui suggère que les transformations observées sous broyage résultent d'un mécanisme de forçage qui place les matériaux dans des états stationnaires dynamiques plutôt que dans des états d'équilibre thermodynamique.LILLE1-BU (590092102) / SudocSudocFranceF

In situ tuning the optical properties of a cavity by wrinkling

In this letter we propose an original, in situ, approach to tune the optical properties of an optical cavity, based on the wrinkling of compressed metal/polymer multilayer thin films. This phenomenon is conceptually described, simulated, and experimentally confirmed. The main idea is to use wrinkling to modulate the effective refractive index of the upper interface. This modulation induces a spectral shift of the cavity modes. The work presented here constitutes a first step to the development of stretchable and curved photonics

Sensitivity-enhanced localized surface plasmon resonance biosensing format dedicated for point-of-care testing tools

peer reviewedThe main requirement for a point-of-care health monitoring tools is that it should involve relatively simple and inexpensive equipment ensuring acceptable accuracy of diseases early diagnostic. Quite commonly in practice, their main function is only to trigger an ‘alarm’ signal, when a specific biomarker of disease is detected in the sample. The affinity label-free biosensing involving surface plasmonic resonance (SPR) phenomena appears to be one of the most appropriate approaches for the above requirements. In our research, we focus on theoretical and experimental investigations of optional plasmonic-related biosensing formats easy to be integrated in lab-on-chip devices involving conventional planar SPR biosensing. One of such detection formats, mentioned in our earliest publications, involves localized surface plasmon resonance (LSPR) spectroscopy at the frustrated total internal reflection conditions (LSPR_TIR). In this paper, we report on the numerical and experimental study of LSPR_TIR spectroscopy of gold nanoparticles (NPs) structures with a relatively high density of NPs, manufactured using two different microfabrication methods: the conventional nano-sphere lithography, and the original one, involving the direct pulse laser writing. The last technology, developed by our research team, provides powerful and cost effective tools for flexible patterning of the disposable multichannel biochip with array of SPR and LSPR probes. The obtained results demonstrate a significant improvement in the LSPR wavelength sensitivity to sample refractive index. In addition, experimental investigations reveal a relatively efficient conversion of the incident light wave polarization that can be attributed to a relatively high efficiency of electromagnetic coupling between closely spaced NPs.BIOSEN

Investigation of the potential of the ICP-MS/MS for total and speciation analysis in petroleum fractions

International audienceThe capability of inductively coupled plasma tandem mass spectrometry (ICP-MS/MS) to achieve total concentration and speciation using direct injection of petroleum products after solvent dilution for severely interfered isotopes was demonstrated here with different applications cases. For the direct determination of heavy elements (Z > 70) in organic matrices, the ICP-MS/MS was less sensitive than the ICP-HRMS. For light elements (Z < 40), the sensitivity was similar or better using ICP-MS/MS and for interfered elements (Si, S, Ca, Fe), the use of the two quadrupoles combined to the octopole reaction/collision cell (ORC) with He, O2 or H2 gave similar or better detection limits (LOD) than the ICP-HRMS in medium resolution. Comparable or better sensitivity were obtained replacing the 1.5 mm by the 1 mm injector diameter and especially for lighter elements (Z < 30) using the ICP-MS/MS. LOD in xylene were ranging from 0.004 μg/kg (V) to 0.9 μg/kg (Al) and appeared in the lowest values published in the literature using ICP-MS/MS in hydrocarbons. To demonstrate the performance of the ICP-MS/MS using direct injection of petroleum products after dilution in hydrocarbon solvent, three application cases were presented.Sulfur at very low levels in reformates was successfully monitored in oxygen mode using the oxide ion (32S → 48SO). The background equivalent concentration (BEC) origin was attributed to solvent contamination by sulfur and was confirmed by ultra-violet fluorescence (UVF) method. Using H2 for Ni (58Ni → 58Ni) and O2 for V (51V → 67VO) as reactant gas, the direct injection ICP-MS/MS method easily confirmed Ni and V concentrations measured using wavelength dispersive X-rays fluorescence (WDXRF) and allowed the determination of 14 elements in the asphaltene fraction, with concentrations ranging from 0.3 mg/kg (Al and Pb) to 37.4 mg/kg for Fe.For speciation of Ni, V and S, gel permeation chromatography (GPC) hyphenated to ICP-MS/MS is particularly powerful using O2 (2.5 mL/min) both for vacuum residue and hydrotreated (HDT) vacuum residue. Contrary to GPC-ICP-HRMS where two injections of sample were required (medium resolution for S and V and low resolution for Ni), GPC-ICP-MS/MS easily allowed the acquisition of the 3 elements in one mode during the same run and considerably reduce the analysis cost and time. Both for total and speciation analysis, the direct injection of petroleum products after solvent dilution ICP-MS/MS method is a significant advantage and appealing in high-volume petroleum laboratories

Slippery or Sticky Boundary Conditions: Control of Wrinkling in Metal-Capped Thin Polymer Films by Selective Adhesion to Substrates

Wrinkling patterns at the metallized surface of thin polymer films are shown to be sensitive to the sticky or slippery character of the polymer-substrate interface. Existing theoretical models were expanded to specific boundary conditions (adhesive versus slippery) in order to rationalize these observations. Based on this concept, we were able to propose a new and simple method to orient the wrinkles by chemically patterning the substrate with regions of high and low adhesion

Drought effects on damage by forest insects and pathogens : a meta-analysis

International audienceIn the context of climate change, the effects of prolonged or more severe droughts on pest and pathogen damage are a major concern for forest ecosystems. To date, there is great uncertainty about the direction, magnitude and sources of variation in responses to drought by insects and fungi. We report the outcomes of a meta-analysis of 100 pairwise comparisons of insect pest or pathogen damage to water-stressed and control trees from 40 publications. The type of feeding substrate for insects and fungi and the water stress severity emerged as the main factors influencing the level of damage in water-stressed trees. Overall, primary damaging agents living in wood caused significantly lower damage to the water-stressed trees compared with the control, whereas primary pests and pathogens living on foliage caused more damage to water-stressed trees, in all cases irrespective of stress severity. In contrast, damage by secondary agents increased with stress severity, which was best estimated by the ratio between the predawn leaf water potential in stressed trees and the xylem pressure inducing 50% loss in hydraulic conductance due to cavitation, a species-specific index of drought tolerance. Insect and fungus feeding behaviour, affected tree part, and water stress severity are therefore proposed as three important predictors of forest damage in drought conditions

A Scalable Approach to Network Enabled Servers

Also available as INRIA Research Report RR-450