MOON: MapReduce On Opportunistic eNvironments

Abstract—MapReduce offers a flexible programming model for processing and generating large data sets on dedicated resources, where only a small fraction of such resources are every unavailable at any given time. In contrast, when MapReduce is run on volunteer computing systems, which opportunistically harness idle desktop computers via frameworks like Condor, it results in poor performance due to the volatility of the resources, in particular, the high rate of node unavailability. Specifically, the data and task replication scheme adopted by existing MapReduce implementations is woefully inadequate for resources with high unavailability. To address this, we propose MOON, short for MapReduce On Opportunistic eNvironments. MOON extends Hadoop, an open-source implementation of MapReduce, with adaptive task and data scheduling algorithms in order to offer reliable MapReduce services on a hybrid resource architecture, where volunteer computing systems are supplemented by a small set of dedicated nodes. The adaptive task and data scheduling algorithms in MOON distinguish between (1) different types of MapReduce data and (2) different types of node outages in order to strategically place tasks and data on both volatile and dedicated nodes. Our tests demonstrate that MOON can deliver a 3-fold performance improvement to Hadoop in volatile, volunteer computing environments

Biofouling characteristics in Xinghua Bay of Fujian, China

Biofouling is one of the main factors affecting the efficiency and safety of cooling water systems in coastal nuclear power plants. Understanding the population dynamics, succession rules and cumulative effects of major fouling organisms is the basis for targeted prevention and control. A 1-year simulated concrete panel test was conducted from December 2020 to November 2021 in Xinghua Bay, China. A total of 78 species of fouling organisms were recorded by combining the monthly, seasonal, semiannual, annual and monthly cumulative panels, and the community composition was dominated by nearshore warm-water species, making for a typical subtropical inner bay-type community. The fouling organisms had a peak attachment period from June to October. Significantly more attachment was observed during summer (from June to August) than during the other three seasons. The attachment amount in the second half-year (from June to November) was much higher than that in the first half-year (from December to May). The attachment thickness, density, and biomass of the bottom summer panels reached 20 cm, 105,150 ind./m2, and 19,274.50 g/m2, respectively, while those of the bottom annual panels were 40 cm, 27,300 ind./m2, and 17,762.50 g/m2, respectively. The dominant fouling organisms with calcified shells mainly included Amphibalanus reticulatus and Pernaviridis. These species had high attachment amounts,could accumulate attachments for a long time, and even might cause secondary blockage, making them the most detrimental to the safety of a cooling system. Moreover,the seasonal upward growth of hydroids and bryozoans can also significantly reduce the efficiency of cooling water intake. We suggest that targeted prevention and control should be carried out according to the larval attachment period of different dominant groups of fouling organisms during June-October, which can greatly improve the prevention and control efficiency. Strengthening the research on the biological cycle phenomenon of the main species and their main environmental impact factors, and establishing a scientific and effective early-warning model are the governance direction of formulating and implementing scientific pollution prevention and control in the future

The effects of oxygen in spinel oxide Li1+xTi2-xO4-delta thin films

The evolution from superconducting LiTi2O4-delta to insulating Li4Ti5O12 thin films has been studied by precisely adjusting the oxygen pressure during the sample fabrication process. In the superconducting LiTi2O4-delta films, with the increase of oxygen pressure, the oxygen vacancies are filled, and the c-axis lattice constant decreases gradually. With the increase of the oxygen pressure to a certain critical value, the c-axis lattice constant becomes stable, which implies that the Li4Ti5O12 phase comes into being. The process of oxygen filling is manifested by the angular bright-field images of the scanning transmission electron microscopy techniques. The temperature of magnetoresistance changed from positive and negative shows a non-monotonous behavior with the increase of oxygen pressure. The theoretical explanation of the oxygen effects on the structure and superconductivity of LiTi2O4-delta has also been discussed in this work.Comment: 11 pages, 5 figure

Advances in Chinese Arctic and subarctic research in marine biology and ecology with emphasis on the Pacific Arctic sector

The Arctic is one of the most sensitive regions that respond through feedback to global climate changes. Climatic, hydrological and ecological changes in the Arctic are clear evidence of global warming. In 2012 and 2014, the 5th and 6th Chinese National Arctic Research Expeditions undertook studies in the Bering Sea, the Arctic Ocean (including the Chukchi Sea), and the Norwegian Sea. These studies provided us with a better understanding of the marine biology and ecology in the Arctic and subarctic regions, particularly in the Pacific Arctic sector. Rapid changes observed in the Arctic environment include the shrinking of cold-water masses in the Bering Sea in the summer, and elevated water temperatures promoting phytoplankton blooms, leading to an increase in phytoplankton transferred to higher trophic levels. As a result, the transfer efficiency of organic matter toward the bottom weakened, leading to a reduction in benthic biomass. This is consistent with expectations that the overall carbon and energy flux will ultimately switch from the dominant mode of sea ice–algae–benthos to one of phytoplankton–zooplankton. Influenced by Pacific water inflow, fluvial runoff and melting sea ice, the Chukchi Sea exhibited different responses to various environmental changes. Interactions between water masses led to other interannual ecological shifts. With the increase in sea ice melt and sunlight in the central region of the Arctic Ocean, the relative abundance of heterotrophic bacteria is expected to increase, and play a vital role in the Arctic microbial loop

Universal scaling of the critical temperature and the strange-metal scattering rate in unconventional superconductors

Dramatic evolution of properties with minute change in the doping level is a hallmark of the complex chemistry which governs cuprate superconductivity as manifested in the celebrated superconducting domes as well as quantum criticality taking place at precise compositions. The strange metal state, where the resistivity varies linearly with temperature, has emerged as a central feature in the normal state of cuprate superconductors. The ubiquity of this behavior signals an intimate link between the scattering mechanism and superconductivity. However, a clear quantitative picture of the correlation has been lacking. Here, we report observation of quantitative scaling laws between the superconducting transition temperature $T_{\rm c}$ and the scattering rate associated with the strange metal state in electron-doped cuprate $\rm La_{2-x}Ce_xCuO_4$ (LCCO) as a precise function of the doping level. High-resolution characterization of epitaxial composition-spread films, which encompass the entire overdoped range of LCCO has allowed us to systematically map its structural and transport properties with unprecedented accuracy and increment of $\Delta x = 0.0015$. We have uncovered the relations $T_{\rm c}\sim(x_{\rm c}-x)^{0.5}\sim(A_1^\square)^{0.5}$, where $x_c$ is the critical doping where superconductivity disappears on the overdoped side and $A_1^\square$ is the scattering rate of perfect $T$-linear resistivity per CuO$_2$ plane. We argue that the striking similarity of the $T_{\rm c}$ vs $A_1^\square$ relation among cuprates, iron-based and organic superconductors is an indication of a common mechanism of the strange metal behavior and unconventional superconductivity in these systems.Comment: 15 pages, 3 figure

High Performance Parallel and Distributed Genomic Sequence Search

Genomic sequence database search identifies similarities between given query sequences and known sequences in a database. It forms a critical class of applications used widely and routinely in computational biology. Due to their wide application in diverse task settings, sequence search tools today are run on several types of parallel systems, including batch jobs on one or more supercomputers and interactive queries through web-based services. Despite successful parallelization of popular sequence search tools such as BLAST, in the past two decades the growth of sequence databases has outpaced that of computing hardware elements, making scalable and efficient parallel sequence search processing crucial in helping life scientists' dealing with the ever-increasing amount of genomic information. In this thesis, we investigate efficient and scalable parallel and distributed sequence-search solutions by addressing unique problems and challenges in the aforementioned execution settings. Specifically, this thesis research 1) introduces parallel I/O techniques into sequence-search tools and proposes novel computation and I/O co-scheduling algorithms that enable genomic sequence search to scale efficiently on massively parallel computers; 2) presents a semantic based distributed I/O framework that leverages the application specific meta information to drastically reduce the amount of data transfer and thus enables distributed sequence searching collaboration in the global scale; 3) proposes a novel request scheduling technique for clustered sequence-search web servers that comprehensively takes into account both data locality and parallel search efficiency to optimize query response time under various server load levels and access scenarios. The efficacy of our proposed solutions has been verified on a broad range of parallel and distributed systems, including Peta-scale supercomputers, the NSF TeraGrid system, and small- or medium-sized clusters. In addition, our optimizations of massively parallel sequence search have been transformed into the official release of mpiBLAST-PIO, currently the only supported branch of mpiBLAST, a popular open-source sequence-search tool. mpiBLAST-PIO is able to achieve 93% parallel efficiency across 32,768 cores on the IBM Blue Gene/P supercomputer

The Green500 List: Year two

The Green500 turned two years old this past Novem-ber at the ACM/IEEE SC|09 Conference. As part of the grassroots movement of the Green500, this paper takes a look back and reflects on how the Green500 has evolved in its second year as well as since its inception. Specifically, it analyzes trends in the Green500 and reports on the implications of these trends. In addi-tion, based on significant feedback from the high-end computing (HEC) community, the Green500 announced three exploratory sub-lists: the Little Green500, the Open Green500, and the HPCC Green500, which are each discussed in this paper. 1