183,598 research outputs found
Discovering Job Preemptions in the Open Science Grid
The Open Science Grid(OSG) is a world-wide computing system which facilitates
distributed computing for scientific research. It can distribute a
computationally intensive job to geo-distributed clusters and process job's
tasks in parallel. For compute clusters on the OSG, physical resources may be
shared between OSG and cluster's local user-submitted jobs, with local jobs
preempting OSG-based ones. As a result, job preemptions occur frequently in
OSG, sometimes significantly delaying job completion time.
We have collected job data from OSG over a period of more than 80 days. We
present an analysis of the data, characterizing the preemption patterns and
different types of jobs. Based on observations, we have grouped OSG jobs into 5
categories and analyze the runtime statistics for each category. we further
choose different statistical distributions to estimate probability density
function of job runtime for different classes.Comment: 8 page
A Tale of Two Data-Intensive Paradigms: Applications, Abstractions, and Architectures
Scientific problems that depend on processing large amounts of data require
overcoming challenges in multiple areas: managing large-scale data
distribution, co-placement and scheduling of data with compute resources, and
storing and transferring large volumes of data. We analyze the ecosystems of
the two prominent paradigms for data-intensive applications, hereafter referred
to as the high-performance computing and the Apache-Hadoop paradigm. We propose
a basis, common terminology and functional factors upon which to analyze the
two approaches of both paradigms. We discuss the concept of "Big Data Ogres"
and their facets as means of understanding and characterizing the most common
application workloads found across the two paradigms. We then discuss the
salient features of the two paradigms, and compare and contrast the two
approaches. Specifically, we examine common implementation/approaches of these
paradigms, shed light upon the reasons for their current "architecture" and
discuss some typical workloads that utilize them. In spite of the significant
software distinctions, we believe there is architectural similarity. We discuss
the potential integration of different implementations, across the different
levels and components. Our comparison progresses from a fully qualitative
examination of the two paradigms, to a semi-quantitative methodology. We use a
simple and broadly used Ogre (K-means clustering), characterize its performance
on a range of representative platforms, covering several implementations from
both paradigms. Our experiments provide an insight into the relative strengths
of the two paradigms. We propose that the set of Ogres will serve as a
benchmark to evaluate the two paradigms along different dimensions.Comment: 8 pages, 2 figure
Evaluation of Community Jobs Scotland Phase 3 and Phase 4 Care Leaver and Young People with Convictions Pilots: Final Report
No abstract available
ISER Working Paper
In communities that largely depend on the extraction of natural resources, attitudes towards conservation and development may seem at odds or particularly rigid. With an unprecedented wealth of natural capital, a growing mining sector, strong oil and gas industry, and a politically conservative population, Alaska serves as a case study to measure such attitudes. This research was motivated by a lack of primary ecosystem service valuation studies in Alaska that could be used to assess the public’s perceived value of ecosystem services in order to guide future land use decisions and incentivize land use decisions that minimize negative externalities. A choice experiment was conducted with 224 households in the Matanuska-Susitna Borough, the fastest growing region in Alaska and one of the fastest growing regions in the U.S. Rapid development with few restrictions has led to changes for local ecosystems particularly important to salmon, negative effects on access related to recreation and tourism, and caused conversion of valuable farmland. Study results show that attitudes and values vary regarding future land use and economic development efforts. On average, policy action to improve conditions for local salmon stocks are most valuable to local residents followed by protecting farm and ranch lands as well as public access to recreation sites. Conversely, residents show negative preferences towards rapid population growth and developing local mining, oil and gas, and timber resources but support developing a professional and technical services sector. The quantified welfare changes related to different development scenarios show that focusing on conserving valuable ecosystem services is in the public’s best interest
- …