Small-world networks, distributed hash tables and the e-resource discovery problem

Resource discovery is one of the most important underpinning problems behind producing a scalable, robust and efficient global infrastructure for e-Science. A number of approaches to the resource discovery and management problem have been made in various computational grid environments and prototypes over the last decade. Computational resources and services in modern grid and cloud environments can be modelled as an overlay network superposed on the physical network structure of the Internet and World Wide Web. We discuss some of the main approaches to resource discovery in the context of the general properties of such an overlay network. We present some performance data and predicted properties based on algorithmic approaches such as distributed hash table resource discovery and management. We describe a prototype system and use its model to explore some of the known key graph aspects of the global resource overlay network - including small-world and scale-free properties

Distributed resource discovery using a context sensitive infrastructure

Distributed Resource Discovery in a World Wide Web environment using full-text indices will never scale. The distinct properties of WWW information (volume, rate of change, topical diversity) limits the scaleability of traditional approaches to distributed Resource Discovery. An approach combining metadata clustering and query routing can, on the other hand, be proven to scale much better. This paper presents the Content-Sensitive Infrastructure, which is a design building on these results. We also present an analytical framework for comparing scaleability of different distribution strategies

The Impact of Web-Scale Discovery on the Use of Electronic Resources

In 2015, the University of California, Berkeley, launched EBSCO Discovery Service (EDS), a web-scale discovery tool, with a goal of improving visibility and usage of collections. This study applies linear regression analysis to usage data for ebooks, ejournals, and abstracts and indexing (A&I) databases before and after implementation of EDS in order to identify correlations between the discovery layer and usage of library electronic resources across platforms. Our findings diverge from conclusions drawn in the previous literature that indicate that resource use generally increases after a discovery tool is implemented. We examine data from a longer period of time than the previous literature had, looking for statistically significant changes in resource use. The discovery layer at UC Berkeley did not lead to equal increases across platforms, but rather to a complex array of increases and decreases in use according to a variety of factors.

Exploiting Social Annotation for Automatic Resource Discovery

Information integration applications, such as mediators or mashups, that require access to information resources currently rely on users manually discovering and integrating them in the application. Manual resource discovery is a slow process, requiring the user to sift through results obtained via keyword-based search. Although search methods have advanced to include evidence from document contents, its metadata and the contents and link structure of the referring pages, they still do not adequately cover information sources -- often called ``the hidden Web''-- that dynamically generate documents in response to a query. The recently popular social bookmarking sites, which allow users to annotate and share metadata about various information sources, provide rich evidence for resource discovery. In this paper, we describe a probabilistic model of the user annotation process in a social bookmarking system del.icio.us. We then use the model to automatically find resources relevant to a particular information domain. Our experimental results on data obtained from \emph{del.icio.us} show this approach as a promising method for helping automate the resource discovery task.Comment: 6 pages, submitted to AAAI07 workshop on Information Integration on the We

Grid resource discovery based on web services

The size of grid systems has increased substantially in the last decades. Resource discovery in grid systems is a fundamental task which provides searching and locating necessary resources for a given process. Various different approaches are proposed in literature for this problem. Grid resource discovery using web services is an important approach which has resulted in many tools to become de facto standards of today's grid resource management. In this paper, we propose a survey of recent grid resource discovery studies based on web services. We provide synthesis, analysis and evaluation of these studies by classification. We also give a comparative study of different classes proposed

Thesauri on the Web: current developments and trends

This article provides an overview of recent developments relating to the application of thesauri in information organisation and retrieval on the World Wide Web. It describes some recent thesaurus projects undertaken to facilitate resource description and discovery and access to wide-ranging information resources on the Internet. Types of thesauri available on the Web, thesauri integrated in databases and information retrieval systems, and multiple-thesaurus systems for cross-database searching are also discussed. Collective efforts and events in addressing the standardisation and novel applications of thesauri are briefly reviewed

EXPRESS: EXPressing REstful Semantic Web Services

Existing approaches to Semantic Web Services (SWS) require both a domain ontology and a semantic description of the service. We propose EXPRESS a lightweight approach to SWS. Its simplicity stems from the similarities between REST and the Semantic Web such as resource-realization, self?describing representations, and uniform interfaces. The semantics of a service is elicited from the resource descriptions in the domain ontology and the semantics of the uniform interface, hence eliminating the need for ontologically describing services. In this poster we describe EXPRESS and show how it represents different service types. It also discusses our ongoing and future work on service discovery and choreograph