Provenance-based trust for grid computing: Position Paper

Current evolutions of Internet technology such as Web Services, ebXML, peer-to-peer and Grid computing all point to the development of large-scale open networks of diverse computing systems interacting with one another to perform tasks. Grid systems (and Web Services) are exemplary in this respect and are perhaps some of the first large-scale open computing systems to see widespread use - making them an important testing ground for problems in trust management which are likely to arise. From this perspective, today's grid architectures suffer from limitations, such as lack of a mechanism to trace results and lack of infrastructure to build up trust networks. These are important concerns in open grids, in which "community resources" are owned and managed by multiple stakeholders, and are dynamically organised in virtual organisations. Provenance enables users to trace how a particular result has been arrived at by identifying the individual services and the aggregation of services that produced such a particular output. Against this background, we present a research agenda to design, conceive and implement an industrial-strength open provenance architecture for grid systems. We motivate its use with three complex grid applications, namely aerospace engineering, organ transplant management and bioinformatics. Industrial-strength provenance support includes a scalable and secure architecture, an open proposal for standardising the protocols and data structures, a set of tools for configuring and using the provenance architecture, an open source reference implementation, and a deployment and validation in industrial context. The provision of such facilities will enrich grid capabilities by including new functionalities required for solving complex problems such as provenance data to provide complete audit trails of process execution and third-party analysis and auditing. As a result, we anticipate that a larger uptake of grid technology is likely to occur, since unprecedented possibilities will be offered to users and will give them a competitive edge

Towards a service-oriented e-infrastructure for multidisciplinary environmental research

Research e-infrastructures are considered to have generic and thematic parts. The generic part provids high-speed networks, grid (large-scale distributed computing) and database systems (digital repositories and data transfer systems) applicable to all research commnities irrespective of discipline. Thematic parts are specific deployments of e-infrastructures to support diverse virtual research communities. The needs of a virtual community of multidisciplinary envronmental researchers are yet to be investigated. We envisage and argue for an e-infrastructure that will enable environmental researchers to develop environmental models and software entirely out of existing components through loose coupling of diverse digital resources based on the service-oriented achitecture. We discuss four specific aspects for consideration for a future e-infrastructure: 1) provision of digital resources (data, models & tools) as web services, 2) dealing with stateless and non-transactional nature of web services using workflow management systems, 3) enabling web servce discovery, composition and orchestration through semantic registries, and 4) creating synergy with existing grid infrastructures

A voyage to Arcturus: a model for automated management of a WLCG Tier-2 facility

With the current trend towards "On Demand Computing" in big data environments it is crucial that the deployment of services and resources becomes increasingly automated. Deployment based on cloud platforms is available for large scale data centre environments but these solutions can be too complex and heavyweight for smaller, resource constrained WLCG Tier-2 sites. Along with a greater desire for bespoke monitoring and collection of Grid related metrics, a more lightweight and modular approach is desired. In this paper we present a model for a lightweight automated framework which can be use to build WLCG grid sites, based on "off the shelf" software components. As part of the research into an automation framework the use of both IPMI and SNMP for physical device management will be included, as well as the use of SNMP as a monitoring/data sampling layer such that more comprehensive decision making can take place and potentially be automated. This could lead to reduced down times and better performance as services are recognised to be in a non-functional state by autonomous systems

Peer-to-Peer Metadata Management for Knowledge Discovery Applications in Grids

Computational Grids are powerful platforms gathering computational power and storage space from thousands of geographically distributed resources. The applications running on such platforms need to efficiently and reliably access the various and heterogeneous distributed resources they offer. This can be achieved by using metadata information describing all available resources. It is therefore crucial to provide efficient metadata management architectures and frameworks. In this paper we describe the design of a Grid metadata management service. We focus on a particular use case: the Knowledge Grid architecture which provides high-level Grid services for distributed knowledge discovery applications. Taking advantage of an existing Grid data-sharing service, namely JuxMem, the proposed solution lies at the border between peer-to-peer systems and Web services

eBank UK: linking research data, scholarly communication and learning

This paper includes an overview of the changing landscape of scholarly communication and describes outcomes from the innovative eBank UK project, which seeks to build links from e-research through to e-learning. As introduction, the scholarly knowledge cycle is described and the role of digital repositories and aggregator services in linking data-sets from Grid-enabled projects to e-prints through to peer-reviewed articles as resources in portals and Learning Management Systems, are assessed. The development outcomes from the eBank UK project are presented including the distributed information architecture, requirements for common ontologies, data models, metadata schema, open linking technologies, provenance and workflows. Some emerging challenges for the future are presented in conclusion

Understanding IT management in Higher Education

This is a full research paper prepared for submission to an international conference. It is not yet published elsewhere.A meeting of academics concluded that the management of IT resources in education is sub-optimal and under-researched. The extent of IT-related changes indicates a need for strategic management, proper attention to the expectations of stakeholders, and careful management of the implementation of new systems. Representative role players provided both open and structured input to a study that contrasted open coding of transcribed text and structured analysis of repertory grid data. The results of the open coding were limited but the repertory grid data provided useful insight into the management of information technology and information systems in higher education. The principal findings were that the management of the scope of information systems, services and projects must be managed well, and when coupled with risk management this provides the best possibility of successful working. The controlled management of cost, value, and innovation, are revealed to be distinct areas of strategic importance

A platform to support civil protection applications on the GRID

The CROSS-Fire is a Portuguese NGI funded project focus-ing on the development of a grid-based risk management decision support system for the Civil Protection (CP), using forest fires as the main case study. The project defines a general approach for the development of a CP application by defining an architecture that integrates three main layers: the CROSS-Fire Platform and two external infrastructures: a Spatial Data Infrastructure (SDI) and the GRID. The CROSS-Fire Platform is defined and implemented as a set of WPS algorithms dealing with most of the functionalities of its three components: Business Logic, Grid Services and Geospatial services. The present work stresses the relevance of standards adoption: OGC-WS WCS/WFS/WMS/WPS, to exploit/enable geospatial services for data access processing, and OGC-SWE SOS to address other CP data sources, such as meteorological station networks (MSN) or satellites. The adoption of a Web Services (WS) approach allows integrating easily with existing systems typically based on WS technologies. We also present CFS, a grid user interface SDI based client, compliant with OGC and EU INSPIRE directives which allows decision makers to access the spatial data infrastructure, to launch simulations on the grid and visualize the fire propagation simulations.Fundação para a Ciência e a Tecnologia (FCT

Computational Intelligence Applications in Smart Grids: Enabling Methodologies for Proactive and Self Organizing Power Systems

This book considers the emerging technologies and methodologies of the application of computational intelligence to smart grids. From a conceptual point of view, the smart grid is the convergence of information and operational technologies applied to the electric grid, allowing sustainable options to customers and improved levels of security. Smart grid technologies include advanced sensing systems, two-way high-speed communications, monitoring and enterprise analysis software, and related services used to obtain location-specific and real-time actionable data for the provision of enhanced services for both system operators (i.e. distribution automation, asset management, advanced metering infrastructure) and end-users (i.e. demand side management, demand response). In this context, a crucial issue is how to support the evolution of existing electrical grids from static hierarchal systems to self-organizing, highly scalable and pervasive networks. Modern trends are oriented toward the employment of computational intelligence techniques for deploying advanced control, protection and monitoring architectures that move away from the older centralized paradigm to systems distributed across the field with an increasing pervasion of intelligence devices. The large-scale deployment of computational intelligence technologies in smart grids could lead to a more efficient tasks distribution amongst energy resources and, consequently, to a sensible improvement of the electrical grid flexibility

The role of communication systems in smart grids: Architectures, technical solutions and research challenges

The purpose of this survey is to present a critical overview of smart grid concepts, with a special focus on the role that communication, networking and middleware technologies will have in the transformation of existing electric power systems into smart grids. First of all we elaborate on the key technological, economical and societal drivers for the development of smart grids. By adopting a data-centric perspective we present a conceptual model of communication systems for smart grids, and we identify functional components, technologies, network topologies and communication services that are needed to support smart grid communications. Then, we introduce the fundamental research challenges in this field including communication reliability and timeliness, QoS support, data management services, and autonomic behaviors. Finally, we discuss the main solutions proposed in the literature for each of them, and we identify possible future research directions