Exploiting WSRF and WSRF.NET for Remote Job Execution in Grid Environments

new way for manipulating "stateful resources " to perform grid computing tasks using Web Services. This paper discusses, to our knowledge, the most complex application built to date utilizing WSRF concepts. We describe a remote job execution system that handles scheduling, data movement, security and inter-job dependencies. The application is built on top of WSRF.NET, the first publicly-available toolkit for constructing WSRF-compliant Web Services. WSRF.NET is an open-source project that implements both the WSRF and WS-Notification family of specifications and runs on the Microsoft.NET platform. Our explicit goal in the effort reported in this paper is not to replace the existing tools such as GRAM/GlobusRun, MDS and Condor/Condor-G but rather to evaluate--via a concrete implementation--the new capabilities provided for such Grid operations via WSRF. We find that, in general, WSRF and WS-Notification facilitate far richer client-side and server-side interactions than previously accomplished in the state of the art in Grid computing. 1

A Semantically Enhanced Approach for Orchestration of Web Services in Factory Automation Systems

The Service-oriented Architecture (SOA) paradigm makes it possible to build systems from several independent components. Most typically, web services are chosen as the building blocks of such a system. A web service is essentially a passive software entity, which listens for request messages sent to it over the network, possibly reacts to the requests by performing some operations, and finally sends response messages to the request senders. The traditional application domain of web services belongs to the so-called IT domain. While opening new horizons in software development life-cycles, web services have been adopted in various new application domains, including the domain of factory automation (software development for factory automation). Indeed, recent research projects have experimented with controlling production system equipment through web service interfaces. When migrated from pure software to the physical realm involving industrial equipment, web services set additional demands for the application domains. For example, since the domains involve operations with physical effects, roll-back or application recovery procedures become challenging. This research work targets the orchestration of factory automation systems encapsulated as web services and presents various techniques for overcoming the difficulties. Orchestrating web services to accomplish a complicated production task can be difficult due to the transitoriness of both production equipment states and the set of available web services. Nevertheless, the selection of appropriate web services can be facilitated by augmenting each service with semantic information describing its conditions and effects. Web services augmented with such descriptions are termed semantic web services. While Web Ontology Language, OWL, is ideal for describing application domain concepts and property relationships, the OWL-S ontology, which is based on OWL, has been specifically developed for describing web services. Once the semantic service descriptions have been analyzed to find the appropriate web services, the selected services can be invoked using their syntactic WSDL descriptions. In addition to automated web service selection, semantic descriptions allow the composition of web services to achieve production tasks. Service composition involves first analyzing the descriptions to determine the appropriate service invocation process for achieving the desired goal and then executing the process. This dissertation presents an approach in which the production equipment and their states are represented using an ontology, and the model is dynamically used in decision-making. In particular, the devices in the considered production systems provide web service interfaces through which they can be controlled, while semantic web service descriptions formulated in OWL-S make it possible to determine the conditions and effects of invoking the web services. The approach presented in this research work additionally involves a set of specialized web services that co-operate to achieve production goals using the domain web services. One of the services maintains a semantic model of the current system state, while another uses the model to compose the domain web services so that they jointly achieve the desired goals. The semantic model of the system is automatically updated based on event notifications sent by the domain services. Software agents controlling production devices must maintain an up-to-date view of the physical world state in order to efficiently reason and plan their actions. Especially in a factory automation system, the world state undergoes rapid evolution, and the world view must remain synchronized with the changes. This research discusses two approaches to updating the world view based on event notifications sent by web services representing production devices in a manufacturing system. One of the approaches is based on separately specified update rules, and one automatically uses semantic web service descriptions formulated in OWL-S. While all of the examples presented in this research work specifically focus on the factory automation domain, the presented approaches are applicable to all domains involving semantic web services. Semantic Web Service descriptions facilitate the automated discovery and composition of web services. Particularly in the production system domain, the service condition and effect descriptions are essential in selecting the appropriate service or service composition for a given task. OWL-S is one of the most popular semantic web service description languages, and due to its XML syntax, OWL-S can be effortlessly incorporated into service WSDL descriptions. However, developing OWL-S documents for each service instance is laborious. This dissertation presents an approach to automatically generating executable OWL-S descriptions from semantically annotated service WSDL files. Computing clouds facilitate rapid and effortless resource allocation. Cloud consumers can generally be ignorant of the physical computing resources used or their geographical location, as the resources are abstracted into a commodity that can be dynamically leased from the cloud provider. In particular, Infrastructure-as-a-Service clouds allow clients to dynamically lease virtual machines that behave similarly to physical servers. However, executing an application by directly using computing cloud resources is complicated and typically involves similar steps as installing and executing an application on a physical machine. Moreover, starting numerous application instances on a single virtual machine may result in poor performance. Thus, this dissertation considers the development of a web service that facilitates the use of cloud resources by abstracting them. When the web service is used, an application can be effortlessly started in a computing cloud by invoking simple web service operations. Furthermore, when multiple applications are started, the workload can be automatically distributed between several virtual machines, resulting in higher performance. To conclude, the results presented in this research work demonstrate that semantic web service descriptions can indeed facilitate automatic web service composition and invocation. However, the effort of developing semantic web service descriptions can partly undermine the benefits achieved through their application. Therefore, new tools and methods should be developed to minimize the effort of developing such descriptions

Modelling Workflow Using Web Services

The use of web services technology is becoming more widespread with many businesses wishing to provide services to their clients over the Internet. Although web services technology is currently the best method for providing services remotely over the Internet it does not provide any concept of state or any way to model workflow. This has resulted in new specifications to deal with these issues, namely WSRF and BPEL4WS. In order to effectively model certain types of workflow, such as that of the Chem-Search laboratory, there needs to be a method for integrating BPEL4WS and WSRF, so that stateful workflow can be modelled. This research proposed a method of integration using a proxy service to enable BPEL4WS to support WSRF that was evaluated by modelling the workflow of the laboratory. The results showed that the method enabled BPEL4WS to work with WSRF and provided a mechanism that ensured a client always had a valid endpoint reference to the WSRF web service. This research also raised some problems with the specifications and tools used to implement this method that would need to be resolved to ensure the widespread adoption and standardisation of these specifications.Unpublished[Amin et al., 2004] Amin K., von Laszewski G., Hategan M., Zaluzec N. J., Hampton S., Rossi A., GridAnt: A Client-Controllable Grid Workflow System, Proceedings of the 37th Annual Hawaii International Conference on System Sciences, Volume 07, Number 7, pp 70210c, 2004. [Andrews et al., 2003] Andrews T., Curbera F., Dholakia H., Goland Y., Klein J., Leymann F., Liu K., Roller D., Smith D., Thatte S., Trickovic I., Weerawarana S., Business Process Execution Language for Web Services Version 1.1, 2003. Available at: ftp://www6.software.ibm.com/software/developer/library/ws-bpel.pdf. [Ant, 2005] Ant, http: //ant . apache . org/, accessed 11 July 2005. [Apache, 2005] Apache, http : //www apache org/, accessed 11 July 2005. [Atkinson et al., 2005] Atkinson M., DeRoure D., Dunlop A., Fox G., Henderson P., Hey T., Paton N., Newhouse S., Parastatidis S., Trefethen A., Watson P., Webber J., Web Services Grids: An Evolutionary Approach, Concurrency and Computation: Practice and Experience, Volume 17, pp 377-389, 2005. [CapeClear, 2005] CapeClear, http : //www . capeclear . com/, accessed 4 October 2005. [Chao et al., 2004] Chao K., Younas M., Griffiths N., Awan I., Anane R., Tsai C., Analysis of Grid Service Composition with BPEL4WS, 18th International Conference on Advanced Information Networking and Applications, Volume 01, Number 1, pp 284, 2004. [Churches et al., 2005] Churches D., Gombas G., Harrison A., Maassen J., Robinson C., Shields M., Taylor I., Wang I., Programming Scientific and Distributed Workflow with Triana Services. Available at: http://www.extreme.incliana.edu/groc/ggf10-ww/prograrnming scientific_ and_ distributed_ workflow with_ triana_ services/ TrianaWorkflow.pdf. [Czajkowski et al., 2004] Czajkowski K., Ferguson D., Foster I., Frey J., Graham S., Sedukhin I., Snelling D., Tuecke S., Vambenepe W., The WS-Resource Framework, Version 1.0, 2004. Available at: http://www-128.ibm.comAleveloperworks/library/ws-resource/ ws-wsrf.pdf, accessed 11 July 2005. [eclipse, 2005] eclipse, http : //www. eclipse . org/, accessed 4 October 2005. [Foster et al., 2001] [Foster et al., 2002] Foster I., Kesselman C., Tuecke S., The Anatomy of the Grid: Enabling Scalable Virtual Organizations, First International Symposium on Cluster Computing and the Grid, Volume 00, pp 6, 2001. Foster, I., Kesselman, C., Nick, J., Tuecke, S., The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration, Globus Project, 2002. Available at: http : //www . globus org/research/papers/ogsa .pdf . [Foster et al., 2004] Foster I., Frey J., Graham S., Tuecke S., Czajkowski K., Ferguson D., Leymann F., Nally M., Sedukhin I., Snelling D., Storey T., Vambenepe W., Weerawarana S., Modelling Stateful Resources with Web Services, Version 1.1, 2004. Available at: http://www-128.ibm.com/developerworks/library/ ws-resource/ws-modelingresources.pdf, accessed 11 July 2005. [GridAnt, 2005] GridAnt, http : //www-unix globus org/cog/proj ects/gridant/, accessed 11 July 2005. [Hey et al., 2005] Hey T., Fox, G., Special Issue: Grids and Web Services for e-Science, Concurrency and Computation: Practice and Experience, Volume 17, Number 2-4, 2005, pp 317-322. [Humphrey et al., 2004] Humphrey M., Wasson G., Morgan M., Beekwilder N., An Early Evaluation of WSRF and WS-Notification via WSRF.NET, The Fifth IEEE/ACM International Workshop on Grid Computing, Volume 00, pp 172-181, 2004. [Hunter et al., 2005] Hunter J., Cook R., Pope S., E-Research Middleware: The Missing Link in Australia's e-Research Agenda, 2004. Available at: http://www.dstc.edu.au/Publications/eReseachMiddleware.pdf, accessed 18 July 2005. [Johnson, 2005] Johnson B., Building a Web Service The Beginning--What is a Web Service?, http://www.developerfusion.com/show/3245/, accessed 11 July 2005. [Krishnan et al., 2005] Krishnan S., Wagstrom P., von Laszewskil G., GSFL: A Workflow Framework for Grid Services. Available at: http://www.cs.indiana.edu/ srikrish/ publications/gsfl.pdf, accessed 18 July 2005. [Leymann, 2005] [MySQL, 2005] [Oracle, 2005] [Pasley, 2005] [Slomiski, 2005] Leymann F., Choreography for the Grid: Towards Fitting BPEL to the Resource Framework. Available at: http://www.cc-pe.net/CCPEwebresource/ c8545to872workflow/c8541eymann/c854Leymann.pdf, accessed 11 July 2005. MySQL, http : //www. mysql . com/, accessed 4 October 2005. Executive Briefing: Grid Computing. Available at: http://regitworld.com/serylet/Frs.frs?Context- LOGENTRY&Source=cwstrip&Source_BC=0 SzScript--/LP/10003705/reg. Pasley J., How BPEL and SOA Are Changing Web Services Development, IEEE Internet Computing, Volume 09, Number 3, pp 60-67, 2005. Slomiski A., On Using BPEL Extensibility to Implement OGSI and WSRF Grid Workflows, March 2005. Available at: http://www.extreme.indiana.edu/groc/ggf10-ww/on_using_bpel extensibility_to_implements_ogsi_and_wsrf_grids/C871 GridWorkflow2004_Mar05_0n_Using_BPEL_extensibility implements_OGSI_and_WSRF_Grids_5.doc. [Sotomayor, 2005] Sotomayor B., The Globus Toolkit 4 Programmer's Tutorial, http://gdp.globus.org/gt4-tutorial/singlehtml/progtutorial_0.1.1.html, accessed 4 October 2005. [Staab et al., 2003] [Taylor et al., 2005] Staab S., van der Aalst W., Benjamins V. R., Sheth A., Miller J. A., Bussler C., Maedche A., Fensel D., Gannon D., Web Services: Been There, Done That?, IEEE Intelligent Systems, Volume 18, Number 1, pp 72-85, 2003. Taylor I., Wang I., Shields M., Majithia S., Distributed Computing with Triana on the Grid, Concurrency and Computation: Practice and Experience, Volume 17, 2005, pp 1-18. [Tomcat, 2005] Apache Tomcat, http: //tomcat .apache. org/, accessed 4 October 2005. [Triana, 2005] Triana, http://www.trianacode.org/, accessed 11 July 2005. [Tuecke et al., 2003] Tuecke S., Czajkowski K., Foster I., Frey J., Graham S., Kesselman C., Maguire T., Sandholm T.,Snelling D., Vanderbilt P., Open Grid Services Infrastructure (OGSI), Version 1.0. Available at: http://www-unix.globus.org/toolkit/ draft-ggf-ogsi-gridservice-33_2003-06-27.pdf, accessed 18 October 2005. [UDDI, 2004] [W3C, 2001] [W3C, 2003] [W3C, 2004a] UDDI Spec Technical Committee, UDDI Version 3.0.2, 2004, http://uddi.org/pubs/uddi_v3.htm, accessed 11 July 2005. W3C, Web Services Description Language (WSDL) 1.1, 2001, http://www.w3.org/TR/wsdl, accessed 11 July 2005. W3C, SOAP Version 1.2 Part 1: Messaging Framework, 2003, http://www,w3.org/TR/soap12-part1/, accessed 11 July 2005. W3C, Web Services Glossary, 2004a, http://www.w3.org/TR/ws-gloss/, accessed 18 July 2005. [W3C, 2004b] W3C, Web Services Addressing (WS-Addressing), 2004b. Available at: http://www.w3.org/Submission/2004/SUBM-ws-addressing-20040810/. [W3C, 2004c] W3C, Web Services Architecture, 2004c, http://www.w3.org/TR/ws-arch/, accessed 12 July 2005. [Wasson et al., 2005] Wasson G., Humphrey M., Exploiting WSRF and WSRF.NET for Remote Job Execution in Grid Environments, Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium, Volume 01, Number 1, pp 12, 2005. [Yang et al., 2004] Yang Y., Tang S., Zhang W., Fang L., A Workflow Language for Grid Services in OGSI-based Grids, Lecture Notes in Computer Science, Volume 3251, pp 65-72, 2004

Modelling Workflow Using Web Services

The use of web services technology is becoming more widespread with many businesses wishing to provide services to their clients over the Internet. Although web services technology is currently the best method for providing services remotely over the Internet it does not provide any concept of state or any way to model workflow. This has resulted in new specifications to deal with these issues, namely WSRF and BPEL4WS. In order to effectively model certain types of workflow, such as that of the Chem-Search laboratory, there needs to be a method for integrating BPEL4WS and WSRF, so that stateful workflow can be modelled. This research proposed a method of integration using a proxy service to enable BPEL4WS to support WSRF that was evaluated by modelling the workflow of the laboratory. The results showed that the method enabled BPEL4WS to work with WSRF and provided a mechanism that ensured a client always had a valid endpoint reference to the WSRF web service. This research also raised some problems with the specifications and tools used to implement this method that would need to be resolved to ensure the widespread adoption and standardisation of these specifications.Unpublished[Amin et al., 2004] Amin K., von Laszewski G., Hategan M., Zaluzec N. J., Hampton S., Rossi A., GridAnt: A Client-Controllable Grid Workflow System, Proceedings of the 37th Annual Hawaii International Conference on System Sciences, Volume 07, Number 7, pp 70210c, 2004. [Andrews et al., 2003] Andrews T., Curbera F., Dholakia H., Goland Y., Klein J., Leymann F., Liu K., Roller D., Smith D., Thatte S., Trickovic I., Weerawarana S., Business Process Execution Language for Web Services Version 1.1, 2003. Available at: ftp://www6.software.ibm.com/software/developer/library/ws-bpel.pdf. [Ant, 2005] Ant, http: //ant . apache . org/, accessed 11 July 2005. [Apache, 2005] Apache, http : //www apache org/, accessed 11 July 2005. [Atkinson et al., 2005] Atkinson M., DeRoure D., Dunlop A., Fox G., Henderson P., Hey T., Paton N., Newhouse S., Parastatidis S., Trefethen A., Watson P., Webber J., Web Services Grids: An Evolutionary Approach, Concurrency and Computation: Practice and Experience, Volume 17, pp 377-389, 2005. [CapeClear, 2005] CapeClear, http : //www . capeclear . com/, accessed 4 October 2005. [Chao et al., 2004] Chao K., Younas M., Griffiths N., Awan I., Anane R., Tsai C., Analysis of Grid Service Composition with BPEL4WS, 18th International Conference on Advanced Information Networking and Applications, Volume 01, Number 1, pp 284, 2004. [Churches et al., 2005] Churches D., Gombas G., Harrison A., Maassen J., Robinson C., Shields M., Taylor I., Wang I., Programming Scientific and Distributed Workflow with Triana Services. Available at: http://www.extreme.incliana.edu/groc/ggf10-ww/prograrnming scientific_ and_ distributed_ workflow with_ triana_ services/ TrianaWorkflow.pdf. [Czajkowski et al., 2004] Czajkowski K., Ferguson D., Foster I., Frey J., Graham S., Sedukhin I., Snelling D., Tuecke S., Vambenepe W., The WS-Resource Framework, Version 1.0, 2004. Available at: http://www-128.ibm.comAleveloperworks/library/ws-resource/ ws-wsrf.pdf, accessed 11 July 2005. [eclipse, 2005] eclipse, http : //www. eclipse . org/, accessed 4 October 2005. [Foster et al., 2001] [Foster et al., 2002] Foster I., Kesselman C., Tuecke S., The Anatomy of the Grid: Enabling Scalable Virtual Organizations, First International Symposium on Cluster Computing and the Grid, Volume 00, pp 6, 2001. Foster, I., Kesselman, C., Nick, J., Tuecke, S., The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration, Globus Project, 2002. Available at: http : //www . globus org/research/papers/ogsa .pdf . [Foster et al., 2004] Foster I., Frey J., Graham S., Tuecke S., Czajkowski K., Ferguson D., Leymann F., Nally M., Sedukhin I., Snelling D., Storey T., Vambenepe W., Weerawarana S., Modelling Stateful Resources with Web Services, Version 1.1, 2004. Available at: http://www-128.ibm.com/developerworks/library/ ws-resource/ws-modelingresources.pdf, accessed 11 July 2005. [GridAnt, 2005] GridAnt, http : //www-unix globus org/cog/proj ects/gridant/, accessed 11 July 2005. [Hey et al., 2005] Hey T., Fox, G., Special Issue: Grids and Web Services for e-Science, Concurrency and Computation: Practice and Experience, Volume 17, Number 2-4, 2005, pp 317-322. [Humphrey et al., 2004] Humphrey M., Wasson G., Morgan M., Beekwilder N., An Early Evaluation of WSRF and WS-Notification via WSRF.NET, The Fifth IEEE/ACM International Workshop on Grid Computing, Volume 00, pp 172-181, 2004. [Hunter et al., 2005] Hunter J., Cook R., Pope S., E-Research Middleware: The Missing Link in Australia's e-Research Agenda, 2004. Available at: http://www.dstc.edu.au/Publications/eReseachMiddleware.pdf, accessed 18 July 2005. [Johnson, 2005] Johnson B., Building a Web Service The Beginning--What is a Web Service?, http://www.developerfusion.com/show/3245/, accessed 11 July 2005. [Krishnan et al., 2005] Krishnan S., Wagstrom P., von Laszewskil G., GSFL: A Workflow Framework for Grid Services. Available at: http://www.cs.indiana.edu/ srikrish/ publications/gsfl.pdf, accessed 18 July 2005. [Leymann, 2005] [MySQL, 2005] [Oracle, 2005] [Pasley, 2005] [Slomiski, 2005] Leymann F., Choreography for the Grid: Towards Fitting BPEL to the Resource Framework. Available at: http://www.cc-pe.net/CCPEwebresource/ c8545to872workflow/c8541eymann/c854Leymann.pdf, accessed 11 July 2005. MySQL, http : //www. mysql . com/, accessed 4 October 2005. Executive Briefing: Grid Computing. Available at: http://regitworld.com/serylet/Frs.frs?Context- LOGENTRY&Source=cwstrip&Source_BC=0 SzScript--/LP/10003705/reg. Pasley J., How BPEL and SOA Are Changing Web Services Development, IEEE Internet Computing, Volume 09, Number 3, pp 60-67, 2005. Slomiski A., On Using BPEL Extensibility to Implement OGSI and WSRF Grid Workflows, March 2005. Available at: http://www.extreme.indiana.edu/groc/ggf10-ww/on_using_bpel extensibility_to_implements_ogsi_and_wsrf_grids/C871 GridWorkflow2004_Mar05_0n_Using_BPEL_extensibility implements_OGSI_and_WSRF_Grids_5.doc. [Sotomayor, 2005] Sotomayor B., The Globus Toolkit 4 Programmer's Tutorial, http://gdp.globus.org/gt4-tutorial/singlehtml/progtutorial_0.1.1.html, accessed 4 October 2005. [Staab et al., 2003] [Taylor et al., 2005] Staab S., van der Aalst W., Benjamins V. R., Sheth A., Miller J. A., Bussler C., Maedche A., Fensel D., Gannon D., Web Services: Been There, Done That?, IEEE Intelligent Systems, Volume 18, Number 1, pp 72-85, 2003. Taylor I., Wang I., Shields M., Majithia S., Distributed Computing with Triana on the Grid, Concurrency and Computation: Practice and Experience, Volume 17, 2005, pp 1-18. [Tomcat, 2005] Apache Tomcat, http: //tomcat .apache. org/, accessed 4 October 2005. [Triana, 2005] Triana, http://www.trianacode.org/, accessed 11 July 2005. [Tuecke et al., 2003] Tuecke S., Czajkowski K., Foster I., Frey J., Graham S., Kesselman C., Maguire T., Sandholm T.,Snelling D., Vanderbilt P., Open Grid Services Infrastructure (OGSI), Version 1.0. Available at: http://www-unix.globus.org/toolkit/ draft-ggf-ogsi-gridservice-33_2003-06-27.pdf, accessed 18 October 2005. [UDDI, 2004] [W3C, 2001] [W3C, 2003] [W3C, 2004a] UDDI Spec Technical Committee, UDDI Version 3.0.2, 2004, http://uddi.org/pubs/uddi_v3.htm, accessed 11 July 2005. W3C, Web Services Description Language (WSDL) 1.1, 2001, http://www.w3.org/TR/wsdl, accessed 11 July 2005. W3C, SOAP Version 1.2 Part 1: Messaging Framework, 2003, http://www,w3.org/TR/soap12-part1/, accessed 11 July 2005. W3C, Web Services Glossary, 2004a, http://www.w3.org/TR/ws-gloss/, accessed 18 July 2005. [W3C, 2004b] W3C, Web Services Addressing (WS-Addressing), 2004b. Available at: http://www.w3.org/Submission/2004/SUBM-ws-addressing-20040810/. [W3C, 2004c] W3C, Web Services Architecture, 2004c, http://www.w3.org/TR/ws-arch/, accessed 12 July 2005. [Wasson et al., 2005] Wasson G., Humphrey M., Exploiting WSRF and WSRF.NET for Remote Job Execution in Grid Environments, Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium, Volume 01, Number 1, pp 12, 2005. [Yang et al., 2004] Yang Y., Tang S., Zhang W., Fang L., A Workflow Language for Grid Services in OGSI-based Grids, Lecture Notes in Computer Science, Volume 3251, pp 65-72, 2004