Dvorák,  F.

Filipovic,  J.

Kouril,  D.

Krenek,  A.

Matyska,  L.

Salvet,  Z.

Sitera,  J.

Sustr, Z.

Vocu,  M.

English

NEUROSURGERY ENTHUSIASTIC WOMEN SOCIETY

LB Service - beyond glite-wms-job-status

ZENODO

For more information: www.eu-emi.euL&B Service – beyond glite-wms-job-statusŠustr, Z.; Sitera, J.; Krˇenek, A.; Vocu˚, M.; Filipovicˇ, J.; Salvet, Z.; Matyska, L.; Dvorˇák, F.; Kourˇil, D.CESNETTeaching L&B to Know about Sandbox TransfersSandbox transfer problems are a major cause for delayed or failedjobs in gLite. It is essential to know more about failures and theirpossible causes.gLite’s L&B service [1] is used to track computing jobs managed bythe WMS [2]. Additionally, L&B was extended to support other typesof computing jobs such as Condor, PBS, native CREAM jobs, etc.Users can access information on their jobs in several ways.L&B receives events from various grid components and computes thestates jobs at any given time. This is a general principle that can beapplied not only to computing tasks but to other processes as well.In this case, we are employing the same principle to track the trans-fer of sandboxes. Events are generated by the Job Wrapper, whichis where the transfers themselves are initiated. Each transfer (inputsandbox and output sandbox) is registered as a unique job with itsown JobID, and cross-links are added to the status structure of therelevant computing job.Thanks to the fact that the tracking of sandbox transfers is fully sep-arated from the traditional gLite WMS job state diagram, the existingimplementation can also be used to support file transfer tracking inother applications or other computing job types.Extended Info on Running WMS JobsBesides the usual job state information L&B now also follows the status of sandbox transfers, giving users a more detailed overview of the sta-tus of their jobs. Sandbox transfer status information can be accessed by standard tools (API, command line utilities, HTTPs, notifications. . . )in the same manner as traditional computing jobs. Examples shown bellow use glite-lb-job_status to query the L&B server.Output Sandbox TransferRegisteredRunningDoneRunningReallyRunningDoneState and Details of the Computing Jobstate : RunningjobId : https://harad.ics.muni.cz:9158/KlDYyXPUAWwHXvCqALwQagowner : /DC=cz/DC=cesnet-ca/O=Masaryk University/CN=Ales Krenekjobtype : SIMPLE...sandbox_retrieved : 0jw_status : Wrapper_runningisb_transfer : https://harad.ics.muni.cz:9158/FT:DHXaS98mTXnKHAPTIGIjmQosb_transfer : https://harad.ics.muni.cz:9158/FT:JdVGHFd8pLsRjVQy3-m8mg...Output Sandbox Transfer Statusstate : RunningjobId : https://harad.ics.muni.cz:9158/FT:JdVGHFd8pLsRjVQy3-m8mgowner : /DC=cz/DC=cesnet-ca/O=Masaryk University/CN=Ales Krenekjobtype : FILE_TRANSFER...ft_compute_job : https://harad.ics.muni.cz:9158/KlDYyXPUAWwHXvCqALwQagft_sandbox_type : OUTPUTft_src : file:///scratch/5728608.batch.grid.cyf-kr.edu.pl/https_3a_2f_2fharad...ft_dest : gsiftp://pelargir1.ics.muni.cz:2811/var/glite/SandboxDir/Kl/https_3a_...File Transfer Events sent by Job WrapperEvents that affect the state of the Sandbox Transfer jobs originate from the Job Wrapper, running on the Computing Element.Both sandbox transfers are registered at the beginning and subsequent events (start, success or failure) are logged accordingly.Traditional WMS Job Life-CycleState of the Computing Job interpreted, as usual, by L&B. More detail can be achieved by logging and processing events regarding the status of sandbox transfers.Job State ExampleOur example shows a running computing job. The Input Sandbox has already been retrieved, the computation is done and the Computing Elements currently finds itself in the process of uploading the Output Sandbox.Status information obtained by calling glite-lb-job_status.Input Sandbox TransferRegisteredRunningDoneInput Sandbox Transfer Statusstate : DonejobId : https://harad.ics.muni.cz:9158/FT:DHXaS98mTXnKHAPTIGIjmQowner : /DC=cz/DC=cesnet-ca/O=Masaryk University/CN=Ales Krenekjobtype : FILE_TRANSFER...ft_compute_job : https://harad.ics.muni.cz:9158/KlDYyXPUAWwHXvCqALwQagft_sandbox_type : INPUTft_src : gsiftp://pelargir1.ics.muni.cz:2811/var/glite/SandboxDir/Kl/https_3a_...ft_dest : file:///scratch/5728608.batch.grid.cyf-kr.edu.pl/https_3a_2f_2fharad...References[1] The Logging and Bookkeeping Subsystem, http://egee.cesnet.cz/cs/JRA1/LB/[2] The gLite Workload Management System, Cecchi M. et al., Lecture Notes in Computer Science, 2009, Volume 5529Contact: L&B Product TeamE-mail: emi-lb@metacentrum.cz

The gLite Workload Management System, Cecchi M. et al.,

The Logging and Bookkeeping Subsystem,

https://zenodo.org/record/6709/files/sustr-EGITF10.pdf

LB Service - beyond glite-wms-job-status

Abstract

Similar works

Full text

Available Versions

NEUROSURGERY ENTHUSIASTIC WOMEN SOCIETY

ZENODO