94 research outputs found
Autonomous resource-aware scheduling of large-scale media workflows
The media processing and distribution industry generally requires considerable resources to be able to execute the various tasks and workflows that constitute their business processes. The latter processes are often tied to critical constraints such as strict deadlines. A key issue herein is how to efficiently use the available computational, storage and network resources to be able to cope with the high work load. Optimizing resource usage is not only vital to scalability, but also to the level of QoS (e.g. responsiveness or prioritization) that can be provided. We designed an autonomous platform for scheduling and workflow-to-resource assignment, taking into account the different requirements and constraints. This paper presents the workflow scheduling algorithms, which consider the state and characteristics of the resources (computational, network and storage). The performance of these algorithms is presented in detail in the context of a European media processing and distribution use-case
Performance model for āJust-in-Timeā problems in real-time multimedia applications
Over the last few years, the use of large-scale
multimedia data applications has been growing tremendously,
and this growth is not likely to slow down in the near future.
Many multimedia applications operate in a real-time environment
(e.g., surveillance cameras, iris scans), which must meet strict
time constraints, i.e. to analyze video frames at the same rate as
a camera produces them. To meet this requirement, Grid computing
is rapidly becoming indispensable. However, the variabilities
of the software and the hardware in grid environment cause
the strong burstiness in the transmission delay of video frames.
Because the burstiness is unknown beforehand, it is difficult to
determine the right sending moments of video frames. If the
time interval between sending two sequential frames is too large,
then the service utilization may be low. If use large buffer to
guarantee the service utilization, then video frames may be outof-
date because of the long waiting time at buffer in the server
side. This problem is referred to as āJust-in-timeā problem. To
solve this problem, it is essential to determine the right sending
moments of video frames, properly dealing with the trade-off
between the service utilization and the āup-to-dateā of video
frames.
Motivated by this, in this paper we develop an adaptive control
method that react to the continuously changing circumstances in
grid system so as to obtain the highest service utilization on the
one hand and to keep the video frame up-to-date on the other
hand. Extensive experimental validation in our DAS-3 testbed
and the trace-driven simulation show that our method is indeed
highly effective
P-3PC: A Point-to-Point Communication Model for Automatic and Optimal Decomposition of Regular Domain Problems
A comparison of distributed data parallel multimedia computing over conventional and optical wide-area networks
- ā¦