Congestion-Aware Scalable Video Streaming

Postprin

Rate-distortion performance of H.264/AVC compared to state-of-the-art video codecs

In the domain of digital video coding, new technologies and solutions are emerging in a fast pace, targeting the needs of the evolving multimedia landscape. One of the questions that arises is how to assess these different video coding technologies in terms of compression efficiency. In this paper, several compression schemes are compared by means of peak signal-to-noise ratio (PSNR) and just noticeable difference (JND). The codecs examined are XviD 0.9.1 (conform to the MPEG-4 Visual Simple Profile), DivX 5.1 (implementing the MPEG-4 Visual Advanced Simple Profile), Windows Media Video 9, MC-EZBC and H.264/AVC AHM 2.0 (version JM 6.1 of the reference software, extended with rate control). The latter plays a key role in this comparison because the H.264/AVC standard can be considered as the de facto benchmark in the field of digital video coding. The obtained results show that H.264/AVC ARM 2.0 outperforms current proprietary and standards-based implementations in almost all cases. Another observation is that the choice of a particular quality metric can influence general statements about the relation between the different codecs

Description-driven Adaptation of Media Resources

The current multimedia landscape is characterized by a significant diversity in terms of available media formats, network technologies, and device properties. This heterogeneity has resulted in a number of new challenges, such as providing universal access to multimedia content. A solution for this diversity is the use of scalable bit streams, as well as the deployment of a complementary system that is capable of adapting scalable bit streams to the constraints imposed by a particular usage environment (e.g., the limited screen resolution of a mobile device). This dissertation investigates the use of an XML-driven (Extensible Markup Language) framework for the format-independent adaptation of scalable bit streams. Using this approach, the structure of a bit stream is first translated into an XML description. In a next step, the resulting XML description is transformed to reflect a desired adaptation of the bit stream. Finally, the transformed XML description is used to create an adapted bit stream that is suited for playback in the targeted usage environment. The main contribution of this dissertation is BFlavor, a new tool for exposing the syntax of binary media resources as an XML description. Its development was inspired by two other technologies, i.e. MPEG-21 BSDL (Bitstream Syntax Description Language) and XFlavor (Formal Language for Audio-Visual Object Representation, extended with XML features). Although created from a different point of view, both languages offer solutions for translating the syntax of a media resource into an XML representation for further processing. BFlavor (BSDL+XFlavor) harmonizes the two technologies by combining their strengths and eliminating their weaknesses. The expressive power and performance of a BFlavor-based content adaptation chain, compared to tool chains entirely based on either BSDL or XFlavor, were investigated by several experiments. One series of experiments targeted the exploitation of multi-layered temporal scalability in H.264/AVC, paying particular attention to the use of sub-sequences and hierarchical coding patterns, as well as to the use of metadata messages to communicate the bit stream structure to the adaptation logic. BFlavor was the only tool to offer an elegant and practical solution for XML-driven adaptation of H.264/AVC bit streams in the temporal domain

Control-theoretic adaptive mechanisms for performance optimization of IEEE 802.11 WLANs: design, implementation and experimental evaluation

The media access control (MAC) layer of the IEEE 802.11 standard specifies a set of parameters that regulate the behavior of the wireless stations when accessing the channel. Although the standard defines a set of recommended values for these parameters, they are statically set and do not take into account the current conditions in the wireless local area network (WLAN) in terms of, e.g., number of contending stations and the traffic they generate, which results in suboptimal performance. In this thesis we propose two novel control theoretic approaches to optimally configure the WLAN parameters based on the dynamically observed network conditions: a Centralized Adaptive Control (CAC) algorithm, whereby the access point (AP) computes the con guration that maximizes performance and signals it to the active stations, and a Distributed Adaptive Control (DAC) algorithm, which is independently employed by each station with the same goal. In contrast to previous proposals, which are mostly based on heuristics, our approaches build upon (i) analytical models of the WLAN performance, used to derive the optimal point of operation of the IEEE 802.11 protocol, and (ii) mathematical foundations from single- and multi-variable control theory, used to design the mechanisms that drive the WLAN to this point of operation. Another key advantage of the proposed algorithms over existing approaches is that they are compliant with the IEEE 802.11 standard and can be implemented with current wireless cards without introducing any modifications into their hardware and/or firmware. We show by means of an exhaustive performance evaluation study that our algorithms maximize the WLAN performance in terms of throughput and delay under a wide set of network conditions, substantially outperforming the standard recommended configuration as well as previous adaptive proposals. Finally, we present our experiences with implementing the proposed adaptive algorithms in a real IEEE 802.11 testbed and discuss the implementation details of the building blocks that comprise these mechanisms. We evaluate their performance by conducting extensive measurements, considering different network conditions in terms of number of nodes, transmission power employed and tra c generated. Based on the obtained results, we provide valuable insights on the performance of the distributed and centralized algorithms and discuss the suitability of these schemes for real deployments. ------------------------------------------------------------------------------------------------------------------------------------------------------------------------El nivel MAC (Media Access Control) del estándar IEEE 802.11 especifica una serie de parámetros que definen el comportamiento de las estaciones inalámbricas cuando acceden al canal. En dicho estándar se define un conjunto de valores recomendados para estos parámetros, si bien estos valores, constantes, no tienen en cuenta las condiciones de la red inalámbrica -en términos de, por ejemplo, número de estaciones o tráfico cursado- por lo que resultan en un rendimiento subóptimo. En esta tesis se proponen dos nuevos algoritmos para configurar de forma óptima estos parámetros partiendo de las condiciones observadas de la red. Dichos algoritmos, construidos sobre la base de la teoría de control, son los siguientes: CAC (Centralized Adaptive Control), que se ejecuta en el punto de acceso, el cual distribuye la configuración a usar al resto de estaciones; y DAC (Distributed Adaptive Control), ejecutado por cada estación de la red inalámbrica de forma independiente. A diferencia de las propuestas anteriores, casi todas ellas basada en heurísticos, los algoritmos se basan en (i) un modelo analítico del rendimiento de la red inalámbrica, necesario para obtener el punto de operación óptimo de la red; y (ii) fundamentos matemáticos de la teoría de control mono y multivariable, aplicados para diseñar el mecanismo que lleva la red a dicho punto de operación. Otra ventaja de los esquemas propuestos frente al trabajo previo es que son compatibles con el estándar IEEE 802.11, y pueden ser implementados sobre las tarjetas existentes sin necesidad de cambiar el hardware o el firmware. Mediante una extensa evaluación de rendimiento bajo diversas condiciones, se comprueba que los algoritmos maximizan las prestaciones de la red tanto en ancho de banda como en retardo, mejorando notablemente los resultados proporcionados por la configuración recomendada en el estándar así como por propuestas dinámicas anteriores. Por último, se presentan las experiencias del prototipado de dichos algoritmos sobre dispositivos IEEE 802.11, discutiendo los detalles de implementación de sus diferentes bloques. Se evalúan las prestaciones de los mismos mediante una extensa serie de experimentos, incluyendo diferentes escenarios en términos del número de nodos, potencia de transmisión usada y tráfico generado. Los resultados obtenidos permiten extraer valiosas conclusiones sobre el rendimiento de los esquemas adaptativos centralizados y distribuidos, así como la viabilidad de su despliegue en escenarios reales

Detection and representation of moving objects for video surveillance

In this dissertation two new approaches have been introduced for the automatic detection of moving objects (such as people and vehicles) in video surveillance sequences. The first technique analyses the original video and exploits spatial and temporal information to find those pixels in the images that correspond to moving objects. The second technique analyses video sequences that have been encoded according to a recent video coding standard (H.264/AVC). As such, only the compressed features are analyzed to find moving objects. The latter technique results in a very fast and accurate detection (up to 20 times faster than the related work). Lastly, we investigated how different XML-based metadata standards can be used to represent information about these moving objects. We proposed the usage of Semantic Web Technologies to combine information described according to different metadata standards