Algorithms and Hardware Co-Design of HEVC Intra Encoders

Digital video is becoming extremely important nowadays and its importance has greatly increased in the last two decades. Due to the rapid development of information and communication technologies, the demand for Ultra-High Definition (UHD) video applications is becoming stronger. However, the most prevalent video compression standard H.264/AVC released in 2003 is inefficient when it comes to UHD videos. The increasing desire for superior compression efficiency to H.264/AVC leads to the standardization of High Efficiency Video Coding (HEVC). Compared with the H.264/AVC standard, HEVC offers a double compression ratio at the same level of video quality or substantial improvement of video quality at the same video bitrate. Yet, HE-VC/H.265 possesses superior compression efficiency, its complexity is several times more than H.264/AVC, impeding its high throughput implementation. Currently, most of the researchers have focused merely on algorithm level adaptations of HEVC/H.265 standard to reduce computational intensity without considering the hardware feasibility. What’s more, the exploration of efficient hardware architecture design is not exhaustive. Only a few research works have been conducted to explore efficient hardware architectures of HEVC/H.265 standard. In this dissertation, we investigate efficient algorithm adaptations and hardware architecture design of HEVC intra encoders. We also explore the deep learning approach in mode prediction. From the algorithm point of view, we propose three efficient hardware-oriented algorithm adaptations, including mode reduction, fast coding unit (CU) cost estimation, and group-based CABAC (context-adaptive binary arithmetic coding) rate estimation. Mode reduction aims to reduce mode candidates of each prediction unit (PU) in the rate-distortion optimization (RDO) process, which is both computation-intensive and time-consuming. Fast CU cost estimation is applied to reduce the complexity in rate-distortion (RD) calculation of each CU. Group-based CABAC rate estimation is proposed to parallelize syntax elements processing to greatly improve rate estimation throughput. From the hardware design perspective, a fully parallel hardware architecture of HEVC intra encoder is developed to sustain UHD video compression at 4K@30fps. The fully parallel architecture introduces four prediction engines (PE) and each PE performs the full cycle of mode prediction, transform, quantization, inverse quantization, inverse transform, reconstruction, rate-distortion estimation independently. PU blocks with different PU sizes will be processed by the different prediction engines (PE) simultaneously. Also, an efficient hardware implementation of a group-based CABAC rate estimator is incorporated into the proposed HEVC intra encoder for accurate and high-throughput rate estimation. To take advantage of the deep learning approach, we also propose a fully connected layer based neural network (FCLNN) mode preselection scheme to reduce the number of RDO modes of luma prediction blocks. All angular prediction modes are classified into 7 prediction groups. Each group contains 3-5 prediction modes that exhibit a similar prediction angle. A rough angle detection algorithm is designed to determine the prediction direction of the current block, then a small scale FCLNN is exploited to refine the mode prediction

Earth resources. A continuing bibliography with indexes, issue 23

This bibliography lists 226 reports, articles, and other documents introduced into the NASA scientific and technical information system between July 1, 1979 and September 30, 1979. Emphasis is placed on the use of remote sensing and geophysical instrumentation in spacecraft and aircraft to survey and inventory natural resources and urban areas. Subject matter is grouped according to agriculture and forestry, environmental changes and cultural resources, geodesy and cartography, geology and mineral resources, hydrology and water management, data processing and distribution systems, instrumentation and sensors, and economic analysis

Integrated payload and mission planning, phase 3. Volume 3: Ground real-time mission operations

The payloads tentatively planned to fly on the first two Spacelab missions were analyzed to examine the cost relationships of providing mission operations support from onboard vs the ground-based Payload Operations Control Center (POCC). The quantitative results indicate that use of a POCC, with data processing capability, to support real-time mission operations is the most cost effective case

Landslide motion assessment including thermal interaction : an MPM approach

Risk associated with landslides of natural or man-made origin depends on the prediction of the post-failure behaviour of the mobilized mass. Numerical models capable of integrating the landslide geometry and its evolution, the coupled hydro mechanical interaction and the soil properties in the context of dynamic forces and large displacements are currently under development. This thesis is a contribution to this effort. In this sense, the material point method (MPM) is especially suited for analyzing landslides with large displacements. This numerical procedure must be accompanied by tests under controlled conditions in order to accurately check and calibrate the numerical response. In this thesis the capabilities of the MPM code developed are evaluated through the modelling of scaled laboratory slope tests with large displacements. In order to achieve an adequate comparison of the experimental and numerical results, the experiments are analysed by means of the interpretation of sequential digital images of the movement of the granular medium during the test (PIV technique). A novel procedure is developed to obtain the field of deformations over time and the tracking of particle path in a manner suitable for comparison with numerical results calculated in MPM. The main objective of the thesis was the development of a comprehensive calculation tool capable of simulating the behaviour of the slides from the initial triggering to the post-failure phase including thermal effects that determine the evolution of the movement. A formulation for non-isothermal problems coupled with hydraulic and mechanical behaviour in MPM was developed and implemented. The formulation includes the dissipation of frictional work as heat, which takes place, mainly, in shear bands. The described phenomena are strongly dependent on the thickness of the shear band and this result in a strong dependence of the numerical results in MPM with the discretization mesh. A novel procedure to solve this problem is presented in this thesis. Finally, very rapid Vajont landslide (Italy 1963) is modelled. A plain strain 2D model is presented without an “a priori” definition of the sliding surface. In fact, in a generalization of previous and recent work, the mobilized materials are not restricted to rigid solids interconnected along a predefined contact surface and the heat generation is not it is limited to a single predefined surface. Thus, thermal interaction processes are developed throughout the model as a function of the location and intensity of deformations.El riesgo asociado con deslizamientos de origen natural o artificial depende de la predicción del comportamiento posterior a la rotura de la masa movilizada. Actualmente se están desarrollando modelos numéricos capaces de integrar la geometría del deslizamiento y su evolución, la interacción hidromecánica acoplada y las propiedades del suelo en el contexto de fuerzas dinámicas y grandes desplazamientos. Esta tesis es una contribución a este esfuerzo. En este sentido, el método del punto material (MPM) es especialmente adecuado para analizar deslizamientos con grandes desplazamientos. Este procedimiento numérico debe ir acompañado de ensayos bajo condiciones controladas para poder comprobar y calibrar la respuesta numérica. En esta tesis se evalúan las capacidades del código MPM desarrollado, mediante la modelación de ensayos de laboratorio a escala con grandes desplazamientos. Para lograr una adecuada comparación de los resultados experimentales y numéricos, se analizan los experimentos mediante la interpretación de imágenes digitales secuenciales del movimiento del medio granular durante el ensayo (técnica PIV). Con este fin, se desarrolla un procedimiento novedoso para la obtención del campo de deformaciones en el tiempo y el seguimiento de la trayectoria de las partículas de forma idónea para la comparación con resultados numéricos calculados en MPM. El principal objetivo de la tesis fue el desarrollo de una herramienta potente de cálculo capaz de simular el comportamiento de los deslizamientos desde la rotura inicial hasta la fase de post-rotura incluyendo efectos térmicos que determinan la evolución del movimiento. Para esto, se desarrolla e implementa una formulación para problemas no isotérmicos acoplados con el comportamiento hidráulico y mecánico en MPM. Esta formulación incluye la disipación del trabajo friccional en forma de calor, lo cual ocurre principalmente en las bandas donde se localiza la deformación de corte. Este fenómeno descrito es fuertemente dependiente con el espesor de la banda de corte y esto se traduce en una fuerte dependencia de los resultados numéricos en MPM con la malla de discretización empleada. En esta tesis se presenta un novedoso procedimiento para solventar este problema. Por último se presenta la modelación del movimiento ocurrido en el deslizamiento rápido de Vajont (Italia 1963). Se introduce un modelo 2D en deformación plana sin una definición "a priori" de la superficie de deslizamiento. De hecho, generalizando los trabajos hechos anteriormente, los materiales movilizados no se restringen a solidos rígidos interconectados a lo largo de una superficie de contacto predefinida y la generación de calor no se limita a una única superficie predefinida. Así, los procesos de interacción térmica se desarrollan en todo el modelo en función de la localización e intensidad de las deformaciones.Postprint (published version

Numerical Simulation and Characterisation of the Packing of Granular Materials

The scientific problems related to granular matter are ubiquitous. It is currently an active area of research for physicists and earth scientists, with a wide range of applications within the industrial community. Simple analogue experiments exhibit behaviour that is neither predicted nor described by any current theory. The work presented here consists of modelling granular media using a two-dimensional combined Finite-Discrete Element Method (FEM-DEM). While computationally expensive, as well as modelling accurately the dynamic interactions between independent and arbitrarily shaped grains, this method allows for a complete description of the stress state within individual grains during their transient motion. After a detailed description of FEM-DEM principles, this computational approach is used to investigate the packing of elliptical particles. The work is aimed at understanding the influence of the particle shape (the ellipse aspect ratio) on the emergent properties of the granular matrix such as the particle coordination number and the packing density. The diff erences in microstructure of the resultant packing are analysed using pair correlation functions, particle orientations and pore size distributions. A comparison between frictional and frictionless systems is carried out. It shows great diff erences not only in the calculated porosity and coordination number, but also in terms of structural arrangement and stress distribution. The results suggest that the particle's shape a ffects the structural order of the particle assemblage, which itself controls the stress distribution between the pseudo-static grains. The study then focuses on describing the stress patterns or \force chains" naturally generated in a frictional system. An algorithm based on the analysis of the contact force network is proposed and applied to various packs in order to identify the force chains. A statistical analysis of the force chains looking at their orientation, length and proportion of the particles that support the loads is then performed. It is observed that force chains propagate less efficiently and more heterogeneously through granular systems made of elliptical particles than through systems of discs and it is proposed that structural diff erences due to the particle shape lead to a signifi cant reduction in the length of the stress path that propagates across connected particles. Finally, the e ffect of compression on the granular packing, the emergent properties and the contact force distribution is examined. Results show that the force network evolves towards a more randomly distributed system (from an exponential to a Gaussian distribution), and it confi rms the observations made from simulations using discs. To conclude, the combined finite-discrete element method applied to the study of granular systems provides an attractive modelling strategy to improve the knowledge of granular matter. This is due to the wide range of static and dynamic problems that can be treated with a rigorous physical basis. The applicability of the method was demonstrated through to a variety of problems that involve di fferent physical processes modelled with the FEM-DEM (internal deformations, fracture, and complex geometry). With the rapid extension of the practical limits of computational models, this work emphasizes the opportunity to move towards a modern generation of computer software to understand the complexity of the phenomena associated with discontinua

Advances in Computer Recognition, Image Processing and Communications, Selected Papers from CORES 2021 and IP&C 2021

As almost all human activities have been moved online due to the pandemic, novel robust and efficient approaches and further research have been in higher demand in the field of computer science and telecommunication. Therefore, this (reprint) book contains 13 high-quality papers presenting advancements in theoretical and practical aspects of computer recognition, pattern recognition, image processing and machine learning (shallow and deep), including, in particular, novel implementations of these techniques in the areas of modern telecommunications and cybersecurity

The Sixth Annual Workshop on Space Operations Applications and Research (SOAR 1992)

This document contains papers presented at the Space Operations, Applications, and Research Symposium (SOAR) hosted by the U.S. Air Force (USAF) on 4-6 Aug. 1992 and held at the JSC Gilruth Recreation Center. The symposium was cosponsored by the Air Force Material Command and by NASA/JSC. Key technical areas covered during the symposium were robotic and telepresence, automation and intelligent systems, human factors, life sciences, and space maintenance and servicing. The SOAR differed from most other conferences in that it was concerned with Government-sponsored research and development relevant to aerospace operations. The symposium's proceedings include papers covering various disciplines presented by experts from NASA, the USAF, universities, and industry

Landslide motion assessment including thermal interaction : an MPM approach

Risk associated with landslides of natural or man-made origin depends on the prediction of the post-failure behaviour of the mobilized mass. Numerical models capable of integrating the landslide geometry and its evolution, the coupled hydro mechanical interaction and the soil properties in the context of dynamic forces and large displacements are currently under development. This thesis is a contribution to this effort. In this sense, the material point method (MPM) is especially suited for analyzing landslides with large displacements. This numerical procedure must be accompanied by tests under controlled conditions in order to accurately check and calibrate the numerical response. In this thesis the capabilities of the MPM code developed are evaluated through the modelling of scaled laboratory slope tests with large displacements. In order to achieve an adequate comparison of the experimental and numerical results, the experiments are analysed by means of the interpretation of sequential digital images of the movement of the granular medium during the test (PIV technique). A novel procedure is developed to obtain the field of deformations over time and the tracking of particle path in a manner suitable for comparison with numerical results calculated in MPM. The main objective of the thesis was the development of a comprehensive calculation tool capable of simulating the behaviour of the slides from the initial triggering to the post-failure phase including thermal effects that determine the evolution of the movement. A formulation for non-isothermal problems coupled with hydraulic and mechanical behaviour in MPM was developed and implemented. The formulation includes the dissipation of frictional work as heat, which takes place, mainly, in shear bands. The described phenomena are strongly dependent on the thickness of the shear band and this result in a strong dependence of the numerical results in MPM with the discretization mesh. A novel procedure to solve this problem is presented in this thesis. Finally, very rapid Vajont landslide (Italy 1963) is modelled. A plain strain 2D model is presented without an “a priori” definition of the sliding surface. In fact, in a generalization of previous and recent work, the mobilized materials are not restricted to rigid solids interconnected along a predefined contact surface and the heat generation is not it is limited to a single predefined surface. Thus, thermal interaction processes are developed throughout the model as a function of the location and intensity of deformations.El riesgo asociado con deslizamientos de origen natural o artificial depende de la predicción del comportamiento posterior a la rotura de la masa movilizada. Actualmente se están desarrollando modelos numéricos capaces de integrar la geometría del deslizamiento y su evolución, la interacción hidromecánica acoplada y las propiedades del suelo en el contexto de fuerzas dinámicas y grandes desplazamientos. Esta tesis es una contribución a este esfuerzo. En este sentido, el método del punto material (MPM) es especialmente adecuado para analizar deslizamientos con grandes desplazamientos. Este procedimiento numérico debe ir acompañado de ensayos bajo condiciones controladas para poder comprobar y calibrar la respuesta numérica. En esta tesis se evalúan las capacidades del código MPM desarrollado, mediante la modelación de ensayos de laboratorio a escala con grandes desplazamientos. Para lograr una adecuada comparación de los resultados experimentales y numéricos, se analizan los experimentos mediante la interpretación de imágenes digitales secuenciales del movimiento del medio granular durante el ensayo (técnica PIV). Con este fin, se desarrolla un procedimiento novedoso para la obtención del campo de deformaciones en el tiempo y el seguimiento de la trayectoria de las partículas de forma idónea para la comparación con resultados numéricos calculados en MPM. El principal objetivo de la tesis fue el desarrollo de una herramienta potente de cálculo capaz de simular el comportamiento de los deslizamientos desde la rotura inicial hasta la fase de post-rotura incluyendo efectos térmicos que determinan la evolución del movimiento. Para esto, se desarrolla e implementa una formulación para problemas no isotérmicos acoplados con el comportamiento hidráulico y mecánico en MPM. Esta formulación incluye la disipación del trabajo friccional en forma de calor, lo cual ocurre principalmente en las bandas donde se localiza la deformación de corte. Este fenómeno descrito es fuertemente dependiente con el espesor de la banda de corte y esto se traduce en una fuerte dependencia de los resultados numéricos en MPM con la malla de discretización empleada. En esta tesis se presenta un novedoso procedimiento para solventar este problema. Por último se presenta la modelación del movimiento ocurrido en el deslizamiento rápido de Vajont (Italia 1963). Se introduce un modelo 2D en deformación plana sin una definición "a priori" de la superficie de deslizamiento. De hecho, generalizando los trabajos hechos anteriormente, los materiales movilizados no se restringen a solidos rígidos interconectados a lo largo de una superficie de contacto predefinida y la generación de calor no se limita a una única superficie predefinida. Así, los procesos de interacción térmica se desarrollan en todo el modelo en función de la localización e intensidad de las deformaciones

Trajectory prediction of moving objects by means of neural networks

Thesis (Master)--Izmir Institute of Technology, Computer Engineering, Izmir, 1997Includes bibliographical references (leaves: 103-105)Text in English; Abstract: Turkish and Englishviii, 105 leavesEstimating the three-dimensional motion of an object from a sequence of object positions and orientation is of significant importance in variety of applications in control and robotics. For instance, autonomous navigation, manipulation, servo, tracking, planning and surveillance needs prediction of motion parameters. Although "motion estimation" is an old problem (the formulations date back to the beginning of the century), only recently scientists have provided with the tools from nonlinear system estimation theory to solve this problem eural Networks are the ones which have recently been used in many nonlinear dynamic system parameter estimation context. The approximating ability of the neural network is used to identifY the relation between system variables and parameters of a dynamic system. The position, velocity and acceleration of the object are estimated by several neural networks using the II most recent measurements of the object coordinates as input to the system Several neural network topologies with different configurations are introduced and utilized in the solution of the problem. Training schemes for each configuration are given in detail. Simulation results for prediction of motion having different characteristics via different architectures with alternative configurations are presented comparatively