Supervised Deep Learning for Content-Aware Image Retargeting with Fourier Convolutions

Image retargeting aims to alter the size of the image with attention to the contents. One of the main obstacles to training deep learning models for image retargeting is the need for a vast labeled dataset. Labeled datasets are unavailable for training deep learning models in the image retargeting tasks. As a result, we present a new supervised approach for training deep learning models. We use the original images as ground truth and create inputs for the model by resizing and cropping the original images. A second challenge is generating different image sizes in inference time. However, regular convolutional neural networks cannot generate images of different sizes than the input image. To address this issue, we introduced a new method for supervised learning. In our approach, a mask is generated to show the desired size and location of the object. Then the mask and the input image are fed to the network. Comparing image retargeting methods and our proposed method demonstrates the model's ability to produce high-quality retargeted images. Afterward, we compute the image quality assessment score for each output image based on different techniques and illustrate the effectiveness of our approach.Comment: 18 pages, 5 figure

Separation of Players in Teams during Basketball Matches

This paper represents a framework for automatic player separation in teams during basketball matches. Separation is made in images broadcasted via television stations. In them, we have view from only single camera in particular point of time. This makes detection of players and their separation much more difficult. The player detection is based on mixture of non-oriented pictorial structures. After detection we extract image parts that represent player’s jersey. Over that area we calculate histogram on S value from HSV color system. According to top five picks, we cluster players in teams. This approach give us accuracy of 92.38%. Its main advantages are robustness and applicability on the large number of footages from different basketball games without need for additional training and algorithm changes

Basketball game analyzing based on computer vision

As tremendous improvement in computer vision technology, various industries start to apply computer vision to analyze huge multimedia content. Sports as one of the biggest resource invested industries also step up to utilize this technology to enhance their sports intelligent products. The thesis is following this development to provide prototype implementations of computer vision algorithms in sports industry. Main objective is to develop initial algorithms to solve play-field detection and player tracking in basketball game video. Play-field detection is an important task in sports video content analysis, as it provides the foundation for further operations such as object detection, object tracking or semantic event highlight and summarization. On the other hand, player tracking highlight player movements in critical events in basketball game. It is also a challenging task to develop effective and efficient player tracking in basketball video, due to factors such as pose variation, illumination change, occlusion, and motion blur. This thesis proposed reliable and efficient prototype algorithms to address play- field detection and single player tracking. SURF algorithm is utilized and modified to offer precise location of play-field and overlay trajectory data to improve viewer’s experience on sports product. And compressive tracking algorithm implemented for the aim of capture and track single player in important events to reveal player’s secret tactics. Prototype implementation to meet the current needs in basketball video content analyzing field

Texture and Colour in Image Analysis

Research in colour and texture has experienced major changes in the last few years. This book presents some recent advances in the field, specifically in the theory and applications of colour texture analysis. This volume also features benchmarks, comparative evaluations and reviews

Gaze-Based Human-Robot Interaction by the Brunswick Model

We present a new paradigm for human-robot interaction based on social signal processing, and in particular on the Brunswick model. Originally, the Brunswick model copes with face-to-face dyadic interaction, assuming that the interactants are communicating through a continuous exchange of non verbal social signals, in addition to the spoken messages. Social signals have to be interpreted, thanks to a proper recognition phase that considers visual and audio information. The Brunswick model allows to quantitatively evaluate the quality of the interaction using statistical tools which measure how effective is the recognition phase. In this paper we cast this theory when one of the interactants is a robot; in this case, the recognition phase performed by the robot and the human have to be revised w.r.t. the original model. The model is applied to Berrick, a recent open-source low-cost robotic head platform, where the gazing is the social signal to be considered

Semantic aware sport image resizing jointly using seam carving and warping

In content aware image resizing, saliency map or gradient is usually used to determine the important regions of images. But for sport images such as basketball and football images, these methods may falsely classify parts of court fields as unimportant regions, while parts of grandstands as important regions. Such results are not consistent with human perception. In this paper, a semantic aware image resizing approach is proposed. We extract the semantic information automatically. We segment the court fields as important regions and detect the boundary of court fields as the semantic edges. Considering the complementary characteristic of discrete image resizing approaches such as seam carving and continuous approaches such as warping, seam carving and warping are jointly used in our scheme