Gestão de conteúdos digitais em múltiplos monitores

With the generalized use of systems for digital contents dissemination arises the opportunity for implementing solutions capable of evaluating audience reaction. This dissertation reflects the implementation of one of those solutions. To this end, the development involved adapting a previously functional digital signage system. In this sense, digital cameras were paired to the content display terminals in order to capture information from the area in front of them. Using computer vision technologies, the terminals detect, in real time, people who appear in the cameras’ field of view, and this information is communicated to a server for data extraction. On the server, methods are used to perform face and emotion recognition, and also to extract data indicating the position of the head, which allows the calculation of an attention coefficient. The data is stored in a relational database, and can be consulted through a web platform, where they are presented associated with the contents corresponding to the moment of their capture and extraction. This solution thus allows the evaluation of the impact of the digital contents presented by the system.Com a utilização generalizada de sistemas de disseminação de conteúdos digitais, surge a oportunidade de implementar soluções capazes de avaliar a reacção do público. Esta dissertação reflete a implementação de uma dessas soluções. Para isso, o desenvolvimento passou pela adaptação de um sistema de sinalização digital previamente funcional. Neste sentido, aos terminais de exposição de conteúdos, foram emparelhadas câmaras digitais de modo a permitir a captação de informação da área à frente destes. Com recurso a tecnologias de visão de computador, os terminais fazem, em tempo real, deteção de pessoas que apareçam no campo de visão das câmaras, sendo esta informação comunicada a um servidor para extração de dados. No servidor, são utilizados métodos para realização de reconhecimento de faces e emoções, e também é feita extração de dados indicadores da posição da cabeça, o que permite o cálculo de um coeficiente de atenção. Os dados são guardados numa base de dados relacional e podem ser consultados através de uma plataforma web, onde são apresentados associados aos contéudos correspondentes ao momento de captação e extração destes. Esta solução, permite, assim, a avaliação do impacto dos conteúdos digitais apresentados pelo sistema.Mestrado em Engenharia de Computadores e Telemátic

Design Considerations for Multi-Stakeholder Display Analytics

Measuring viewer interactions through detailed analytics will be crucial to improving the overall performance of future open display networks. However, in contrast to traditional sign and web analytics systems, such display networks are likely to feature multiple stakeholders each with the ability to collect a subset of the required analytics information. Combining analytics data from multiple stakeholders could lead to new insights, but stakeholders may have limited willingness to share information due to privacy concerns or commercial sensitivities. In this paper, we provide a comprehensive overview of analytics data that might be captured by different stakeholders in a display network, make the case for the synthesis of analytics data in such display networks, present design considerations for future architectures designed to enable the sharing of display analytics information, and offer an example of how such systems might be implemented

Face and emotion recognition on commercial property under EU data protection law

This paper integrates and cuts through domains of privacy law and biometrics. Specifically, this paper presents a legal analysis on the use of Automated Facial Recognition Systems (the AFRS) in commercial (retail store) settings within the European Union data protection framework. The AFRS is a typical instance of biometric technologies, where a distributed system of dozens of low-cost cameras uses psychological states, sociodemographic characteristics, and identity recognition algorithms on thousands of passers-by and customers. Current use cases and theoretical possibilities are discussed due to the technology’s potential of becoming a substantial privacy issue. First, this paper introduces the AFRS and EU data protection law. This is followed by an analysis of European Data protection law and its application in relation to the use of the AFRS, including requirements concerning data quality and legitimate processing of personal data, which, finally, leads to an overview of measures that traders can take to comply with data protection law, including by means of information, consent, and anonymization

Shopping For Privacy: How Technology in Brick-and-Mortar Retail Stores Poses Privacy Risks for Shoppers

As technology continues to rapidly advance, the American legal system has failed to protect individual shoppers from the technology implemented into retail stores, which poses significant privacy risks but does not violate the law. In particular, I examine the technologies implemented into many brick-and-mortar stores today, many of which the average everyday shopper has no idea exists. This Article criticizes these technologies, suggesting that many, if not all of them, are questionable in their legality taking advantage of their status in a legal gray zone. Because the American judicial system cannot adequately protect the individual shopper from these questionable privacy practices, I call upon the Federal Trade Commission, the de facto privacy regulator in the United States, to increase its policing of physical retail stores to protect the shopper from any further harm

AGE ESTIMATION UNTUK INTELLIGENT ADVERTISING PADA POSTER DIGITAL MENGGUNAKAN CONVOLUTIONAL NEURAL NETWORK

Sebagai bagian dari intelligent advertising, age estimation digunakan untuk menyesuaikan iklan dari hasil estimasi usia audience. Age estimation (AE) dapat dibangun menggunakan deep learning menggunakan ConvNet dengan kendala seperti data training wajah usia tua yang sedikit, ketidak seimbangan dataset di dalamnya, serta membutuhkan jumlah data yang besar. Salah satu solusi dari permasalahan ini adalah melakukan data augmentasi menggunakan model generatif ACGAN untuk melakukan generate gambar sesuai dengan kelas. Intelligent advertising pada poster digital hanya disimulasikan pada komputer. Simulasi intelligent advertising berfungsi dengan baik terlepas dari terbatasnya iklan dan tidak konsistennya hasil estimasi usia. Hasil dari penggunaan model generatifACGAN untuk data augmentation berhasil meningkatkan performa hasil pada model AE terlepas dari rendahnya skor IS dan FID serta kualitas gambar yang dihasilkan. Hasil data augmentation lebih terlihat pada model B dengan peningkatan akurasi cumulative score sebesar 4,8% dan skor MAE sebesar 1,297

Audience monitor:an open source tool for tracking audience mobility in front of pervasive displays

Understanding an audience's behavior is an important aspect of evaluating display installations. In particular, it is important to understand how people move around in the vicinity of displays, including viewer transitions from noticing a display, through approach, to final use of the display. Despite the importance of measuring viewer mobility patterns, there are still relatively few low-cost tools that can be used with research display deployments to capture detailed spatial and temporal behavior of an audience. In this paper, we present an approach to audience monitoring that uses an off-the-shelf depth sensor and open source computer vision algorithms to monitor the space in front of a digital display, tracking presence and movements of both passers-by and display users. We believe that our approach can help display researchers evaluate their public display deployments and improve the level of quantitative data underpinning our field

PUBLIC OCR SIGN AGE RECOGNITION WITH SKEW & SLANT CORRECTION FOR VISUALLY IMP AIRED PEOPLE

This paper presents an OCR hybrid recognition model for the Visually Impaired People (VIP). The VIP often encounters problems navigating around independently because they are blind or have poor vision. They are always being discriminated due to their limitation which can lead to depression to the VIP. Thus, they require an efficient technological assistance to help them in their daily activity. The objective of this paper is to propose a hybrid model for Optical Character Recognition (OCR) to detect and correct skewed and slanted character of public signage. The proposed hybrid model should be able to integrate with speech synthesizer for VIP signage recognition. The proposed hybrid model will capture an image of a public signage to be converted into machine readable text in a text file. The text will then be read by a speech synthesizer and translated to voice as the output. In the paper, hybrid model which consist of Canny Method, Hough Transformation and Shearing Transformation are used to detect and correct skewed and slanted images. An experiment was conducted to test the hybrid model performance on 5 blind folded subjects. The OCR hybrid recognition model has successfully achieved a Recognition Rate (RR) of 82. 7%. This concept of public signage recognition is being proven by the proposed hybrid model which integrates OCR and speech synthesizer