Context-Aware Embeddings for Automatic Art Analysis

Automatic art analysis aims to classify and retrieve artistic representations from a collection of images by using computer vision and machine learning techniques. In this work, we propose to enhance visual representations from neural networks with contextual artistic information. Whereas visual representations are able to capture information about the content and the style of an artwork, our proposed context-aware embeddings additionally encode relationships between different artistic attributes, such as author, school, or historical period. We design two different approaches for using context in automatic art analysis. In the first one, contextual data is obtained through a multi-task learning model, in which several attributes are trained together to find visual relationships between elements. In the second approach, context is obtained through an art-specific knowledge graph, which encodes relationships between artistic attributes. An exhaustive evaluation of both of our models in several art analysis problems, such as author identification, type classification, or cross-modal retrieval, show that performance is improved by up to 7.3% in art classification and 37.24% in retrieval when context-aware embeddings are used

Interactive situation modelling in knowledge intensive domains

Interactive Situation Modelling (ISM) method, a semi-methodological approach, is proposed to tackle issues associated with modelling complex knowledge intensive domains, which cannot be easily modelled using traditional approaches. This paper presents the background and implementation of ISM within a complex domain, where synthesizing knowledge from various sources is critical, and is based on the principles of ethnography within a constructivist framework. Although the motivation for the reported work comes from the application presented in the paper, the actual scope of the paper covers a wide range of issues related to modelling complex systems. The author firstly reviews approaches used for modelling knowledge intensive domains, preceded by a brief discussion about two main issues: symmetry of ignorance and system behaviour, which are often confronted when applying modelling approaches to business domains. The ISM process is then characterized and critiqued with lessons from an exemplar presented to illustrate its effectiveness

Designing Familiar Open Surfaces

While participatory design makes end-users part of the design process, we might also want the resulting system to be open for interpretation, appropriation and change over time to reflect its usage. But how can we design for appropriation? We need to strike a good balance between making the user an active co-constructor of system functionality versus making a too strong, interpretative design that does it all for the user thereby inhibiting their own creative use of the system. Through revisiting five systems in which appropriation has happened both within and outside the intended use, we are going to show how it can be possible to design with open surfaces. These open surfaces have to be such that users can fill them with their own interpretation and content, they should be familiar to the user, resonating with their real world practice and understanding, thereby shaping its use