RAID: A relation-augmented image descriptor

As humans, we regularly interpret scenes based on how objects are related, rather than based on the objects themselves. For example, we see a person riding an object X or a plank bridging two objects. Current methods provide limited support to search for content based on such relations. We present RAID, a relation-augmented image descriptor that supports queries based on inter-region relations. The key idea of our descriptor is to encode region-to-region relations as the spatial distribution of point-to-region relationships between two image regions. RAID allows sketch-based retrieval and requires minimal training data, thus making it suited even for querying uncommon relations. We evaluate the proposed descriptor by querying into large image databases and successfully extract nontrivial images demonstrating complex inter-region relations, which are easily missed or erroneously classified by existing methods. We assess the robustness of RAID on multiple datasets even when the region segmentation is computed automatically or very noisy

Multimedia Chinese Web Search Engines: A Survey

The objective of this paper is to explore the state of multimedia search functionality on major general and dedicated Web search engines in Chinese language. The authors studied: a) how many Chinese Web search engines presently make use of multimedia searching, and b) the type of multimedia search functionality available. Specifically, the following were examined: a) multimedia features - features allowing multimedia search; and b) extent of personalization - the extent to which a search engine Web site allows users to control multimedia search. Overall, Chinese Web search engines offer limited multimedia searching functionality. The significance of the study is based on two factors: a) little research has been conducted on Chinese Web search engines, and b) the instrument used in the study and the results obtained by this research could help users, Web designers, and Web search engine developers. By large, general Web search engines support more multimedia features than specialized one

Strategies for image visualisation and browsing

PhDThe exploration of large information spaces has remained a challenging task even though the proliferation of database management systems and the state-of-the art retrieval algorithms is becoming pervasive. Signi cant research attention in the multimedia domain is focused on nding automatic algorithms for organising digital image collections into meaningful structures and providing high-semantic image indices. On the other hand, utilisation of graphical and interactive methods from information visualisation domain, provide promising direction for creating e cient user-oriented systems for image management. Methods such as exploratory browsing and query, as well as intuitive visual overviews of image collection, can assist the users in nding patterns and developing the understanding of structures and content in complex image data-sets. The focus of the thesis is combining the features of automatic data processing algorithms with information visualisation. The rst part of this thesis focuses on the layout method for displaying the collection of images indexed by low-level visual descriptors. The proposed solution generates graphical overview of the data-set as a combination of similarity based visualisation and random layout approach. Second part of the thesis deals with problem of visualisation and exploration for hierarchical organisation of images. Due to the absence of the semantic information, images are considered the only source of high-level information. The content preview and display of hierarchical structure are combined in order to support image retrieval. In addition to this, novel exploration and navigation methods are proposed to enable the user to nd the way through database structure and retrieve the content. On the other hand, semantic information is available in cases where automatic or semi-automatic image classi ers are employed. The automatic annotation of image items provides what is referred to as higher-level information. This type of information is a cornerstone of multi-concept visualisation framework which is developed as a third part of this thesis. This solution enables dynamic generation of user-queries by combining semantic concepts, supported by content overview and information ltering. Comparative analysis and user tests, performed for the evaluation of the proposed solutions, focus on the ways information visualisation a ects the image content exploration and retrieval; how e cient and comfortable are the users when using di erent interaction methods and the ways users seek for information through di erent types of database organisation

Iconic Indexing for Video Search

Submitted for the degree of Doctor of Philosophy, Queen Mary, University of London

Image-Based Query by Example Using MPEG-7 Visual Descriptors

This project presents the design and implementation of a Content-Based Image Retrieval (CBIR) system where queries are formulated by visual examples through a graphical interface. Visual descriptors and similarity measures implemented in this work followed mainly those defined in the MPEG-7 standard although, when necessary, extensions are proposed. Despite the fact that this is an image-based system, all the proposed descriptors have been implemented for both image and region queries, allowing the future system upgrade to support region-based queries. This way, even a contour shape descriptor has been developed, which has no sense for the whole image. The system has been assessed on different benchmark databases; namely, MPEG-7 Common Color Dataset, and Corel Dataset. The evaluation has been performed for isolated descriptors as well as for combinations of them. The strategy studied in this work to gather the information obtained from the whole set of computed descriptors is weighting the rank list for each isolated descriptor

NovenaNetwork: A Catholic Social Media iOS Application for Praying Novenas as a Community

Recent years have seen the rise of a Catholic presence on the Internet and on social media in particular. At the same time, there has been a movement among young Catholics to rediscover and revitalize the traditions of the Church. Novenas, an ancient form of spirituality involving praying for nine consecutive days for some special purpose, are one such tradition. NovenaNetwork, which debuted in the App Store on May 23, 2017 and acquired over 50 users in three countries within its first six days, is an iOS social media application for praying novenas with others. While multiple apps and websites already exist for praying novenas, NovenaNetwork is the first social media network on any platform for doing so, making it unique in this space. I will begin by presenting the functionality of NovenaNetwork in depth and examining how the app differs from its competitors. Next, I will outline the design and implementation of the app. Finally, I will offer an evaluation of the app and unveil features I intend to implement in subsequent releases of NovenaNetwork

A GIS for Balboa Park’s Desert Garden in San Diego, California

Balboa Park’s Desert Garden in San Diego, California, contains a collection of desert plants from around the world that attracts a growing number of park enthusiasts each year. The park’s staff desires a GIS inventory of the garden’s assets and spatial tools to aid in querying, reporting, analyzing, and mapping. A quality garden inventory made available to the public for educational purposes will fulfill one of the criteria for future accreditation provided by the American Association of Museums. This project provides: (a) a geodatabase of the plant inventory and garden infrastructure, (b) georeferenced digital photographs of garden features, (c) a digital elevation model compiled from lidar data and a related 3-D land surface map, (d) a map and brochure for the garden’s information kiosk and Balboa Park visitor center, (e) an interactive web mapping service for the public to explore the garden via the internet, and (f) a project workflow poster

www.artellite.co.uk

£150,000 www.artellite.co.uk Principal Investigator Design & Build for Degree Art Ltd funded by the NESTA Digital R&D Fund.  Transformational service design for a ‘big data’ digital platform to augment the arts marketplace, an eCommerce engine and hub built in Drupal aiming to support emerging artists to develop a sustainable career. Concept Development, Digital Strategy & UX Design for the system aims to support the careers of emerging artists whilst maintaining the value chains of existing stakeholders, such as galleries and arts organisations. The back end database gathers metrics for AHRC, NESTA & Arts Council to provide an insight into how arts market is evolving.   A major measure of success, is that now https://www.degreeart.com, as a result of integrating the https://artellite.co.uk platform are now listed as 19th worldwide, with Amazon Art at 16, by the 2018 Hiscox Online Art Trade Report https://www.hiscox.co.uk/online-art-trade-repor