A Framework for Computational Design and Adaptation of Extended Reality User Interfaces

To facilitate high quality interaction during the regular use of computing systems, it is essential that the user interface (UI) deliver content and components in an appropriate manner. Although extended reality (XR) is emerging as a new computing platform, we still have a limited understanding of how best to design and present interactive content to users in such immersive environments. Adaptive UIs offer a promising approach for optimal presentation in XR as the user's environment, tasks, capabilities, and preferences vary under changing context. In this position paper, we present a design framework for adapting various characteristics of content presented in XR. We frame these as five considerations that need to be taken into account for adaptive XR UIs: What?, How Much?, Where?, How?, and When?. With this framework, we review literature on UI design and adaptation to reflect on approaches that have been adopted or developed in the past towards identifying current gaps and challenges, and opportunities for applying such approaches in XR. Using our framework, future work could identify and develop novel computational approaches for achieving successful adaptive user interfaces in such immersive environments.Comment: 5 pages, CHI 2023 Workshop on The Future of Computational Approaches for Understanding and Adapting User Interface

AutoPoster: A Highly Automatic and Content-aware Design System for Advertising Poster Generation

Advertising posters, a form of information presentation, combine visual and linguistic modalities. Creating a poster involves multiple steps and necessitates design experience and creativity. This paper introduces AutoPoster, a highly automatic and content-aware system for generating advertising posters. With only product images and titles as inputs, AutoPoster can automatically produce posters of varying sizes through four key stages: image cleaning and retargeting, layout generation, tagline generation, and style attribute prediction. To ensure visual harmony of posters, two content-aware models are incorporated for layout and tagline generation. Moreover, we propose a novel multi-task Style Attribute Predictor (SAP) to jointly predict visual style attributes. Meanwhile, to our knowledge, we propose the first poster generation dataset that includes visual attribute annotations for over 76k posters. Qualitative and quantitative outcomes from user studies and experiments substantiate the efficacy of our system and the aesthetic superiority of the generated posters compared to other poster generation methods.Comment: Accepted for ACM MM 202

Beyond Grids, Interactive Graphical Substrates to Structure Digital Layout

International audienceTraditional graphic design tools emphasize the grid for structuring layout. Interviews with professional graphic designers revealed that they use surprisingly sophisticated structures that go beyond the grid, which we call graphical substrates. We present a framework to describe how designers establish graphical substrates based on properties extracted from concepts, content and context, and use them to compose layouts in both space and time. We developed two technology probes to explore how to embed graphical substrates into tools. Contextify lets designers tailor layouts according to each reader's intention and context; while Linkify lets designers create dynamic layouts based on relationships among content properties. We tested the probes with professional graphic designers, who all identified novel uses in their current projects. We incorporated their suggestions into, StyleBlocks, a prototype that reifies CSS declarations into interactive graphical substrates. Graphical substrates offer an untapped design space for tools that can help graphic designers generate personal layout structures

Localization Provision in New Zealand: Arabic Speakers' Preference for Different Paralingual Webpage Layouts.

This research is designed to test Arabic speakers’ preference for different paralingual webpage layouts to assist newcomers to New Zealand such as international students,refugees and immigrants who have inadequate English language proficiency to access vital information available on governmental websites. Paralingual is coined from the prefix ‘Para’ (which means side by side or together in Greek), and ‘lingual’ meaning language such as in bilingual (grasp of two languages). Mixed and triangulation methods were used to collect data consisting of an online websurvey; an eye tracking experiment; and participants’ interviews. The results show: a) That the mainstreams of Arabic speakers prefer English text on the left and the Arabic translation on the right as a paralingual webpage layout; b) That inadequate English language proficiency discourages Arabic speaking newcomers from accessing governmental websites; c) That paralingual web design could be used as an educational tool; d) That paralingual web design is easier to read; and e) That paralingual web design increases trust in the government. There have been limitations such as the participation of refugees and immigrants in the eye tracking experiment and the participants’ interviews. There have been recommendations such as the use of paralingual web design in governmental websites for maternity and medical health