Reinforcement Learning for Generative AI: State of the Art, Opportunities and Open Research Challenges

Generative Artificial Intelligence (AI) is one of the most exciting developments in Computer Science of the last decade. At the same time, Reinforcement Learning (RL) has emerged as a very successful paradigm for a variety of machine learning tasks. In this survey, we discuss the state of the art, opportunities and open research questions in applying RL to generative AI. In particular, we will discuss three types of applications, namely, RL as an alternative way for generation without specified objectives; as a way for generating outputs while concurrently maximizing an objective function; and, finally, as a way of embedding desired characteristics, which cannot be easily captured by means of an objective function, into the generative process. We conclude the survey with an in-depth discussion of the opportunities and challenges in this fascinating emerging area.Comment: Published in JAIR at https://www.jair.org/index.php/jair/article/view/1527

Deep Vectorization of Technical Drawings

We present a new method for vectorization of technical line drawings, such as floor plans, architectural drawings, and 2D CAD images. Our method includes (1) a deep learning-based cleaning stage to eliminate the background and imperfections in the image and fill in missing parts, (2) a transformer-based network to estimate vector primitives, and (3) optimization procedure to obtain the final primitive configurations. We train the networks on synthetic data, renderings of vector line drawings, and manually vectorized scans of line drawings. Our method quantitatively and qualitatively outperforms a number of existing techniques on a collection of representative technical drawings

An HCI-Centric Survey and Taxonomy of Human-Generative-AI Interactions

Generative AI (GenAI) has shown remarkable capabilities in generating diverse and realistic content across different formats like images, videos, and text. In Generative AI, human involvement is essential, thus HCI literature has investigated how to effectively create collaborations between humans and GenAI systems. However, the current literature lacks a comprehensive framework to better understand Human-GenAI Interactions, as the holistic aspects of human-centered GenAI systems are rarely analyzed systematically. In this paper, we present a survey of 291 papers, providing a novel taxonomy and analysis of Human-GenAI Interactions from both human and Gen-AI perspectives. The dimensions of design space include 1) Purposes of Using Generative AI, 2) Feedback from Models to Users, 3) Control from Users to Models, 4) Levels of Engagement, 5) Application Domains, and 6) Evaluation Strategies. Our work is also timely at the current development stage of GenAI, where the Human-GenAI interaction design is of paramount importance. We also highlight challenges and opportunities to guide the design of Gen-AI systems and interactions towards the future design of human-centered Generative AI applications

Design revolutions: IASDR 2019 Conference Proceedings. Volume 4: Learning, Technology, Thinking

In September 2019 Manchester School of Art at Manchester Metropolitan University was honoured to host the bi-annual conference of the International Association of Societies of Design Research (IASDR) under the unifying theme of DESIGN REVOLUTIONS. This was the first time the conference had been held in the UK. Through key research themes across nine conference tracks – Change, Learning, Living, Making, People, Technology, Thinking, Value and Voices – the conference opened up compelling, meaningful and radical dialogue of the role of design in addressing societal and organisational challenges. This Volume 4 includes papers from Learning, Technology and Thinking tracks of the conference

Youth in Lebanon: Using collaborative and interdisciplinary communication design methods to improve social integration in post-conflict societies

In 1995, the World Summit for Social Development identified social integration as one of the three overriding objectives for social and economic development. This priority arose following a century that ended with the collapse of many states and the sharpening of strife around the world. Social integration was seen as a pathway to reinforcing common identities, supporting cooperation and lessening the likelihood of violence and conflict. For the past 20 years, governmental, academic and third sector organisations – with the United Nations at the forefront – sought to improve social integration. However their methods and interventions have commonly been restricted to policymaking and dialogue practices. Peacebuilding and reconciliation are affected by communication within and amongst different groups. Nonetheless, the potential for communication design to contribute towards social integration remains unexplored. This practice-led communication design research focuses on 18 to 30 year old youth in Lebanon – an extreme case of a politically, religiously, geographically, culturally and linguistically segregated post-conflict generation. The research adopts an innovative, interdisciplinary(1.) and collaborative(2.) approach, to explore the contribution of communication design methods towards social integration interventions. The interdisciplinary and collaborative case study process spans seven stages of practice: Discover, Delve, Define, Develop, Deliver, Determine Impact and Diverge. I developed this process with Darren Raven in 2010, and have been testing and refining it over the past five years through the socially-focused design projects of BA Design for Graphic Communication students and staff at the London College of Communication. This process builds on the Design Council’s Double Diamond design process by incorporating stages from the National Social Marketing Centre’s process. Through these stages, the research developed several innovative communication design methods: Explorations, a cultural probes toolkit exploring young people’s local context; Road Trip, an autoethnographic journey preparing the researcher; Connections, an effective method for recruiting stakeholders; Expressions Corner, a confidential diary room for understanding young people’s experiences, attitudes and behaviours; Imagination Studio, a collaborative workshop series for developing social integration interventions; Imagination Market, an efficient platform for piloting these interventions; and a Social Impact Framework; to evaluate the impact of the interventions and research. These methods enhanced candid input from young people, reduced ethical tensions, and improved their engagement with the research. The methods also involved youth and wider stakeholders in understanding and reframing the problem, invited them to generate and deliver solutions, strengthened their sense of ownership and therefore the sustainability of the research outputs, and finally, built their capabilities throughout the process. The social integration interventions developed and piloted through the case-study research ranged from a citizen journalism platform reducing media bias, to a youth-led internal tourism service encouraging geographic mobility. The evaluation of the 24-hour pilot interventions demonstrated a positive shift in young people’s willingness to integrate. The social impact and social value assessment suggests that effective social integration interventions – such as the ones developed and piloted in the case study research – have higher chances of delivering positive social and economic outcomes for the communities involved. This practice-led research presents a number of contributions, the most significant of which is a methodology, process and set of methods highly transferable across social integration challenges worldwide. The research also provides social integration theory and practice with a clear demonstration of the value and potential of communication design to advance interventions from replication to innovation. To communication design theory and practice, the research makes the case for the value of interdisciplinary and collaborative principles in enhancing rigour and social impact. Finally, to the Lebanese context, the research provides in-depth qualitative insights on social group dynamics, segments, and behaviours, which act as an evidence-base to underpin future local interventions. Beyond this thesis, the knowledge gained from this research will be disseminated to the various relevant communities of practice – including researchers, designers, policy makers, and community development workers – in the form of Creative Commons licensed design guidelines, as well as presentations, capacity building workshops, and academic publications. The dissemination of knowledge hopes to inspire and enable these communities to adopt, adapt and build on communication design methods when addressing social segregation challenges within their varying contexts. Notes in the text: (1.) Drawing on disciplines such as social, political, behavioural, and psychological sciences. (2.) Engaging multiple stakeholders including young people, civil society, institutions, topic experts and policy-makers

Volume 60, Number 04 (April 1942)

Music a Permanent Art Sir Thomas Beecham Has His Say: A Striking Feuilleton Upon England\u27s Distinguished Orchestral Conductor Shepherds\u27 Pipes for Modern Players Easter, the Alleluja Season Bombs, Bands and Bonds: Los Angeles County Band Sells Thousands of Dollars Worth a Day Rhythm Must Be Felt: Learn the Secrets of Rhythm by Tapping It Handel\u27s Messiah Two Centuries Old: A Colorful Picture of the Development of the World\u27s Most Famous Oratorios Jánossys and Johnsons Look Your Best to Capture Public Favor: Crank Up Your Curls and Exercise Off the Bulge if You Would Succeed with the Public Save the Child Voice Minimum Speed Limit Has Today\u27s Popular Music a Place in the Teaching Repertoire? Scientific Approach to Singing (interview with Conrad Thibault) Technic of the Month—Melody with Flowing Accompaniment Heller Op. 47, No. 2https://digitalcommons.gardner-webb.edu/etude/1239/thumbnail.jp