Theoretical Approaches to Musical Creativity: The Ubimus Perspective

We tackle the theoretical implications of an emergent field of study, ubiquitous music (ubimus). Striving to place musical research within the wider field of creativity studies, this paper covers theoretical background and critical discussions of three music creativity models - a model proposed by Mannis (2014), the In-group, Out-group model (MDF - Ferraz and Keller 2014) and the ecologically grounded perspective (Keller and Lazzarini 2017). Data and on-site observations of creative activities provide the raw materials to test musical theories. Recent ubiquitous music research features multiple experimental initiatives, involving children (Pereira et al. in press), adolescents (Lima et al. 2012) or the elderly, and targeting trained musicians (Ferreira et al. 2015), novices (Miletto et al. 2011) and cognitively challenged adults. We chose three ubimus studies to exemplify empirical research that brings to light issues that have not been considered by some of the current theoretical approaches to musical creativity. Abordamos as implicações teóricas de um campo de estudos emergente – a música ubíqua (ubimus). Buscando situar a pesquisa musical dentro dos estudos sobre criatividade, este artigo abrange o substrato teórico e as discussões críticas de três modelos de criatividade musical – um modelo proposto por Mannis (2014), o Modelo Dentro-Fora (MDF - Ferraz e Keller 2014) e a perspectiva ecológica (Keller e Lazzarini 2017). Os dados e as observações in loco de atividades criativas forneceram materiais brutos para testarmos teorias musicais. Pesquisas recentes em música ubíqua concentram-se em múltiplas iniciativas experimentais, envolvendo crianças (Pereira et al. no prelo), adolescentes (Lima et al. 2012) ou idosos, e focando em músicos profissionais (Ferreira et al. 2015), iniciantes (Miletto et al. 2011) e adultos com deficiências cognitivas. Escolhemos três estudos em música ubíqua para exemplificar as pesquisas empíricas que trazem à luz problemas que ainda não foram tratados desde as perspectivas teóricas da criatividade musical

Embodied creativity: a process continuum from artistic creation to creative participation

This thesis breaks new ground by attending to two contemporary developments in art and science. In art, computer-mediated interactive artworks comprise creative engagement between collaborating practitioners and a creatively participating audience, erasing all notions of a dividing line between them. The procedural character of this type of communicative real-time interaction replaces the concept of a finished artwork with a ‘field of artistic communication’. In science, the field of creativity research investigates creative thought as mental operations that combine and reorganise extant knowledge structures. A recent paradigm shift in cognition research acknowledges that cognition is embodied. Neither embodiment in cognition nor the ‘field of artistic communication’ in interactive art have been assimilated by creativity research. This thesis takes an interdisciplinary approach to examine the embodied cognitive processes in a ‘field of artistic communication’ using a media artwork called Sim-Suite as a case study research strategy. This interactive installation, created and exhibited in an authentic real-world context, engages three people to play on wobble-boards. The thesis argues that creative processes related to Sim-Suite operate within a continuum, encompassing collaborative artistic creation and cooperative creative participation. This continuum is investigated via mixed methods, conducting studies with qualitative and quantitative analysis. These are interpreted through a theoretical lens of embodied cognition principles, the 4E approaches. The results obtained demonstrate that embodied cognitive processes in Sim-Suite’s ‘field of artistic communication’ function on a continuum. We give an account of the creative process continuum relating our findings to the ‘embedded-extended-enactive lens’, empirical studies in embodied cognition and creativity research. Within this context a number of topics and sub-themes are identified. We discuss embodied communication, aspects of agency, forms of coordination, levels of evaluative processes and empathetic foundation. The thesis makes conceptual, empirical and methodological contributions to creativity research

Connecting Theater and Virtual Reality with Cognitive Sciences: Positioning from computer science and artist meeting

International audienceThis positioning paper presents arguments in favor of collaboration between artists and computer scientists in touch with cognitive science. Each part met the other for a technical collaboration during one theater experimentation named " il était Xn fois ". The article starts with the scientists position relative to the link between cognitive sciences, virtual reality and artificial intelligence. This section highlights the need of autonomous entities to improve presence in artificial world and presents enactive artificial intelligence which aims at producing strong autonomous entities. The second part presents the purpose of the theatrical experimentation "il était Xn fois", which was publicly presented in 2009 by the theater dérézo. The last section is a synthetic view of what should complete artistic and computer scientists area

Processes and experiences of creative cognition in seven Western classical composers

In a qualitative study, we explored the range of reflections and experiences involved in the composition of score-based music by administering a 15-item, open-ended, questionnaire to seven professional composers from Europe and North America. Adopting a grounded theory approach, we organized six different codes emerging from our data into two higher-order categories ( the act of composing and establishing relationships). Our content analysis, inspired by the theoretical resources of 4E cognitive science, points to three overlapping characteristics of creative cognition in music composition: it is largely exploratory, it is grounded in bodily experience, and it emerges from the recursive dialogue of agents and their environment. More generally, such preliminary findings suggest that musical creativity may be advantageously understood as a process of constant adaptation – one in which composers enact their musical styles and identities by exploring novel interactivities hidden in their contingent and historical milieux

"Arte Factus" : estudo e co-design socialmente consciente de artefatos digitais socioenativos

Orientador: Maria Cecília Calani BaranauskasTese (doutorado) - Universidade Estadual de Campinas, Instituto de ComputaçãoResumo: Atualmente, a tecnologia computacional tornou-se cada vez mais pervasiva por meio de computadores de diferentes tamanhos, formas e capacidades. Mas avanços tecnológicos, embora necessários, não são suficientes para tornar a interação com tecnologia computacional mais transparente, como preconizado pela computação ubíqua. Sistemas computacionais atuais ainda exigem um vocabulário técnico de entradas e saídas para serem utilizados. No campo da Interação Humano-Computador (IHC), a adoção da teoria da cognição enativa pode lançar luz sobre um novo paradigma de interação que preenche a lacuna entre ação e percepção. Sistemas computacionais enativos são um promissor tema de pesquisa, mas seu design e avaliação ainda são pouco explorados. Além disso, sistemas enativos, como já proposto na literatura, carecem de consideração do contexto social. O objetivo desta tese de doutorado é contribuir para o design de tecnologia computacional dentro de uma abordagem da cognição enativa, além de também sensível à aspectos sociais. Portanto, esta tese investiga os conceitos de sistemas enativos e socioenativos por meio do co-design de arte interativa e instalações. Para atingir esse objetivo, é proposto um arcabouço teórico-metodológico chamado "Arte Factus" para apoiar o estudo e o co-design socialmente consciente de artefatos digitais. O arcabouço "Arte Factus" foi utilizado em três estudos de design relatados nesta tese: InterArt, InstInt e InsTime. Esses estudos envolveram a participação de 105 estudantes de graduação e pós-graduação em Ciência da Computação e Engenharia de Computação no co-design de 19 instalações. O processo envolveu o uso de tecnologia pervasiva do tipo Faça-Você-Mesmo ("Do-It-Yourself, DIY"), e algumas dessas instalações foram estudadas em oficinas de prática situada que ocorreram em cenários educacionais (escola e museu exploratório de ciências). O arcabouço "Arte Factus", como a principal contribuição desta tese de doutorado, mostrou-se eficaz no apoio ao co-design socialmente consciente de instalações interativas que materializam o conceito de artefatos digitais socioenativos. Além disso, através do estudo dos artefatos criados no contexto desta investigação, esta tese também contribui para a construção teórica do conceito de sistemas socioenativosAbstract: Currently, computational technology has become more and more pervasive with computers of different sizes, shapes, and capacities. But technological advancements, although necessary, are not enough to make the interaction with computational technology more transparent, as preconized by the ubiquitous computing. Current computational systems still require a technical vocabulary of inputs and outputs to be interacted with. Within the field of Human-Computer Interaction (HCI), the adoption of the enactive cognition theory can shed light on a new interaction paradigm that bridges the gap between action and perception. Enactive computational systems are a promising subject of research, but their design and evaluation are still hardly explored. Furthermore, enactive systems as already proposed in the literature lack a social context consideration. The objective of this doctoral thesis is to contribute towards the design of computational technology within an enactive approach to cognition, while also being sensitive to social aspects. Therefore, this thesis investigates the concepts of enactive and socioenactive systems by enabling the co-design of interactive art installations. To achieve this objective, a theoretical-methodological framework named "Arte Factus" is proposed to support the study and socially aware co-design of digital artifacts. The "Arte Factus" framework was used in three design studies reported in this thesis: InterArt, InstInt, and InsTime. These studies involved the participation of 105 Computer Science and Computer Engineering undergraduate and graduate students in the co-design of 19 installations. The process involved the use of pervasive "Do-It-Yourself" (DIY) technology, and some of these installations were further studied in workshops of situated practice that took place in educational scenarios (school and exploratory science museum). The "Arte Factus" framework, as the main contribution of this doctoral thesis, has shown effective in supporting the socially aware co-design of interactive installations that materialize the concept of socioenactive digital artifacts. Moreover, through the study of the artifacts created in the context of this investigation, this thesis also contributes towards the theoretical construction of the concept of socioenactive systemsDoutoradoCiência da ComputaçãoDoutor em Ciência da Computação2017/06762-0FAPESPCAPE

Musical Bodies, Musical Minds

An enactive account of musicality that proposes new ways of thinking about musical experience, musical development in infancy, music and evolution, and more. Musical Bodies, Musical Minds offers an innovative account of human musicality that draws on recent developments in embodied cognitive science. The authors explore musical cognition as a form of sense-making that unfolds across the embodied, environmentally embedded, and sociomaterially extended dimensions that compose the enactment of human worlds of meaning. This perspective enables new ways of understanding musical experience, the development of musicality in infancy and childhood, music's emergence in human evolution, and the nature of musical emotions, empathy, and creativity. Developing their account, the authors link a diverse array of ideas from fields including neuroscience, theoretical biology, psychology, developmental studies, social cognition, and education. Drawing on these insights, they show how dynamic processes of adaptive body-brain-environment interactivity drive musical cognition across a range of contexts, extending it beyond the personal (inner) domain of musical agents and out into the material and social worlds they inhabit and influence. An enactive approach to musicality, they argue, can reveal important aspects of human being and knowing that are often lost or obscured in the modern technologically driven world

Ih­mi­sen ja tie­to­ko­neen vä­li­nen yh­teis­luo­vuus : runoja kirjoittavien yh­teis­luo­vien jär­jes­tel­mien suun­nit­te­lu ja ar­vioin­ti sekä yh­teis­luo­van pro­ses­sin mal­lin­ta­mi­nen

Human-computer co-creativity examines creative collaboration between humans and artificially intelligent computational agents. Human-computer co-creativity researchers assume that instead of using computational systems to merely automate creative tasks, computational creativity methods can be leveraged to design computational collaborators capable of sharing creative responsibility with a human collaborator. This has potential for extending both human and computational creative capability. This thesis focuses on the case of one human and one computational collaborator. More specifically this thesis studies how children collaborate with a computational collaborator called the Poetry Machine in the linguistically creative task of writing poems. This thesis investigates three topics related to human-computer co-creativity: The design of human-computer co-creative systems, their evaluation and the modelling of human-computer co-creative processes. These topics are approached from two perspectives: an interaction design perspective and a computational creativity perspective. The interaction design perspective provides practical methods for the design and evaluation of interactive systems as well as methodological frameworks for analysing design practices in the field. The computational creativity perspective then again provides a theoretical view to the evaluation and modelling of human-computer co-creativity. The thesis itself consists of five papers. This thesis starts with an analysis of the interaction design process for computational collaborators. The design process is examined through a review of case studies, and a thorough description of the design process of the Poetry Machine system described in Paper I. The review shows that several researchers in the field have assumed a user-centered design approach, but some good design practices, including the reporting of design decisions, iterative design and early testing with users are not yet fulfilled according to the best standards. After illustrating the general design process, this thesis examines different approaches to the evaluation of human-computer co-creativity. Two case studies are conducted to evaluate the usability of and user experiences with the Poetry Machine system. The first evaluations are described in Paper II. They produced useful feedback for developing the system further. The second evaluation, described in Papers III and IV, investigates specific metrics for evaluating the co-creative writing experience in more detail. To promote the accumulation of design knowledge, special care is taken to report practical issues related to evaluating co-creative systems. These include, for example, issues related to formulating suitable evaluation tasks. Finally the thesis considers modelling human-computer co-creativity. Paper V approaches modelling from a computationally creative perspective, by extending the creativity-as-a-search paradigm into co-creative systems. The new model highlights specific issues for interaction designers to be aware of when designing new computational collaborators.Ihmisen ja tietokoneen välinen yhteisluovuus on tutkimusala, joka käsittelee ihmisten ja tekoälyagenttien välistä luovaa yhteistyötä. Tekoälyagenttien perustana toimivat uudet laskennallisen luovuuden metodit. Ne mahdollistavat pelkän luovien tehtävien automatisoinnin sijaan tasapainoisemman vastuunjaon ja vuorovaikutuksen ihmisen ja tekoälyagentin välillä. Tämä tarjoaa sekä ihmisille että laskennallisille agenteille uusia luovia mahdollisuuksia. Väitöskirja keskittyy erityisesti yhden ihmisen ja laskennallisesti luovan agentin yhteistyöhön. Väitöskirja koostuu viidestä erillisestä julkaisusta, ja siihen kuuluvissa tapaustutkimuksissa havainnoidaan lasten ja laskennalliseen kielelliseen luovuuteen perustuvan Runokone–nimisen laskennallisesti luovan agentin yhteistyötä. Väitöskirjassa käsitellään ihmisen ja tietokoneen välisen yhteisluovuuden kolmea teemaa: yhteisluovien järjestelmien suunnittelua, niiden arviointia ja ihmisen ja tietokoneen välisen yhteisluovan prosessin mallinnusta. Teemojen tutkimiseen käytetään vuorovaikutussuunnittelun ja laskennallisen luovuuden menetelmiä. Vuorovaikutussuunnittelu tarjoaa käytännönläheisiä menetelmiä järjestelmien suunnitteluun ja arviointiin sekä erilaisia teoreettisia näkökulmia alalla vallitsevien suunnittelukäytäntöjen tarkasteluun. Laskennallisen luovuuden tutkimus puolestaan tarjoaa teoreettisen näkökulman yhteisluovien järjestelmien arviointiin ja yhteisluovuuden mallinnukseen. Ensimmäistä teemaa, yhteisluovien järjestelmien suunnittelua, käsitellään väitöskirjan julkaisussa I. Julkaisussa kuvataan yhteisluovien järjestelmien yleistä vuorovaikutussuunnitteluprosessia tapaustutkimuskatsauksen kautta, ja tarkastellaan Runokoneen suunnitteluprosessia. Tutkimuskatsaus osoittaa alan tutkijoiden usein valitsevan tutkimuksensa lähtökohdaksi käyttäjäkeskeisen suunnittelun. He kuitenkin noudattavat parhaita vuorovaikutussuunnittelun käytäntöjä vain löyhästi. Tiedeyhteisön sisällä tulisikin siksi parantaa erityisesti suunnittelupäätösten dokumentointia, iteratiivista suunnittelua ja varhaista käyttäjätestausta. Toista teemaa, ihmisen ja koneen välisen yhteisluovuuden arviointia, tarkastellaan väitöksessä kahden tapaustutkimuksen kautta. Niistä ensimmäisessä keskitytään Runokoneen käytettävyyden arviointiin ja toisessa Runokoneen käyttäjien kokemusten arviointiin. Käytettävyyden arviointia on kuvattu tarkemmin julkaisussa II. Arviointi tuotti hyödyllistä palautetta järjestelmän jatkokehitystä varten. Julkaisuissa III ja IV tarkastellaan mittareita, joiden avulla voidaan arvioida tarkemmin käyttäjien käyttäjäkokemuksia erilaisissa yhteisluovan kirjoittamisen prosesseissa. Vuorovaikutussuunnittelun tutkimuksen ja käytännön suunnittelutyön tukemiseksi julkaisuissa paneudutaan erityisesti yhteisluovien järjestelmien arvioinnin käytännön ongelmiin. Näihin kuuluu esimerkiksi sopivien arviointitehtävien muodostaminen. Lopuksi väitöskirjassa käsitellään ihmisen ja koneen välisen yhteisluovuuden mallinnusta. Julkaisussa V tarkastellaan mallinnusta laskennallisen luovuuden näkökulmasta laajentamalla luovan haun paradigmaa yhteisluoviin järjestelmiin. Luovan haun paradigma kuvaa luomisprosessia sekä esteettisesti miellyttävien että luovaan kohdealaan sopivien artefaktien etsintänä hakuavaruudessa. Kuvatussa laajennuksessa painottuvat vuorovaikutussuunnittelun kannalta oleelliset ristiriitatilanteet, joiden ratkaisutavat vaikuttavat laskennallisesti luovien yhteistyökumppaneiden ominaisuuksiin

PRINCIPLES OF METADESIGN Processes and Levels of Co-Creation in the New Design Space

In the tight of the material and cultural conditions of the present world and within the context of current design theories, this research aims to provide an understanding of Metadesign as emerging design cutture, and to integrate and advance its conceptual framework and principles through a tra nsdisci pli nary dialogue with the aesthetics and practice of Net Art. By rejecting the notion of Metadesign as an established design approach and practice, the creation of an etymological hypothesis based on the meanings of the prefix "-meta" (behind, together, between) becomes possible. Following this historical and cultural path, the research describes theories, frameworks and practices of Metadesign that have occurred in art, culture and media since the 1980s, in fields, such as, graphic design, industrial design, software engineering, information design, interaction design, biotechnotogical design, telecommunication art, experimental aesthetics, and architecture. The comparison and integration of all these approaches and viewpoints attows the identification of some design trends. More significantly, however, such an analysis enables the deconstruction of clusters of concepts and the production of a map of coherent etements. The anticipatory, participatory and sociotechnical issues raised 4 by the emerging and interconnected concepts that underlie Metadesign can be articulated and summarized in a three-fotd path based on the initial epistemological hypothesis. This can be characterized by three specific terms: 1) behind (designing design); 2) with (designing together); 3) betweenlamon3 (designing the "inbetween "). Interactive Art practitioners and theorists, both at an aesthetic and practical level, also share concerns about interaction, participation and co-creation. Compared to more financially oriented fields, Interactive Art, and collaborative practices of Net Art specificalty, have been We to answer to the new materiat and existentiat condition outlined by interconnectivity with a more dismantling experimentalism. The insights and advances they have produced in relation to the embodied and intersubjective dimension of human experience and creativity are stilt to be fully explored. Such insights can significantly fortify the three-fold path elaborated by this research, particutarty the third fo(d, which is concerned with the design of the 0rinbetween ". Focusing on collaborative systems for graphical interaction, as more suitable to the goal of understanding basic embodied and intersubjective processes of co-creation, the research identifies and analyses three projects of Net Art as case studies (GL&n6rateur Po*i 6tique, Open Studio, SITO Synergy Gridcosm). The results of these case studies provide an understanding of the experience of co-creation, a grasp of motivationat paths to co-creation, and a description of the features of the computationat environment which can sustain co-creation