Connotation in Computational Creativity

Computational creativity is the application of computers to perform tasks that would be regarded as creative if performed by humans. One approach to computational creativity is to regard it as a search process, where some conceptual space is searched, and perhaps transformed, to find an outcome that would be regarded as creative. Typically, such search processes have been guided by one or more objective functions that judge how creative each solution is on one or more dimensions. This paper introduces a contrasting approach, which is search based on the idea of connotations. Rather than exploring a space constructed solely of potential outcomes, a larger space is explored consisting of such outcomes together with other relevant information. This allows us to define search processes that include a more exploratory process, out of which an outcome emerges via density of connotations. Both the general principles behind this and some specific ideas are explored

Evaluating computational creativity: a standardised procedure for evaluating creative systems and its application

This thesis proposes SPECS: a Standardised Procedure for Evaluating Creative Systems. No methodology has been accepted as standard for evaluating the creativity of a system in the field of computational creativity and the multi-faceted and subjective nature of creativity generates substantial definitional issues. Evaluative practice has developed a general lack of rigour and systematicity, hindering research progress. SPECS is a standardised and systematic methodology for evaluating computational creativity. It is flexible enough to be applied to a variety of different types of creative system and adaptable to specific demands in different types of creativity. In the three-stage process of evaluation, researchers are required to be specific about what creativity entails in the domain they work in and what standards they test a system’s creativity by. To assist researchers, definitional issues are investigated and a set of components representing aspects of creativity is presented, which was empirically derived using computational linguistics analysis. These components are recommended for use within SPECS, being offered as a general definition of creativity that can be customised to account for any specific priorities for creativity in a given domain. SPECS is applied in a case study for detailed comparisons of the creativity of three musical improvisation systems, identifying which systems are more creative than others and why. In a second case study, SPECS is used to capture initial impressions on the creativity of systems presented at a 2011 computational creativity research event. Five systems performing different creative tasks are compared and contrasted. These case studies exemplify the valuable information that can be obtained on a system’s strengths and weaknesses. SPECS gives researchers vital feedback for improving their systems’ creativity, informing further progress in computational creativity research

TwitSong: A current events computer poet and the thorny problem of assessment.

This thesis is driven by the question of how computers can generate poetry, and how that poetry can be evaluated. We survey existing work on computer-generated poetry and interdisciplinary work on how to evaluate this type of computer-generated creative product. We perform experiments illuminating issues in evaluation which are specific to poetry. Finally, we produce and evaluate three versions of our own generative poetry system, TwitSong, which generates poetry based on the news, evaluates the desired qualities of the lines that it chooses, and, in its final form, can make targeted and goal-directed edits to its own work. While TwitSong does not turn out to produce poetry comparable to that of a human, it represents an advancement on the state of the art in its genre of computer-generated poetry, particularly in its ability to edit for qualities like topicality and emotion

Evaluating computational creativity: a standardised procedure for evaluating creative systems and its application

This thesis proposes SPECS: a Standardised Procedure for Evaluating Creative Systems. No methodology has been accepted as standard for evaluating the creativity of a system in the field of computational creativity and the multi-faceted and subjective nature of creativity generates substantial definitional issues. Evaluative practice has developed a general lack of rigour and systematicity, hindering research progress. SPECS is a standardised and systematic methodology for evaluating computational creativity. It is flexible enough to be applied to a variety of different types of creative system and adaptable to specific demands in different types of creativity. In the three-stage process of evaluation, researchers are required to be specific about what creativity entails in the domain they work in and what standards they test a system’s creativity by. To assist researchers, definitional issues are investigated and a set of components representing aspects of creativity is presented, which was empirically derived using computational linguistics analysis. These components are recommended for use within SPECS, being offered as a general definition of creativity that can be customised to account for any specific priorities for creativity in a given domain. SPECS is applied in a case study for detailed comparisons of the creativity of three musical improvisation systems, identifying which systems are more creative than others and why. In a second case study, SPECS is used to capture initial impressions on the creativity of systems presented at a 2011 computational creativity research event. Five systems performing different creative tasks are compared and contrasted. These case studies exemplify the valuable information that can be obtained on a system’s strengths and weaknesses. SPECS gives researchers vital feedback for improving their systems’ creativity, informing further progress in computational creativity research