Andersen, H.K.G. (Kristina)

Hofmeyer, Herm

IJsselsteijn, Wijnand A.

Lin, Pei-Ying

Pauwels, Pieter

Schmidt, R.P.W.

Schoenmakers, Sanne

English

Pure OAI Repository

 Weighted Prompt Engineering: Helpful or Hindering?Citation for published version (APA):Schmidt, R. P. W., Lin, P.-Y., Schoenmakers, S., Hofmeyer, H., Pauwels, P., Andersen, H. K. G., & IJsselsteijn,W. A. (2023). Weighted Prompt Engineering: Helpful or Hindering?. Poster session presented at Holst MemorialLecture 2023 , Eindhoven, Netherlands.Document license:UnspecifiedDocument status and date:Published: 30/11/2023Document Version:Publisher’s PDF, also known as Version of Record (includes final page, issue and volume numbers)Please check the document version of this publication:• A submitted manuscript is the version of the article upon submission and before peer-review. There can beimportant differences between the submitted version and the official published version of record. Peopleinterested in the research are advised to contact the author for the final version of the publication, or visit theDOI to the publisher's website.• The final author version and the galley proof are versions of the publication after peer review.• The final published version features the final layout of the paper including the volume, issue and pagenumbers.Link to publicationGeneral rightsCopyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright ownersand it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights.            • Users may download and print one copy of any publication from the public portal for the purpose of private study or research.            • You may not further distribute the material or use it for any profit-making activity or commercial gain            • You may freely distribute the URL identifying the publication in the public portal.If the publication is distributed under the terms of Article 25fa of the Dutch Copyright Act, indicated by the “Taverne” license above, pleasefollow below link for the End User Agreement:www.tue.nl/taverneTake down policyIf you believe that this document breaches copyright please contact us at:openaccess@tue.nlproviding details and we will investigate your claim.Download date: 14. Jul. 2024RESULTS• Scores for creativity, self-expression, and value decrease when going from unweighted to weighted prompt engineering• Scores for novelty and surprise are higher for weighted prompt engineering compared to unweighted prompt engineering• Participants didn’t like adding numbers to text“Using weights lays more emphasis on the weights instead of processing your ideas”“Not using numbers doesn’t break my flow of thought”“Thinking in numbers limited me coming up with new ideas”• Participants felt like they had higher expectations using the Weighted Prompt Engineering method“I'd be more disappointed in weighted going wrong than unweighted”“When using the weighted, I noticed that I really wanted or expected what I asked for”“Weighted was also frustrating because I did not get what I asked for”CONCLUSION→ Weighted Prompt Engineering decreases self-expression but does not have a significant effect on creativity→ Weighted Prompt Engineering seems to make the images more likely to be perceived as novel or surprising, but not enough evidence was found to confirm this→ Based on this data, Weighted Prompt Engineering seems to be a less promising method to increase creativity and other methods, e.g. a ‘troublemaker’ should be exploredINTRODUCTION• Increasing creativity in design and engineering may potentially lead to better solutions and processes• Text-to-Image models can create images from a text prompt, but this does not always go as expected• Gap between the user’s intention and the system’s output1• Adding control methods can increase self-expression and, in turn perceived creativity2HYPOTHESIS→ Adding a control method to the image generation process leads to higher perceived creativityPOSSIBLE SOLUTIONWeighted Prompt EngineeringMETHOD• 44 participants generated 8 images using both unweighted (standard) and weighted (new) prompt engineering • Participants rated the images’ perceived creativity, self-expression, value, novelty, and surprise3 on a 7-pt. scale, followed by an interviewMonster city:0.60 in water:0.40blue:0.40 turtle:0.60 A sunflower field by sunset“A sheep on a motorcycle”Dog in a roller coaster Dog:0.30 in a roller coaster0.70Weighted Prompt Engineering: Helpful or Hindering?THE EFFECTS OF WEIGHTED PROMPT ENGINEERING ON THE CREATIVITY OF TEXT-TO-IMAGE GENERATIONR. Schmidt1, P. Lin2, S. Schoenmakers3, H. Hofmeyer1, P. Pauwels4, K. Andersen2, W. IJsselsteijn31. Unit Structural Engineering and Design, Built Environment, Eindhoven University of Technology, the Netherlands2. Future Everyday group, Industrial Design, Eindhoven University of Technology, the Netherlands 3. Human-Technology Interaction group, Industrial Engineering and Innovation Sciences, Eindhoven University of Technology, the Netherlands 4. Unit Urban Systems and Real Estate, Built Environment, Eindhoven University of Technology, the NetherlandsBUILT ENVIRONMENT / STRUCTURAL ENGINEERING AND DESIGN1. Gal, R., Alaluf, Y., Atzmon, Y., Patashnik, O., Bermano, A. H., Chechik, G., & Cohen-Or, D. (2022). An image is worth one word: Personalizing text-to-image generation using textual inversion. https://doi.org/10.48550/ARXIV.2208.016182. Jordanous, A. (2012). A standardised procedure for evaluating creative systems: Computational creativity evaluation based on what it is to be creative. Cognitive Computation, 4(3), 246–279. https://doi.org/10.1007/s12559-012-9156-13. Boden, M. A. (1998). Creativity and artificial intelligence. Artificial Intelligence, 103(1), 347–356. https://doi.org/10.1016/S0004-3702(98)00055-1r.p.w.schmidt@tue.nl** ***01234567Creativity Self-Expression Value Novelty SurpriseVariableMeanMethodUnweightedPromptingWeightedPromptingVariable Scores during Text-to-Image Generation

Weighted Prompt Engineering: Helpful or Hindering?

https://pure.tue.nl/ws/files/314580623/POS_20_20231130_poster_Eindhoven_Netherlands_Holst_Memorial_Schmidt.pdf

Weighted Prompt Engineering: Helpful or Hindering?

Abstract

Similar works

Full text

Available Versions

Pure OAI Repository