Automatic generation of Chinese calligraphic writings with style imitation

A parametric representation of stroke shapes is derived by adopting style imitation, a shape-generation-based process, to compactly represent the shapes of single strokes for the automatic generation of Chinese calligraphic writings. An image-processing-based approach is employed to derive the distance between the two strokes. The concept of stroke context is introduced to determine the shape of a stroke to be produced and the distance between two strokes is defined as the shortest distance between two points. An important difference between personal handwriting and a script generated from a font system is that a human writer writes a certain stroke or character differently each time, while a font system generates the same output. The shape-based criterion used in this study makes direct use of areas, which is more reliable than using shape contours because stroke contour details vary greatly.published_or_final_versio

TextPainter: Multimodal Text Image Generation with Visual-harmony and Text-comprehension for Poster Design

Text design is one of the most critical procedures in poster design, as it relies heavily on the creativity and expertise of humans to design text images considering the visual harmony and text-semantic. This study introduces TextPainter, a novel multimodal approach that leverages contextual visual information and corresponding text semantics to generate text images. Specifically, TextPainter takes the global-local background image as a hint of style and guides the text image generation with visual harmony. Furthermore, we leverage the language model and introduce a text comprehension module to achieve both sentence-level and word-level style variations. Besides, we construct the PosterT80K dataset, consisting of about 80K posters annotated with sentence-level bounding boxes and text contents. We hope this dataset will pave the way for further research on multimodal text image generation. Extensive quantitative and qualitative experiments demonstrate that TextPainter can generate visually-and-semantically-harmonious text images for posters.Comment: Accepted to ACM MM 2023. Dataset Link: https://tianchi.aliyun.com/dataset/16003

Arts Integration in Elementary Curriculum: 2nd Edition

This open textbook was revised in 2018 under a Round Eleven Mini-Grant for Revisions. Topics include: Arts Integration Music Visual Arts Literary Arts Performing Arts Physical Education and Movement A set of lecture slides for the textbook are also included as an additional file. Accessible files with optical character recognition (OCR) and auto-tagging provided by the Center for Inclusive Design and Innovation.https://oer.galileo.usg.edu/education-textbooks/1002/thumbnail.jp

Natural history connects medical concepts and painting theories in China

The earliest decipherable Chinese history traces back to the Shang Dynasty (B.C. 1766 – 1154). This period was considered prehistory until the discovery of artifacts describing divination rites in this era, practices that forge a culture. Divination rites included patterns in nature (natural law, li) such as the Five Elements and the Eight Trigrams. The Eight Trigrams were the first attempt at writing ancient philosophies. Eight symbols represent categories that are not static, but the changing patterns in nature are captured by organizing events and forms in nature relative to seven other influences. Later this idea expanded eight-fold, embracing the patterns of nature as well as human nature, thus creating Sixty-four Hexagrams. Such categories illuminating ‘likeness’ and ‘kind’ in nature originated in ritualistic practices and were the theoretical foundations of Chinese traditional art and medicine still in practice today. This thesis finds that ancient philosophies and rituals are the roots of Chinese culture, medicine and art. One ancient concept that is still prevalent in medical theories today is that of the body as a microcosm reflecting the macrocosmic universe. Medical concepts about the body illuminate a view of nature based on the concept of largeness in smallness. The technique of ‘depicting things as they are’ asks artists to capture the likeness of forms in nature. This is a time-honored aim of Chinese artists. Artists should strive to capture ‘likeness’ representing nature’s complexity, such that there is largeness in the smallest forms (such as humans) and space in nothingness (such as mist)

An Investigation of Holographic Technologies Applied to Contemporary Art Practice A new approach to temporal aesthetics

The works of contemporary art using audio, 35mm slide, video, film and computer- based technologies are commonly referred to as time-based media, since they have duration as a dimension. By looking at artworks which are classified in this category, it appears that temporal visual perceptual interpretations are mainly created through the use of the illusion of movement, which is primarily constituted by sequential images. In art holography, the light-based characteristic qualities of this medium compose a kinetic and interactive visual syntax, which are not seen in other imaging technologies, stating its unique creative possibilities. Thus, this study intends to employ holography as an art medium to explore its temporal properties in order to establish a new approach to time-based media art practice. To review the practice and artworks created for this study, the author recognises that the characteristic qualities of a medium is key for the development of its own aesthetic culture. Moreover, the author also identifies that the combination of both the slips form of a hologram and a portable lighting device would be fundamental elements of the suggested new approach. This approach integrates the holographic image replaying process and the Chinese bamboo slips structure to create a scroll form of an artwork presentation, which suggests a viewer to observe with an unrolling activity, section by section. The role of light in this approach is essential as it not only reconstructs the image, but also acts as an intangible guide to indicate the viewing direction, which forms a directional linear temporal expression. This study combines the suggested approach with classical Chinese poetry to create a series of experimental artworks, demonstrating that the literal and figurative meaning of the poem could possibly be elevated through the manipulation of the light source and the scroll from of the image presentation, as the former creates the holographic kinetic expression and the latter reinforces the poetic linearity. This approach could be interpreted as a time-based holographic manifestation, as it unfolds the art to the viewer over time. Furthermore, in terms of the characteristic qualities of holography, the visual expressive techniques and aesthetic features created for this study indicate that such works cannot be recreated without the use of holography. This study reveals that the irreplaceable aesthetic qualities of holography, suggesting that it could expand and diversify the creative potential of time-based media art; and the discussion of this category would not be comprehensive unless taking this medium into consideration. This study establishes a creative possibility of holography and expects the finding to lead to a greater appreciation for future time-based media art practice, thus enriching the temporal artistic expressions. Moreover, as it is practice-based, the process of the research is primarily expressed through a series of holographic artworks, and combined with written format of discussion, which is presented in this thesis. For comprehensive understanding, reading the thesis in conjunction with viewing the artworks in person is suggested, as the photographic reproduction of the holographic images in this thesis is only for illustration purpose

Online comics for the teaching and learning of Chinese language in the Australian context

This research explores the potential value of online comics in Chinese as a foreign language (CFL) education for nonbackground learners in the context of Australia. Mixed research methods, quantitative and qualitative, were adopted to investigate the affordances of online comics in CFL education, examining their effectiveness in improving students’ word recognition ability and exploring how students’ attitudes towards online comics influence their word recognition ability. During the time of the research, when the researcher was a teacher-researcher in the research school, data was collected from 60 students and one mentor teacher, through pre- and post-tests, artefacts, survey questionnaire, interview, and the teacher-researcher’s self-reflective journals. It was found that online comics’ affordances were connected with the characteristics of meaningful learning, which afforded CFL teaching and learning by showing it as usable with everyday life content, by making it useful through online comic creation, and by creating a fun and conducive teaching and learning environment in the classroom. In addition, the quantitative data analysis indicated that as the main teaching and learning method, the strategy of using online comics to teach Chinese characters may have improved their word recognition ability. Moreover, students’ attitudes towards online comics had significant influence on their Chinese word recognition ability. Students’ perceptions of online comics’ effectiveness, regardless of year and gender, were found to be related to their improvement in word recognition ability. On the other hand, students of different years and genders had different preferences towards online comics, and such preferences had different influences on their word recognition ability. Specifically, Year 6 students’ perceptions of online comics increased their motivation and were found to influence improvement of their word recognition ability. Girls’ opinions of thinking online comics were interesting in CFL learning were found to influence their improvement in word recognition ability. This thesis hopes to illuminate online comics in CFL teaching and learning. The findings of this research suggest the importance of adopting effective teaching approaches that align with students’ preferences

Schedule, Fall 2007

Schedule of classes for Taos campus for the fall of 2007

Representation, Recognition and Collaboration with Digital Ink

Pen input for computing devices is now widespread, providing a promising interaction mechanism for many purposes. Nevertheless, the diverse nature of digital ink and varied application domains still present many challenges. First, the sampling rate and resolution of pen-based devices keep improving, making input data more costly to process and store. At the same time, existing applications typically record digital ink either in proprietary formats, which are restricted to single platforms and consequently lack portability, or simply as images, which lose important information. Moreover, in certain domains such as mathematics, current systems are now achieving good recognition rates on individual symbols, in general recognition of complete expressions remains a problem due to the absence of an effective method that can reliably identify the spatial relationships among symbols. Last, but not least, existing digital ink collaboration tools are platform-dependent and typically allow only one input method to be used at a time. Together with the absence of recognition, this has placed significant limitations on what can be done. In this thesis, we investigate these issues and make contributions to each. We first present an algorithm that can accurately approximate a digital ink curve by selecting a certain subset of points from the original trace. This allows a compact representation of digital ink for efficient processing and storage. We then describe an algorithm that can automatically identify certain important features in handwritten symbols. Identifying the features can help us solve a number of problems such as improving two-dimensional mathematical recognition. Last, we present a framework for multi-user online collaboration in a pen-based and graphical environment. This framework is portable across multiple platforms and allows multimodal interactions in collaborative sessions. To demonstrate our ideas, we present InkChat, a whiteboard application, which can be used to conduct collaborative sessions on a shared canvas. It allows participants to use voice and digital ink independently and simultaneously, which has been found useful in remote collaboration