Facial Capture Lip-Sync

Facial model lip-sync is a large field of research within the animation industry. The mouth is a complex facial feature to animate, thus multiple techniques have arisen to simplify this process. These techniques, however, can lead to unappealing flat animation that lack full facial expression or eerie over-expressive animations that make the viewer uneasy. This thesis proposes an animation system that produces natural speech movements while conveying facial expression and compares them to previous techniques. This system used a text input of the dialogue to generate a phoneme-to-blend shape map to automate the facial model. An actor was motion captured to record the audio, provide speech motion data, and to directly control the facial expression in the regions of the face other than the mouth. The actor\u27s speech motion and the phoneme-to-blend shape map worked in conjunction to create a final lip-synced animation that viewers compared to phonetic driven animation and animation created with just motion capture. In this comparison, this system\u27s resultant animation was the least favorite, while the dampened motion capture animation gained the most preference

Animation of a hierarchical image based facial model and perceptual analysis of visual speech

In this Thesis a hierarchical image-based 2D talking head model is presented, together with robust automatic and semi-automatic animation techniques, and a novel perceptual method for evaluating visual-speech based on the McGurk effect. The novelty of the hierarchical facial model stems from the fact that sub-facial areas are modelled individually. To produce a facial animation, animations for a set of chosen facial areas are first produced, either by key-framing sub-facial parameter values, or using a continuous input speech signal, and then combined into a full facial output. Modelling hierarchically has several attractive qualities. It isolates variation in sub-facial regions from the rest of the face, and therefore provides a high degree of control over different facial parts along with meaningful image based animation parameters. The automatic synthesis of animations may be achieved using speech not originally included in the training set. The model is also able to automatically animate pauses, hesitations and non-verbal (or non-speech related) sounds and actions. To automatically produce visual-speech, two novel analysis and synthesis methods are proposed. The first method utilises a Speech-Appearance Model (SAM), and the second uses a Hidden Markov Coarticulation Model (HMCM) - based on a Hidden Markov Model (HMM). To evaluate synthesised animations (irrespective of whether they are rendered semi automatically, or using speech), a new perceptual analysis approach based on the McGurk effect is proposed. This measure provides both an unbiased and quantitative method for evaluating talking head visual speech quality and overall perceptual realism. A combination of this new approach, along with other objective and perceptual evaluation techniques, are employed for a thorough evaluation of hierarchical model animations.EThOS - Electronic Theses Online ServiceGBUnited Kingdo

Animation of a hierarchical image based facial model and perceptual analysis of visual speech

In this Thesis a hierarchical image-based 2D talking head model is presented, together with robust automatic and semi-automatic animation techniques, and a novel perceptual method for evaluating visual-speech based on the McGurk effect. The novelty of the hierarchical facial model stems from the fact that sub-facial areas are modelled individually. To produce a facial animation, animations for a set of chosen facial areas are first produced, either by key-framing sub-facial parameter values, or using a continuous input speech signal, and then combined into a full facial output. Modelling hierarchically has several attractive qualities. It isolates variation in sub-facial regions from the rest of the face, and therefore provides a high degree of control over different facial parts along with meaningful image based animation parameters. The automatic synthesis of animations may be achieved using speech not originally included in the training set. The model is also able to automatically animate pauses, hesitations and non-verbal (or non-speech related) sounds and actions. To automatically produce visual-speech, two novel analysis and synthesis methods are proposed. The first method utilises a Speech-Appearance Model (SAM), and the second uses a Hidden Markov Coarticulation Model (HMCM) - based on a Hidden Markov Model (HMM). To evaluate synthesised animations (irrespective of whether they are rendered semi automatically, or using speech), a new perceptual analysis approach based on the McGurk effect is proposed. This measure provides both an unbiased and quantitative method for evaluating talking head visual speech quality and overall perceptual realism. A combination of this new approach, along with other objective and perceptual evaluation techniques, are employed for a thorough evaluation of hierarchical model animations

Methods in Costume and Projection Design for Theatre

A report detailing multiple practices for theatre design in costumes and projection. It is focused on playscript analysis, the design process, and the final build of the design for production

Vocaodoru - Rhythm Gaming and Artificial Cinematography in Virtual Reality

Vocaodoru is a virtual reality rhythm game centered around two novel components. The gameplay of Vocaodoru is a never before-seen pose-based gameplay system that uses a player’s measurements to adapt gameplay to their needs. Tied to the gameplay is a human-in-the-loop utility AI that controls a cinematographic camera to allow streamers to broadcast a more interesting, dynamic view of the player. We discuss our efforts to develop and connect these components and how we plan to continue development after the conclusion of the MQP

Digital Alchemy: Matter and Metamorphosis in Contemporary Digital Animation and Interface Design

The recent proliferation of special effects in Hollywood film has ushered in an era of digital transformation. Among scholars, digital technology is hailed as a revolutionary moment in the history of communication and representation. Nevertheless, media scholars and cultural historians have difficulty finding a language adequate to theorizing digital artifacts because they are not just texts to be deciphered. Rather, digital media artifacts also invite critiques about the status of reality because they resurrect ancient problems of embodiment and transcendence.In contrast to scholarly approaches to digital technology, computer engineers, interface designers, and special effects producers have invented a robust set of terms and phrases to describe the practice of digital animation. In order to address this disconnect between producers of new media and scholars of new media, I argue that the process of digital animation borrows extensively from a set of preexisting terms describing materiality that were prominent for centuries prior to the scientific revolution. Specifically, digital animators and interface designers make use of the ancient science, art, and technological craft of alchemy. Both alchemy and digital animation share several fundamental elements: both boast the power of being able to transform one material, substance, or thing into a different material, substance, or thing. Both seek to transcend the body and materiality but in the process, find that this elusive goal (realism and gold) is forever receding onto the horizon.The introduction begins with a literature review of the field of digital media studies. It identifies a gap in the field concerning disparate arguments about new media technology. On the one hand, scholars argue that new technologies like cyberspace and digital technology enable radical new forms of engagement with media on individual, social, and economic levels. At the same time that media scholars assert that our current epoch is marked by a historical rupture, many other researchers claim that new media are increasingly characterized by ancient metaphysical problems like embodiment and transcendence. In subsequent chapters I investigate this disparity

February 1999

DEPARTMENTS AND COLUMNS AT DEADLINE ............................................................................................ .3 EDITORIAL…COMMENTARY .................................................................. 6 CLOSE UP: NELL SOTO ........................................................................... 7 PRO/CON ..................................................................................................... 8 CORPORATE PROFILE: AVERBECK INSURANCE.. ......................... 9 COMPUTERS/SOFTWARE ..................................................................... 10 GETTING ORGANIZED .......................................................................... 11 THE EMPLOYERS GROUP ................................................................... 12 FACES IN BUSINESS ............................................................................... 13 CORNER ON THE MARKET ................................................................. 14 EXPORTING .............................................................................................. 15 LAW ............................................................................................................. 16 MANAGING ............................................................................................... 17 LIST: TOP COMMERCIAL CONTRACfORS ..................................... 35 DUFF & PHELPS, LLC STOCK SHEET ............................................... 38 UST: RESIDENTIAL REAL ESTATE BUILDERS ..................................... 40 LIST: ARCHITECTUAL ENGINEERING FIRMS ………………… 43 & 44 DESERT BUSINESS JOURNAL ............................................................. 45 EXECUTIVE OUT ......................................................................... 46 MANAGER\u27S BOOKSHELF .................... , .............................................. 53 RESTAURANT REVIEW ......................................................................... 54 MEAD ON WINE ............................. , ........................................................ 55 CALENDAR ............................................................................................... 51 NEWS AND FEATURES A GLOBAL VIEW AT THE TOP OF THE HILL ................................. 5 PEAK PERFORMANCE! YOU CAN\u27T FALL TO THE TOP ............ 5 A NEW ERA FOR INDIAN GAMING .................................................. 5 PVHMC\u27S YOCHUM NAMED GOOD SCOUT OF THE YEAR ..... 23 TWO MAJOR PROJECTS UNDERWAY IN ONTARIO .................. 23 DEL WEBB\u27S SUN CITY PALM DESERT SETS SALES RECORDS ... 34 FLEETWOOD REBOUNDS AFTER TOUGH YEAR ....................... 38 EMWD NAMES NEW LEADERS ...................................................... .45 SULLIVAN\u27S STEAKHOUSE TO OPEN IN PALM DESERT ........ .45 CASINO NAMES NEW OFFICIAL .................................................. ..45 POLICE OFFICERS FIND THEMSELVES IN BUSINESS ............. 47 MK WALKER TAPPED FOR LEAD PR ROLE ................................ 47 AIRTOUCH PACKAGE MAKES CELLUlAR MORE ACCESSIBLE .... .48 DON\u27T WORRY, MAKE MONEY .................................................. 5