This invention uses newly defined mechanisms, fields and character glyphs that enable closed captioning to convey emotional and other intent

Publication, Defensive

English

Technical Disclosure Common

Technical Disclosure Commons Defensive Publications Series May 2021 Signaling and Displaying Emotion and Other Intent with CLOSED CAPTIONING Defensive Publication Follow this and additional works at: https://www.tdcommons.org/dpubs_series Recommended Citation Publication, Defensive, "Signaling and Displaying Emotion and Other Intent with CLOSED CAPTIONING", Technical Disclosure Commons, (May 25, 2021) https://www.tdcommons.org/dpubs_series/4320 This work is licensed under a Creative Commons Attribution 4.0 License. This Article is brought to you for free and open access by Technical Disclosure Commons. It has been accepted for inclusion in Defensive Publications Series by an authorized administrator of Technical Disclosure Commons. Page 1 of 3  5/20/2021  Signaling and Displaying Emotion and Other Intent with CLOSED CAPTIONING   SONY GROUP CORPORATION     Inventors: Brant Candelore Adam Goldberg Robert Blanchard     SonyDP@oinkanalytics.com    2Publication: Signaling and Displaying Emotion and Other Intent  with CLOSED CAPublished by Technical Disclosure Commons, 2021Page 2 of 3  Signaling and Displaying Emotion and Other Intent with CLOSED CAPTIONING  SYP337182  ABSTRACT This invention uses newly defined mechanisms, fields and character glyphs that enable closed captioning to convey emotional and other intent.  BACKGROUND Captioning can convey the words spoken, but there are no tools that can be used to convey the emphasis, emotional content, and other features of language usage beyond simple word choice.  A lot of the communication nuances are lost.  DESCRIPTION The invention uses newly defined mechanisms, fields and character glyphs that enable closed captioning to convey emotional and other intent. The captioning data extension is described in this disclosure.   See RELATED INNOVATION #1 below, in addition to the mechanisms described there, since closed captioning is already text.  It is envisioned that some of the emotional data could be displayed as punctuation, font color and style, as well as symbols, and emojis (as disclosed in Innovation #1 below). The invention can benefit from SPEECH SYNTHESIS MARKUP LANGUAGE (SSML).  Instead of sending this to a speech synthesizer, the mark-up will need to display something in the text for the user to 3Defensive Publications Series, Art. 4320 [2021]https://www.tdcommons.org/dpubs_series/4320Page 3 of 3  see.  The mark-up itself is not displayed. Among other things, the SSML is used by the speech synthesizer to add 1) prosody, 2) emphasis, 3) pauses, etc...  To show these things visually instead of announcing them through the speech synthesizer, the following could be done: The boldness of words could be adjusted to convey sound volume... VERY BOLD, BOLD, NORMAL, THIN. This can be done through different character sets - Arial, Arial Bold, Arial lite, etc. . .  Emphasis on certain vowels or consonants could be accomplished by doing the same thing to certain letters of a word.   Pauses could be announced and written as {pause} in the closed captioning window. Other text that might be used could {sigh}, {German accent}, {heavy breathing}, {slow breathing); etc. ...  In lieu of modifying the text, as an alternative, it is possible that a type of emoji could be used to signal loudness, normal, or softness in sound volume. Existing emojis could be used or developed for the other nuances conveyed. 4Publication: Signaling and Displaying Emotion and Other Intent  with CLOSED CAPublished by Technical Disclosure Commons, 2021

Signaling and Displaying Emotion and Other Intent  with CLOSED CAPTIONING

https://www.tdcommons.org/cgi/viewcontent.cgi?article=5402&context=dpubs_series

Signaling and Displaying Emotion and Other Intent with CLOSED CAPTIONING

Abstract

Similar works

Full text

Available Versions

Technical Disclosure Common