Distributed Representations of Words and Phrases and their Compositionality

The recently introduced continuous Skip-gram model is an efficient method for learning high-quality distributed vector representations that capture a large number of precise syntactic and semantic word relationships. In this paper we present several extensions that improve both the quality of the vectors and the training speed. By subsampling of the frequent words we obtain significant speedup and also learn more regular word representations. We also describe a simple alternative to the hierarchical softmax called negative sampling. An inherent limitation of word representations is their indifference to word order and their inability to represent idiomatic phrases. For example, the meanings of "Canada" and "Air" cannot be easily combined to obtain "Air Canada". Motivated by this example, we present a simple method for finding phrases in text, and show that learning good vector representations for millions of phrases is possible

ASSISTANT WITH HISTORICAL LOCATION BASED TRIGGERS

A virtual, intelligent, or computational assistant (e.g., also referred to simply as an “assistant”) is described that performs actions based on an inferred user location, user direction of movement, and/or historical actions performed for previous locations or directions of movement. In some implementations, a user may explicitly command the assistant to perform a particular action when the user is moving relative to, or at, a particular location. In other implementations, the assistant may learn what actions the user performs or causes the assistant to perform when the user is moving relative to, or at, a particular location. In either case, the assistant may monitor location or movement information of the user (e.g., a location history, a current location, etc.) and perform the requested or learned action when the current location or movement information matches the commanded or learned behavior. This way, the assistant is enabled to trigger performance of previously defined actions or tasks based on changes in user’s future location or future movement

CREATION OF THEME-BASED AND/OR GENRE-BASED MUSIC PLAYLISTS USING AN INTERACTIVE ASSISTANT

An interactive assistant, referred to herein as “an interactive assistant,” “a virtual assistant,” or simply “an assistant,” may be configured to create comprehensive playlists based on singer/artist, composer, genre, theme, or other criteria, based on queries from a user. For example, an interactive assistant may accept queries from a user, perform searches for songs and related content based on certain theme-based and/or genre-based criteria specified in the queries (e.g., criteria for one or more love songs, happy songs, scary songs, sad songs, hard-rock songs, and the like), and generate or modify music playlists based on the search results. The interactive assistant may also execute one or more applications, such as a music application, to play the songs included in the generated playlists

OBSERVATION-BASED FORM ASSISTANT

A virtual, intelligent, or computational assistant (e.g., also referred to simply as an “assistant”) is described that is configured to selectively aid users when completing forms (e.g., documents, surveys, orders, fields, questionnaires, set of questions, etc.) or other online activities for which aid can be offered. When a user is filling out a form, the assistant may monitor the user’s rate of progress (e.g., filling out) of the form. If the rate decreases, the assistant may offer aid in completing the form. If the user accepts the aid, the assistant may fill in some or all of the form

DEVICE SETTINGS ASSISTANT

An interactive assistant, referred to herein as “an interactive assistant,” “a virtual assistant,” or simply “an assistant” may execute on counter-top devices, mobile phones, automobiles, and many other type of computing devices. The interactive assistant may be configured to guide the user to access features and settings of the computer device, and may also introduce features and settings of the computer device to the user

PROCESSING MULTIPLE TASKS BY VIRTUAL ASSISTANTS

An interactive assistant, referred to herein as “an interactive assistant,” “a virtual assistant,” or simply an “assistant,” is described that processes multiple tasks presented in a single query by a user. The user may, in other words, issue a query requesting that the virtual assistant perform multiple tasks. The virtual assistant may parse and buffer (or, stated differently, cache) each of the tasks of the multiple tasks, and process them appropriately, such as serially or concurrently (which may be referred to as being processed “in parallel”)

PROVISION OF PERSONALIZED DATE-BASED CONTENT

An interactive assistant computing system, referred to herein as “an interactive assistant,” “a virtual assistant,” “a computational assistant,” or simply an “assistant,” is described that stores and/or retrieves information related to items associated with particular days for a user such that the assistant can automatically retrieve one or more items associated with the current day (e.g., a local weather forecast, a current weather report, upcoming calendar items for the current day, current news stories, stock prices, indications of the day having personal importance, etc.) and provide a personalized report that includes the items specific to the current day. The assistant may also provide an audible indication of one or more of the items, such as an audible verbalization of a birthday wish to the user. This way, the assistant can present an improved, personalized indication of important aspects of the current day, eliminating the need for the user to access multiple different applications in order to access information regarding matters of the immediate future

USING AN INTERACTIVE ASSISTANT AS A PASSWORD VAULT

An interactive assistant, referred to herein as “an interactive assistant,” “a virtual assistant,” or simply “an assistant,” may be configured to securely store passwords, access codes, private keys, digital certificates, and other secret information. When the interactive assistant receives a request from the user to perform an action that requires the use of the secret information stored by the interactive assistant, the interactive assistant can provide such secret information to web sites, services, devices, systems, and the like to authenticate the interactive assistant to gain access to resources as part of performing the requested action. For example, when the interactive assistant encounters a website with username and password fields, the interactive assistant may retrieve the username and password associated with the website and may fill in the retrieved username and password into the username and password fields

DISAMBIGUATING ASSISTANT TASKS USING SUPPLEMENTAL DATA

A virtual, intelligent, or computational assistant (e.g., also referred to simply as an “assistant”) is described that relies on supplemental data (e.g., contextual information, user information, etc.) to decipher, and determine actions to perform based on, otherwise ambiguous user commands. With explicit permission from a user, the assistant may access a user’s location history, calendar, e-mail, messages, past assistant interactions, contacts, photos, search history, sensor data, and other contextual or user information to interpret user statements. The supplemental data can be stored locally on a device that is executing the assistant or in a cloud computing environment that is accessible to the assistant from the device. This way, the assistant can understand, and perform actions in response to, more complex, compound, and often ambiguous commands even if the commands are generalized, not specific, and/or could be interpreted in different ways, depending on the context or location in which the user provides the command