Characterizing User Search Intent and Behavior for Click Analysis in Sponsored Search

Interpreting user actions to better understand their needs provides an important tool for improving information access services. In the context of organic Web search, considerable effort has been made to model user behavior and infer query intent, with the goal of improving the overall user experience. Much less work has been done in the area of sponsored search, i.e., with respect to the advertisement links (ads) displayed on search result pages by many commercial search engines. This thesis develops and evaluates new models and methods required to interpret user browsing and click behavior and understand query intent in this very different context. The concern of the initial part of the thesis is on extending the query categories for commercial search and on inferring query intent, with a focus on two major tasks: i) enriching queries with contextual information obtained from search result pages returned for these queries, and ii) developing relatively simple methods for the reliable labeling of training data via crowdsourcing. A central idea of this thesis work is to study the impact of contextual factors (including query intent, ad placement, and page structure) on user behavior. Later, this information is incorporated into probabilistic models to evaluate the quality of advertisement links within the context that they are displayed in their history of appearance. In order to account for these factors, a number of query and location biases are proposed and formulated into a group of browsing and click models. To explore user intent and behavior and to evaluate the performance of the proposed models and methods, logs of query and click information provided for research purposes are used. Overall, query intent is found to have substantial impact on predictions of user click behavior in sponsored search. Predictions are further improved by considering ads in the context of the other ads displayed on a result page. The parameters of the browsing and click models are learned using an expectation maximization technique applied to click signals recorded in the logs. The initial motivation of the user to browse the ad list and their browsing persistence are found to be related to query intent and browsing/click behavior. Accommodating these biases along with the location bias in user models appear as effective contextual signals, improving the performance of the existing models

Matroid Bandits: Fast Combinatorial Optimization with Learning

A matroid is a notion of independence in combinatorial optimization which is closely related to computational efficiency. In particular, it is well known that the maximum of a constrained modular function can be found greedily if and only if the constraints are associated with a matroid. In this paper, we bring together the ideas of bandits and matroids, and propose a new class of combinatorial bandits, matroid bandits. The objective in these problems is to learn how to maximize a modular function on a matroid. This function is stochastic and initially unknown. We propose a practical algorithm for solving our problem, Optimistic Matroid Maximization (OMM); and prove two upper bounds, gap-dependent and gap-free, on its regret. Both bounds are sublinear in time and at most linear in all other quantities of interest. The gap-dependent upper bound is tight and we prove a matching lower bound on a partition matroid bandit. Finally, we evaluate our method on three real-world problems and show that it is practical

Don't Let Me Be Misunderstood: Comparing Intentions and Perceptions in Online Discussions

Discourse involves two perspectives: a person's intention in making an utterance and others' perception of that utterance. The misalignment between these perspectives can lead to undesirable outcomes, such as misunderstandings, low productivity and even overt strife. In this work, we present a computational framework for exploring and comparing both perspectives in online public discussions. We combine logged data about public comments on Facebook with a survey of over 16,000 people about their intentions in writing these comments or about their perceptions of comments that others had written. Unlike previous studies of online discussions that have largely relied on third-party labels to quantify properties such as sentiment and subjectivity, our approach also directly captures what the speakers actually intended when writing their comments. In particular, our analysis focuses on judgments of whether a comment is stating a fact or an opinion, since these concepts were shown to be often confused. We show that intentions and perceptions diverge in consequential ways. People are more likely to perceive opinions than to intend them, and linguistic cues that signal how an utterance is intended can differ from those that signal how it will be perceived. Further, this misalignment between intentions and perceptions can be linked to the future health of a conversation: when a comment whose author intended to share a fact is misperceived as sharing an opinion, the subsequent conversation is more likely to derail into uncivil behavior than when the comment is perceived as intended. Altogether, these findings may inform the design of discussion platforms that better promote positive interactions.Comment: Proceedings of The Web Conference (WWW) 202

Population and fertility by age and sex for 195 countries and territories, 1950–2017: a systematic analysis for the Global Burden of Disease Study 2017

Background: Population estimates underpin demographic and epidemiological research and are used to track progress on numerous international indicators of health and development. To date, internationally available estimates of population and fertility, although useful, have not been produced with transparent and replicable methods and do not use standardised estimates of mortality. We present single-calendar year and single-year of age estimates of fertility and population by sex with standardised and replicable methods. Methods: We estimated population in 195 locations by single year of age and single calendar year from 1950 to 2017 with standardised and replicable methods. We based the estimates on the demographic balancing equation, with inputs of fertility, mortality, population, and migration data. Fertility data came from 7817 location-years of vital registration data, 429 surveys reporting complete birth histories, and 977 surveys and censuses reporting summary birth histories. We estimated age-specific fertility rates (ASFRs; the annual number of livebirths to women of a specified age group per 1000 women in that age group) by use of spatiotemporal Gaussian process regression and used the ASFRs to estimate total fertility rates (TFRs; the average number of children a woman would bear if she survived through the end of the reproductive age span [age 10–54 years] and experienced at each age a particular set of ASFRs observed in the year of interest). Because of sparse data, fertility at ages 10–14 years and 50–54 years was estimated from data on fertility in women aged 15–19 years and 45–49 years, through use of linear regression. Age-specific mortality data came from the Global Burden of Diseases, Injuries, and Risk Factors Study (GBD) 2017 estimates. Data on population came from 1257 censuses and 761 population registry location-years and were adjusted for underenumeration and age misreporting with standard demographic methods. Migration was estimated with the GBD Bayesian demographic balancing model, after incorporating information about refugee migration into the model prior. Final population estimates used the cohort-component method of population projection, with inputs of fertility, mortality, and migration data. Population uncertainty was estimated by use of out-of-sample predictive validity testing. With these data, we estimated the trends in population by age and sex and in fertility by age between 1950 and 2017 in 195 countries and territories. Findings: From 1950 to 2017, TFRs decreased by 49\ub74% (95% uncertainty interval [UI] 46\ub74–52\ub70). The TFR decreased from 4\ub77 livebirths (4\ub75–4\ub79) to 2\ub74 livebirths (2\ub72–2\ub75), and the ASFR of mothers aged 10–19 years decreased from 37 livebirths (34–40) to 22 livebirths (19–24) per 1000 women. Despite reductions in the TFR, the global population has been increasing by an average of 83\ub78 million people per year since 1985. The global population increased by 197\ub72% (193\ub73–200\ub78) since 1950, from 2\ub76 billion (2\ub75–2\ub76) to 7\ub76 billion (7\ub74–7\ub79) people in 2017; much of this increase was in the proportion of the global population in south Asia and sub-Saharan Africa. The global annual rate of population growth increased between 1950 and 1964, when it peaked at 2\ub70%; this rate then remained nearly constant until 1970 and then decreased to 1\ub71% in 2017. Population growth rates in the southeast Asia, east Asia, and Oceania GBD super-region decreased from 2\ub75% in 1963 to 0\ub77% in 2017, whereas in sub-Saharan Africa, population growth rates were almost at the highest reported levels ever in 2017, when they were at 2\ub77%. The global average age increased from 26\ub76 years in 1950 to 32\ub71 years in 2017, and the proportion of the population that is of working age (age 15–64 years) increased from 59\ub79% to 65\ub73%. At the national level, the TFR decreased in all countries and territories between 1950 and 2017; in 2017, TFRs ranged from a low of 1\ub70 livebirths (95% UI 0\ub79–1\ub72) in Cyprus to a high of 7\ub71 livebirths (6\ub78–7\ub74) in Niger. The TFR under age 25 years (TFU25; number of livebirths expected by age 25 years for a hypothetical woman who survived the age group and was exposed to current ASFRs) in 2017 ranged from 0\ub708 livebirths (0\ub707–0\ub709) in South Korea to 2\ub74 livebirths (2\ub72–2\ub76) in Niger, and the TFR over age 30 years (TFO30; number of livebirths expected for a hypothetical woman ageing from 30 to 54 years who survived the age group and was exposed to current ASFRs) ranged from a low of 0\ub73 livebirths (0\ub73–0\ub74) in Puerto Rico to a high of 3\ub71 livebirths (3\ub70–3\ub72) in Niger. TFO30 was higher than TFU25 in 145 countries and territories in 2017. 33 countries had a negative population growth rate from 2010 to 2017, most of which were located in central, eastern, and western Europe, whereas population growth rates of more than 2\ub70% were seen in 33 of 46 countries in sub-Saharan Africa. In 2017, less than 65% of the national population was of working age in 12 of 34 high-income countries, and less than 50% of the national population was of working age in Mali, Chad, and Niger. Interpretation: Population trends create demographic dividends and headwinds (ie, economic benefits and detriments) that affect national economies and determine national planning needs. Although TFRs are decreasing, the global population continues to grow as mortality declines, with diverse patterns at the national level and across age groups. To our knowledge, this is the first study to provide transparent and replicable estimates of population and fertility, which can be used to inform decision making and to monitor progress. Funding: Bill & Melinda Gates Foundation

Population and fertility by age and sex for 195 countries and territories, 1950–2017: a systematic analysis for the Global Burden of Disease Study 2017

Background: Population estimates underpin demographic and epidemiological research and are used to track progress on numerous international indicators of health and development. To date, internationally available estimates of population and fertility, although useful, have not been produced with transparent and replicable methods and do not use standardised estimates of mortality. We present single-calendar year and single-year of age estimates of fertility and population by sex with standardised and replicable methods. Methods: We estimated population in 195 locations by single year of age and single calendar year from 1950 to 2017 with standardised and replicable methods. We based the estimates on the demographic balancing equation, with inputs of fertility, mortality, population, and migration data. Fertility data came from 7817 location-years of vital registration data, 429 surveys reporting complete birth histories, and 977 surveys and censuses reporting summary birth histories. We estimated age-specific fertility rates (ASFRs; the annual number of livebirths to women of a specified age group per 1000 women in that age group) by use of spatiotemporal Gaussian process regression and used the ASFRs to estimate total fertility rates (TFRs; the average number of children a woman would bear if she survived through the end of the reproductive age span [age 10–54 years] and experienced at each age a particular set of ASFRs observed in the year of interest). Because of sparse data, fertility at ages 10–14 years and 50–54 years was estimated from data on fertility in women aged 15–19 years and 45–49 years, through use of linear regression. Age-specific mortality data came from the Global Burden of Diseases, Injuries, and Risk Factors Study (GBD) 2017 estimates. Data on population came from 1257 censuses and 761 population registry location-years and were adjusted for underenumeration and age misreporting with standard demographic methods. Migration was estimated with the GBD Bayesian demographic balancing model, after incorporating information about refugee migration into the model prior. Final population estimates used the cohort-component method of population projection, with inputs of fertility, mortality, and migration data. Population uncertainty was estimated by use of out-of-sample predictive validity testing. With these data, we estimated the trends in population by age and sex and in fertility by age between 1950 and 2017 in 195 countries and territories. Findings: From 1950 to 2017, TFRs decreased by 49·4% (95% uncertainty interval [UI] 46·4–52·0). The TFR decreased from 4·7 livebirths (4·5–4·9) to 2·4 livebirths (2·2–2·5), and the ASFR of mothers aged 10–19 years decreased from 37 livebirths (34–40) to 22 livebirths (19–24) per 1000 women. Despite reductions in the TFR, the global population has been increasing by an average of 83·8 million people per year since 1985. The global population increased by 197·2% (193·3–200·8) since 1950, from 2·6 billion (2·5–2·6) to 7·6 billion (7·4–7·9) people in 2017; much of this increase was in the proportion of the global population in south Asia and sub-Saharan Africa. The global annual rate of population growth increased between 1950 and 1964, when it peaked at 2·0%; this rate then remained nearly constant until 1970 and then decreased to 1·1% in 2017. Population growth rates in the southeast Asia, east Asia, and Oceania GBD super-region decreased from 2·5% in 1963 to 0·7% in 2017, whereas in sub-Saharan Africa, population growth rates were almost at the highest reported levels ever in 2017, when they were at 2·7%. The global average age increased from 26·6 years in 1950 to 32·1 years in 2017, and the proportion of the population that is of working age (age 15–64 years) increased from 59·9% to 65·3%. At the national level, the TFR decreased in all countries and territories between 1950 and 2017; in 2017, TFRs ranged from a low of 1·0 livebirths (95% UI 0·9–1·2) in Cyprus to a high of 7·1 livebirths (6·8–7·4) in Niger. The TFR under age 25 years (TFU25; number of livebirths expected by age 25 years for a hypothetical woman who survived the age group and was exposed to current ASFRs) in 2017 ranged from 0·08 livebirths (0·07–0·09) in South Korea to 2·4 livebirths (2·2–2·6) in Niger, and the TFR over age 30 years (TFO30; number of livebirths expected for a hypothetical woman ageing from 30 to 54 years who survived the age group and was exposed to current ASFRs) ranged from a low of 0·3 livebirths (0·3–0·4) in Puerto Rico to a high of 3·1 livebirths (3·0–3·2) in Niger. TFO30 was higher than TFU25 in 145 countries and territories in 2017. 33 countries had a negative population growth rate from 2010 to 2017, most of which were located in central, eastern, and western Europe, whereas population growth rates of more than 2·0% were seen in 33 of 46 countries in sub-Saharan Africa. In 2017, less than 65% of the national population was of working age in 12 of 34 high-income countries, and less than 50% of the national population was of working age in Mali, Chad, and Niger. Interpretation: Population trends create demographic dividends and headwinds (ie, economic benefits and detriments) that affect national economies and determine national planning needs. Although TFRs are decreasing, the global population continues to grow as mortality declines, with diverse patterns at the national level and across age groups. To our knowledge, this is the first study to provide transparent and replicable estimates of population and fertility, which can be used to inform decision making and to monitor progress