Algorithms in future capital markets: A survey on AI, ML and associated algorithms in capital markets

This paper reviews Artificial Intelligence (AI), Machine Learning (ML) and associated algorithms in future Capital Markets. New AI algorithms are constantly emerging, with each 'strain' mimicking a new form of human learning, reasoning, knowledge, and decisionmaking. The current main disrupting forms of learning include Deep Learning, Adversarial Learning, Transfer and Meta Learning. Albeit these modes of learning have been in the AI/ML field more than a decade, they now are more applicable due to the availability of data, computing power and infrastructure. These forms of learning have produced new models (e.g., Long Short-Term Memory, Generative Adversarial Networks) and leverage important applications (e.g., Natural Language Processing, Adversarial Examples, Deep Fakes, etc.). These new models and applications will drive changes in future Capital Markets, so it is important to understand their computational strengths and weaknesses. Since ML algorithms effectively self-program and evolve dynamically, financial institutions and regulators are becoming increasingly concerned with ensuring there remains a modicum of human control, focusing on Algorithmic Interpretability/Explainability, Robustness and Legality. For example, the concern is that, in the future, an ecology of trading algorithms across different institutions may 'conspire' and become unintentionally fraudulent (cf. LIBOR) or subject to subversion through compromised datasets (e.g. Microsoft Tay). New and unique forms of systemic risks can emerge, potentially coming from excessive algorithmic complexity. The contribution of this paper is to review AI, ML and associated algorithms, their computational strengths and weaknesses, and discuss their future impact on the Capital Markets

A case study on smart band

학위논문 (석사) -- 서울대학교 대학원 : 공과대학 산업공학과, 2020. 8. 윤명환 .The aim of this study is to prove that the consumer review-based text mining methods proposed in the paper for cross-cultural design are effective. To prove it, we took Mi band 3 as a case study where we compared the cross-cultural differences in product preference of users from different cultural regions with this method. With the development of global market, more and more products and services are sold across the globe. Users from different cultures have different behaviors, cognitive styles, and value systems. Therefore, product should be designed to meet the needs and preferences of users from different cultural groups. In the field of cross-cultural design, existing studies are mainly focused on traditional usability and UX research methods. However, these methods expose some disadvantages when applied into cross-cultural design contexts. E-commerce websites provide a large volume of product reviews and it is easy to collect review data online. There is no need to employ foreign participants or make a survey onsite or remotely, which will save much more cost and time. There is a new trend that customer reviews are examined to know consumer opinions. Neverlessness, there are not many studies by analyzing online reviews in the field of cross-cultural design. Thus, my research proposed consumer review-based text mining methods for cross-cultural design, which consist of aspect-level opinion mining, sentiment analysis, and semantic network analysis. We collected review data from the following three websites: Naver of South Korea, Jingdong of China, and Amazon of the United States. Text mining methods including opinion mining, sentiment analysis, and semantic network analysis were performed. Firstly, product aspects were extracted from reviews according to word frequency. This indicates how much users are paying attention to different aspects of the product. Aspect-level sentiment analysis was conducted to find out customer satisfaction with different product aspects. Then, the words most associated with each product aspect were listed. Cluster analysis was conducted and the topic of each cluster was summarized. Data visualization of each dataset was done. Lastly, cross-cultural difference among three countries from the results was observed and discussed. Though there exist similar issues in product preferences of users from South Korea, China, and the United States, cross-cultural differences about Mi band 3 are shown in many product aspects. Korean tend to take Mi band as a fashionable, cool, yet not useful wearable device. They often buy it as a nice gift. They are interested in the appearance of the strap and often buy straps of different colors and materials. Korean do not enjoy outdoor activities as much as American. And the function of NFC is not prevalent in Korea. Thus, the smart band is not useful to Korean. These can explain why Korean do not care about quality of the smart band and do not want to buy Mi band at a high price. Korean think that the language of Korean on the display, application, and manual is the most important feature. The length of Korean texts is longer than Chinese to convey the same information. On the other hand, Korean prefer to check message notification on smart band rather than call notification. Therefore, Korean need a larger size for screen. Chinese are more concerned about different kinds of functions including fitness tracker (step counting, heart rate monitoring, and sleep monitoring), notification, and NFC. These different functions are all important and practical to Chinese. American enjoy outdoor activities and tend to use smart band mostly as activity tracker. They care more about activity tracker function including heart rate monitoring and step counting than Korean and Chinese. They have a higher requirement about the accuracy of measured data and have more negative reviews on activity tracker function than Korean and Chinese. Besides, they need the mode for swimming. Because American usually use the smart band for outdoor activities, they complain a lot that the screen is prone to scratches and is invisible under the outdoor sunlight. Also, they pay attention to the quality of screen and strap, expecting the material make the screen and strap durable. Besides, battery is the most significant aspect to American. They always try to test each function to find which function makes battery life short. The results of the case study prove that the consumer review-based text mining method proposed in the paper can generate cross-cultural difference in product preference effectively, which is helpful to cross-cultural design research. And this method is relatively easy and fast compared to other conventional methods.Chapter 1. Introduction 1 1.1 Background and Motivation 1 1.2 Research Objective 3 1.3 Organization of the Thesis 4 Chapter 2. Literature Review 5 2.1 Cross-Cultural Design 5 2.1.1 Definition 5 2.1.2 Necessity 6 2.1.3 Method 7 2.2 Opinion Mining and Sentiment Analysis 10 2.2.1 Aspect Level Opinion Mining 10 2.2.2 Cross-Lingual Opinion Mining 11 2.3 Semantic Network Analysis 13 Chapter 3. Methodology 15 3.1 Data Collection 15 3.2 Data Processing 16 3.2.1 Text Preprocessing 16 3.2.2 Opinion Mining and Sentiment Analysis 16 3.2.3 Semantic Network Analysis 17 3.2.4 Result Sample 18 Chapter 4. Result 20 4.1 Overview 20 4.2 Opinion Mining and Sentiment Analysis 21 4.2.1 Normalized Frequency 21 4.2.2 Sentiment Analysis 23 4.3 Semantic Network Analysis 26 4.3.1 Associated Words 26 4.3.1 Cluster Analysis 31 4.3.1 Data Visualization 34 4.4 Results based on Aspects 37 4.4.1 Battery 37 4.4.2 Price 39 4.4.3 Function 41 4.4.4 Step Counting 43 4.4.5 Korean 45 4.4.6 Heart Rate Monitoring 47 4.4.7 Sleep Monitoring 49 4.4.8 Quality 51 4.4.9 Notification 53 4.4.10 Screen 55 4.4.11 Exercise 57 4.4.12 App 59 4.4.13 Call 61 4.4.14 Connection 63 4.4.15 Waterproof 65 4.4.16 Display 67 4.4.17 Message 69 4.4.18 Alarm 71 4.4.19 Gift 73 4.4.20 Strap 75 Chapter 5. Conclusion 78 5.1 Summary of Findings 78 5.2 Future Research 80 Bibliography 82Maste

Yelp Rating Prediction with Sentiment and Topic Models.

Online reviews have been widely used for sentiment analysis tasks, for example, sentiment polarity prediction. In this paper, I address the rating prediction problem, using Yelp reviews. A star rating, in most cases, agrees with its review sentiment, which makes sentiment-words a reasonable solution for this task. Topics in reviews, on the other hand, are also likely to influence rating prediction. For example, for a restaurant, a customer may think it has a 5-stars service but the food is just 3-stars. So overall, that customer might give that restaurant a 4-stars rating. Using this idea, in this paper, I investigate whether topics, in addition to sentiment, are helpful in rating prediction task. I incorporated topic model with sentiment model and observed performance improvement.Master of Science in Information Scienc

Uso de técnicas de Computação Social para tomada de decisão de compra e venda de ações no mercado brasileiro de bolsa de valores

Tese (doutorado)—Universidade de Brasília, Faculdade de Tecnologia, Departamento de Engenharia Elétrica, 2015.O rastreamento do sentimento público para predição de indicadores do mercado financeiro tem ganhado atenção tanto da academia quanto do mundo dos negócios. Entretanto, há várias questões em relação à precisão e significância de modelos que necessitam ser aprimorados. Nesse sentido, este trabalho propõe analisar o relacionamento entre dados obtidos da rede social Twitter em português e do mercado de ações brasileiro através de um sistema de auxílio a tomada de decisão que realiza compra e venda de ações. Para isso, foram coletadas mensagens postadas de agosto de 2013 a abril de 2015 que continham palavras relacionadas às ações de nove empresas brasileiras expressivas no mercado de ações, e dados de volume e preço dessas na Bovespa. Sobre os dados advindos do Twitter, foram aplicadas técnicas para análise de sentimento e tendência para obtenção de indicadores que inicialmente foram relacionados estatisticamente com os da Bovespa e, posteriormente, usados no sistema simulador. Os resultados obtidos demonstraram que o investimento nessa área é promissor apesar dos grandes desafios que esta impõe.The tracking of public sentiment indicators to predict the financial market has gained much attention from academia and the business world. However, there are several issues regarding the accuracy and significance of models that need to be improved. Thus, this work aims to analyze the relationship between data in Portuguese language obtained from the social network Twitter and Brazilian stock market through a decision aid system which performs purchase and sale of shares. In order that, messages posted from August 2013 to April 2014 that contained words related to the actions of nine important Brazilian companies in the stock market, and Bovespa data as volume and price were collected. Techniques for sentiment analysis and trend were applied in the data to obtain indicators that were initially associated statistically with the Bovespa and subsequently, they were used in the simulator system. The results showed that investment in this area is promising despite the great challenges it imposes

Generación de recursos para Análisis de Opiniones en español

[ES] El Análisis de Sentimientos (AS) se refiere al tratamiento de la información subjetiva en los textos, sobretodo comentarios u opiniones personales. Una de las tareas básicas de AS es la clasificación de la polaridad de un texto determinado en un documento o frase, es decir, si la opinión expresada es positiva, negativa o neutra. Mucho se ha investigado en la clasificación de polaridad en documentos escritos en inglés. Sin embargo, actualmente cada vez más personas expresan comentarios u opiniones en su propio idioma. Para llevar a cabo esta labor es necesario el uso de los recursos lingüísticos (lexicones y corpora) que son escasos, cuando no inexistentes, en idiomas distintos al inglés. Por tales circunstancias, esta tesis tiene como objetivo la generación de nuevos recursos para el AS en español, tercer idioma con más relevancia en la web 2.0.[EN] Sentiment Analysis (SA) refers to the treatment of the subjective information in texts, product reviews, comments on blogs or personal opinions. One of the basic tasks in SA is classifying the polarity of a given text in a document, i.e., whether the opinion expressed is positive, negative, or neutral. Many studies have investigated the polarity classification in documents written in English. However, nowadays more and more people express their comments, opinions or points of view in their own language. For this reason, it is necessary to develop systems than can extract and analyze all this information in different languages. In this work we focus on polarity detection for Spanish reviews. We are mainly concerned with linguistic resources for Spanish sentiment analysis because, in addition to the lack of resources for this language in this area, it is currently the third most used language in the web 2.0.Tesis Univ. Jaén. Departamento de Informática- Leída el 28 de noviembre de 201

Statistical approaches to concept-level sentiment analysis

10.1109/MIS.2013.68IEEE Intelligent Systems2836-