Combining Enterprise Knowledge Graph and News Sentiment Analysis for Stock Price Prediction

Many state of the art methods analyze sentiments in news to predict stock price. When predicting stock price movement, the correlation between stocks is a factor that can’t be ignored because correlated stocks could cause co-movement. Traditional methods of measuring the correlation between stocks are mostly based on the similarity between corresponding stock price data, while ignoring the business relationships between companies, such as shareholding, cooperation and supply-customer relationships. To solve this problem, this paper proposes a new method to calculate the correlation by using the enterprise knowledge graph embedding that systematically considers various types of relationships between listed stocks. Further, we employ Gated Recurrent Unit (GRU) model to combine the correlated stocks’ news sentiment, the focal stock’s news sentiment and the focal stock’s quantitative features to predict the focal stock’s price movement. Results show that our method has an improvement of 8.1% compared with the traditional method

Context Retrieval via Normalized Contextual Latent Interaction for Conversational Agent

Conversational agents leveraging AI, particularly deep learning, are emerging in both academic research and real-world applications. However, these applications still face challenges, including disrespecting knowledge and facts, not personalizing to user preferences, and enormous demand for computational resources during training and inference. Recent research efforts have been focused on addressing these challenges from various aspects, including supplementing various types of auxiliary information to the conversational agents. However, existing methods are still not able to effectively and efficiently exploit relevant information from these auxiliary supplements to further unleash the power of the conversational agents and the language models they use. In this paper, we present a novel method, PK-NCLI, that is able to accurately and efficiently identify relevant auxiliary information to improve the quality of conversational responses by learning the relevance among persona, chat history, and knowledge background through low-level normalized contextual latent interaction. Our experimental results indicate that PK-NCLI outperforms the state-of-the-art method, PK-FoCus, by 47.80%/30.61%/24.14% in terms of perplexity, knowledge grounding, and training efficiency, respectively, and maintained the same level of persona grounding performance. We also provide a detailed analysis of how different factors, including language model choices and trade-offs on training weights, would affect the performance of PK-NCLI.Comment: 2023 IEEE International Conference on Data Mining Workshops (ICDMW

Improving Input-label Mapping with Demonstration Replay for In-context Learning

In-context learning (ICL) is an emerging capability of large autoregressive language models where a few input-label demonstrations are appended to the input to enhance the model's understanding of downstream NLP tasks, without directly adjusting the model parameters. The effectiveness of ICL can be attributed to the strong language modeling capabilities of large language models (LLMs), which enable them to learn the mapping between input and labels based on in-context demonstrations. Despite achieving promising results, the causal nature of language modeling in ICL restricts the attention to be backward only, i.e., a token only attends to its previous tokens, failing to capture the full input-label information and limiting the model's performance. In this paper, we propose a novel ICL method called Repeated Demonstration with Sliding Causal Attention, (RdSca). Specifically, we duplicate later demonstrations and concatenate them to the front, allowing the model to `observe' the later information even under the causal restriction. Besides, we introduce sliding causal attention, which customizes causal attention to avoid information leakage. Experimental results show that our method significantly improves the input-label mapping in ICL demonstrations. We also conduct an in-depth analysis of how to customize the causal attention without training, which has been an unexplored area in previous research

PreQuant: A Task-agnostic Quantization Approach for Pre-trained Language Models

While transformer-based pre-trained language models (PLMs) have dominated a number of NLP applications, these models are heavy to deploy and expensive to use. Therefore, effectively compressing large-scale PLMs becomes an increasingly important problem. Quantization, which represents high-precision tensors with low-bit fix-point format, is a viable solution. However, most existing quantization methods are task-specific, requiring customized training and quantization with a large number of trainable parameters on each individual task. Inspired by the observation that the over-parameterization nature of PLMs makes it possible to freeze most of the parameters during the fine-tuning stage, in this work, we propose a novel ``quantize before fine-tuning'' framework, PreQuant, that differs from both quantization-aware training and post-training quantization. PreQuant is compatible with various quantization strategies, with outlier-aware parameter-efficient fine-tuning incorporated to correct the induced quantization error. We demonstrate the effectiveness of PreQuant on the GLUE benchmark using BERT, RoBERTa, and T5. We also provide an empirical investigation into the workflow of PreQuant, which sheds light on its efficacy.Comment: Findings of ACL202

A new species of Passaloecus Shuckard (Hymenoptera, Crabronidae) from China, with a key to Oriental species

A new species of Passaloecus Shuckard, P. birugatus Bashir & Chen, sp. nov., is described and illustrated from Yunnan Province, China. The new species can be easily distinguished from known species of Passaloecus by its very long petiole, which is distinctly longer than wide, obscure scrobal suture, propodeum rugae and striations, body punctation, and coloration. An identification key to the Oriental species of Passaloecus is given

Kronos: A Secure and Generic Sharding Blockchain Consensus with Optimized Overhead

Sharding enhances blockchain scalability by dividing the network into shards, each managing specific unspent transaction outputs or accounts. As an introduced new transaction type, cross-shard transactions pose a critical challenge to the security and efficiency of sharding blockchains. Currently, there is a lack of a generic sharding consensus pattern that achieves both security and low overhead. In this paper, we present Kronos, a secure sharding blockchain consensus achieving optimized overhead. In particular, we propose a new secure sharding consensus pattern, based on a buffer managed jointly by shard members. Valid transactions are transferred to the payee via the buffer, while invalid ones are rejected through happy or unhappy paths. Kronos is proved to achieve security with atomicity under malicious clients with optimal intra-shard overhead $k\mathcal{B}$ ($k$ for involved shard number and $\mathcal{B}$ for a Byzantine fault tolerance (BFT) cost). Efficient rejection even requires no BFT execution in happy paths, and the cost in unhappy paths is still lower than a two-phase commit. Besides, we propose secure cross-shard certification methods based on batch certification and reliable cross-shard transfer. The former combines hybrid trees or vector commitments, while the latter integrates erasure coding. Handling $b$ transactions, Kronos is proved to achieve reliability with low cross-shard overhead $\mathcal{O}(n b \lambda)$ ($n$ for shard size and $\lambda$ for the security parameter). Notably, Kronos imposes no restrictions on BFT and does not rely on time assumptions, offering optional constructions in various modules. Kronos could serve as a universal framework for enhancing the performance and scalability of existing BFT protocols, supporting generic models, including asynchronous networks, increasing the throughput by several orders of magnitude. We implement Kronos using two prominent BFT protocols: asynchronous Speeding Dumbo (NDSS\u2722) and partial synchronous Hotstuff (PODC\u2719). Extensive experiments (over up to 1000 AWS EC2 nodes across 4 AWS regions) demonstrate Kronos scales the consensus nodes to thousands, achieving a substantial throughput of 320 ktx/sec with 2.0 sec latency. Compared with the past solutions, Kronos outperforms, achieving up to a 12$\times$ improvement in throughput and a 50% reduction in latency when cross-shard transactions dominate the workload

Development of an Energy Planning Model Using Temporal Production Simulation and Enhanced NSGA-III

This paper presents an innovative model of Energy Planning Model which allows navigating the complexities of modern energy systems. Our model utilizes a combination of Temporal Production Simulation and an Enhanced Non-Dominated Sorting Genetic Algorithm III to address the challenge associated with fluctuating energy demands and renewable sources integration. The model represents a significant advancement in energy planning due to its capacity to simulate energy production and consumption dynamics over time. The unique feature of the model is based on Temporal Production Simulation, meaning that the model is capable of accounting for hourly, daily, and seasonal fluctuations in energy supply and demand. Such temporal sensitivity is crucial for optimization in systems with high percentages of intermittent renewable sources, as existing planning solutions largely ignore such fluctuations. Another component of the model is the Enhanced NSGA-III algorithm that is uniquely tailored for the nature of multi-objective energy planning where one must balance their cost, environmental performance, and reliability. We have developed improvements to NSGAIII to enhance its efficiency when navigating the complex decision space associated with energy planning to reach faster convergence and to explore more optimal solutions. Methodologically, we use a combination of in-depth problem definition approach, advanced simulation, and algorithmic adjustments. We have validated our model against existing models and testing it in various scenarios to illustrate its superior ability to reach optimal energy plans based on efficiency, sustainability, and reliability under various conditions. Overall, through its unique incorporation of the Temporal Production Simulation and an improved optimization algorithm, the Energy Planning Model provides novel insights and practical decision support for policymakers and energy planners developed to reach the optimal sustainable solutions required for the high penetration of renewables

Enhancing the visibility of Vernier effect in a tri-microfiber coupler fiber loop interferometer for ultrasensitive refractive index and temperature sensing

In this paper a Vernier effect based sensor is analyzed and demonstrated experimentally in a tri-microfiber coupler (Tri-MFC) and polarization-maintaining fiber (PMF) loop interferometer (Tri-MFC-PMF) to provide ultrasensitive refractive index and temperature sensing. The main novelty of this work is an analysis of parameters of the proposed Tri-MFC-PMF with the objective of determining the conditions leading to a “strong” Vernier effect. It has been identified by simulation that the Vernier effect is a primary factor in the design of Tri-MFC-PMF loop sensing structure for sensitivity enhancement. It is furthermore demonstrated experimentally that enhancing the visibility of the Vernier spectrum in the Tri-MFC-PMF allows to achieve an ultrahigh refractive index and temperature sensitivity with improved measurement accuracy. Specifically it is shown that small values of the total phase difference ( π / 16 + Nπ )∼( π / 4 + Nπ ), where N is an integer, accumulated over the PMF loop and Tri-MFC loop result in a “strong” Vernier effect. Experimentally an ultrahigh refractive index sensitivity of -20588 nm/RIU and temperature sensitivity of 0.019 nm/°C are demonstrated by utilizing the stronger Vernier effect with “clear” Vernier spectrum. This analysis of the parameters may be useful to future researchers seeking to increase the measurement accuracy of sensors by enhancing the spectral visibility of the Vernier effect in other types of fiber optic interferometers