GAN-powered Deep Distributional Reinforcement Learning for Resource Management in Network Slicing

Network slicing is a key technology in 5G communications system. Its purpose is to dynamically and efficiently allocate resources for diversified services with distinct requirements over a common underlying physical infrastructure. Therein, demand-aware resource allocation is of significant importance to network slicing. In this paper, we consider a scenario that contains several slices in a radio access network with base stations that share the same physical resources (e.g., bandwidth or slots). We leverage deep reinforcement learning (DRL) to solve this problem by considering the varying service demands as the environment state and the allocated resources as the environment action. In order to reduce the effects of the annoying randomness and noise embedded in the received service level agreement (SLA) satisfaction ratio (SSR) and spectrum efficiency (SE), we primarily propose generative adversarial network-powered deep distributional Q network (GAN-DDQN) to learn the action-value distribution driven by minimizing the discrepancy between the estimated action-value distribution and the target action-value distribution. We put forward a reward-clipping mechanism to stabilize GAN-DDQN training against the effects of widely-spanning utility values. Moreover, we further develop Dueling GAN-DDQN, which uses a specially designed dueling generator, to learn the action-value distribution by estimating the state-value distribution and the action advantage function. Finally, we verify the performance of the proposed GAN-DDQN and Dueling GAN-DDQN algorithms through extensive simulations

Profiling user activities with minimal traffic traces

Understanding user behavior is essential to personalize and enrich a user's online experience. While there are significant benefits to be accrued from the pursuit of personalized services based on a fine-grained behavioral analysis, care must be taken to address user privacy concerns. In this paper, we consider the use of web traces with truncated URLs - each URL is trimmed to only contain the web domain - for this purpose. While such truncation removes the fine-grained sensitive information, it also strips the data of many features that are crucial to the profiling of user activity. We show how to overcome the severe handicap of lack of crucial features for the purpose of filtering out the URLs representing a user activity from the noisy network traffic trace (including advertisement, spam, analytics, webscripts) with high accuracy. This activity profiling with truncated URLs enables the network operators to provide personalized services while mitigating privacy concerns by storing and sharing only truncated traffic traces. In order to offset the accuracy loss due to truncation, our statistical methodology leverages specialized features extracted from a group of consecutive URLs that represent a micro user action like web click, chat reply, etc., which we call bursts. These bursts, in turn, are detected by a novel algorithm which is based on our observed characteristics of the inter-arrival time of HTTP records. We present an extensive experimental evaluation on a real dataset of mobile web traces, consisting of more than 130 million records, representing the browsing activities of 10,000 users over a period of 30 days. Our results show that the proposed methodology achieves around 90% accuracy in segregating URLs representing user activities from non-representative URLs

Productivity Dynamics and Structural Change in the U.S. Manufacturing Sector

The paper investigates structural change among the four-digit (SIC) industries of the U.S. manufacturing sector during 1958-96 within a distribution dynamics framework. Focus is on the transition density of the Markov process that characterizes the value added shares of the industries. This transition density is estimated nonparametrically as well as by maximum likelihood, in which case the functional form of the density is derived from a search theoretic model. The nonparametric and the maximum likelihood fits show striking similarities. The relation of structural change to a relative measure of total factor productivity change is tested by an application of quantile regression and is found to be significantly positive throughout.structural change, productivity, manufacturing, quantile regression

A Note on Implementing Box-Cox Quantile Regression

The Box-Cox quantile regression model using the two stage method suggested by Chamberlain (1994) and Buchinsky (1995) provides a flexible and numerically attractive extension of linear quantile regression techniques. However, the objective function in stage two of the method may not exists. We suggest a simple modification of the estimator which is easy to implement. The modified estimator is still pn{consistent and we derive its asymptotic distribution. A simulation study confirms that the modified estimator works well in situations, where the original estimator is not well defined. --Box-Cox quantile regression,iterative estimator