Reinforcement Learning in Multiple-UAV Networks: Deployment and Movement Design

A novel framework is proposed for quality of experience (QoE)-driven deployment and dynamic movement of multiple unmanned aerial vehicles (UAVs). The problem of joint non-convex three-dimensional (3D) deployment and dynamic movement of the UAVs is formulated for maximizing the sum mean opinion score (MOS) of ground users, which is proved to be NP-hard. In the aim of solving this pertinent problem, a three-step approach is proposed for attaining 3D deployment and dynamic movement of multiple UAVs. Firstly, genetic algorithm based K-means (GAK-means) algorithm is utilized for obtaining the cell partition of the users. Secondly, Q-learning based deployment algorithm is proposed, in which each UAV acts as an agent, making their own decision for attaining 3D position by learning from trial and mistake. In contrast to conventional genetic algorithm based learning algorithms, the proposed algorithm is capable of training the direction selection strategy offline. Thirdly, Q-learning based movement algorithm is proposed in the scenario that the users are roaming. The proposed algorithm is capable of converging to an optimal state. Numerical results reveal that the proposed algorithms show a fast convergence rate after a small number of iterations. Additionally, the proposed Q-learning based deployment algorithm outperforms K-means algorithms and Iterative-GAKmean (IGK) algorithms with a low complexity

Generation of nonlinear vortex precursors

We numerically study the propagation of a few-cycle pulse carrying orbital angular momentum (OAM) through a dense atomic system. Nonlinear precursors consisting of high-order vortex har- monics are generated in the transmitted field due to ultrafast Bloch oscillation. The nonlinear precursors survive to propagation effects and are well separated with the main pulse, which provide a straightforward way of measuring precursors. By the virtue of carrying high-order OAM, the obtained vortex precursors as information carriers have potential applications in optical informa- tion and communication fields where controllable loss, large information-carrying capacity and high speed communication are required

Existence and uniqueness of the global conservative weak solutions for the integrable Novikov equation

The integrable Novikov equation can be regarded as one of the Camassa-Holm-type equations with cubic nonlinearity. In this paper, we prove the global existence and uniqueness of the H\"older continuous energy conservative solutions for the Cauchy problem of the Novikov equation

Trajectory Design and Power Control for Multi-UAV Assisted Wireless Networks: A Machine Learning Approach

A novel framework is proposed for the trajectory design of multiple unmanned aerial vehicles (UAVs) based on the prediction of users' mobility information. The problem of joint trajectory design and power control is formulated for maximizing the instantaneous sum transmit rate while satisfying the rate requirement of users. In an effort to solve this pertinent problem, a three-step approach is proposed which is based on machine learning techniques to obtain both the position information of users and the trajectory design of UAVs. Firstly, a multi-agent Q-learning based placement algorithm is proposed for determining the optimal positions of the UAVs based on the initial location of the users. Secondly, in an effort to determine the mobility information of users based on a real dataset, their position data is collected from Twitter to describe the anonymous user-trajectories in the physical world. In the meantime, an echo state network (ESN) based prediction algorithm is proposed for predicting the future positions of users based on the real dataset. Thirdly, a multi-agent Q-learning based algorithm is conceived for predicting the position of UAVs in each time slot based on the movement of users. In this algorithm, multiple UAVs act as agents to find optimal actions by interacting with their environment and learn from their mistakes. Additionally, we also prove that the proposed multi-agent Q-learning based trajectory design and power control algorithm can converge under mild conditions. Numerical results are provided to demonstrate that as the size of the reservoir increases, the proposed ESN approach improves the prediction accuracy. Finally, we demonstrate that throughput gains of about 17% are achieved

Modeling and Analysis of Two-Way Relay Non-Orthogonal Multiple Access Systems

A two-way relay non-orthogonal multiple access (TWR-NOMA) system is investigated, where two groups of NOMA users exchange messages with the aid of one half-duplex (HD) decode-and-forward (DF) relay. Since the signal-plus-interference-to-noise ratios (SINRs) of NOMA signals mainly depend on effective successive interference cancellation (SIC) schemes, imperfect SIC (ipSIC) and perfect SIC (pSIC) are taken into account. In order to characterize the performance of TWR-NOMA systems, we first derive closed-form expressions for both exact and asymptotic outage probabilities of NOMA users' signals with ipSIC/pSIC. Based on the derived results, the diversity order and throughput of the system are examined. Then we study the ergodic rates of users' signals by providing the asymptotic analysis in high SNR regimes. Lastly, numerical simulations are provided to verify the analytical results and show that: 1) TWR-NOMA is superior to TWR-OMA in terms of outage probability in low SNR regimes; 2) Due to the impact of interference signal (IS) at the relay, error floors and throughput ceilings exist in outage probabilities and ergodic rates for TWR-NOMA, respectively; and 3) In delay-limited transmission mode, TWR-NOMA with ipSIC and pSIC have almost the same energy efficiency. However, in delay-tolerant transmission mode, TWR-NOMA with pSIC is capable of achieving larger energy efficiency compared to TWR-NOMA with ipSIC.Comment: 12 pages, 8 figures. arXiv admin note: substantial text overlap with arXiv:1801.0817

Outage Performance of A Unified Non-Orthogonal Multiple Access Framework

In this paper, a unified framework of non-orthogonal multiple access (NOMA) networks is proposed, which can be applied to code-domain NOMA (CD-NOMA) and power-domain NOMA (PD-NOMA). Since the detection of NOMA users mainly depend on efficient successive interference cancellation (SIC) schemes, both imperfect SIC (ipSIC) and perfect SIC (pSIC) are taken into considered. To characterize the performance of this unified framework, the exact and asymptotic expressions of outage probabilities as well as delay-limited throughput for CD/PD-NOMA with ipSIC/pSIC are derived. Based on the asymptotic analysis, the diversity orders of CD/PD-NOMA are provided. It is confirmed that due to the impact of residual interference (RI), the outage probability of the n-th user with ipSIC for CD/PD-NOMA converges to an error floor in the high signal-to-noise ratio (SNR) region. Numerical simulations demonstrate that the outage behavior of CD-NOMA is superior to that of PD-NOMA.Comment: Accecpted by IEEE ICC 201

The origin of the Redshift Spikes in the reflection spectrum of a Few-cycle Pulse in a Dense Medium

We give a detailed description about the reflected spectrum of a few-cycle pulse propagating through a resonant dense medium. An unexpected low-frequency spike appeared in the red edge of the spectrum. To figure out the origin of this redshift spike, we analysis the mechanisms responsible for the redshift of the reflected field. So far, the redshift has not been well studied for few-cycle pulses except a brief explanation made by the previous study [Kaloshan et al., Phys. Rev. Lett. 83 544 (1999).], which attributed the origin of the redshift to the so-called intrapulse four-wave mixing. However, we demonstrate numerically that the redshift consists of two separated spikes is actually produced by the Doppler effect of backpropagation waves, which is an analogue effect of dynamic nonlinear optical skin effect. Our study elucidates the underlying physics of the dynamic nonlinear optical effects responsible for the redshift spikes. Moreover, the dependency of the their frequency on the laser and medium parameters, such as medium density and input pulse area are also discussed

Stability of solitary waves of a generalized two-component Camassa-Holm system

We study here the existence of solitary wave solutions of a generalized two-component Camassa-Holm system. In addition to those smooth solitary-wave solutions, we show that there are solitary waves with singularities: peaked and cusped solitary waves. We also demonstrate that all smooth solitary waves are orbitally stable in the energy space. We finally give a sufficient condition for global strong solutions to the equation without certain parameters.Comment: 23 pages, 1 figur

Gene-based Association Analysis for Bivariate Time-to-event Data through Functional Regression with Copula Models

Several gene-based association tests for time-to-event traits have been proposed recently, to detect whether a gene region (containing multiple variants), as a set, is associated with the survival outcome. However, for bivariate survival outcomes, to the best of our knowledge, there is no statistical method that can be directly applied for gene-based association analysis. Motivated by a genetic study to discover gene regions associated with the progression of a bilateral eye disease, Age-related Macular Degeneration (AMD), we implement a novel functional regression method under the copula framework. Specifically, the effects of variants within a gene region are modeled through a functional linear model, which then contributes to the marginal survival functions within the copula. Generalized score test and likelihood ratio test statistics are derived to test for the association between bivariate survival traits and the genetic region. Extensive simulation studies are conducted to evaluate the type-I error control and power performance of the proposed approach, with comparisons to several existing methods for a single survival trait, as well as the marginal Cox functional regression model using the robust sandwich estimator for bivariate survival traits. Finally, we apply our method to a large AMD study, the Age-related Eye Disease Study (AREDS), to identify gene regions that are associated with AMD progression

Solar Cell Surface Defect Inspection Based on Multispectral Convolutional Neural Network

Similar and indeterminate defect detection of solar cell surface with heterogeneous texture and complex background is a challenge of solar cell manufacturing. The traditional manufacturing process relies on human eye detection which requires a large number of workers without a stable and good detection effect. In order to solve the problem, a visual defect detection method based on multi-spectral deep convolutional neural network (CNN) is designed in this paper. Firstly, a selected CNN model is established. By adjusting the depth and width of the model, the influence of model depth and kernel size on the recognition result is evaluated. The optimal CNN model structure is selected. Secondly, the light spectrum features of solar cell color image are analyzed. It is found that a variety of defects exhibited different distinguishable characteristics in different spectral bands. Thus, a multi-spectral CNN model is constructed to enhance the discrimination ability of the model to distinguish between complex texture background features and defect features. Finally, some experimental results and K-fold cross validation show that the multi-spectral deep CNN model can effectively detect the solar cell surface defects with higher accuracy and greater adaptability. The accuracy of defect recognition reaches 94.30%. Applying such an algorithm can increase the efficiency of solar cell manufacturing and make the manufacturing process smarter.Comment: 14 pages, 7 figures,14 table