Universal Estimation of Divergence for Continuous Distributions via Data-Dependent Partitions

Abstract — We present a universal estimator of the divergence D(P �Q) for two arbitrary continuous distributions P and Q satisfying certain regularity conditions. This algorithm, which observes i.i.d. samples from both P and Q, is based on the estimation of the Radon-Nikodym derivative d