Skip to main content
Article thumbnail
Location of Repository

Kullback-Leibler approach to Gaussian mixture reduction

By Andrew R. Runnalls


A common problem in multi-target tracking is to approximate a Gaussian mixture by one containing fewer components; similar problems can arise in integrated navigation. A common approach is successively to merge pairs of components, replacing the pair with a single Gaussian component whose moments up to second order match those of the merged pair. Salmond [1] and Williams [2, 3] have each proposed algorithms along these lines, but using different criteria for selecting the pair to be merged at each stage. The paper shows how under certain circumstances each of these pair-selection criteria can give rise to anomalous behaviour, and proposes that a key consideration should be the Kullback-Leibler (KL) discrimination of the reduced mixture with respect to the original mixture. Although computing this directly would normally be impractical, the paper shows how an easily computed upper bound can be used as a pair-selection criterion which avoids the anomalies of the earlier approaches. The behaviour of the three algorithms is compared using a high-dimensional example drawn from terrain-referenced navigation

Topics: TK5101, TK
Publisher: IEEE- Institute of Electrical Electronics Engineers Inc
Year: 2007
OAI identifier:

Suggested articles


  1. (2003). Cost-function-based Gaussian mixture reduction,”
  2. (1999). Design and Analysis of Modern Tracking Systems. Artech House,
  3. (1991). Elements of Information Theory. doi
  4. (2003). Gaussian mixture reduction for tracking multiple maneuvering targets in clutter,” doi
  5. (1973). Linear Statistical Inference and its Applications, 2nd ed. doi
  6. (1990). Mixture reduction algorithms for target tracking in clutter,” doi
  7. (1951). On information and sufficiency,” doi
  8. (2004). Optimising the integration of terrain-referenced navigation with INS and GPS,” doi
  9. (1987). Principles and Practice of Information Theory. doi
  10. (2005). Terrain-referenced navigation using the IGMAP data fusion algorithm,”

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.