Outlier hypothesis testing is studied in a universal setting. Multiple
sequences of observations are collected, a small subset of which are outliers.
A sequence is considered an outlier if the observations in that sequence are
distributed according to an ``outlier'' distribution, distinct from the
``typical'' distribution governing the observations in all the other sequences.
Nothing is known about the outlier and typical distributions except that they
are distinct and have full supports. The goal is to design a universal test to
best discern the outlier sequence(s). It is shown that the generalized
likelihood test is universally exponentially consistent under various settings.
The achievable error exponent is also characterized. In the other settings, it
is also shown that there cannot exist any universally exponentially consistent
test.Comment: IEEE Trans. Inf. Theory, to appear, 201