A Link Between Cepstral Shrinking and the Weighted Product Rule in Audio-visual Speech Recognition

The weighted product rule has been shown empirically to be of great benefit in audio-visual speech recognition (AVSR), for isolated word recognition tasks. A firm theoretical ba-sis for the selection of effective weights is of considerable interest to the audio-visual speech processing community. In this paper a clear link is established between the selec-tion of effective weightings and the approximately isotropic shrinkage that the distribution of acoustic cepstral features undergo in the presence of additive noise. An elucidation of the theoretical relationship between the cepstral shrinkage and the variance of the HMM audio log-likelihoods is then explored. 1