Upper bound on error exponents with delay for lossless source coding with side-information

Abstract — The traditional view of source coding with side information is in the block coding context in which all the source symbols are known in advance by the encoder. We instead consider a sequential setting in which source symbols are revealed to the encoder in real time and need to be reconstructed at the decoder within a certain fixed delay. We derive an upper bound on the reliability function with delay that considers the errors induced by atypically strange side-information. It is shown to be tight for certain “symmetric ” sources in low rate regime. I