Vector quantization

During the past ten years Vector Quantization (VQ) has developed from a theoretical possibility promised by Shannon's source coding theorems into a powerful and competitive technique for speech and image coding and compression at medium to low bit rates. In this survey, the basic ideas behind the design of vector quantizers are sketched and some comments made on the state-of-the-art and current research efforts

Nested turbo codes for the costa problem

Driven by applications in data-hiding, MIMO broadcast channel coding, precoding for interference cancellation, and transmitter cooperation in wireless networks, Costa coding has lately become a very active research area. In this paper, we first offer code design guidelines in terms of source- channel coding for algebraic binning. We then address practical code design based on nested lattice codes and propose nested turbo codes using turbo-like trellis-coded quantization (TCQ) for source coding and turbo trellis-coded modulation (TTCM) for channel coding. Compared to TCQ, turbo-like TCQ offers structural similarity between the source and channel coding components, leading to more efficient nesting with TTCM and better source coding performance. Due to the difference in effective dimensionality between turbo-like TCQ and TTCM, there is a performance tradeoff between these two components when they are nested together, meaning that the performance of turbo-like TCQ worsens as the TTCM code becomes stronger and vice versa. Optimization of this performance tradeoff leads to our code design that outperforms existing TCQ/TCM and TCQ/TTCM constructions and exhibits a gap of 0.94, 1.42 and 2.65 dB to the Costa capacity at 2.0, 1.0, and 0.5 bits/sample, respectively

Trellis-coded quantization with unequal distortion.

Kwong Cheuk Fai.Thesis (M.Phil.)--Chinese University of Hong Kong, 2001.Includes bibliographical references (leaves 72-74).Abstracts in English and Chinese.Acknowledgements --- p.iAbstract --- p.iiTable of Contents --- p.ivChapter 1 --- Introduction --- p.1Chapter 1.1 --- Quantization --- p.2Chapter 1.2 --- Trellis-Coded Quantization --- p.3Chapter 1.3 --- Thesis Organization --- p.4Chapter 2 --- Trellis-Coded Modulation --- p.6Chapter 2.1 --- Convolutional Codes --- p.7Chapter 2.1.1 --- Generator Polynomials and Generator Matrix --- p.9Chapter 2.1.2 --- Circuit Diagram --- p.10Chapter 2.1.3 --- State Transition Diagram --- p.11Chapter 2.1.4 --- Trellis Diagram --- p.12Chapter 2.2 --- Trellis-Coded Modulation --- p.13Chapter 2.2.1 --- Uncoded Transmission verses TCM --- p.14Chapter 2.2.2 --- Trellis Representation --- p.17Chapter 2.2.3 --- Ungerboeck Codes --- p.18Chapter 2.2.4 --- Set Partitioning --- p.19Chapter 2.2.5 --- Decoding for TCM --- p.22Chapter 3 --- Trellis-Coded Quantization --- p.26Chapter 3.1 --- Scalar Trellis-Coded Quantization --- p.26Chapter 3.2 --- Trellis-Coded Vector Quantization --- p.31Chapter 3.2.1 --- Set Partitioning in TCVQ --- p.33Chapter 3.2.2 --- Codebook Optimization --- p.34Chapter 3.2.3 --- Numerical Data and Discussions --- p.35Chapter 4 --- Trellis-Coded Quantization with Unequal Distortion --- p.38Chapter 4.1 --- Design Procedures --- p.40Chapter 4.2 --- Fine and Coarse Codebooks --- p.41Chapter 4.3 --- Set Partitioning --- p.44Chapter 4.4 --- Codebook Optimization --- p.45Chapter 4.5 --- Decoding for Unequal Distortion TCVQ --- p.46Chapter 5 --- Unequal Distortion TCVQ on Memoryless Gaussian Source --- p.47Chapter 5.1 --- Memoryless Gaussian Source --- p.49Chapter 5.2 --- Set Partitioning of Codewords of Memoryless Gaussian Source --- p.49Chapter 5.3 --- Numerical Results and Discussions --- p.51Chapter 6 --- Unequal Distortion TCVQ on Markov Gaussian Source --- p.57Chapter 6.1 --- Markov Gaussian Source --- p.57Chapter 6.2 --- Set Partitioning of Codewords of Markov Gaussian Source --- p.58Chapter 6.3 --- Numerical Results and Discussions --- p.59Chapter 7 --- Conclusions --- p.70Bibliography --- p.7

Optimal soft-decoding combined trellis-coded quantization/modulation.

Chei Kwok-hung.Thesis (M.Phil.)--Chinese University of Hong Kong, 2000.Includes bibliographical references (leaves 66-73).Abstracts in English and Chinese.Chapter Chapter 1 --- Introduction --- p.1Chapter 1.1 --- Typical Digital Communication Systems --- p.2Chapter 1.1.1 --- Source coding --- p.3Chapter 1.1.2 --- Channel coding --- p.5Chapter 1.2 --- Joint Source-Channel Coding System --- p.5Chapter 1.3 --- Thesis Organization --- p.7Chapter Chapter 2 --- Trellis Coding --- p.9Chapter 2.1 --- Convolutional Codes --- p.9Chapter 2.2 --- Trellis-Coded Modulation --- p.12Chapter 2.2.1 --- Set Partitioning --- p.13Chapter 2.3 --- Trellis-Coded Quantization --- p.14Chapter 2.4 --- Joint TCQ/TCM System --- p.17Chapter 2.4.1 --- The Combined Receiver --- p.17Chapter 2.4.2 --- Viterbi Decoding --- p.19Chapter 2.4.3 --- Sequence MAP Decoding --- p.20Chapter 2.4.4 --- Sliding Window Decoding --- p.21Chapter 2.4.5 --- Block-Based Decoding --- p.23Chapter Chapter 3 --- Soft Decoding Joint TCQ/TCM over AWGN Channel --- p.25Chapter 3.1 --- System Model --- p.26Chapter 3.2 --- TCQ with Optimal Soft-Decoder --- p.27Chapter 3.3 --- Gaussian Memoryless Source --- p.30Chapter 3.3.1 --- Theorem Limit --- p.31Chapter 3.3.2 --- Performance on PAM Constellations --- p.32Chapter 3.3.3 --- Performance on PSK Constellations --- p.36Chapter 3.4 --- Uniform Memoryless Source --- p.38Chapter 3.4.1 --- Theorem Limit --- p.38Chapter 3.4.2 --- Performance on PAM Constellations --- p.39Chapter 3.4.3 --- Performance on PSK Constellations --- p.40Chapter Chapter 4 --- Soft Decoding Joint TCQ/TCM System over Rayleigh Fading Channel --- p.42Chapter 4.1 --- Wireless Channel --- p.43Chapter 4.2 --- Rayleigh Fading Channel --- p.44Chapter 4.3 --- Idea Interleaving --- p.45Chapter 4.4 --- Receiver Structure --- p.46Chapter 4.5 --- Numerical Results --- p.47Chapter 4.5.1 --- Performance on 4-PAM Constellations --- p.48Chapter 4.5.2 --- Performance on 8-PAM Constellations --- p.50Chapter 4.5.3 --- Performance on 16-PAM Constellations --- p.52Chapter Chapter 5 --- Joint TCVQ/TCM System --- p.54Chapter 5.1 --- Trellis-Coded Vector Quantization --- p.55Chapter 5.1.1 --- Set Partitioning in TCVQ --- p.56Chapter 5.2 --- Joint TCVQ/TCM --- p.59Chapter 5.2.1 --- Set Partitioning and Index Assignments --- p.60Chapter 5.2.2 --- Gaussian-Markov Sources --- p.61Chapter 5.3 --- Simulation Results and Discussion --- p.62Chapter Chapter 6 --- Conclusion and Future Work --- p.64Chapter 6.1 --- Conclusion --- p.64Chapter 6.2 --- Future Works --- p.65Bibliography --- p.66Appendix-Publications --- p.7

Near-capacity dirty-paper code design : a source-channel coding approach

This paper examines near-capacity dirty-paper code designs based on source-channel coding. We first point out that the performance loss in signal-to-noise ratio (SNR) in our code designs can be broken into the sum of the packing loss from channel coding and a modulo loss, which is a function of the granular loss from source coding and the target dirty-paper coding rate (or SNR). We then examine practical designs by combining trellis-coded quantization (TCQ) with both systematic and nonsystematic irregular repeat-accumulate (IRA) codes. Like previous approaches, we exploit the extrinsic information transfer (EXIT) chart technique for capacity-approaching IRA code design; but unlike previous approaches, we emphasize the role of strong source coding to achieve as much granular gain as possible using TCQ. Instead of systematic doping, we employ two relatively shifted TCQ codebooks, where the shift is optimized (via tuning the EXIT charts) to facilitate the IRA code design. Our designs synergistically combine TCQ with IRA codes so that they work together as well as they do individually. By bringing together TCQ (the best quantizer from the source coding community) and EXIT chart-based IRA code designs (the best from the channel coding community), we are able to approach the theoretical limit of dirty-paper coding. For example, at 0.25 bit per symbol (b/s), our best code design (with 2048-state TCQ) performs only 0.630 dB away from the Shannon capacity

The design of finite-state machines for quantization using simulated annealing

Ankara : Department of Electrical and Electronics Engineering and Institute of Engineering and Sciences, Bilkent Univ., 1993.Thesis (Master's) -- Bilkent University, 1993.Includes bibliographical references leaves 121-125In this thesis, the combinatorial optimization algorithm known as simulated annealing (SA) is applied to the solution of the next-state map design problem of data compression systems based on finite-state machine decoders. These data compression systems which include finite-state vector ciuantization (FSVQ), trellis waveform coding (TWC), predictive trellis waveform coding (PTWC), and trellis coded quantization (TCQ) are studied in depth. Incorporating generalized Lloyd algorithm for the optimization of output map to SA, a finite-state machine decoder design algorithm for the joint optimization of output map and next-state map is constructed. Simulation results on several discrete-time sources for FSVQ, TWC and PTWC show that decoders with higher performance are obtained by the SA-I-CLA algorithm, when compared to other related work in the literature. In TCQ, simulation results are obtained for sources with memory and new observations are made.Kuruoğlu, Ercan EnginM.S