DRASIC: Distributed Recurrent Autoencoder for Scalable Image Compression

We propose a new architecture for distributed image compression from a group of distributed data sources. The work is motivated by practical needs of data-driven codec design, low power consumption, robustness, and data privacy. The proposed architecture, which we refer to as Distributed Recurrent Autoencoder for Scalable Image Compression (DRASIC), is able to train distributed encoders and one joint decoder on correlated data sources. Its compression capability is much better than the method of training codecs separately. Meanwhile, the performance of our distributed system with 10 distributed sources is only within 2 dB peak signal-to-noise ratio (PSNR) of the performance of a single codec trained with all data sources. We experiment distributed sources with different correlations and show how our data-driven methodology well matches the Slepian-Wolf Theorem in Distributed Source Coding (DSC). To the best of our knowledge, this is the first data-driven DSC framework for general distributed code design with deep learning

Progressively communicating rich telemetry from autonomous underwater vehicles via relays

Submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy at the Massachusetts Institute of Technology and the Woods Hole Oceanographic Institution June 2012As analysis of imagery and environmental data plays a greater role in mission construction and execution, there is an increasing need for autonomous marine vehicles to transmit this data to the surface. Without access to the data acquired by a vehicle, surface operators cannot fully understand the state of the mission. Communicating imagery and high-resolution sensor readings to surface observers remains a significant challenge – as a result, current telemetry from free-roaming autonomous marine vehicles remains limited to ‘heartbeat’ status messages, with minimal scientific data available until after recovery. Increasing the challenge, longdistance communication may require relaying data across multiple acoustic hops between vehicles, yet fixed infrastructure is not always appropriate or possible. In this thesis I present an analysis of the unique considerations facing telemetry systems for free-roaming Autonomous Underwater Vehicles (AUVs) used in exploration. These considerations include high-cost vehicle nodes with persistent storage and significant computation capabilities, combined with human surface operators monitoring each node. I then propose mechanisms for interactive, progressive communication of data across multiple acoustic hops. These mechanisms include wavelet-based embedded coding methods, and a novel image compression scheme based on texture classification and synthesis. The specific characteristics of underwater communication channels, including high latency, intermittent communication, the lack of instantaneous end-to-end connectivity, and a broadcast medium, inform these proposals. Human feedback is incorporated by allowing operators to identify segments of data thatwarrant higher quality refinement, ensuring efficient use of limited throughput. I then analyze the performance of these mechanisms relative to current practices. Finally, I present CAPTURE, a telemetry architecture that builds on this analysis. CAPTURE draws on advances in compression and delay tolerant networking to enable progressive transmission of scientific data, including imagery, across multiple acoustic hops. In concert with a physical layer, CAPTURE provides an endto- end networking solution for communicating science data from autonomous marine vehicles. Automatically selected imagery, sonar, and time-series sensor data are progressively transmitted across multiple hops to surface operators. Human operators can request arbitrarily high-quality refinement of any resource, up to an error-free reconstruction. The components of this system are then demonstrated through three field trials in diverse environments on SeaBED, OceanServer and Bluefin AUVs, each in different software architectures.Thanks to the National Science Foundation, and the National Oceanic and Atmospheric Administration for their funding of my education and this work

Video Quality Assessment in Underwater Acoustic Networks

Fecha de Lectura de Tesis Doctoral: 23 de mayo de 2018.Las imágenes subacuáticas reciben una atención cada vez mayor por parte de la comunidad científica dado que las fotografías y los vídeos son herramientas de gran valor en el estudio del entorno oceánico que cubre el 90% de la biosfera de nuestro planeta. Sin embargo, las Redes de Sensores Submarinas deben enfrentarse al canal hostil que el agua de mar constituye. Las comunicaciones de medio rango son sólo posibles con modems acústicos de capacidades muy limitadas con tasas binarias de pico de unas decenas de kbps. En transmisión de vídeo, estas reducidas tasas binarias fuerzan una compresión elevada que produce niveles de distorsión mucho mayores que en otros entornos. Además, los usuarios de vídeo submarino son oceanógrafos u otros especialistas con una percepción de la calidad diferente a la de un grupo genérico de usuarios. Las peculiaridades descritas exigen un estudio dedicado de la evaluación de calidad de vídeo para redes submarinas. Esta tesis doctoral aborda el problema de la evaluación de calidad de vídeo y presenta contribuciones en las dos áreas principales de esta disciplina: evaluación subjetiva y evaluación objetiva. La referencia para la percepción de calidad en cualquier servicio es la opinión de los usuarios y, por tanto, un análisis de la calidad subjetiva es el primer paso en este trabajo. Se presentan el diseño experimental y los resultados de un test de acuerdo a métodos psicométricos estándares. Los participantes del test fueron científicos del océano y las secuencias de vídeo utilizadas fueron grabadas en campañas de exploración y procesadas para simular las condiciones de las comunicaciones submarinas. Los resultados experimentales muestran como los vídeos son útiles para tareas científicas incluso en condiciones de muy baja tasa binaria. Los métodos de evaluación de la calidad objetiva son algoritmos diseñados para calcular puntuaciones de calidad

Underwater Image Transmission Using Spatial Modulation Unequal Error Protection for Internet of Underwater Things.

A spatial modulation (SM) scheme has been developed as a hopeful candidate for spectral and energy-efficient wireless communication systems, as it provides a great judgment for the system performance, data transmission rate, receiver complexity, and energy/spectrum efficiency. In SM, the data is conveyed by both habitual M-ary signal constellations and the transmit antennas indices. Therefore, the system data rate improvement due to the side information bits transmitted, encapsulated in indices of the transmit antennas, improves the SM transmission efficiency compared to the different MIMO players. The information bits transmitted over the antenna index and data symbol constellation using M-ary signal performance have different levels of bit error rate (BER) performance. This paper proposes unequal error protection (UEP) scheme for image transmission over the Internet of Underwater Things (IoUTs) using SM. The Set Partitioning in Hierarchical Trees (SPIHT) coders encode the underwater image and classify the encoded bits in two categories: critical and uncritical bits. The critical bits are transmitted over the SM index bits and have a low BER while the uncritical bits are transmitted over high order M-ary signal constellation to resolve the underwater acoustic channel bandwidth limitation problem. The proposed SM-UEP technique has been developed carefully with enough justification and evaluation over the measured underwater acoustic channel and the simulated channel. The simulation results show that the proposed SM-UEP can increase the average peak signal-to-noise ratio (PSNR) of the reconstructed received image considerably, and significantly

Design and analysis of a high-rate acoustic link for underwater video transmission

Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Ocean Engineering, 2004.Includes bibliographical references (leaves 74-75).A high bit rate acoustic link for underwater video transmission is examined. Currently, encoding standards support video transmission at bit rates as low as 64 kbps. While this rate is still above the limit of commercially available acoustic modems, prototype acoustic modems based on phase coherent modulation/detection have demonstrated successful transmission at 30 kbps over a deep water channel. The key to bridging the remaining gap between the bit-rate needed for video transmission and that supported by the acoustic channel lies in two approaches: use of efficient image/video compression algorithms and use of high-level bandwidth-efficient modulation methods. An experimental system, based on discrete cosine transform (DCT) and Huffman entropy coding for image compression, and variable rate M-ary quadrature amplitude modulation (QAM) was implemented. Phase-coherent equalization is accomplished by joint operation of a decision feedback equalizer (DFE) and a second order phase locked loop (PLL). System performance is demonstrated experimentally, using transmission rate of 25000 symbols/sec at a carrier frequency of 75 kHz over a 10 m vertical path.(cont.) Excellent results were obtained, thus demonstrating bit rates as high as 150 kbps, which are sufficient for real-time transmission of compressed video. As an alternative to conventional QAM signaling, whose high-level constellations are sensitive to phase distortions induced by the channel, M-ary differential amplitude and phase shift keying (DAPSK) was used. DAPSK does not require explicit carrier phase synchronization at the receiver, but instead relies on simple differentially coherent detection. Receiver processing includes a linear equalizer whose coefficients are adjusted using a modified linear least square (LMS) algorithm. Simulation results confirm good performance of the differentially coherent equalization scheme employed.by Konstantinos Pelekanakis.S.M

Implementation of a wireless underwater video link

Thesis (M. Eng.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2008.This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.Includes bibliographical references (p. 73-75).Autonomous underwater vehicles (AUVs) are increasingly being considered for remotely supervised missions, primarily for routine subsea inspection tasks currently performed by tethered remotely operated vehicles (ROVs). This project is a step in the development of a high speed, networked wireless communication capability for AUVs using MIT Sea Grant's software defined Reconfigurable Modem (R-Modem) acoustic communications platform. We have demonstrated a test implementation of live streaming video with a digital camera connected to an R-Modem transceiver; and explored a range of tuning parameters for the video link.by James Paul Morash.M.Eng

Environmental model-based time-reversal underwater communications

Advances in underwater acoustic communications require the development of methods to accurately compensate channels that are prone to severe double spreading of time-varying multipath propagation, fading and signal phase variations. Assuming the environmental information as a key issue, this work aims to improve communications performance of single-input-multiple-output transmission systems in such channels through the enhancement of their estimates used for equalization. The acoustic propagation physical parameters of the environment between the source and the receivers are considered in the process. The approach is to mitigate noise e ects in channel identi cation for Passive Time-Reversal (PTR), which is a low complexity probe-based refocusing technique to reduce time spreading and inter-symbol interference. The method Environmental-based PTR (EPTR) is proposed that, inspired by matched eld inversion, inserts physics of acoustic propagation in the channel compensation procedure through ray trace modeling and environmental focalization processing. The focalization is the process of tweaking the environmental parameters to obtain a noise-free numerical model generated channel response that best matches the observed data. The EPTR performance is tested and compared to the pulse-compressed PTR and to the regularized `1-norm PTR. The former is based on classical `2-norm channel estimation and the latter, inspired by compressive sensing, uses weighted `1-norm into the `2-norm estimation problem to obtain improved estimates of sparse channels. Successful experimental results were obtained with the proposed method for signals containing image messages transmitted at 4 kbit/s from a source to a 16-hydrophones vertical array at 890 m range during the UAN'11 experiment conducted o the coast of Trondheim (Norway). The scienti c contributions of this work are (i) the understanding of the process of employing physical modeling and environmental focalization to equalize and retrieve received messages in underwater acoustic communications, thus exploiting the sensitivity of environmental parameters in order to adapt a communications system to the scenario where it is used; and (ii) the presentation of a new PTR-based method that focuses environmental parameters to model suitable noise-free channel responses for equalization and whose real data results were successful for a set of coherent signals collected at sea. The proposed method is a step forward to a better understanding on how to insert physical knowledge of the environment for equalization in digital underwater acoustic communications

Design of a wireless remote control for underwater equipment

While the presence of a wired control system is very important in order to guide a ROV, the same system often represents the main limitation in terms of mobility. This thesis proposes a solution for this problem: a multi-technology and multi-hop wireless ROV control system. In particular, three different technologies are compared and analyzed: underwater acoustic, optical and electromagnetic (radio-frequency (RF)) communications

Low probability of detection underwater acoustic communications

Low probability of detection (LPD) underwater acoustic communications are an essential requirement for command and control of autonomous underwater vehicles (AUV) or submarines performing covert missions, avoiding their detection while communicating. Based on low power signals, these covert communications may also extend the autonomy of battery-operated AUVs, and contribute to reducing the impacts of the environmental noise level on marine life. The present thesis aims to develop LPD communications based on modeled and real data from three shallow water experiments. Thus, a superimposed training method has been proposed. A bitstream is created superimposing a long probe to the message before transmission. Computationally simple, the algorithm explores temporal diversity to increase the processing gain and uses a Wiener filter for equalization. Experimental results presented bit-error rates (BER) < 10−2 for signal-tonoise ratios (SNR) < −8 dB. To understand the effects of coastal upwelling phenomena over low SNR communications, a study compares the acoustic propagation for different sound speed profiles using a propagation model and analyzes data from the BioCom’19 experiment, performed off Cabo Frio Island (Brazil). Temporal and spatial coherence of low power signals propagating in this harsh environment are estimated, and both a criterion for multichannel combining and a double Wiener filter to improve equalization are presented. Passive time-reversal (pTR) techniques have been widely employed for communications. To address the pTR channel mismatch due to the environmental variability between the probe and the data transmissions, this work proposes a superimposed training pTR (STpTR) approach for single and multichannel systems. Despite the high noise levels, varying from -5 to +6 dB, the STpTR combined with a Wiener filter achieved BER < 10−2, for bit rates up to 220 bps. To improve covert communications for AUVs, this work also presents a study about vector sensor multichannel combining. Using the STpTR approach, results from an experiment on the coast of Algarve/Portugal indicate that combining the pressure and particle velocity channels of a vector sensor may provide an average SNR and mean squared-error gain of up to 9.4 and 3.1 dB, respectively, compared to the pressure channel. Therefore, a better understanding of the environment combined with the superimposed training pTR using a vector sensor may improve the LPD communication system’s performance and robustness while keeping covertness.No ´últimos anos, os trabalhos de investigação sobre comunicações acústicas submarinas com baixa probabilidade de deteção (BPD) tem sido incentivados pela indústria, pelos governos, e pela própria academia em razão de suas m´múltiplas aplicações. Na ´área militar, as comunicações BPD permitem que submarinos e veículos autónomos possam se comunicar sem serem detectados. Na ´área civil, permitem a economia de energia de sensores alimentados por baterias, aumentando o tempo de funcionamento, bem como contribui para reduzir os impactos sobre a vida marinha causados pelos altos n´ıveis de ru´ıdo submarino, entre outras aplica¸c˜oes. Neste contexto, esta tese pretende desenvolver comunica¸c˜oes BPD utilizando um modelo de propaga¸c˜ao ac´ustica e dados obtidos a partir de trˆes experimentos em ´aguas rasas. Este trabalho apresenta um m´etodo de treinamento superposto para comunica¸c˜oes submarinas em um ambiente com baixa rela¸c˜ao sinal/ru´ıdo, e demonstra sua aplica¸c˜ao para comunica¸c˜oes BPD. Computacionalmente simples, o m´etodo foi desenvolvido para funcionar com um ´único projetor acústico, transmitindo com baixa potência, e um hidrofone, sem o ganho de um arranjo de sensores distribuídos no espaço. Antes da transmissão, uma longa sequência de comprimento m´máximo ´e somada `a mensagem para efeitos de equalização e sincronismo. Os dois sinais são binários, modulados em fase e possuem 2047 bits. Porém, possuem amplitudes diferentes. Na realidade, a amplitude do sinal de treinamento ´e ligeiramente superior `a da mensagem. Em um ambiente com baixa rela¸c˜ao sinal ru´ıdo, um sinal de treinamento mais forte permite ocultar a mensagem a ser transmitida, bem como melhorar o ganho para a estima¸c˜ao da resposta impulsiva e para a sincroniza¸c˜ao do sistema. A mensagem ´e composta por 3 bits nulos e 4 sequˆencias de 511 bits. Delimitados por uma curta sequˆencia de comprimento m´aximo de 31 bits, para dupla sincroniza¸c˜ao, os pacotes de dados possuem 480 bits e transportam o seguinte pangrama: (The Quick Brown Fox Jumps Over the Lazy Dog 0123456789!@#$). O m´etodo explora a diversidade temporal do canal, transmitindo a mesma sequˆencia diversas vezes para aumentar o ganho de processamento do sinal e implementar a corre¸c˜ao de erros atrav´es da soma coerente dos sinais. A resposta impulsiva do canal ´e estimada pela transformada r´apida de Hadamard, e a equaliza¸c˜ao do sinal ´e feita por um filtro de Wiener. A remo¸c˜ao da interferˆencia causada pelo sinal de treinamento ´e realizada pelo m´etodo “hyperslice cancellation by coordinate zeroing (HCC0)”, e a seguir a mensagem ´e decodificada. Resultados obtidos a partir de um experimento em ´aguas rasas, utilizando uma fonte e um ´único hidrofone, apresentaram taxas de erro de bit menores que 10−2, para relações sinal/ruído inferiores a −8 dB. A ressurgência costeira ´e um fenómeno oceanográfico dinâmico que modifica, profundamente, a estratificação de temperatura do oceano, influenciando diretamente na propagação acústica. Por outro lado, os crescentes n´níveis de ruído antropogénico não apenas reduzem o desempenho dos sistema de comunicação, corrompendo a informação transmitida, mas tamb´em afetam a vida marinha. Para compreender os efeitos da ressurgˆencia costeira sobre as comunica¸c˜oes com baixa rela¸c˜ao sinal/ru´ıdo, um estudo analisa os dados do experimento BioCom’19, realizado nas proximidades da Ilha do Cabo Frio, Rio de Janeiro (Brasil). As respostas impulsivas do canal e a propaga¸c˜ao ac´ustica, para diferentes perfis de velocidade do som, foram estimadas usando o modelo de propaga¸c˜ao ac´ustica “Monterey-Miami Parabolic Equation model (MMPE)”. Al´em disso, o desempenho do sistema de comunica¸c˜oes foi correlacionado com os perfis de temperatura durante o experimento. Os resultados obtidos indicam uma significativa redu¸c˜ao da energia ac´ustica nos receptores durante a ressurgˆencia, degradando o desempenho do sistema. A coerˆencia temporal e espacial dos sinais de baixa potˆencia transmitidos no experimento BioCom’19 foi estimada, e um crit´erio para combina¸c˜ao dos sinais, provenientes dos m´ultiplos hidrofones, foi proposto. Utilizando dados de um arranjo piramidal e um arranjo vertical linear, de 4 hidrofones cada, a coerˆencia foi estimada antes e depois do filtro de Wiener para mostrar o impacto do multicaminhamento sobre a taxa de erro de bit. Os resultados mostram que a coˆerencia temporal pode ser utilizada como crit´erio para combinar sinais consecutivos em um mesmo canal, enquanto a diversidade espacial permite a combina¸c˜ao de m´ultiplos canais do arranjo de sensores. Sequˆencias cuja coerˆencia temporal esteja acima de um limite pr´e-definido s˜ao somadas. A coerˆencia espacial entre canais foi estimada e comparada em termos da taxa de erro de bit. Para diferentes taxas de transmiss˜ao, as taxas de erro de bit est˜ao em concordˆancia com a evoluc˜ao da coerˆencia espacial. Quanto mais elevada a coerˆencia, melhor o desempenho e menor a taxa de erro de bit. Um duplo filtro de Wiener para melhorar a equaliza¸c˜ao dos sinais de baixa potˆencia, durante a ressurgˆencia, tambem foi proposto. Utilizando dados dos 4 hidrofones de um arranjo piramidal, as respostas impulsivas foram estimadas para observar a variabilidade das condi¸c˜oes de propaga¸c˜ao. Em uma condi¸c˜ao de perfil de temperatura isot´ermico, as respostas impulsivas apresentaram multicaminhamento curto, com chegadas mais fortes nos receptores. `A medida que a ressurgˆencia ocorria, foram observadas quedas abruptas de temperatura superiores a 10◦C, na posi¸c˜ao dos hidrofones, acarretando uma forte refra¸c˜ao da onda sonora para o fundo marinho. Em consequˆencia, sinais mais fracos foram observados nos hidrofones. Os resultados obtidos com dados do BioCom’19 mostram que, para uma rela¸c˜ao sinal/ru´ıdo variando entre −3.9 e 7.3 dB, o duplo filtro de Wiener forneceu um ganho do erro m´edio quadr´atico de at´e 2.8 dB, comparado com o filtro de Wiener simples. As t´ecnicas de tempo reverso passivo (TRP) tem sido amplamente empregadas nas comunica¸c˜oes submarinas. Por´em, as r´apidas altera¸c˜oes das condi¸c˜oes de propaga¸c˜ao em canais submarinos variantes no tempo, durante as transmiss˜oes da sequˆencia de treinamento e da mensagem, degradam o desempenho das t´ecnicas TRP de equaliza¸c˜ao. Assim, esse trabalho prop˜oe um m´etodo de TRP utilizando treinamento superposto, para sistemas com um ou m´ultiplos sensores. O m´etodo proposto utiliza uma sequˆencia de treinamento, com o efeito Doppler corrigido, para estimar o canal e realizar o TRP. O m´etodo compara 3 differentes estrat´egias para melhorar a performance do sistema de comunica¸c˜ao: a diversidade temporal devido aos sinais idˆenticos transmitidos continuamente, a diversidade espacial devido aos 2 arranjos de hidrofones, piramidal e linear, com 4 hidrofones cada um, al´em da combina¸c˜ao dos 2 arranjos (8 hidrofones). Neste m´etodo, a t´ecnica de TRP com treinamento superposto minimiza o multicaminhamento e realiza a corre¸c˜ao de erros atrav´es da soma coerente dos diferentes canais. A interferˆencia intersimb´olica residual ´e removida pelo filtro de Wiener. Resultados obtidos com dados do experimento BioCom’19 mostram que o m´etodo proposto pode fornecer um ganho do erro médio quadrático de até 1.62 dB para canais independentes, e 3.13 dB, para canais combinados, comparativamente ao m´etodo sem o TRP, usando apenas o filtro de Wiener. Neste contexto, o m´etodo de TRP utilizando treinamento superposto alcan¸cou taxas de erro de bit < 10−2 para uma rela¸c˜ao sinal ru´ıdo, na banda de transmiss˜ao, variando entre −5 a +6 dB. Focado em comunica¸c˜oes com baixa probabilidade de detec¸c˜ao para pequenos ve´ıculos submarinos, este trabalho tamb´em apresenta um estudo sobre a combina¸c˜ao dos canais de press˜ao e velocidade de part´ıcula dos sensores vetoriais. Os sensores vetoriais possuem pequenas dimens˜oes, adequadas `a utilizac˜ao em ve´ıculos autˆonomos, e permitem obter um ganho de diversidade para as comunica¸c˜oes BPD. Para testar o m´etodo de treinamento superposto com o tempo reverso passivo utilizando sensores vetoriais, um experimento foi realizado, em ´aguas rasas, na costa do Algarve/Portugal. Para reduzir a rela¸c˜ao sinal/ru´ıdo para uma faixa de 0 a −10 dB, foi adicionado ru´ıdo gravado no experimento. Os resultados experimentais indicam que a combina¸c˜ao dos canais podem fornecer um ganho da rela¸c˜ao sinal/ru´ıdo e do erro m´edio quadr´atico de at´e 9.4 e 3.1 dB, respectivamente, comparados com os resultados do sensor de press˜ao. Portanto, as principais contribui¸c˜oes dessa tese s˜ao (i) a proposta do m´etodo de treinamento superposto para comunica¸c˜oes com baixa probabilidade de detec¸c˜ao, (ii) a compreens ˜ao dos efeitos da ressurgˆencia costeira sobre as comunica¸c˜oes, e seus impactos sobre a coerˆencia temporal e espacial, (iii) o m´etodo de treinamento superposto em conjunto com o tempo reverso passivo para lidar com a varia¸c˜ao do canal entre o tempo de recep¸c˜ao do sinal de treinamento e da mensagem, e (iv) a combina¸c˜ao dos m´ultiplos canais dos sensores vetoriais para comunica¸c˜oes BPD. Dessa forma, uma melhor compreens˜ao do canal submarino e a utiliza¸c˜ao dos m´etodos propostos combinados com sensores do estado da arte, como os sensores vetoriais, se configura como um avan¸co neste campo do conhecimento, permitindo aumentar a robustez do sistema BPD, bem como reduzir a probabilidade de detec¸c˜ao, mantendo a ocultação das comunicações.I am also grateful for the sponsorship provided by the Brazilian Navy through the Postgraduate Study Abroad Program, Grant No. Port.227/MB/2019