Matrix Transform Imager Architecture for On-Chip Low-Power Image Processing

Camera-on-a-chip systems have tried to include carefully chosen signal processing units for better functionality, performance and also to broaden the applications they can be used for. Image processing sensors have been possible due advances in CMOS active pixel sensors (APS) and neuromorphic focal plane imagers. Some of the advantages of these systems are compact size, high speed and parallelism, low power dissipation, and dense system integration. One can envision using these chips for portable and inexpensive video cameras on hand-held devices like personal digital assistants (PDA) or cell-phones In neuromorphic modeling of the retina it would be very nice to have processing capabilities at the focal plane while retaining the density of typical APS imager designs. Unfortunately, these two goals have been mostly incompatible. We introduce our MAtrix Transform Imager Architecture (MATIA) that uses analog floating--gate devices to make it possible to have computational imagers with high pixel densities. The core imager performs computations at the pixel plane, but still has a fill-factor of 46 percent - comparable to the high fill-factors of APS imagers. The processing is performed continuously on the image via programmable matrix operations that can operate on the entire image or blocks within the image. The resulting data-flow architecture can directly perform all kinds of block matrix image transforms. Since the imager operates in the subthreshold region and thus has low power consumption, this architecture can be used as a low-power front end for any system that utilizes these computations. Various compression algorithms (e.g. JPEG), that use block matrix transforms, can be implemented using this architecture. Since MATIA can be used for gradient computations, cheap image tracking devices can be implemented using this architecture. Other applications of this architecture can range from stand-alone universal transform imager systems to systems that can compute stereoscopic depth.Ph.D.Committee Chair: Hasler, Paul; Committee Member: David Anderson; Committee Member: DeWeerth, Steve; Committee Member: Jackson, Joel; Committee Member: Smith, Mar

Characterization and design of coherent optical OFDM transmission systems based on Hartley Transform

Nowadays, due to huge deployment of optical transport networks, a continuous increase towards higher data rates up to 100 Gb/s and beyond is observed. Furthermore, an evolution of the current optical networks is forecasted, acquiring new functionalities, e.g. elastic spectrum assignment for the optical signals. The target for these new challenges in transmission is to find techniques ready to deal with a growth of demand for bandwidth continuously asked by network operators, for whom the standard systems do not meet the new functionalities while higher rates are being set up. A solution for covering all of those needs is to adapt techniques capable to deal with such enormous data rates, and ensuring the same high efficiency for long distances and mitigate the optical impairments accumulated along the transmission path. Additionally, these transmission techniques are expected to provide some degree of flexibility, in order to enhance the network flexibility. A promising technology that can fully cope with those requires is the coherent optical orthogonal frequency division multiplexing (CO-OFDM). CO-OFDM provides several advantages, namely high sensitivity and spectral efficiency, simple integration and possibility to fully recover a signal in phase, amplitude and polarization. These systems are composed by digital signal processing (DSP) blocks that easily process data and can equalize and compensate the main impairments, providing high tolerance for dispersion effects. However, CO-OFDM systems are not free from drawbacks. Their high peak-to-average power ratio (PAPR) reduce their tolerance to nonlinearities. Furthermore, CO-OFDM systems are sensitive to any frequency shift and phase offset. Hence, a constant envelope optical OFDM (CE-OFDM) is proposed for significantly reducing the PAPR and solving high sensitivity to nonlinear impairments. It consists in a phase modulated discrete multi-tone signal, which is coherently detected at the receiver side. An alternative transform, the discrete Hartley transform, is proposed to speed up calculations in the DSP and eliminate the need to have a Hermitian symmetry. The optical CE-OFDM by its unique flexibility and rate scalability turns out as a great technology applicable to different configurations, ranging from access to core networks. In case of access solutions, several cases are investigated. First, the optical CE-OFDM is applied for radio access network signals delivery by means of a wavelength division multiplexing (WDM) overlay in deployed access architecture. A decomposed radio access network is deployed over an existing standard passive optical network (PON), capable to avoid interference and cross talks with access signals between network clients. The system exhibited narrow channel spacing, while reducing losses fed into the access equipment path. Next, a full duplex 10 Gb/s bidirectional PON transmission over a single wavelength with RSOA based ONU is investigated. The key point of that system is the upstream transmission, which is achieved re-modulating the phase of a downstream intensity modulated signal after proper saturation. The reported sensitivity performances show a power budget matching the PON standards and an OSNR easy to reach on non-amplified PON. Next, a flexible metropolitan area network of up to 100km with traffic add/drop using WDM is investigated. There the narrowing effect of the optical filters is studied. Finally, an elastic upgrade of the existing Telefonica model of the Spanish national core network is proposed. For that, the transceiver architecture is proposed to be operated featuring polarization multiplexing. Respect to the existing fixed grid, the flexible approach (enabled by the CE-OFDM transceiver) results into reduced bandwidth occupancy and low OSNR requirement.Hoy en día, debido al gran despliegue de las redes de ópticas de transporte, se espera un aumento continuado hacia mayores velocidades de datos, hasta 100 Gb/s y más allá. Por otra parte, la evolución que se prevé para las redes ópticas actuales, incluye la adquisición de nuevas funcionalidades, por ejemplo, la asignación del espectro de forma elástica para las señales ópticas. Por tanto, el claro desafío en cuanto a las tecnologías de transmisión es encontrar técnicas preparadas para hacer frente a un crecimiento de la demanda de ancho de banda; demanda que continuamente se incrementa por parte de los operadores de red, para quienes los sistemas estándar no se acaban de ajustar a las nuevas funcionalidades que esperan para la red. Una solución para cubrir todas estas necesidades es la adaptación de técnicas capaces de hacer frente a estas velocidades de datos enormes, y garantizar el mismo nivel de eficiencia para las largas distancias y mitigar las deficiencias ópticas acumuladas a lo largo de la ruta de transmisión. Además, se espera que estas técnicas de transmisión puedan proporcionar cierto grado de flexibilidad, a fin de mejorar y hacer más eficiente la gestión de la red. Una tecnología prometedora que puede hacer frente a estos requisitos es lo que se llama multiplexación por división de frecuencias ortogonales, combinado con la detección óptica coherente (CO-OFDM). CO-OFDM ofrece varias ventajas, entre otras: alta sensibilidad y eficiencia espectral y, sobre todo, la posibilidad de recuperar por completo de una señal en fase, la amplitud y la polarización. Estos sistemas están compuestos por bloques de procesado de señales digitales (DSP) que permiten detectar los datos fácilmente así como también compensar las principales degradaciones, proporcionando alta tolerancia a los efectos de dispersión. Sin embargo, los sistemas CO-OFDM no están exentos de inconvenientes. Su alta relación de potencia de pico a potencia media (PAPR) reduce sensiblemente la tolerancia no linealidades. Por otra parte, los sistemas CO-OFDM son sensibles a cualquier cambio de frecuencia y desplazamiento de fase. Por tanto, se propone un sistema OFDM de envolvente constante (CE-OFDM) para reducir significativamente la PAPR y solucionar la alta sensibilidad a las degradaciones no lineales. Consiste en una señal OFDM modulada en fase, que se detecta coherentemente en el receptor. Una transformada alternativa, la transformada discreta de Hartley, se propone para acelerar los cálculos en el DSP. El sistema CE-OFDM por su flexibilidad y escalabilidad única, resulta una tecnología aplicable a diferentes escenarios, que van desde las redes de acceso hasta las redes troncales. En el caso de las soluciones de acceso, se investigan varios casos. En primer lugar, el CE-OFDM aplica para el desarrollo y soporte de datos de una red radio, reutilizando una red óptica de acceso ya desplegada. A continuación, se investiga la transmisión bidireccional dúplex a 10 Gb / s sobre una sola longitud de onda empleando un RSOA a las unidades de usuario. El punto clave de este sistema es la transmisión en sentido ascendente, que se consigue re-modulando la fase de una señal de intensidad modulada después de saturar de forma adecuada. A continuación, se estudia una red de área metropolitana flexible de hasta 100 km. Concretamente el efecto de concatenación de filtros ópticos es el objetivo de este estudio. Finalmente, se propone una actualización elástica del modelo de Telefónica I+D para la red troncal española. Por ello, se propone operar el CE-OFDM en multiplexación de polarización. Los resultados muestran que esta combinación reduce sensiblemente el empleo de ancho de banda esto como los requisitos de los enlaces transmisión, reduciendo también los costes tanto de desarrollo como de operación y mantenimiento de la red.Avui dia, a causa del gran desplegament de les xarxes de òptiques de transport, s'espera un augment continuat cap a majors velocitats de dades, fins a 100 Gb/s i més enllà. D'altra banda, l'evolució que es preveu per a les xarxes òptiques actuals, inclou l'adquisició de noves funcionalitats, per exemple, assignació de l'espectre de forma elàstica per als senyals òptics. Per tant, el clar desafiament pel que fa a les tecnologies de transmissió és trobar tècniques preparades per fer front a un creixement de la demanda d'ample de banda; demanda que contínuament es fa per part dels operadors de xarxa, per als qui els sistemes estàndard no s'acaben d'ajustar a les noves funcionalitats que esperen per a la xarxa. Una solució per a cobrir totes aquestes necessitats és l'adaptació de tècniques capaces de fer front a aquestes velocitats de dades enormes, i garantir el mateix nivell d'eficiència per a les llargues distàncies i mitigar les deficiències òptiques acumulades al llarg de la ruta de transmissió. A més, s'espera que aquestes tècniques de transmissió puguin proporcionar cert grau de flexibilitat, per tal de millorar i tornar més eficient la gestió de la xarxa. Una tecnologia prometedora que pot fer front a aquests requisits és el que s'anomena multiplexació per divisió de freqüències ortogonals, combinat amb la detecció òptica coherent (CO-OFDM). CO-OFDM ofereix diversos avantatges, entre altres: alta sensibilitat i eficiència espectral i, sobretot, la possibilitat de recuperar per complet d'una senyal en fase, l'amplitud i la polarització. Aquests sistemes estan compostos per blocs de processament de senyals digitals (DSP) que permeten detectar les dades fàcilment així com també compensar les principals degradacions, proporcionant alta tolerància pels efectes de dispersió. No obstant això, els sistemes CO-OFDM no estan exempts d'inconvenients. La seva alta relació de potència de pic a potència mitjana (PAPR) redueix sensiblement la tolerància a no linealitats. D'altra banda, els sistemes de CO-OFDM són sensibles a qualsevol canvi de freqüència i desplaçament de fase. Per tant, es proposa un sistema OFDM d'envolvent constant (CE-OFDM) per a reduir significativament la PAPR i solucionar l'alta sensibilitat a les degradacions no lineals. Consisteix en un senyal OFDM modulat en fase, que es detecta coherentment en el receptor. Una transformada alternativa, la transformada discreta d'Hartley, es proposa accelerar els càlculs en el DSP. El sistema CE-OFDM per la seva flexibilitat i escalabilitat única, resulta una tecnologia aplicable a diferents escenaris, que van des de les xarxes d'accés fins a les xarxes troncals. En el cas de les solucions d'accés, s'investiguen diversos casos. En primer lloc, el CE-OFDM s'aplica per al desplegament i suport de dades d'una xarxa radio, reutilitzant una xarxa òptica d'accés ja desplegada. A continuació, s'investiga la transmissió bidireccional dúplex a 10 Gb/s sobre una sola longitud d'ona emprant un RSOA a les unitats d'usuari. El punt clau d'aquest sistema és la transmissió en sentit ascendent, que s'aconsegueix re-modulant la fase d'un senyal d'intensitat modulada després de saturar-la de forma adequada. A continuació, s'estudia una xarxa d'àrea metropolitana flexible de fins a 100 km. Concretament l'efecte de concatenació de filtres òptics és l'objectiu d'aquest estudi. Finalment, es proposa una actualització elàstica del model de Telefónica I+D per a la xarxa troncal espanyola. Per això, es proposa operar el CE-OFDM en multiplexació de polarització. Els resultats mostren que aquesta combinació redueix sensiblement l'ocupació d'ample de banda això com també els requisits dels enllaços transmissió, reduint també els costos tant de desplegament com d'operació i manteniment de la xarxa

A network transparent, retained mode multimedia processing framework for the Linux operating system environment

Die Arbeit präsentiert ein Multimedia-Framework für Linux, das im Unterschied zu früheren Arbeiten auf den Ideen "retained-mode processing" und "lazy evaluation" basiert: Statt Transformationen unmittelbar auszuführen, wird eine abstrakte Repräsentation aller Medienelemente aufgebaut. "renderer"-Treiber fungieren als Übersetzer, die diese Darstellung zur Laufzeit in konkrete Operationen umsetzen, wobei das Datenmodell zahlreiche Optimierungen zur Reduktion der Anzahl der Schritte oder der Minimierung von Kommunikation erlaubt. Dies erlaubt ein stark vereinfachtes Programmiermodell bei gleichzeitiger Effizienzsteigerung. "renderer"-Treiber können zur Ausführung von Transformationen den lokalen Prozessor verwenden, oder können die Operationen delegieren. In der Arbeit wird eine Erweiterung des X Window Systems um Mechanismen zur Medienverarbeitung vorgestellt, sowie ein "renderer"-Treiber, der diese zur Delegation der Verarbeitung nutzt

FPGA Prototyping of a Watermarking Algorithm for MPEG-4

In the immediate future, multimedia product distribution through the Internet will become main stream. However, it can also have the side effect of unauthorized duplication and distribution of multimedia products. That effect could be a critical challenge to the legal ownership of copyright and intellectual property. Many schemes have been proposed to address these issues; one is digital watermarking which is appropriate for image and video copyright protection. Videos distributed via the Internet must be processed by compression for low bit rate, due to bandwidth limitations. The most widely adapted video compression standard is MPEG-4. Discrete cosine transform (DCT) domain watermarking is a secure algorithm which could survive video compression procedures and, most importantly, attacks attempting to remove the watermark, with a visibly degraded video quality result after the watermark attacks. For a commercial broadcasting video system, real-time response is always required. For this reason, an FPGA hardware implementation is studied in this work. This thesis deals with video compression, watermarking algorithms and their hardware implementation with FPGAs. A prototyping VLSI architecture will implement video compression and watermarking algorithms with the FPGA. The prototype is evaluated with video and watermarking quality metrics. Finally, it is seen that the video qualities of the watermarking at the uncompressed vs. the compressed domain are only 1dB of PSNR lower. However, the cost of compressed domain watermarking is the complexity of drift compensation for canceling the drifting effect

Filter-Bank-Based Narrowband Interference Detection and Suppression in Spread Spectrum Systems

<p/> <p>A filter-bank-based narrowband interference detection and suppression method is developed and its performance is studied in a spread spectrum system. The use of an efficient, complex, critically decimated perfect reconstruction filter bank with a highly selective subband filter prototype, in combination with a newly developed excision algorithm, offers a solution with efficient implementation and performance close to the theoretical limit derived as a function of the filter bank stopband attenuation. Also methods to cope with the transient effects in case of frequency hopping interference are developed and the resulting performance shows only minor degradation in comparison to the stationary case.</p

Filter Bank Multicarrier Modulation for Spectrally Agile Waveform Design

In recent years the demand for spectrum has been steadily growing. With the limited amount of spectrum available, Spectrum Pooling has gained immense popularity. As a result of various studies, it has been established that most of the licensed spectrum remains underutilized. Spectrum Pooling or spectrum sharing concentrates on making the most of these whitespaces in the licensed spectrum. These unused parts of the spectrum are usually available in chunks. A secondary user looking to utilize these chunks needs a device capable of transmitting over distributed frequencies, while not interfering with the primary user. Such a process is known as Dynamic Spectrum Access (DSA) and a device capable of it is known as Cognitive Radio. In such a scenario, multicarrier communication that transmits data across the channel in several frequency subcarriers at a lower data rate has gained prominence. Its appeal lies in the fact that it combats frequency selective fading. Two methods for implementing multicarrier modulation are non-contiguous orthogonal frequency division multiplexing (NCOFDM)and filter bank multicarrier modulation (FBMC). This thesis aims to implement a novel FBMC transmitter using software defined radio (SDR) with modulated filters based on a lowpass prototype. FBMCs employ two sets of bandpass filters called analysis and synthesis filters, one at the transmitter and the other at the receiver, in order to filter the collection of subcarriers being transmitted simultaneously in parallel frequencies. The novel aspect of this research is that a wireless transmitter based on non-contiguous FBMC is being used to design spectrally agile waveforms for dynamic spectrum access as opposed to the more popular NC-OFDM. Better spectral containment and bandwidth efficiency, combined with lack of cyclic prefix processing, makes it a viable alternative for NC-OFDM. The main aim of this thesis is to prove that FBMC can be practically implemented for wireless communications. The practicality of the method is tested by transmitting the FBMC signals real time by using the Simulink environment and USRP2 hardware modules

Towards visualization and searching :a dual-purpose video coding approach

In modern video applications, the role of the decoded video is much more than filling a screen for visualization. To offer powerful video-enabled applications, it is increasingly critical not only to visualize the decoded video but also to provide efficient searching capabilities for similar content. Video surveillance and personal communication applications are critical examples of these dual visualization and searching requirements. However, current video coding solutions are strongly biased towards the visualization needs. In this context, the goal of this work is to propose a dual-purpose video coding solution targeting both visualization and searching needs by adopting a hybrid coding framework where the usual pixel-based coding approach is combined with a novel feature-based coding approach. In this novel dual-purpose video coding solution, some frames are coded using a set of keypoint matches, which not only allow decoding for visualization, but also provide the decoder valuable feature-related information, extracted at the encoder from the original frames, instrumental for efficient searching. The proposed solution is based on a flexible joint Lagrangian optimization framework where pixel-based and feature-based processing are combined to find the most appropriate trade-off between the visualization and searching performances. Extensive experimental results for the assessment of the proposed dual-purpose video coding solution under meaningful test conditions are presented. The results show the flexibility of the proposed coding solution to achieve different optimization trade-offs, notably competitive performance regarding the state-of-the-art HEVC standard both in terms of visualization and searching performance.Em modernas aplicações de vídeo, o papel do vídeo decodificado é muito mais que simplesmente preencher uma tela para visualização. Para oferecer aplicações mais poderosas por meio de sinais de vídeo,é cada vez mais crítico não apenas considerar a qualidade do conteúdo objetivando sua visualização, mas também possibilitar meios de realizar busca por conteúdos semelhantes. Requisitos de visualização e de busca são considerados, por exemplo, em modernas aplicações de vídeo vigilância e comunicações pessoais. No entanto, as atuais soluções de codificação de vídeo são fortemente voltadas aos requisitos de visualização. Nesse contexto, o objetivo deste trabalho é propor uma solução de codificação de vídeo de propósito duplo, objetivando tanto requisitos de visualização quanto de busca. Para isso, é proposto um arcabouço de codificação em que a abordagem usual de codificação de pixels é combinada com uma nova abordagem de codificação baseada em features visuais. Nessa solução, alguns quadros são codificados usando um conjunto de pares de keypoints casados, possibilitando não apenas visualização, mas também provendo ao decodificador valiosas informações de features visuais, extraídas no codificador a partir do conteúdo original, que são instrumentais em aplicações de busca. A solução proposta emprega um esquema flexível de otimização Lagrangiana onde o processamento baseado em pixel é combinado com o processamento baseado em features visuais objetivando encontrar um compromisso adequado entre os desempenhos de visualização e de busca. Os resultados experimentais mostram a flexibilidade da solução proposta em alcançar diferentes compromissos de otimização, nomeadamente desempenho competitivo em relação ao padrão HEVC tanto em termos de visualização quanto de busca

Current reuse topology in UWB CMOS LNA

Non