Algorithmic issues in visual object recognition

This thesis is divided into two parts covering two aspects of research in the area of visual object recognition. Part I is about human detection in still images. Human detection is a challenging computer vision task due to the wide variability in human visual appearances and body poses. In this part, we present several enhancements to human detection algorithms. First, we present an extension to the integral images framework to allow for constant time computation of non-uniformly weighted summations over rectangular regions using a bundle of integral images. Such computational element is commonly used in constructing gradient-based feature descriptors, which are the most successful in shape-based human detection. Second, we introduce deformable features as an alternative to the conventional static features used in classifiers based on boosted ensembles. Deformable features can enhance the accuracy of human detection by adapting to pose changes that can be described as translations of body features. Third, we present a comprehensive evaluation framework for cascade-based human detectors. The presented framework facilitates comparison between cascade-based detection algorithms, provides a confidence measure for result, and deploys a practical evaluation scenario. Part II explores the possibilities of enhancing the speed of core algorithms used in visual object recognition using the computing capabilities of Graphics Processing Units (GPUs). First, we present an implementation of Graph Cut on GPUs, which achieves up to 4x speedup against compared to a CPU implementation. The Graph Cut algorithm has many applications related to visual object recognition such as segmentation and 3D point matching. Second, we present an efficient sparse approximation of kernel matrices for GPUs that can significantly speed up kernel based learning algorithms, which are widely used in object detection and recognition. We present an implementation of the Affinity Propagation clustering algorithm based on this representation, which is about 6 times faster than another GPU implementation based on a conventional sparse matrix representation

Design and development of mobile channel simulators using digital signal processing techniques

A mobile channel simulator can be constructed either in the time domain using a tapped delay line filter or in the frequency domain using the time variant transfer function of the channel. Transfer function modelling has many advantages over impulse response modelling. Although the transfer function channel model has been envisaged by several researchers as an alternative to the commonly employed tapped delay line model, so far it has not been implemented. In this work, channel simulators for single carrier and multicarrier OFDM system based on time variant transfer function of the channel have been designed and implemented using DSP techniques in SIMULINK. For a single carrier system, the simulator was based on Bello's transfer function channel model. Bello speculated that about 10Βτ(_MAX) frequency domain branches might result in a very good approximation of the channel (where в is the signal bandwidth and τ(_MAX) is the maximum excess delay of the multi-path channel). The simulation results showed that 10Bτ(_MAX) branches gave close agreement with the tapped delay line model(where Be is the coherence bandwidth). This number is π times higher than the previously speculated 10Bτ(_MAX).For multicarrier OFDM system, the simulator was based on the physical (PHY) layer standard for IEEE 802.16-2004 Wireless Metropolitan Area Network (WirelessMAN) and employed measured channel transfer functions at the 2.5 GHz and 3.5 GHz bands in the simulations. The channel was implemented in the frequency domain by carrying out point wise multiplication of the spectrum of OFDM time The simulator was employed to study BER performance of rate 1/2 and rate 3/4 coded systems with QPSK and 16-QAM constellations under a variety of measured channel transfer functions. The performance over the frequency selective channel mainly depended upon the frequency domain fading and the channel coding rate

Single-Laser Multi-Terabit/s Systems

Optical communication systems carry the bulk of all data traffic worldwide. This book introduces multi-Terabit/s transmission systems and three key technologies for next generation networks. A software-defined multi-format transmitter, an optical comb source and an optical processing scheme for the fast Fourier transform for Tbit/s signals. Three world records demonstrate the potential: The first single laser 10 Tbit/s and 26 Tbit/s OFDM and the first 32.5 Tbit/s Nyquist WDM experiments

Single-Laser Multi-Terabit/s Systems

Optical communication systems carry the bulk of all data traffic worldwide. This book introduces multi-Terabit/s transmission systems and three key technologies for next generation networks. A software-defined multi-format transmitter, an optical comb source and an optical processing scheme for the fast Fourier transform for Tbit/s signals. Three world records demonstrate the potential: The first single laser 10 Tbit/s and 26 Tbit/s OFDM and the first 32.5 Tbit/s Nyquist WDM experiments

Disambiguoiva morfologinen jäsennys probabilistisilla sekvenssimalleilla

A morphological tagger is a computer program that provides complete morphological descriptions of sentences. Morphological taggers find applications in many NLP fields. For example, they can be used as a pre-processing step for syntactic parsers, in information retrieval and machine translation. The task of morphological tagging is closely related to POS tagging but morphological taggers provide more fine-grained morphological information than POS taggers. Therefore, they are often applied to morphologically complex languages, which extensively utilize inflection, derivation and compounding for encoding structural and semantic information. This thesis presents work on data-driven morphological tagging for Finnish and other morphologically complex languages. There exists a very limited amount of previous work on data-driven morphological tagging for Finnish because of the lack of freely available manually prepared morphologically tagged corpora. The work presented in this thesis is made possible by the recently published Finnish dependency treebanks FinnTreeBank and Turku Dependency Treebank. Additionally, the Finnish open-source morphological analyzer OMorFi is extensively utilized in the experiments presented in the thesis. The thesis presents methods for improving tagging accuracy, estimation speed and tagging speed in presence of large structured morphological label sets that are typical for morphologically complex languages. More specifically, it presents a novel formulation of generative morphological taggers using weighted finite-state machines and applies finite-state taggers to context sensitive spelling correction of Finnish. The thesis also explores discriminative morphological tagging. It presents structured sub-label dependencies that can be used for improving tagging accuracy. Additionally, the thesis presents a cascaded variant of the averaged perceptron tagger. In presence of large label sets, a cascaded design results in substantial reduction of estimation speed compared to a standard perceptron tagger. Moreover, the thesis explores pruning strategies for perceptron taggers. Finally, the thesis presents the FinnPos toolkit for morphological tagging. FinnPos is an open-source state-of-the-art averaged perceptron tagger implemented by the author.Disambiguoiva morfologinen jäsennin on ohjelma, joka tuottaa yksikäsitteisiä morfologisia kuvauksia virkkeen sanoille. Tällaisia jäsentimiä voidaan hyödyntää monilla kielenkäsittelyn osa-alueilla, esimerkiksi syntaktisen jäsentimen tai konekäännösjärjestelmän esikäsittelyvaiheena. Kieliteknologisena tehtävänä disambiguoiva morfologinen jäsennys muistuttaa perinteistä sanaluokkajäsennystä, mutta se tuottaa hienojakoisempaa morfologista informaatiota kuin perinteinen sanaluokkajäsennin. Tämän takia disambiguoivia morfologisia jäsentimiä hyödynnetäänkin pääsääntöisesti morfologisesti monimutkaisten kielten, kuten suomen kielen, kieliteknologiassa. Tällaisissa kielissä käytetään paljon sananmuodostuskeinoja kuten taivutusta, johtamista ja yhdyssananmuodostusta. Väitöskirjan esittelemä tutkimus liittyy morfologisesti rikkaiden kielten disambiguoivaan morfologiseen jäsentämiseen koneoppimismenetelmin. Vaikka suomen disambiguoivaa morfologista jäsentämistä on tutkittu aiemmin (esim. Constraint Grammar -formalismin avulla), koneoppimismenetelmiä ei ole aiemmin juurikaan sovellettu. Tämä johtuu siitä että jäsentimen oppimiseen tarvittavia korkealuokkaisia morfologisesti annotoituja korpuksia ei ole ollut avoimesti saatavilla. Tässä väitöskirjassa esitelty tutkimus hyödyntää vastikään julkaistuja suomen kielen dependenssijäsennettyjä FinnTreeBank ja Turku Dependency Treebank korpuksia. Lisäksi tutkimus hyödyntää suomen kielen avointa morfologista OMorFi-jäsennintä. Väitöskirja esittelee menetelmiä jäsennystarkkuuden parantamiseen ja jäsentimen opetusnopeuden sekä jäsennysnopeuden kasvattamiseen. Väitöskirja esittää uuden tavan rakentaa generatiivisia jäsentimiä hyödyntäen painollisia äärellistilaisia koneita ja soveltaa tällaisia jäsentimiä suomen kielen kontekstisensitiiviseen oikeinkirjoituksentarkistukseen. Lisäksi väitöskirja käsittelee diskriminatiivisia jäsennysmalleja. Se esittelee tapoja hyödyntää morfologisten analyysien osia jäsennystarkkuuden parantamiseen. Lisäksi se esittää kaskadimallin, jonka avulla jäsentimen opetusaika lyhenee huomattavasi. Väitöskirja esittää myös tapoja jäsenninmallien pienentämiseen. Lopuksi esitellään FinnPos, joka on kirjoittaman toteuttama avoimen lähdekoodin työkalu disambiguoivien morfologisten jäsentimien opettamiseen

Code-division multiplexing

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2004.Includes bibliographical references (p. 395-404).(cont.) counterpart. Among intra-cell orthogonal schemes, we show that the most efficient broadcast signal is a linear superposition of many binary orthogonal waveforms. The information set is also binary. Each orthogonal waveform is generated by modulating a periodic stream of finite-length chip pulses with a receiver-specific signature code that is derived from a special class of binary antipodal, superimposed recursive orthogonal code sequences. With the imposition of practical pulse shapes for carrier modulation, we show that multi-carrier format using cosine functions has higher bandwidth efficiency than the single-carrier format, even in an ideal Gaussian channel model. Each pulse is shaped via a prototype baseband filter such that when the demodulated signal is detected through a baseband matched filter, the resulting output samples satisfy the Generalized Nyquist criterion. Specifically, we propose finite-length, time overlapping orthogonal pulse shapes that are g-Nyquist. They are derived from extended and modulated lapped transforms by proving the equivalence between Perfect Reconstruction and Generalized Nyquist criteria. Using binary data modulation format, we measure and analyze the accuracy of various Gaussian approximation methods for spread-spectrum modulated (SSM) signalling ...We study forward link performance of a multi-user cellular wireless network. In our proposed cellular broadcast model, the receiver population is partitioned into smaller mutually exclusive subsets called cells. In each cell an autonomous transmitter with average transmit power constraint communicates to all receivers in its cell by broadcasting. The broadcast signal is a multiplex of independent information from many remotely located sources. Each receiver extracts its desired information from the composite signal, which consists of a distorted version of the desired signal, interference from neighboring cells and additive white Gaussian noise. Waveform distortion is caused by time and frequency selective linear time-variant channel that exists between every transmitter-receiver pair. Under such system and design constraints, and a fixed bandwidth for the entire network, we show that the most efficient resource allocation policy for each transmitter based on information theoretic measures such as channel capacity, simultaneously achievable rate regions and sum-rate is superposition coding with successive interference cancellation. The optimal policy dominates over its sub-optimal alternatives at the boundaries of the capacity region. By taking into account practical constraints such as finite constellation sets, frequency translation via carrier modulation, pulse shaping and real-time signal processing and decoding of finite-length waveforms and fairness in rate distribution, we argue that sub-optimal orthogonal policies are preferred. For intra-cell multiplexing, all orthogonal schemes based on frequency, time and code division are equivalent. For inter-cell multiplexing, non-orthogonal code-division has a larger capacity than its orthogonalby Ceilidh Hoffmann.Ph.D

Characterization and design of coherent optical OFDM transmission systems based on Hartley Transform

Nowadays, due to huge deployment of optical transport networks, a continuous increase towards higher data rates up to 100 Gb/s and beyond is observed. Furthermore, an evolution of the current optical networks is forecasted, acquiring new functionalities, e.g. elastic spectrum assignment for the optical signals. The target for these new challenges in transmission is to find techniques ready to deal with a growth of demand for bandwidth continuously asked by network operators, for whom the standard systems do not meet the new functionalities while higher rates are being set up. A solution for covering all of those needs is to adapt techniques capable to deal with such enormous data rates, and ensuring the same high efficiency for long distances and mitigate the optical impairments accumulated along the transmission path. Additionally, these transmission techniques are expected to provide some degree of flexibility, in order to enhance the network flexibility. A promising technology that can fully cope with those requires is the coherent optical orthogonal frequency division multiplexing (CO-OFDM). CO-OFDM provides several advantages, namely high sensitivity and spectral efficiency, simple integration and possibility to fully recover a signal in phase, amplitude and polarization. These systems are composed by digital signal processing (DSP) blocks that easily process data and can equalize and compensate the main impairments, providing high tolerance for dispersion effects. However, CO-OFDM systems are not free from drawbacks. Their high peak-to-average power ratio (PAPR) reduce their tolerance to nonlinearities. Furthermore, CO-OFDM systems are sensitive to any frequency shift and phase offset. Hence, a constant envelope optical OFDM (CE-OFDM) is proposed for significantly reducing the PAPR and solving high sensitivity to nonlinear impairments. It consists in a phase modulated discrete multi-tone signal, which is coherently detected at the receiver side. An alternative transform, the discrete Hartley transform, is proposed to speed up calculations in the DSP and eliminate the need to have a Hermitian symmetry. The optical CE-OFDM by its unique flexibility and rate scalability turns out as a great technology applicable to different configurations, ranging from access to core networks. In case of access solutions, several cases are investigated. First, the optical CE-OFDM is applied for radio access network signals delivery by means of a wavelength division multiplexing (WDM) overlay in deployed access architecture. A decomposed radio access network is deployed over an existing standard passive optical network (PON), capable to avoid interference and cross talks with access signals between network clients. The system exhibited narrow channel spacing, while reducing losses fed into the access equipment path. Next, a full duplex 10 Gb/s bidirectional PON transmission over a single wavelength with RSOA based ONU is investigated. The key point of that system is the upstream transmission, which is achieved re-modulating the phase of a downstream intensity modulated signal after proper saturation. The reported sensitivity performances show a power budget matching the PON standards and an OSNR easy to reach on non-amplified PON. Next, a flexible metropolitan area network of up to 100km with traffic add/drop using WDM is investigated. There the narrowing effect of the optical filters is studied. Finally, an elastic upgrade of the existing Telefonica model of the Spanish national core network is proposed. For that, the transceiver architecture is proposed to be operated featuring polarization multiplexing. Respect to the existing fixed grid, the flexible approach (enabled by the CE-OFDM transceiver) results into reduced bandwidth occupancy and low OSNR requirement.Hoy en día, debido al gran despliegue de las redes de ópticas de transporte, se espera un aumento continuado hacia mayores velocidades de datos, hasta 100 Gb/s y más allá. Por otra parte, la evolución que se prevé para las redes ópticas actuales, incluye la adquisición de nuevas funcionalidades, por ejemplo, la asignación del espectro de forma elástica para las señales ópticas. Por tanto, el claro desafío en cuanto a las tecnologías de transmisión es encontrar técnicas preparadas para hacer frente a un crecimiento de la demanda de ancho de banda; demanda que continuamente se incrementa por parte de los operadores de red, para quienes los sistemas estándar no se acaban de ajustar a las nuevas funcionalidades que esperan para la red. Una solución para cubrir todas estas necesidades es la adaptación de técnicas capaces de hacer frente a estas velocidades de datos enormes, y garantizar el mismo nivel de eficiencia para las largas distancias y mitigar las deficiencias ópticas acumuladas a lo largo de la ruta de transmisión. Además, se espera que estas técnicas de transmisión puedan proporcionar cierto grado de flexibilidad, a fin de mejorar y hacer más eficiente la gestión de la red. Una tecnología prometedora que puede hacer frente a estos requisitos es lo que se llama multiplexación por división de frecuencias ortogonales, combinado con la detección óptica coherente (CO-OFDM). CO-OFDM ofrece varias ventajas, entre otras: alta sensibilidad y eficiencia espectral y, sobre todo, la posibilidad de recuperar por completo de una señal en fase, la amplitud y la polarización. Estos sistemas están compuestos por bloques de procesado de señales digitales (DSP) que permiten detectar los datos fácilmente así como también compensar las principales degradaciones, proporcionando alta tolerancia a los efectos de dispersión. Sin embargo, los sistemas CO-OFDM no están exentos de inconvenientes. Su alta relación de potencia de pico a potencia media (PAPR) reduce sensiblemente la tolerancia no linealidades. Por otra parte, los sistemas CO-OFDM son sensibles a cualquier cambio de frecuencia y desplazamiento de fase. Por tanto, se propone un sistema OFDM de envolvente constante (CE-OFDM) para reducir significativamente la PAPR y solucionar la alta sensibilidad a las degradaciones no lineales. Consiste en una señal OFDM modulada en fase, que se detecta coherentemente en el receptor. Una transformada alternativa, la transformada discreta de Hartley, se propone para acelerar los cálculos en el DSP. El sistema CE-OFDM por su flexibilidad y escalabilidad única, resulta una tecnología aplicable a diferentes escenarios, que van desde las redes de acceso hasta las redes troncales. En el caso de las soluciones de acceso, se investigan varios casos. En primer lugar, el CE-OFDM aplica para el desarrollo y soporte de datos de una red radio, reutilizando una red óptica de acceso ya desplegada. A continuación, se investiga la transmisión bidireccional dúplex a 10 Gb / s sobre una sola longitud de onda empleando un RSOA a las unidades de usuario. El punto clave de este sistema es la transmisión en sentido ascendente, que se consigue re-modulando la fase de una señal de intensidad modulada después de saturar de forma adecuada. A continuación, se estudia una red de área metropolitana flexible de hasta 100 km. Concretamente el efecto de concatenación de filtros ópticos es el objetivo de este estudio. Finalmente, se propone una actualización elástica del modelo de Telefónica I+D para la red troncal española. Por ello, se propone operar el CE-OFDM en multiplexación de polarización. Los resultados muestran que esta combinación reduce sensiblemente el empleo de ancho de banda esto como los requisitos de los enlaces transmisión, reduciendo también los costes tanto de desarrollo como de operación y mantenimiento de la red.Avui dia, a causa del gran desplegament de les xarxes de òptiques de transport, s'espera un augment continuat cap a majors velocitats de dades, fins a 100 Gb/s i més enllà. D'altra banda, l'evolució que es preveu per a les xarxes òptiques actuals, inclou l'adquisició de noves funcionalitats, per exemple, assignació de l'espectre de forma elàstica per als senyals òptics. Per tant, el clar desafiament pel que fa a les tecnologies de transmissió és trobar tècniques preparades per fer front a un creixement de la demanda d'ample de banda; demanda que contínuament es fa per part dels operadors de xarxa, per als qui els sistemes estàndard no s'acaben d'ajustar a les noves funcionalitats que esperen per a la xarxa. Una solució per a cobrir totes aquestes necessitats és l'adaptació de tècniques capaces de fer front a aquestes velocitats de dades enormes, i garantir el mateix nivell d'eficiència per a les llargues distàncies i mitigar les deficiències òptiques acumulades al llarg de la ruta de transmissió. A més, s'espera que aquestes tècniques de transmissió puguin proporcionar cert grau de flexibilitat, per tal de millorar i tornar més eficient la gestió de la xarxa. Una tecnologia prometedora que pot fer front a aquests requisits és el que s'anomena multiplexació per divisió de freqüències ortogonals, combinat amb la detecció òptica coherent (CO-OFDM). CO-OFDM ofereix diversos avantatges, entre altres: alta sensibilitat i eficiència espectral i, sobretot, la possibilitat de recuperar per complet d'una senyal en fase, l'amplitud i la polarització. Aquests sistemes estan compostos per blocs de processament de senyals digitals (DSP) que permeten detectar les dades fàcilment així com també compensar les principals degradacions, proporcionant alta tolerància pels efectes de dispersió. No obstant això, els sistemes CO-OFDM no estan exempts d'inconvenients. La seva alta relació de potència de pic a potència mitjana (PAPR) redueix sensiblement la tolerància a no linealitats. D'altra banda, els sistemes de CO-OFDM són sensibles a qualsevol canvi de freqüència i desplaçament de fase. Per tant, es proposa un sistema OFDM d'envolvent constant (CE-OFDM) per a reduir significativament la PAPR i solucionar l'alta sensibilitat a les degradacions no lineals. Consisteix en un senyal OFDM modulat en fase, que es detecta coherentment en el receptor. Una transformada alternativa, la transformada discreta d'Hartley, es proposa accelerar els càlculs en el DSP. El sistema CE-OFDM per la seva flexibilitat i escalabilitat única, resulta una tecnologia aplicable a diferents escenaris, que van des de les xarxes d'accés fins a les xarxes troncals. En el cas de les solucions d'accés, s'investiguen diversos casos. En primer lloc, el CE-OFDM s'aplica per al desplegament i suport de dades d'una xarxa radio, reutilitzant una xarxa òptica d'accés ja desplegada. A continuació, s'investiga la transmissió bidireccional dúplex a 10 Gb/s sobre una sola longitud d'ona emprant un RSOA a les unitats d'usuari. El punt clau d'aquest sistema és la transmissió en sentit ascendent, que s'aconsegueix re-modulant la fase d'un senyal d'intensitat modulada després de saturar-la de forma adequada. A continuació, s'estudia una xarxa d'àrea metropolitana flexible de fins a 100 km. Concretament l'efecte de concatenació de filtres òptics és l'objectiu d'aquest estudi. Finalment, es proposa una actualització elàstica del model de Telefónica I+D per a la xarxa troncal espanyola. Per això, es proposa operar el CE-OFDM en multiplexació de polarització. Els resultats mostren que aquesta combinació redueix sensiblement l'ocupació d'ample de banda això com també els requisits dels enllaços transmissió, reduint també els costos tant de desplegament com d'operació i manteniment de la xarxa