Human Attention in Image Captioning: Dataset and Analysis

In this work, we present a novel dataset consisting of eye movements and verbal descriptions recorded synchronously over images. Using this data, we study the differences in human attention during free-viewing and image captioning tasks. We look into the relationship between human attention and language constructs during perception and sentence articulation. We also analyse attention deployment mechanisms in the top-down soft attention approach that is argued to mimic human attention in captioning tasks, and investigate whether visual saliency can help image captioning. Our study reveals that (1) human attention behaviour differs in free-viewing and image description tasks. Humans tend to fixate on a greater variety of regions under the latter task, (2) there is a strong relationship between described objects and attended objects ($97\%$ of the described objects are being attended), (3) a convolutional neural network as feature encoder accounts for human-attended regions during image captioning to a great extent (around $78\%$), (4) soft-attention mechanism differs from human attention, both spatially and temporally, and there is low correlation between caption scores and attention consistency scores. These indicate a large gap between humans and machines in regards to top-down attention, and (5) by integrating the soft attention model with image saliency, we can significantly improve the model's performance on Flickr30k and MSCOCO benchmarks. The dataset can be found at: https://github.com/SenHe/Human-Attention-in-Image-Captioning.Comment: To appear at ICCV 201

Sexism in English Proverbs and Idioms

The study of “language and gender” has been always popular among linguistics. Language, as a mirror of the society, reflects a nation’s values and beliefs. Sexism against women has been common in English-speaking countries. So we can also see sexism in English here and there. Proverbs and idioms are blood and guts of a nation. This paper pays much attention to the sexism in English proverbs and idioms. This paper first discusses the preview studies about sexism and the definition of English proverbs and idioms; and then the thesis expounds the manifestations of sexism in proverbs and idioms from the perspectives of social status, wisdom, character, and marriage; then the paper also makes deep studies into the causes of sexism from three aspects: society, culture and psychology; finally, this paper indicates the development trend of sexism in English proverbs and idioms. Through the studies on English proverbs and idioms, this paper tries to reveal the phenomenon of sexism in language and find out solutions to help people reduce and eliminate discrimination against women in society and language

Receiver Design for DCT Based Multicarrier Signals

DCT based multicarrier system also known as fast orthogonal frequency division multiplexing (FOFDM) is a promising multicarrier transmission technique that requires half the subcarrier spacing compared to conventional OFDM technique. The signal processing complexity and power consumption of such system is also less due to its real arithmetic operations compared to DFT based system (OFDM) that require complex arithmetic operations. However, unlike OFDM, FOFDM requires a finite impulse response (FIR) front-end pre-filter at the receiver to achieve single-tap equalization for simplifying the receiver design. The receiver design can be further improved using the fact that FOFDM system transmits real valued symbols compared to complex valued symbols in conventional OFDM. This fact enabled us to improve the system performance by exploiting the improperness of such DCT based multicarrier signals using widely linear processing (WLP). In this paper, a novel equalization technique using WLP is proposed to effectively improve the system performance, and it is shown that the proposed FOFDM receiver can provide better estimate of the tra

Performance analysis and optimization of DCT-based multicarrier system on frequency-selective fading channels

Regarded as one of the most promising transmission techniques for future wireless communications, the discrete cosine transform (DCT) based multicarrier modulation (MCM) system employs cosine basis as orthogonal functions for real-modulated symbols multiplexing, by which the minimum orthogonal frequency spacing can be reduced by half compared to discrete Fourier transform (DFT) based one. With a time-reversed pre-filter employed at the front of the receiver, interference-free one-tap equalization is achievable for the DCT-based systems. However, due to the correlated pre-filtering operation in time domain, the signal-to-noise ratio (SNR) is enhanced as a result at the output. This leads to reformulated detection criterion to compensate for such filtering effect, rendering minimum-mean-square-error (MMSE) and maximum likelihood (ML) detections applicable to the DCT-based multicarrier system. In this paper, following on the pre-filtering based DCT-MCM model that build in the literature work, we extend the overall system by considering both transceiver perfections and imperfections, where frequency offset, time offset and insufficient guard sequence are included. In the presence of those imperfection errors, the DCT-MCM systems are analysed in terms of desired signal power, inter-carrier interference (ICI) and inter-symbol interference (ISI). Thereafter, new detection algorithms based on zero forcing (ZF) iterative results are proposed to mitigate the imperfection effect. Numerical results show that the theoretical analysis match the simulation results, and the proposed iterative detection algorithms are able to improve the overall system performance significantly

CP Violation with Heavy Hadrons

I review several topics involving CP violation with heavy hadrons. In particular, I discuss (i) Hyperons: CP violation in the decay $\Lambda^0 \to p \pi^-$, (ii) Charm: indirect CP violation in the D^0 system, both within and beyond the SM, and (iii) Beauty: indirect CP violation in the neutral B-meson system beyond the SM. Talk presented at the 2nd International Conference on Hyperons, Charm and Beauty Hadrons, Montr\'eal, Canada, August 1996.Comment: 12 pages, latex, 1 figure (included

A GOOD INITIAL GUESS FOR APPROXIMATING NONLINEAR OSCILLATORS BY THE HOMOTOPY PERTURBATION METHOD

A good initial guess and an appropriate homotopy equation are two main factors in applications of the homotopy perturbation method. For a nonlinear oscillator, a cosine function is used in an initial guess. This article recommends a general approach to construction of the initial guess and the homotopy equation. Duffing oscillator is adopted as an example to elucidate the effectiveness of the method

A Fuzzy-Logic Approach to Dynamic Bayesian Severity Level Classification of Driver Distraction Using Image Recognition

open access articleDetecting and classifying driver distractions is crucial in the prevention of road accidents. These distractions impact both driver behavior and vehicle dynamics. Knowing the degree of driver distraction can aid in accident prevention techniques, including transitioning of control to a level 4 semi- autonomous vehicle, when a high distraction severity level is reached. Thus, enhancement of Advanced Driving Assistance Systems (ADAS) is a critical component in the safety of vehicle drivers and other road users. In this paper, a new methodology is introduced, using an expert knowledge rule system to predict the severity of distraction in a contiguous set of video frames using the Naturalistic Driving American University of Cairo (AUC) Distraction Dataset. A multi-class distraction system comprises the face orientation, drivers’ activities, hands and previous driver distraction, a severity classification model is developed as a discrete dynamic Bayesian (DDB). Furthermore, a Mamdani-based fuzzy system was implemented to detect multi- class of distractions into a severity level of safe, careless or dangerous driving. Thus, if a high level of severity is reached the semi-autonomous vehicle will take control. The result further shows that some instances of driver’s distraction may quickly transition from a careless to dangerous driving in a multi-class distraction context