Multi-argument classification for semantic role labeling

This paper describes a Multi-Argument Classification (MAC) approach to Semantic Role Labeling. The goal is to exploit dependencies between semantic roles by simultaneously classifying all arguments as a pattern. Argument identification, as a pre-processing stage, is carried at using the improved Predicate-Argument Recognition Algorithm (PARA) developed by Lin and Smith (2006). Results using standard evaluation metrics show that multi-argument classification, archieving 76.60 in F₁ measurement on WSJ 23, outperforms existing systems that use a single parse tree for the CoNLL 2005 shared task data. This paper also describes ways to significantly increase the speed of multi-argument classification, making it suitable for real-time language processing tasks that require semantic role labelling

Waiting times for target detection models

One of the major developments in the theory of visual search is the establishment of a performance model based on fitting the search time distribution. Such a distribution is examined, based on a paper by Morawski et al;A modification of the traditional traveling salesman problem is made to relate specifically to the development of optimal search strategies. The modification involves inserting capture probabilities at the cities to be visited, and adapts the traditional dynamic programming algorithms to this added stochastic feature. A countably infinite version of this stochastic modification is formulated. For this formulation, typical ingredients of infinite dynamic programs are explored; these include: the convergence of the optimal value function, Bellman\u27s functional equation, and the construction of optimal (in this case only conditionally optimal) strategies;Visual search is a process involving certain deterministic, as well as random, components. This idea is incorporated into a second search model for which the expected value, variance and distribution of search time are computed, and also approximated numerically. A certain accelerated Monte Carlo method is discussed in connection with the numerical approximation of the distribution of search time

Multimedia Semantic Integrity Assessment Using Joint Embedding Of Images And Text

Real world multimedia data is often composed of multiple modalities such as an image or a video with associated text (e.g. captions, user comments, etc.) and metadata. Such multimodal data packages are prone to manipulations, where a subset of these modalities can be altered to misrepresent or repurpose data packages, with possible malicious intent. It is, therefore, important to develop methods to assess or verify the integrity of these multimedia packages. Using computer vision and natural language processing methods to directly compare the image (or video) and the associated caption to verify the integrity of a media package is only possible for a limited set of objects and scenes. In this paper, we present a novel deep learning-based approach for assessing the semantic integrity of multimedia packages containing images and captions, using a reference set of multimedia packages. We construct a joint embedding of images and captions with deep multimodal representation learning on the reference dataset in a framework that also provides image-caption consistency scores (ICCSs). The integrity of query media packages is assessed as the inlierness of the query ICCSs with respect to the reference dataset. We present the MultimodAl Information Manipulation dataset (MAIM), a new dataset of media packages from Flickr, which we make available to the research community. We use both the newly created dataset as well as Flickr30K and MS COCO datasets to quantitatively evaluate our proposed approach. The reference dataset does not contain unmanipulated versions of tampered query packages. Our method is able to achieve F1 scores of 0.75, 0.89 and 0.94 on MAIM, Flickr30K and MS COCO, respectively, for detecting semantically incoherent media packages.Comment: *Ayush Jaiswal and Ekraam Sabir contributed equally to the work in this pape