Mind the Gap: Another look at the problem of the semantic gap in image retrieval

This paper attempts to review and characterise the problem of the semantic gap in image retrieval and the attempts being made to bridge it. In particular, we draw from our own experience in user queries, automatic annotation and ontological techniques. The first section of the paper describes a characterisation of the semantic gap as a hierarchy between the raw media and full semantic understanding of the media's content. The second section discusses real users' queries with respect to the semantic gap. The final sections of the paper describe our own experience in attempting to bridge the semantic gap. In particular we discuss our work on auto-annotation and semantic-space models of image retrieval in order to bridge the gap from the bottom up, and the use of ontologies, which capture more semantics than keyword object labels alone, as a technique for bridging the gap from the top down

Improving perceptual multimedia quality with an adaptable communication protocol

Copyrights @ 2005 University Computing Centre ZagrebInnovations and developments in networking technology have been driven by technical considerations with little analysis of the benefit to the user. In this paper we argue that network parameters that define the network Quality of Service (QoS) must be driven by user-centric parameters such as user expectations and requirements for multimedia transmitted over a network. To this end a mechanism for mapping user-oriented parameters to network QoS parameters is outlined. The paper surveys existing methods for mapping user requirements to the network. An adaptable communication system is implemented to validate the mapping. The architecture adapts to varying network conditions caused by congestion so as to maintain user expectations and requirements. The paper also surveys research in the area of adaptable communications architectures and protocols. Our results show that such a user-biased approach to networking does bring tangible benefits to the user

Imaging and energetics of single SSB-ssDNA molecules reveal intramolecular condensation and insight into RecOR function.

Escherichia coli single-stranded DNA (ssDNA) binding protein (SSB) is the defining bacterial member of ssDNA binding proteins essential for DNA maintenance. SSB binds ssDNA with a variable footprint of ∼30-70 nucleotides, reflecting partial or full wrapping of ssDNA around a tetramer of SSB. We directly imaged single molecules of SSB-coated ssDNA using total internal reflection fluorescence (TIRF) microscopy and observed intramolecular condensation of nucleoprotein complexes exceeding expectations based on simple wrapping transitions. We further examined this unexpected property by single-molecule force spectroscopy using magnetic tweezers. In conditions favoring complete wrapping, SSB engages in long-range reversible intramolecular interactions resulting in condensation of the SSB-ssDNA complex. RecO and RecOR, which interact with SSB, further condensed the complex. Our data support the idea that RecOR--and possibly other SSB-interacting proteins-function(s) in part to alter long-range, macroscopic interactions between or throughout nucleoprotein complexes by microscopically altering wrapping and bridging distant sites

Designing experiments using digital fabrication in structural dynamics

In engineering, traditional approaches aimed at teaching concepts of dynamics to engineering students include the study of a dense yet sequential theoretical development of proofs and exercises. Structural dynamics are seldom taught experimentally in laboratories since these facilities should be provided with expensive equipment such as wave generators, data-acquisition systems, and heavily wired deployments with sensors. In this paper, the design of an experimental experience in the classroom based upon digital fabrication and modeling tools related to structural dynamics is presented. In particular, all experimental deployments are conceived with low-cost, open-source equipment. The hardware includes Arduino-based open-source electronics whereas the software is based upon object-oriented open-source codes for the development of physical simulations. The set of experiments and the physical simulations are reproducible and scalable in classroom-based environments.Peer ReviewedPostprint (author's final draft

Do synaesthesia and mental imagery tap into similar cross-modal processes?

Synaesthesia has previously been linked with imagery abilities, although an understanding of a causal role for mental imagery in broader synaesthetic experiences remains elusive. This can be partly attributed to our relatively poor understanding of imagery in sensory domains beyond vision. Investigations into the neural and behavioural underpinnings of mental imagery have nevertheless identified an important role for imagery in perception, particularly in mediating cross-modal interactions. However, the phenomenology of synaesthesia gives rise to the assumption that associated cross-modal interactions may be encapsulated and specific to synaesthesia. As such, evidence for a link between imagery and perception may not generalize to synaesthesia. Here, we present results that challenge this idea: first, we found enhanced somatosensory imagery evoked by visual stimuli of body parts in mirror-touch synaesthetes, relative to other synaesthetes or controls. Moreover, this enhanced imagery generalized to tactile object properties not directly linked to their synaesthetic associations. Second, we report evidence that concurrent experience evoked in grapheme-colour synaesthesia was sufficient to trigger visual-to-tactile correspondences that are common to all. Together, these findings show that enhanced mental imagery is a consistent hallmark of synaesthesia, and suggest the intriguing possibility that imagery may facilitate the cross-modal interactions that underpin synaesthesic experiences. This article is part of a discussion meeting issue 'Bridging senses: novel insights from synaesthesia'

Using a new high-throughput video-tracking platform to assess behavioural changes in Daphnia magna exposed to neuro-active drugs

© 2019. ElsevierOne of the major challenges that faces today regulatory risk assessment is to speed up the way of assessing threshold sublethal detrimental effects of existing and new chemical products. Recently advances in imaging allows to monitor in real time the behaviour of individuals under a given stress. Light is a common stress for many different organisms. Fish larvae and many invertebrate species respond to light altering their behaviour. The water flea Daphnia magna as many other zooplanktonic species has a marked diel vertical phototactic swimming behaviour against light due to fish predation. The aim of this study was to develop a high throughput image analysis to study changes in the vertical swimming behaviour to light of D. magna first reproductive adult females exposed to 0.1 and 1 µg/L of four psychiatric drugs: diazepam, fluoxetine, propranolol and carbamazepine during their entire life. Experiments were conducted using a new custom designed vertical oriented four 50 mL chamber device controlled by the Noldus software (Netherlands). Changes in speed, preferred area (bottom vs upper areas) and animal aggregation were analysed using groups of animals under consecutive periods of dark and apical light stimulus of different intensities. Obtained results indicated that light intensity increased the speed but low light intensities allowed to better discriminate individual responses to the studied drugs. The four tested drugs decreased the response of exposed organisms to light: individuals move less, were closer to the bottom and at low light intensities were closer each other. At high light intensities, however, exposed individuals were less aggregated. Propranolol, carbamazepine and fluoxetine were the compounds effecting most the behaviour. Our results indicated that psychiatric drugs at environmental relevant concentrations alter the vertical phototactic behaviour of D. magna individuals and that it is possible to develop appropriate high-throughput image analysis devices to measure those responses.Peer ReviewedPostprint (author's final draft