Surfing the Waves: Live Audio Mosaicing of an Electric Bass Performance as a Corpus Browsing Interface

In this paper, the authors describe how they use an electric bass as a subtle, expressive and intuitive interface to browse the rich sample bank available to most laptop owners. This is achieved by audio mosaicing of the live bass performance audio, through corpus-based concatenative synthesis (CBCS) techniques, allowing a mapping of the multi-dimensional expressivity of the performance onto foreign audio material, thus recycling the virtuosity acquired on the electric instrument with a trivial learning curve. This design hypothesis is contextualised and assessed within the Sandbox#n series of bass+laptop meta-instruments, and the authors describe technical means of the implementation through the use of the open-source CataRT CBCS system adapted for live mosaicing. They also discuss their encouraging early results and provide a list of further explorations to be made with that rich new interface

A Case Study of On-the-Fly Wide-Field Radio Imaging Applied to the Gravitational-wave Event GW 151226

We apply a newly-developed On-the-Fly mosaicing technique on the NSF's Karl G. Jansky Very Large Array (VLA) at 3 GHz in order to carry out a sensitive search for an afterglow from the Advanced LIGO binary black hole merger event GW 151226. In three epochs between 1.5 and 6 months post-merger we observed a 100 sq. deg region, with more than 80% of the survey region having a RMS sensitivity of better than 150 uJy/beam, in the northern hemisphere having a merger containment probability of 10%. The data were processed in near-real-time, and analyzed to search for transients and variables. No transients were found but we have demonstrated the ability to conduct blind searches in a time-frequency phase space where the predicted afterglow signals are strongest. If the gravitational wave event is contained within our survey region, the upper limit on any late-time radio afterglow from the merger event at an assumed mean distance of 440 Mpc is about 1e29 erg/s/Hz. Approximately 1.5% of the radio sources in the field showed variability at a level of 30%, and can be attributed to normal activity from active galactic nuclei. The low rate of false positives in the radio sky suggests that wide-field imaging searches at a few Gigahertz can be an efficient and competitive search strategy. We discuss our search method in the context of the recent afterglow detection from GW 170817 and radio follow-up in future gravitational wave observing runs.Comment: 11 pages. 6 figures. 1 table. Accepted for publication in ApJ Letter

2D Iterative MAP Detection: Principles and Applications in Image Restoration

The paper provides a theoretical framework for the two-dimensional iterative maximum a posteriori detection. This generalization is based on the concept of detection algorithms BCJR and SOVA, i.e., the classical (one-dimensional) iterative detectors used in telecommunication applications. We generalize the one-dimensional detection problem considering the spatial ISI kernel as a two-dimensional finite state machine (2D FSM) representing a network of the spatially concatenated elements. The cellular structure topology defines the design of the 2D Iterative decoding network, where each cell is a general combination-marginalization statistical element (SISO module) exchanging discrete probability density functions (information metrics) with neighboring cells. In this paper, we statistically analyse the performance of various topologies with respect to their application in the field of image restoration. The iterative detection algorithm was applied on the task of binarization of images taken from a CCD camera. The reconstruction includes suppression of the defocus caused by the lens, CCD sensor noise suppression and interpolation (demosaicing). The simulations prove that the algorithm provides satisfactory results even in the case of an input image that is under-sampled due to the Bayer mask

Omnidirectional underwater surveying and telepresence

Exploratory dives are traditionally the first step for marine scientists to acquire information on a previously unknown area of scientific interest. Manned submersibles have been the platform of choice for such exploration, as they allow a high level of environmental perception by the scientist on-board, and the ability to take informed decisions on what to explore next. However, manned submersibles have extremely high operation costs and provide very limited bottom time. Remotely operated vehicles (ROVs) can partially address these two issues, but have operational and cost constraints that restrict their usage. This paper discusses new capabilities to assist scientists operating lightweight hybrid remotely operated vehicles (HROV) in exploratory missions of mapping and surveying. The new capabilities, under development within the Spanish National project OMNIUS, provide a new layer of autonomy for HROVs by exploring three key concepts: Omni-directional optical sensing for collaborative immersive exploration, Proximity safety awareness and Online mapping during mission time.Peer Reviewe

Image Mosaicing Using Feature Detection Algorithms

In most recent couple of decades, image processing specialists has been using image mosaicing as a testing field in real time applications. It has wide utilization in the 3D picture reproduction, field of satellite imaging, computer vision fields and a few therapeutic fields also. Movement recognition & tracking, mosaic-based localisation, resolution enhancement, generating substantial FOV, augmented reality, and so forth are also some of its application fields. In this exploration work, feature based image mosaicing procedure has been proposed. There are five essential steps in feature based procedures: feature extraction, feature matching, transformation model estimation, image re-sampling and transformation, and image blending. The achievement of image mosaicing can be accounted by the feature identification algorithms such as Harris corner detector, SURF, FAST and FREAK. But each of these algorithms has their own particular impediments and preferences as indicated by the applications concerned. The proposed strategy first compares the above mentioned four feature extraction algorithm on the basis of accuracy and computational time and determines FREAK to be the most optimum one and then utilizes this FREAK descriptor algorithm for feature detection. All the distinctive features detected in an image and the feature descriptors are shaped around the corners. Matching between the feature descriptors from both the images is done to achieve best closeness and all the features other than the ones with higher degree of resemblance are rejected. Now, the features with higher degree of resemblance are used for computing the transformation model and correspondingly, the warping of the image is done. The warping of the picture is done on a typical mosaic plane after estimation. The removal of the intensity seam in the neighbourhood of the boundary of the images and to modify the image grey levels at the junction joint to obtain a smooth transition between the images is the final step. Alpha blending technique is utilized for the purpose of image blendin

Real-time Mosaic for Multi-Camera Videoconferencing

This paper describes a system for high resolution video conferencing. A number of camcorders are used to capture the video, which are then mosaiced to generate a wide angle panoramic view. Furthermore this system is made “real-time” by detecting changes and updating them on the mosaic. This system can be deployed on a single machine or on a cluster for better performance. It is also scalable and shows a good real-time performance. The main application for this system is videoconferencing for distance learning but it can be used for any high resolution broadcasting.Singapore-MIT Alliance (SMA

An in Depth Review Paper on Numerous Image Mosaicing Approaches and Techniques

Image mosaicing is one of the most important subjects of research in computer vision at current. Image mocaicing requires the integration of direct techniques and feature based techniques. Direct techniques are found to be very useful for mosaicing large overlapping regions, small translations and rotations while feature based techniques are useful for small overlapping regions. Feature based image mosaicing is a combination of corner detection, corner matching, motion parameters estimation and image stitching.Furthermore, image mosaicing is considered the process of obtaining a wider field-of-view of a scene from a sequence of partial views, which has been an attractive research area because of its wide range of applications, including motion detection, resolution enhancement, monitoring global land usage, and medical imaging. Numerous algorithms for image mosaicing have been proposed over the last two decades.In this paper the authors present a review on different approaches for image mosaicing and the literature over the past few years in the field of image masaicing methodologies. The authors take an overview on the various methods for image mosaicing.This review paper also provides an in depth survey of the existing image mosaicing algorithms by classifying them into several groups. For each group, the fundamental concepts are first clearly explained. Finally this paper also reviews and discusses the strength and weaknesses of all the mosaicing groups