A Novel Framework for Highlight Reflectance Transformation Imaging

We propose a novel pipeline and related software tools for processing the multi-light image collections (MLICs) acquired in different application contexts to obtain shape and appearance information of captured surfaces, as well as to derive compact relightable representations of them. Our pipeline extends the popular Highlight Reflectance Transformation Imaging (H-RTI) framework, which is widely used in the Cultural Heritage domain. We support, in particular, perspective camera modeling, per-pixel interpolated light direction estimation, as well as light normalization correcting vignetting and uneven non-directional illumination. Furthermore, we propose two novel easy-to-use software tools to simplify all processing steps. The tools, in addition to support easy processing and encoding of pixel data, implement a variety of visualizations, as well as multiple reflectance-model-fitting options. Experimental tests on synthetic and real-world MLICs demonstrate the usefulness of the novel algorithmic framework and the potential benefits of the proposed tools for end-user applications.Terms: "European Union (EU)" & "Horizon 2020" / Action: H2020-EU.3.6.3. - Reflective societies - cultural heritage and European identity / Acronym: Scan4Reco / Grant number: 665091DSURF project (PRIN 2015) funded by the Italian Ministry of University and ResearchSardinian Regional Authorities under projects VIGEC and Vis&VideoLa

Using Machine-Learning to Optimize phase contrast in a Low-Cost Cellphone Microscope

Cellphones equipped with high-quality cameras and powerful CPUs as well as GPUs are widespread. This opens new prospects to use such existing computational and imaging resources to perform medical diagnosis in developing countries at a very low cost. Many relevant samples, like biological cells or waterborn parasites, are almost fully transparent. As they do not exhibit absorption, but alter the light's phase only, they are almost invisible in brightfield microscopy. Expensive equipment and procedures for microscopic contrasting or sample staining often are not available. By applying machine-learning techniques, such as a convolutional neural network (CNN), it is possible to learn a relationship between samples to be examined and its optimal light source shapes, in order to increase e.g. phase contrast, from a given dataset to enable real-time applications. For the experimental setup, we developed a 3D-printed smartphone microscope for less than 100 \$ using off-the-shelf components only such as a low-cost video projector. The fully automated system assures true Koehler illumination with an LCD as the condenser aperture and a reversed smartphone lens as the microscope objective. We show that the effect of a varied light source shape, using the pre-trained CNN, does not only improve the phase contrast, but also the impression of an improvement in optical resolution without adding any special optics, as demonstrated by measurements

Using Machine-Learning to Optimize phase contrast in a Low-Cost Cellphone Microscope

Cellphones equipped with high-quality cameras and powerful CPUs as well as GPUs are widespread. This opens new prospects to use such existing computational and imaging resources to perform medical diagnosis in developing countries at a very low cost. Many relevant samples, like biological cells or waterborn parasites, are almost fully transparent. As they do not exhibit absorption, but alter the light's phase only, they are almost invisible in brightfield microscopy. Expensive equipment and procedures for microscopic contrasting or sample staining often are not available. By applying machine-learning techniques, such as a convolutional neural network (CNN), it is possible to learn a relationship between samples to be examined and its optimal light source shapes, in order to increase e.g. phase contrast, from a given dataset to enable real-time applications. For the experimental setup, we developed a 3D-printed smartphone microscope for less than 100 \$ using off-the-shelf components only such as a low-cost video projector. The fully automated system assures true Koehler illumination with an LCD as the condenser aperture and a reversed smartphone lens as the microscope objective. We show that the effect of a varied light source shape, using the pre-trained CNN, does not only improve the phase contrast, but also the impression of an improvement in optical resolution without adding any special optics, as demonstrated by measurements

Monte Carlo-based Noise Compensation in Coil Intensity Corrected Endorectal MRI

Background: Prostate cancer is one of the most common forms of cancer found in males making early diagnosis important. Magnetic resonance imaging (MRI) has been useful in visualizing and localizing tumor candidates and with the use of endorectal coils (ERC), the signal-to-noise ratio (SNR) can be improved. The coils introduce intensity inhomogeneities and the surface coil intensity correction built into MRI scanners is used to reduce these inhomogeneities. However, the correction typically performed at the MRI scanner level leads to noise amplification and noise level variations. Methods: In this study, we introduce a new Monte Carlo-based noise compensation approach for coil intensity corrected endorectal MRI which allows for effective noise compensation and preservation of details within the prostate. The approach accounts for the ERC SNR profile via a spatially-adaptive noise model for correcting non-stationary noise variations. Such a method is useful particularly for improving the image quality of coil intensity corrected endorectal MRI data performed at the MRI scanner level and when the original raw data is not available. Results: SNR and contrast-to-noise ratio (CNR) analysis in patient experiments demonstrate an average improvement of 11.7 dB and 11.2 dB respectively over uncorrected endorectal MRI, and provides strong performance when compared to existing approaches. Conclusions: A new noise compensation method was developed for the purpose of improving the quality of coil intensity corrected endorectal MRI data performed at the MRI scanner level. We illustrate that promising noise compensation performance can be achieved for the proposed approach, which is particularly important for processing coil intensity corrected endorectal MRI data performed at the MRI scanner level and when the original raw data is not available.Comment: 23 page

Bringing "The Moth" to Light: A Planet-Sculpting Scenario for the HD 61005 Debris Disk

The HD 61005 debris disk ("The Moth") stands out from the growing collection of spatially resolved circumstellar disks by virtue of its unusual swept-back morphology, brightness asymmetries, and dust ring offset. Despite several suggestions for the physical mechanisms creating these features, no definitive answer has been found. In this work, we demonstrate the plausibility of a scenario in which the disk material is shaped dynamically by an eccentric, inclined planet. We present new Keck NIRC2 scattered-light angular differential imaging of the disk at 1.2-2.3 microns that further constrains its outer morphology (projected separations of 27-135 AU). We also present complementary Gemini Planet Imager 1.6 micron total intensity and polarized light detections that probe down to projected separations less than 10 AU. To test our planet-sculpting hypothesis, we employed secular perturbation theory to construct parent body and dust distributions that informed scattered-light models. We found that this method produced models with morphological and photometric features similar to those seen in the data, supporting the premise of a planet-perturbed disk. Briefly, our results indicate a disk parent body population with a semimajor axis of 40-52 AU and an interior planet with an eccentricity of at least 0.2. Many permutations of planet mass and semimajor axis are allowed, ranging from an Earth mass at 35 AU to a Jupiter mass at 5 AU.Comment: Accepted to AJ; added Figure 5 and minor text edit

Encoding of arbitrary micrometric complex illumination patterns with reduced speckle

In nonlinear microscopy, phase-only spatial light modulators (SLMs) allow achieving simultaneous two-photon excitation and fluorescence emission from specific regionof-interests (ROIs). However, as iterative Fourier transform algorithms (IFTAs) can only approximate the illumination of selected ROIs, both image formation and/or signal acquisition can be largely affected by the spatial irregularities of the illumination patterns and the speckle noise. To overcome these limitations, we propose an alternative complex illumination method (CIM) able to generate simultaneous excitation of large-area ROIs with full control over the amplitude and phase of light and reduced speckle. As a proof-of-concept we experimentally demonstrate single-photon and second harmonic generation (SHG) with structured illumination over large-area ROIs

Experimental Demonstration of Staggered CAP Modulation for Low Bandwidth Red-Emitting Polymer-LED based Visible Light Communications

In this paper we experimentally demonstrate, for the first time, staggered carrier-less amplitude and phase (sCAP) modulation for visible light communication systems based on polymer light-emitting diodes emitting at ~639 nm. The key advantage offered by sCAP in comparison to conventional multiband CAP is its full use of the available spectrum. In this work, we compare sCAP, which utilises four orthogonal filters to generate the signal, with a conventional 4-band multi-CAP system and on-off keying (OOK). We transmit each modulation format with equal energy and present a record un-coded transmission speed of ~6 Mb/s. This represents gains of 25% and 65% over the achievable rate using 4-CAP and OOK, respectively.Comment: 6 pages, 9 figures, IEEE ICC 2019 conferenc

Spread spectrum-based video watermarking algorithms for copyright protection

Merged with duplicate record 10026.1/2263 on 14.03.2017 by CS (TIS)Digital technologies know an unprecedented expansion in the last years. The consumer can now benefit from hardware and software which was considered state-of-the-art several years ago. The advantages offered by the digital technologies are major but the same digital technology opens the door for unlimited piracy. Copying an analogue VCR tape was certainly possible and relatively easy, in spite of various forms of protection, but due to the analogue environment, the subsequent copies had an inherent loss in quality. This was a natural way of limiting the multiple copying of a video material. With digital technology, this barrier disappears, being possible to make as many copies as desired, without any loss in quality whatsoever. Digital watermarking is one of the best available tools for fighting this threat. The aim of the present work was to develop a digital watermarking system compliant with the recommendations drawn by the EBU, for video broadcast monitoring. Since the watermark can be inserted in either spatial domain or transform domain, this aspect was investigated and led to the conclusion that wavelet transform is one of the best solutions available. Since watermarking is not an easy task, especially considering the robustness under various attacks several techniques were employed in order to increase the capacity/robustness of the system: spread-spectrum and modulation techniques to cast the watermark, powerful error correction to protect the mark, human visual models to insert a robust mark and to ensure its invisibility. The combination of these methods led to a major improvement, but yet the system wasn't robust to several important geometrical attacks. In order to achieve this last milestone, the system uses two distinct watermarks: a spatial domain reference watermark and the main watermark embedded in the wavelet domain. By using this reference watermark and techniques specific to image registration, the system is able to determine the parameters of the attack and revert it. Once the attack was reverted, the main watermark is recovered. The final result is a high capacity, blind DWr-based video watermarking system, robust to a wide range of attacks.BBC Research & Developmen