Improvements to context based self-supervised learning

We develop a set of methods to improve on the results of self-supervised learning using context. We start with a baseline of patch based arrangement context learning and go from there. Our methods address some overt problems such as chromatic aberration as well as other potential problems such as spatial skew and mid-level feature neglect. We prevent problems with testing generalization on common self-supervised benchmark tests by using different datasets during our development. The results of our methods combined yield top scores on all standard self-supervised benchmarks, including classification and detection on PASCAL VOC 2007, segmentation on PASCAL VOC 2012, and "linear tests" on the ImageNet and CSAIL Places datasets. We obtain an improvement over our baseline method of between 4.0 to 7.1 percentage points on transfer learning classification tests. We also show results on different standard network architectures to demonstrate generalization as well as portability. All data, models and programs are available at: https://gdo-datasci.llnl.gov/selfsupervised/.Comment: Accepted paper at CVPR 201

Representation Learning by Learning to Count

We introduce a novel method for representation learning that uses an artificial supervision signal based on counting visual primitives. This supervision signal is obtained from an equivariance relation, which does not require any manual annotation. We relate transformations of images to transformations of the representations. More specifically, we look for the representation that satisfies such relation rather than the transformations that match a given representation. In this paper, we use two image transformations in the context of counting: scaling and tiling. The first transformation exploits the fact that the number of visual primitives should be invariant to scale. The second transformation allows us to equate the total number of visual primitives in each tile to that in the whole image. These two transformations are combined in one constraint and used to train a neural network with a contrastive loss. The proposed task produces representations that perform on par or exceed the state of the art in transfer learning benchmarks.Comment: ICCV 2017(oral

3D printing of oil paintings based on material jetting and its reduction of staircase effect

Material jetting is a high-precision and fast 3D printing technique for color 3D objects reproduction, but it also suffers from color accuracy and jagged issues. The UV inks jetting processes based on the polymer jetting principle have been studied from printing materials regarding the parameters in the default layer order, which is prone to staircase effects. In this work, utilizing the Mimaki UV inks jetting system with a variable layer thickness, a new framework to print a photogrammetry-based oil painting 3D model has been proposed with the tunable coloring layer sequence to improve the jagged challenge between adjacent layers. Based on contour tracking, a height-rendering image of the oil painting model is generated, which is further segmented and pasted to the corresponding slicing layers to control the overall printing sequence of coloring layers and white layers. The final results show that photogrammetric models of oil paintings can be printed vividly by UV-curable color polymers, and that the proposed reverse-sequence printing method can significantly improve the staircase effect based on visual assessment and color difference. Finally, the case of polymer-based oil painting 3D printing provides new insights for optimizing color 3D printing processes based on other substrates and print accuracy to improve the corresponding staircase effect

Engineering data compendium. Human perception and performance. User's guide

The concept underlying the Engineering Data Compendium was the product of a research and development program (Integrated Perceptual Information for Designers project) aimed at facilitating the application of basic research findings in human performance to the design and military crew systems. The principal objective was to develop a workable strategy for: (1) identifying and distilling information of potential value to system design from the existing research literature, and (2) presenting this technical information in a way that would aid its accessibility, interpretability, and applicability by systems designers. The present four volumes of the Engineering Data Compendium represent the first implementation of this strategy. This is the first volume, the User's Guide, containing a description of the program and instructions for its use

Review on passive approaches for detecting image tampering

This paper defines the presently used methods and approaches in the domain of digital image forgery detection. A survey of a recent study is explored including an examination of the current techniques and passive approaches in detecting image tampering. This area of research is relatively new and only a few sources exist that directly relate to the detection of image forgeries. Passive, or blind, approaches for detecting image tampering are regarded as a new direction of research. In recent years, there has been significant work performed in this highly active area of research. Passive approaches do not depend on hidden data to detect image forgeries, but only utilize the statistics and/or content of the image in question to verify its genuineness. The specific types of forgery detection techniques are discussed below

Experimental investigation of color reproduction quality of color 3D printing based on colored layer features

Color three-dimensional (3D) printing is an advanced 3D printing technique for reproducing colorful 3D objects, but it still has color accuracy issues. Plastic-based color 3D printing is a common color 3D printing process, and most factors affecting its color reproduction quality have been studied from printing materials to parameters in the fixed consecutive layers. In this work, and combined with variable stair thickness, the colored layer sequence in sliced layers of a specific 3D color test chart is deliberately changed to test the effects of colored layer features on its final color reproduction quality. Meanwhile, the colorimetric measurement and image acquisition of printed 3D color test charts are both achieved under standard conditions. Results clearly show that the chromatic aberration values and mean structural similarity (MSSIM) values of color samples have a significant correlation with the colored stair thickness, but both did not display a linear relationship. The correlation trends between colored layer sequence and the above two indexes are more localized to the colored stair thickness. Combined with color structural similarity (SSIM) maps analysis, a comprehensive discussion between colored layer features and color reproduction quality of color 3D printing is presented, providing key insights for developing further accurate numerical models

Chromatic assimilation: spread light or neural mechanism?

AbstractChromatic assimilation is the shift in color appearance of a test field toward the appearance of nearby light. Possible explanations of chromatic assimilation include wavelength independent spread light, wavelength-dependent chromatic aberration and neural summation. This study evaluated these explanations by measuring chromatic assimilation from a concentric-ring pattern into an equal-energy-white background, as a function of the inducing rings’ width, separation, chromaticity and luminance. The measurements showed, in the s direction, that assimilation was observed with different inducing-ring widths and separations when the inducing luminance was lower or higher than the test luminance. In general, the thinner the inducing rings and the smaller their separation, the stronger the assimilation in s. In the l direction, either assimilation or contrast was observed, depending on the ring width, separation and luminance. Overall, the measured assimilation could not be accounted for by the joint contributions from wavelength-independent spread light and wavelength-dependent chromatic aberration. Spatial averaging of neural signals explained the assimilation in s reasonably well, but there were clear deviations from neural spatial averaging for the l direction

Planar visual fusion scintigraphy

Planar scintigraphy, while providing useful information about the distribution of the radiopharmaceutical being used, often does not provide adequate information about the surrounding anatomical structures. A proposed method to solve this problem is by registering and fusing a scintigraphic image with a digital visual image. Fusing planar scintigraphic images with visual photographic images to supply an anatomic correlate to regions of radiopharmaceutical accumulation has been explored in this study. The digital visual image will provide a context for the relevant structures in the scintigraphic image. The validity of using one set of affine transformation parameters for registering all patient data has been confirmed with preliminary data. Results using patient data confirm registration accuracy to within .95 cm on average and 2.35 cm as the greatest amount of error. Error was approximated for an optimal imaging radial distance from the optical axis as being 1.70 cm. Initial clinical imaging has subjectively been very useful in low background applications such as lymphoscintigraphy, whole body 1-131 Nal imaging for thyroid cancer and In-l 11 WBC infection imaging

Subjective Assessment of Image Compression Artefacts on Stereoscopic Display

Image and video quality are important to depict any pictorial information vividly and correctly. With the advancement of technology, we can produce high-quality images and can display those in advanced high-resolution displays. But as high-quality images continue to increase in size, transmitting these exceeds the limited bandwidth of display links. To cope, we need to compress the images but desire that the user cannot perceive any difference between the compressed and uncompressed images. In my thesis, psychophysical experiments with a flicker paradigm were undertaken to do a subjective assessment of the visibility of compression artefacts of two sets of images with two codecs viewed on a stereoscopic display. For one set of images the result shows that artefacts can be silenced in some stereo images relative to 2D while testing with the other set of images was inconclusive. This thesis documented evidence for silencing of artefacts in 3D displays. Other differences between stereoscopic and 2D presentation can be predicted but were not observed here (perhaps due to floor effects). Further large-scale subjective assessment with challenging images may help to get a concrete conclusion