Boosting Image Forgery Detection using Resampling Features and Copy-move analysis

Realistic image forgeries involve a combination of splicing, resampling, cloning, region removal and other methods. While resampling detection algorithms are effective in detecting splicing and resampling, copy-move detection algorithms excel in detecting cloning and region removal. In this paper, we combine these complementary approaches in a way that boosts the overall accuracy of image manipulation detection. We use the copy-move detection method as a pre-filtering step and pass those images that are classified as untampered to a deep learning based resampling detection framework. Experimental results on various datasets including the 2017 NIST Nimble Challenge Evaluation dataset comprising nearly 10,000 pristine and tampered images shows that there is a consistent increase of 8%-10% in detection rates, when copy-move algorithm is combined with different resampling detection algorithms

Breast Tomosynthesis: Aspects on detection and perception of simulated lesions

The aim of this thesis was to investigate aspects on detectability of simulated lesions (microcalcifications and masses) in digital mammography (DM) and breast tomosynthesis (BT). Perception in BT image volumes were also investigated by evaluating certain reading conditions. The first study concerned the effect of system noise on the detection of masses and microcalcification clusters in DM images using a free-response task. System noise has an impact on image quality and is related to the dose level. It was found to have a substantial impact on the detection of microcalcification clusters, whereas masses were relatively unaffected. The effect of superimposed tissue in DM is the major limitation hampering the detection of masses. BT is a three-dimensional technique that reduces the effect of superimposed tissue. In the following two studies visibility was quantified for both imaging modalities in terms of the required contrast at a fixed detection performance (92% correct decisions). Contrast detail plots for lesions with sizes 0.2, 1, 3, 8 and 25 mm were generated. The first study involved only an in-plane BT slice, where the lesion centre appeared. The second study repeated the same procedure in BT image volumes for 3D distributed microcalcification clusters and 8 mm masses at two dose levels. Both studies showed that BT needs substantially less contrast than DM for lesions above 1 mm. Furthermore, the contrast threshold increased as the lesion size increased for both modalities. This is in accordance with the reduced effect of superimposed tissue in BT. For 0.2 mm lesions, substantially more contrast was needed. At equal dose, DM was better than BT for 0.2 mm lesions and microcalcification clusters. Doubling the dose substantially improved the detection in BT. Thus, system noise has a substantial impact on detection. The final study evaluated reading conditions for BT image volumes. Four viewing procedures were assessed: free scroll browsing only or combined with initial cine loops at frame rates of 9, 14 and 25 fps. They were viewed on a wide screen monitor placed in vertical or horizontal positions. A free-response task and eye tracking were utilized to record the detection performance, analysis time, visual attention and search strategies. Improved reading conditions were found for horizontally aligned BT image volumes when using free scroll browsing only or combined with a cine loop at the fastest frame rate

Monitoring the UK’s wild mammals: A new grammar for citizen science engagement and ecology

Anthropogenic activities have imperilled not just global ecosystems, but also the ecosystem services they provide which are crucial for human livelihoods. To understand these changes, there is a need for effective monitoring over large spatial and temporal scales. This thesis will build on two proposed solutions. First, citizen science – defined here as the involvement of non-professionals in scientific enquiry – allows the crowdsourcing of data collection and classification to expand monitoring in ways that are logistically infeasible for ecologists alone. Second, motion-sensing camera traps can reduce the labour needed for monitoring since they can be deployed for long periods and provide continuous, relatively unbiased observations. In this thesis, I describe MammalWeb, a citizen science project in north-east England where I enlisted the aid of the local community in wild mammal monitoring. Motivated by the current unevenness of survey effort and data for mammals in Great Britain, MammalWeb involves citizen scientists in both the collection and classification of camera trap images, a novel combination. This is a multidisciplinary project, and in the following chapters I will begin, in Chapter 2, with a detailed reflection on the organisation of the MammalWeb citizen science project and approaches to evaluating its performance. I observe that the majority of contributions came from a small subset of citizen scientists. In Chapter 3, I develop an economical approach to deriving consensus classifications from the aggregated input of multiple users, which is a crucial part of many citizen science projects. This is followed in Chapter 4 by a case study of a partnership I initiated between MammalWeb and the local Belmont Community School, where we empowered a group of secondary school students to not only aid in collecting data for MammalWeb, but also design and deliver ecological outreach to their community. This is now the template for a wider network of school partnerships we are pursuing. Chapter 5 will examine common concerns around estimating species occupancy from camera trap data, including post-hoc discretisation of observations and effects of missing data. I also develop a resampling method to account for uncertain detections, a common issue when crowdsourcing data classifications. I show that, through resampling, the estimated parameters from occupancy models are robust against high uncertainty in the underlying detections. Lastly, Chapter 6 will discuss how my work on MammalWeb has laid the foundation for a wider citizen science camera trapping network in the United Kingdom and avenues for future work. Importantly, I show that MammalWeb citizen scientists have been empowered to be more than “mobile sensors” and act as independent researchers who have initiated ecological studies elsewhere

Resampling Forgery Detection Using Deep Learning and A-Contrario Analysis

The amount of digital imagery recorded has recently grown exponentially, and with the advancement of software, such as Photoshop or Gimp, it has become easier to manipulate images. However, most images on the internet have not been manipulated and any automated manipulation detection algorithm must carefully control the false alarm rate. In this paper we discuss a method to automatically detect local resampling using deep learning while controlling the false alarm rate using a-contrario analysis. The automated procedure consists of three primary steps. First, resampling features are calculated for image blocks. A deep learning classifier is then used to generate a heatmap that indicates if the image block has been resampled. We expect some of these blocks to be falsely identified as resampled. We use a-contrario hypothesis testing to both identify if the patterns of the manipulated blocks indicate if the image has been tampered with and to localize the manipulation. We demonstrate that this strategy is effective in indicating if an image has been manipulated and localizing the manipulations.Comment: arXiv admin note: text overlap with arXiv:1802.0315

Galaxy Zoo: CANDELS barred discs and bar fractions

The formation of bars in disc galaxies is a tracer of the dynamical maturity of the population. Previous studies have found that the incidence of bars in discs decreases from the local Universe to z ~ 1, and by z > 1 simulations predict that bar features in dynamically mature discs should be extremely rare. Here, we report the discovery of strong barred structures in massive disc galaxies at z ~ 1.5 in deep rest-frame optical images from the Cosmic Assembly Near-Infrared Deep Extragalactic Legacy Survey. From within a sample of 876 disc galaxies identified by visual classification in Galaxy Zoo, we identify 123 barred galaxies. Selecting a subsample within the same region of the evolving galaxy luminosity function (brighter than L*), we find that the bar fraction across the redshift range 0.5 ≤ z ≤ 2 (fbar = 10.7+6.3 -3.5 per cent after correcting for incompleteness) does not significantly evolve.We discuss the implications of this discovery in the context of existing simulations and our current understanding of the way disc galaxies have evolved over the last 11 billion yearsPeer reviewedFinal Accepted Versio

Development of a low-cost multi-camera star tracker for small satellites

This thesis presents a novel small satellite star tracker that uses an array of low-cost, off the shelf imaging sensors to achieve high accuracy attitude determination performance. The theoretical analysis of improvements in star detectability achieved by stacking images from multiple cameras is presented. An image processing algorithm is developed to combine images from multiple cameras with arbitrary focal lengths, principal point offsets, distortions, and misalignments. The star tracker also implements other algorithms including the region growing algorithm, the intensity weighted centroid algorithm, the geometric voting algorithm for star identification, and the singular value decomposition algorithm for attitude determination. A star tracker software simulator is used to test the algorithms by generating star images with sensor noises, lens defocusing, and lens distortion. A hardware prototype is being assembled for eventual night sky testing to verify simulated performance levels. Star tracker flight hardware is being developed in the Laboratory for Advanced Space Systems at Illinois (LASSI) at the University of Illinois at Urbana Champaign for future CubeSat missions