Jekyll: Attacking Medical Image Diagnostics using Deep Generative Models

Advances in deep neural networks (DNNs) have shown tremendous promise in the medical domain. However, the deep learning tools that are helping the domain, can also be used against it. Given the prevalence of fraud in the healthcare domain, it is important to consider the adversarial use of DNNs in manipulating sensitive data that is crucial to patient healthcare. In this work, we present the design and implementation of a DNN-based image translation attack on biomedical imagery. More specifically, we propose Jekyll, a neural style transfer framework that takes as input a biomedical image of a patient and translates it to a new image that indicates an attacker-chosen disease condition. The potential for fraudulent claims based on such generated 'fake' medical images is significant, and we demonstrate successful attacks on both X-rays and retinal fundus image modalities. We show that these attacks manage to mislead both medical professionals and algorithmic detection schemes. Lastly, we also investigate defensive measures based on machine learning to detect images generated by Jekyll.Comment: Published in proceedings of the 5th European Symposium on Security and Privacy (EuroS&P '20

A coupled ground heat flux-surface energy balance model of evaporation using thermal remote sensing observations

One of the major undetermined problems in evaporation (ET) retrieval using thermal infrared remote sensing is the lack of a physically based ground heat flux (G) model and its integration within the surface energy balance (SEB) equation. Here, we present a novel approach based on coupling a thermal inertia (TI)-based mechanistic G model with an analytical surface energy balance model, Surface Temperature Initiated Closure (STIC, version STIC1.2). The coupled model is named STIC-TI. The model is driven by noon–night (13:30 and 01:30 local time) land surface temperature, surface albedo, and a vegetation index from MODIS Aqua in conjunction with a clear-sky net radiation sub-model and ancillary meteorological information. SEB flux estimates from STIC-TI were evaluated with respect to the in situ fluxes from eddy covariance measurements in diverse ecosystems of contrasting aridity in both the Northern Hemisphere and Southern Hemisphere. Sensitivity analysis revealed substantial sensitivity of STIC-TI-derived fluxes due to the land surface temperature uncertainty. An evaluation of noontime G (Gi) estimates showed 12 %–21 % error across six flux tower sites, and a comparison between STIC-TI versus empirical G models also revealed the substantially better performance of the former. While the instantaneous noontime net radiation (RNi) and latent heat flux (LEi) were overestimated (15 % and 25 %), sensible heat flux (Hi) was underestimated (22 %). Overestimation (underestimation) of LEi (Hi) was associated with the overestimation of net available energy (RNi−Gi) and use of unclosed surface energy balance flux measurements in LEi (Hi) validation. The mean percent deviations in Gi and Hi estimates were found to be strongly correlated with satellite day–night view angle difference in parabolic and linear pattern, and a relatively weak correlation was found between day–night view angle difference versus LEi deviation. Findings from this parameter-sparse coupled G–ET model can make a valuable contribution to mapping and monitoring the spatiotemporal variability of ecosystem water stress and evaporation using noon–night thermal infrared observations from future Earth observation satellite missions such as TRISHNA, LSTM, and SBG

Spatial Disaggregation of Latent Heat Flux Using Contextual Models over India

Estimation of latent heat flux at the agricultural field scale is required for proper water management. The current generation thermal sensors except Landsat-8 provide data on the order of 1000 m. The aim of this study is to test three approaches based on contextual models using only remote sensing datasets for the disaggregation of latent heat flux over India. The first two approaches are, respectively, based on the estimation of the evaporative fraction (EF) and solar radiation ratio at coarser resolution and disaggregating them to yield the latent heat flux at a finer resolution. The third approach is based on disaggregation of the thermal data and estimating a finer resolution latent heat flux. The three approaches were tested using MODIS datasets and the validation was done using the Bowen Ratio energy balance observations at five sites across India. From the validation, it was observed that the first two approaches performed similarly and better than the third approach at all five sites. The third approach, based on the disaggregation of the thermal data, yielded larger errors. In addition to better performance, the second approach based on the disaggregation of solar radiation ratio was simpler and required lesser data processing than the other approaches. In addition, the first two approaches captured the spatial pattern of latent heat flux without introducing any artefacts in the final output

A hyperspectral R based leaf area index estimator: model development and implementation using AVIRIS-NG

Hyperspectral Remote Sensing (HRS) data is vital for crop growth monitoring due to availability of contiguous bands. This research work provides a new novel crop estimator model given the name “Crop Stage estimator” developed using the HRS data on an open-source R platform. The generic model structure provides an easy way to test and modify the importance of crop parameter namely Leaf Area Index to deduce crop growth stages of winter wheat (Triticum aestivum L.) particularly during –heading, tillering and booting. Further, to know the LAI variations at different agriculture sites, the best model was implemented using the AVIRIS-NG (Airborne Visible Near-Infrared Imaging Spectrometer - Next Generation) hyperspectral datasets. The analysis indicates that during tillering stage the performance was found best during calibration (r = 0.66, RMSE =0.40, and Bias =-0.80) and validation (r = 0.98, RMSE =0.20, and Bias =0.12) in comparison to the ground measurements

A heuristic approach of radiometric calibration for ocean colour sensors

Ocean colour spectral observations play a significant contribution in mapping the earth marine resources through measurements with its inverted geo-physical/bio-physical parameters.The retrieval of parameters from the basic sensor measurements highly depend on atmospheric scattering and absorption of light energy by its constituents. Hence the quantitative applications using these datasets directly affected by the uncertainty in radiative transfer modeling towards atmospheric scattering and absorption and associated sensor degradation with time. Here authors presented an automation of radiometric calibration approach for ocean colour monitor of Oceansat-II (Jan 2017 - Dec 2017) dataset through top of the atmosphere radiance simulation, a non-linear optimization technique. This algorithm also provides an alternative approach of calibrating the sensor vicariously through reduced dependency of systematic congruent in-situ measurements. Kavaratti in Lakshadweep, India is already a well-known site for calibrating the ocean colour sensors. The OCM cloud free images over this calibration site are utilized to perform its radiometric assessment for the year 2017 using radiative transfer model coupled with bio-optical model where the synchronous, relevant model inputs are simulated. </p

Not Available

Not AvailableA field experiment was conducted in 2015 to study the land surface energy fluxes from tropical lowland rice paddy in eastern India with an objective to determine the mass, momentum, and energy exchange rates between rice paddies and the atmosphere. All the land surface energy fluxesweremeasured by eddy covariance (EC) system(make Campbell Scientific) in dry season (DS, 1–125 Julian days), dry fallow (DF, 126–181 Julian days), wet season (WS, 182–324 Julian days), and wet fallow (WF, 325–365 Julian days). The rice was cultivated in dry season (January–May) and wet season (July–November) in low wet lands and the ground is kept fallow during the remainder of the year. Results showed that albedo varied from 0.09 to 0.24 and showed positive value from morning 6:00 h until evening 18:00 h. Mean soil temperature (Tg) was highest in DF, while the skin temperature (Ts) was highest in WS. Average Bowen ratio (B) ranged from 0.21 to 0.64 and large variation in B was observed during the fallow periods as compared to the cropping seasons. The magnitude of aerodynamic, canopy, and climatological resistances increased with the progress of cropping season and their magnitudes decreased during the end of both cropping seasons and found minimum during the fallow periods. At a constant vapor pressure deficit (VPD) at 0.16, 0.18, 0.15, and 0.43 kPa, latent heat flux (LE) initially increased, but later it tended to level off with an increase in VPD. The actual evapotranspiration (ETa) during both the cropping seasons was higher than the fallow period. This study can be used as a source of default values for many land surface energy fluxes which are required in various meteorological or air-quality models for rice paddies. A larger imbalance of energy was observed during the wet season as the energy is stored and perhaps advected in the fresh water.Not Availabl