Seeing Tree Structure from Vibration

Humans recognize object structure from both their appearance and motion; often, motion helps to resolve ambiguities in object structure that arise when we observe object appearance only. There are particular scenarios, however, where neither appearance nor spatial-temporal motion signals are informative: occluding twigs may look connected and have almost identical movements, though they belong to different, possibly disconnected branches. We propose to tackle this problem through spectrum analysis of motion signals, because vibrations of disconnected branches, though visually similar, often have distinctive natural frequencies. We propose a novel formulation of tree structure based on a physics-based link model, and validate its effectiveness by theoretical analysis, numerical simulation, and empirical experiments. With this formulation, we use nonparametric Bayesian inference to reconstruct tree structure from both spectral vibration signals and appearance cues. Our model performs well in recognizing hierarchical tree structure from real-world videos of trees and vessels.Comment: ECCV 2018. The first two authors contributed equally to this work. Project page: http://tree.csail.mit.edu

Towards Standardization of Retinal Vascular Measurements:On the Effect of Image Centering

Within the general framework of consistent and reproducible morphometric measurements of the retinal vasculature in fundus images, we present a quantitative pilot study of the changes in measurements commonly used in retinal biomarker studies (e.g. caliber-related, tortuosity and fractal dimension of the vascular network) induced by centering fundus image acquisition on either the optic disc or on the macula. To our best knowledge, no such study has been reported so far. Analyzing 149 parameters computed from 80 retinal images (20 subjects, right and left eye, optic-disc and macula centered), we find strong variations and limited concordance in images of the two types. Although analysis of larger cohorts is obviously necessary, our results strengthen the need for a structured investigation into the uncertainty of retinal vasculature measurements, ideally in the framework of an international debate on standardization.</p

An Elastic Interaction-Based Loss Function for Medical Image Segmentation

Deep learning techniques have shown their success in medical image segmentation since they are easy to manipulate and robust to various types of datasets. The commonly used loss functions in the deep segmentation task are pixel-wise loss functions. This results in a bottleneck for these models to achieve high precision for complicated structures in biomedical images. For example, the predicted small blood vessels in retinal images are often disconnected or even missed under the supervision of the pixel-wise losses. This paper addresses this problem by introducing a long-range elastic interaction-based training strategy. In this strategy, convolutional neural network (CNN) learns the target region under the guidance of the elastic interaction energy between the boundary of the predicted region and that of the actual object. Under the supervision of the proposed loss, the boundary of the predicted region is attracted strongly by the object boundary and tends to stay connected. Experimental results show that our method is able to achieve considerable improvements compared to commonly used pixel-wise loss functions (cross entropy and dice Loss) and other recent loss functions on three retinal vessel segmentation datasets, DRIVE, STARE and CHASEDB1

The Unreasonable Effectiveness of Encoder-Decoder Networks for Retinal Vessel Segmentation

We propose an encoder-decoder framework for the segmentation of blood vessels in retinal images that relies on the extraction of large-scale patches at multiple image-scales during training. Experiments on three fundus image datasets demonstrate that this approach achieves state-of-the-art results and can be implemented using a simple and efficient fully-convolutional network with a parameter count of less than 0.8M. Furthermore, we show that this framework - called VLight - avoids overfitting to specific training images and generalizes well across different datasets, which makes it highly suitable for real-world applications where robustness, accuracy as well as low inference time on high-resolution fundus images is required

Patch-Based Generative Adversarial Network Towards Retinal Vessel Segmentation

Retinal blood vessels are considered to be the reliable diagnostic biomarkers of ophthalmologic and diabetic retinopathy. Monitoring and diagnosis totally depends on expert analysis of both thin and thick retinal vessels which has recently been carried out by various artificial intelligent techniques. Existing deep learning methods attempt to segment retinal vessels using a unified loss function optimized for both thin and thick vessels with equal importance. Due to variable thickness, biased distribution, and difference in spatial features of thin and thick vessels, unified loss function are more influential towards identification of thick vessels resulting in weak segmentation. To address this problem, a conditional patch-based generative adversarial network is proposed which utilizes a generator network and a patch-based discriminator network conditioned on the sample data with an additional loss function to learn both thin and thick vessels. Experiments are conducted on publicly available STARE and DRIVE datasets which show that the proposed model outperforms the state-of-the-art methods

Modeling, simulation and forecasting of wind power plants using agent-based approach

© 2020 Elsevier Ltd National economy and growth rely heavily on electricity but rapid urbanization, expeditious industrialization and increased domestic use due to population growth are among the reasons for the severe energy crisis in developing countries. The extended demand-supply gaps, depleting reservoirs of fossil fuel, and the environmental hazards altogether ignite the need for wider adoption of renewable energy resources for electricity generation. A functional assessment of the engineering design for this transition is a prerequisite before proceeding to on-ground implementation due to its high impact on system sustainability. To this end, we propose an agent-based modeling and simulation framework for the rapid prototyping of wind power plants. The proposed approach abstracts active components of wind power plants using agents and implements their dynamic behavior through agent interactions. The proposed model helps in composing different model components, design valuation, and forecasting energy generation in a cost-effective and productive manner. The proposed model is demonstrated by conceptualizing the design of the Foundation Wind Energy plant, located at Sindh, Pakistan, and the development of its agent-based model. The obtained short-term and long-term electricity generation profiles are validated with the actual data. We further compared the forecasts with the time series analysis performed on the actual data, using five different time-series forecasting models. The proposed simulation model and time series analysis model fit well on the actual data with a root mean square deviation of approximately 9 MW. The proposed framework will assist the policymakers in estimating the extent of electrical energy produced at given conditions using the wind potential available at the corridors of any country. It will further aid in the realistic analysis of the future dynamics of electricity demand and supply, hence help in effective energy planning