PlaNet - Photo Geolocation with Convolutional Neural Networks

Is it possible to build a system to determine the location where a photo was taken using just its pixels? In general, the problem seems exceptionally difficult: it is trivial to construct situations where no location can be inferred. Yet images often contain informative cues such as landmarks, weather patterns, vegetation, road markings, and architectural details, which in combination may allow one to determine an approximate location and occasionally an exact location. Websites such as GeoGuessr and View from your Window suggest that humans are relatively good at integrating these cues to geolocate images, especially en-masse. In computer vision, the photo geolocation problem is usually approached using image retrieval methods. In contrast, we pose the problem as one of classification by subdividing the surface of the earth into thousands of multi-scale geographic cells, and train a deep network using millions of geotagged images. While previous approaches only recognize landmarks or perform approximate matching using global image descriptors, our model is able to use and integrate multiple visible cues. We show that the resulting model, called PlaNet, outperforms previous approaches and even attains superhuman levels of accuracy in some cases. Moreover, we extend our model to photo albums by combining it with a long short-term memory (LSTM) architecture. By learning to exploit temporal coherence to geolocate uncertain photos, we demonstrate that this model achieves a 50% performance improvement over the single-image model

From Multiview Image Curves to 3D Drawings

Reconstructing 3D scenes from multiple views has made impressive strides in recent years, chiefly by correlating isolated feature points, intensity patterns, or curvilinear structures. In the general setting - without controlled acquisition, abundant texture, curves and surfaces following specific models or limiting scene complexity - most methods produce unorganized point clouds, meshes, or voxel representations, with some exceptions producing unorganized clouds of 3D curve fragments. Ideally, many applications require structured representations of curves, surfaces and their spatial relationships. This paper presents a step in this direction by formulating an approach that combines 2D image curves into a collection of 3D curves, with topological connectivity between them represented as a 3D graph. This results in a 3D drawing, which is complementary to surface representations in the same sense as a 3D scaffold complements a tent taut over it. We evaluate our results against truth on synthetic and real datasets.Comment: Expanded ECCV 2016 version with tweaked figures and including an overview of the supplementary material available at multiview-3d-drawing.sourceforge.ne

Single-Image Depth Prediction Makes Feature Matching Easier

Good local features improve the robustness of many 3D re-localization and multi-view reconstruction pipelines. The problem is that viewing angle and distance severely impact the recognizability of a local feature. Attempts to improve appearance invariance by choosing better local feature points or by leveraging outside information, have come with pre-requisites that made some of them impractical. In this paper, we propose a surprisingly effective enhancement to local feature extraction, which improves matching. We show that CNN-based depths inferred from single RGB images are quite helpful, despite their flaws. They allow us to pre-warp images and rectify perspective distortions, to significantly enhance SIFT and BRISK features, enabling more good matches, even when cameras are looking at the same scene but in opposite directions.Comment: 14 pages, 7 figures, accepted for publication at the European conference on computer vision (ECCV) 202

Reanalysis in Earth System Science: Towards Terrestrial Ecosystem Reanalysis

A reanalysis is a physically consistent set of optimally merged simulated model states and historical observational data, using data assimilation. High computational costs for modelled processes and assimilation algorithms has led to Earth system specific reanalysis products for the atmosphere, the ocean and the land separately. Recent developments include the advanced uncertainty quantification and the generation of biogeochemical reanalysis for land and ocean. Here, we review atmospheric and oceanic reanalyses, and more in detail biogeochemical ocean and terrestrial reanalyses. In particular, we identify land surface, hydrologic and carbon cycle reanalyses which are nowadays produced in targeted projects for very specific purposes. Although a future joint reanalysis of land surface, hydrologic and carbon processes represents an analysis of important ecosystem variables, biotic ecosystem variables are assimilated only to a very limited extent. Continuous data sets of ecosystem variables are needed to explore biotic-abiotic interactions and the response of ecosystems to global change. Based on the review of existing achievements, we identify five major steps required to develop terrestrial ecosystem reanalysis to deliver continuous data streams on ecosystem dynamics

Platelet Function in Acute Experimental Pancreatitis

Acute pancreatitis (AP) is characterized by disturbances of pancreatic microcirculation. It remains unclear whether platelets contribute to these perfusion disturbances. The aim of our study was to investigate platelet activation and function in experimental AP. Acute pancreatitis was induced in rats: (1) control (n = 18; Ringer’s solution), (2) mild AP (n = 18; cerulein), and (3) severe AP (n = 18; glycodeoxycholic acid (GDOC) + cerulein). After 12 h, intravital microscopy was performed. Rhodamine-stained platelets were used to investigate velocity and endothelial adhesion in capillaries and venules. In addition, erythrocyte velocity and leukocyte adhesion were evaluated. Serum amylase, thromboxane A2, and histology were evaluated after 24 h in additional animals of each group. Results showed that 24 h after cerulein application, histology exhibited a mild AP, whereas GDOC induced severe necrotizing AP. Intravital microscopy showed significantly more platelet–endothelium interaction, reduced erythrocyte velocity, and increased leukocyte adherence in animals with AP compared to control animals. Thromboxane levels were significantly elevated in all AP animals and correlated with the extent of platelet activation and severity of AP. In conclusion, platelet activation plays an important role in acute, especially necrotizing, pancreatitis. Mainly temporary platelet–endothelium interaction is observed during mild AP, whereas severe AP is characterized by firm adhesion with consecutive coagulatory activation and perfusion failure

Clinical risk factors for age-related macular degeneration: a systematic review and meta-analysis

BACKGROUND: Age-related macular degeneration (AMD) is the leading cause of blindness in Western countries. Numerous risk factors have been reported but the evidence and strength of association is variable. We aimed to identify those risk factors with strong levels of evidence which could be easily assessed by physicians or ophthalmologists to implement preventive interventions or address current behaviours. METHODS: A systematic review identified 18 prospective and cross-sectional studies and 6 case control studies involving 113,780 persons with 17,236 cases of late AMD that included an estimate of the association between late AMD and at least one of 16 pre-selected risk factors. Fixed-effects meta-analyses were conducted for each factor to combine odds ratio (OR) and/or relative risk (RR) outcomes across studies by study design. Overall raw point estimates of each risk factor and associated 95% confidence intervals (CI) were calculated. RESULTS: Increasing age, current cigarette smoking, previous cataract surgery, and a family history of AMD showed strong and consistent associations with late AMD. Risk factors with moderate and consistent associations were higher body mass index, history of cardiovascular disease, hypertension, and higher plasma fibrinogen. Risk factors with weaker and inconsistent associations were gender, ethnicity, diabetes, iris colour, history of cerebrovascular disease, and serum total and HDL cholesterol and triglyceride levels. CONCLUSIONS: Smoking, previous cataract surgery and a family history of AMD are consistent risk factors for AMD. Cardiovascular risk factors are also associated with AMD. Knowledge of these risk factors that may be easily assessed by physicians and general ophthalmologists may assist in identification and appropriate referral of persons at risk of AMD

Urban structure and dengue incidence in Puntarenas, Costa Rica

Dengue is currently the most important arboviral disease globally and is usually associated with built environments in tropical areas. Remotely sensed information can facilitate the study of urban mosquito-borne diseases by providing multiple temporal and spatial resolutions appropriate to investigate urban structure and ecological characteristics associated with infectious disease. In this study, coarse, medium and fine resolution satellite imagery (Moderate Resolution Imaging Spec- trometer, Advanced Spaceborne Thermal Emission and Reflection Radiometer and QuickBird respectively) and ground-based data were analyzed for the Greater Puntarenas area, Costa Rica for the years 2002–04. The results showed that the mean normalized difference vegetation index (NDVI) was generally higher in the localities with lower incidence of dengue fever during 2002, although the correlation was statistically significant only in the dry season (r=-0.40; p=0.03). Dengue incidence was inversely correlated to built area and directly correlated with tree cover (r=0.75, p=0.01). Overall, the significant correlations between dengue incidence and urban structural variables (tree cover and building density) suggest that properties of urban structure may be associated with dengue incidence in tropical urban settings.National Institutes of Health/[P20RR020770]/NIH/Estados UnidosUniversity of Miami/[]/UM/Estados UnidosUniversidad de Costa Rica/[803-A6-401]/UCR/Costa RicaUCR::Vicerrectoría de Docencia::Salud::Facultad de MicrobiologíaUCR::Vicerrectoría de Investigación::Unidades de Investigación::Ciencias de la Salud::Centro de Investigación en Enfermedades Tropicales (CIET