An Evaluation of Stereo and Multiview Algorithms for 3d Reconstruction with Synthetic Data

The reconstruction of 3D scenes from images has usually been addressed with two different strategies, namely stereo and multi-view. The former requires rectified images and generates a disparity map, while the latter relies on the camera parameters and directly retrieves a depth map. For both cases, deep learning architectures have shown an outstanding performance. However, due to the differences between input and output data, the two strategies are difficult to compare on a common scene. Moreover, for remote sensing applications multi-view data is hard to acquire and the ground truth is either sparse or affected by outliers. Hence, in this article we evaluate the performance of stereo and multi-view architectures trained on synthetic data resembling remote sensing images. The data has been and processed and organized to be compatible with both kind of neural networks. For a fair comparison, training and testing are done only with two views. We focus on the accuracy of the reconstruction, as well as the impact of the depth range and the baseline of the stereo array. Results are presented for deep learning architectures and non-learning algorithms

SyntCities: A Large Synthetic Remote Sensing Dataset for Disparity Estimation

Studies in the last years have proved the outstanding performance of deep learning for computer vision tasks in the remote sensing field, such as disparity estimation. However, available datasets mostly focus on close-range applications like autonomous driving or robot manipulation. To reduce the domain gap while training we present SyntCities, a synthetic dataset resembling the aerial imagery on urban areas. The pipeline used to render the images is based on 3-D modeling, which helps to avoid acquisition costs, provides subpixel accurate dense ground truth and simulates different illumination conditions. The dataset additionally provides multiclass semantic maps and can be converted to point cloud format to benefit a wider research community. We focus on the task of disparity estimation and evaluate the performance of the traditional semiglobal matching and state-of-the-art architectures, trained with SyntCities and other datasets, on real aerial and satellite images. A comparison with the widely used SceneFlow dataset is also presented. Strategies using a mixture of both real and synthetic samples are studied as well. Results show significant improvements in terms of accuracy for the disparity maps

Roof3D: A Real and Synthetic Data Collection for Individual Building Roof Plane and Building Sections Detection

Deep learning is a powerful tool to extract both individual building and roof plane polygons. But deep learning requires a large amount of labeled data. Hence, publicly available level of detail (LoD)-2 datasets are a natural choice to train fully convolutional neural networks (FCNs) models for both building section and roof plane instance segmentation. Since publicly available datasets are often utomatically derived, e.g. based on laser scanning, they lack on annotation accuracy. To complement such a dataset, we introduce manually annotated and synthetically generated data. Manually annotated data is domain-specific and has a high annotation quality but is expensive to obtain. Synthetically generated data has high-quality annotations by definition, but lacks domain-specificity. Moreover, we not only detect individual building section instances, but also roof plane instances. We predict separations not only between individual buildings, but also by a class that describes the line which separates roof planes. The predicted building and roof plane instances are polygonized by a simple tree search algorithm. To achieve more regular polygons, we utilize the Douglas-Peucker polygon simplification algorithm. We describe our dataset in detail to allow comparability between successive methods. To facilitate future works in building and roof plane prediction, our Roof3D dataset is accessible at https: //github.com/dlrPHS/GPUB

SAR-to-Optical Image Translation Based on Conditional Generative Adversarial Networks - Optimization, Opportunities and Limits

Due to its all time capability, synthetic aperture radar (SAR) remote sensing plays an important role in Earth observation. The ability to interpret the data is limited, even for experts, as the human eye is not familiar to the impact of distance-dependent imaging, signal intensities detected in the radar spectrum as well as image characteristics related to speckle or steps of post-processing. This paper is concerned with machine learning for SAR-to-optical image-to-image translation in order to support the interpretation and analysis of original data. A conditional adversarial network is adopted and optimized in order to generate alternative SAR image representations based on the combination of SAR images (starting point) and optical images (reference) for training. Following this strategy, the focus is set on the value of empirical knowledge for initialization, the impact of results on follow-up applications, and the discussion of opportunities/drawbacks related to this application of deep learning. Case study results are shown for high resolution (SAR: TerraSAR-X, optical: ALOS PRISM) and low resolution (Sentinel-1 and -2) data. The properties of the alternative image representation are evaluated based on feedback from experts in SAR remote sensing and the impact on road extraction as an example for follow-up applications. The results provide the basis to explain fundamental limitations affecting the SAR-to-optical image translation idea but also indicate benefits from alternative SAR image representations

GA-Net-Pyramid: An Efficient End-to-End Network for Dense Matching

Dense matching plays a crucial role in computer vision and remote sensing, to rapidly provide stereo products using inexpensive hardware. Along with the development of deep learning, the Guided Aggregation Network (GA-Net) achieves state-of-the-art performance via the proposed Semi-Global Guided Aggregation layers and reduces the use of costly 3D convolutional layers. To solve the problem of GA-Net requiring large GPU memory consumption, we design a pyramid architecture to modify the model. Starting from a downsampled stereo input, the disparity is estimated and continuously refined through the pyramid levels. Thus, the disparity search is only applied for a small size of stereo pair and then confined within a short residual range for minor correction, leading to highly reduced memory usage and runtime. Tests on close-range, aerial, and satellite data demonstrate that the proposed algorithm achieves significantly higher efficiency (around eight times faster consuming only 20–40% GPU memory) and comparable results with GA-Net on remote sensing data. Thanks to this coarse-to-fine estimation, we successfully process remote sensing datasets with very large disparity ranges, which could not be processed with GA-Net due to GPU memory limitations

A 2D/3D multimodal data simulation approach with applications on urban semantic segmentation, building extraction and change detection

Advances in remote sensing image processing techniques have further increased the demand for annotated datasets. However, preparing annotated multi-temporal 2D/3D multimodal data is especially challenging, both for the increased costs of the annotation step and the lack of multimodal acquisitions available on the same area. We introduce the Simulated Multimodal Aerial Remote Sensing (SMARS) dataset, a synthetic dataset aimed at the tasks of urban semantic segmentation, change detection, and building extraction, along with a description of the pipeline to generate them and the parameters required to set our rendering. Samples in the form of orthorectified photos, digital surface models and ground truth for all the tasks are provided. Unlike existing datasets, orthorectified images and digital surface models are derived from synthetic images using photogrammetry, yielding more realistic simulations of the data. The increased size of SMARS, compared to available datasets of this kind, facilitates both traditional and deep learning algorithms. Reported experiments from state-of-the-art algorithms on SMARS scenes yield satisfactory results, in line with our expectations. Both benefits of the SMARS datasets and constraints imposed by its use are discussed. Specifically, building detection on the SMARS-real Potsdam cross-domain test demonstrates the quality and the advantages of proposed synthetic data generation workflow. SMARS is published as an ISPRS benchmark dataset and can be downloaded from https://www2.isprs.org/commissions/comm1/wg8/benchmark_smar

Direct Polyphenol Attachment on the Surfaces of Magnetite Nanoparticles, Using Vitis vinifera, Vaccinium corymbosum, or Punica granatum

This study presents an alternative approach to directly synthesizing magnetite nanoparticles (MNPs) in the presence of Vitis vinifera, Vaccinium corymbosum, and Punica granatum derived from natural sources (grapes, blueberries, and pomegranates, respectively). A modified co-precipitation method that combines phytochemical techniques was developed to produce semispherical MNPs that range in size from 7.7 to 8.8 nm and are coated with a ~1.5 nm thick layer of polyphenols. The observed structure, composition, and surface properties of the MNPs@polyphenols demonstrated the dual functionality of the phenolic groups as both reducing agents and capping molecules that are bonding with Fe ions on the surfaces of the MNPs via –OH groups. Magnetic force microscopy images revealed the uniaxial orientation of single magnetic domains (SMDs) associated with the inverse spinel structure of the magnetite (Fe3O4). The samples’ inductive heating (H0 = 28.9 kA/m, f = 764 kHz), measured via the specific loss power (SLP) of the samples, yielded values of up to 187.2 W/g and showed the influence of the average particle size. A cell viability assessment was conducted via the MTT and NRu tests to estimate the metabolic and lysosomal activities of the MNPs@polyphenols in K562 (chronic myelogenous leukemia, ATCC) cells

Antimicrobial resistance among migrants in Europe: a systematic review and meta-analysis

BACKGROUND: Rates of antimicrobial resistance (AMR) are rising globally and there is concern that increased migration is contributing to the burden of antibiotic resistance in Europe. However, the effect of migration on the burden of AMR in Europe has not yet been comprehensively examined. Therefore, we did a systematic review and meta-analysis to identify and synthesise data for AMR carriage or infection in migrants to Europe to examine differences in patterns of AMR across migrant groups and in different settings. METHODS: For this systematic review and meta-analysis, we searched MEDLINE, Embase, PubMed, and Scopus with no language restrictions from Jan 1, 2000, to Jan 18, 2017, for primary data from observational studies reporting antibacterial resistance in common bacterial pathogens among migrants to 21 European Union-15 and European Economic Area countries. To be eligible for inclusion, studies had to report data on carriage or infection with laboratory-confirmed antibiotic-resistant organisms in migrant populations. We extracted data from eligible studies and assessed quality using piloted, standardised forms. We did not examine drug resistance in tuberculosis and excluded articles solely reporting on this parameter. We also excluded articles in which migrant status was determined by ethnicity, country of birth of participants' parents, or was not defined, and articles in which data were not disaggregated by migrant status. Outcomes were carriage of or infection with antibiotic-resistant organisms. We used random-effects models to calculate the pooled prevalence of each outcome. The study protocol is registered with PROSPERO, number CRD42016043681. FINDINGS: We identified 2274 articles, of which 23 observational studies reporting on antibiotic resistance in 2319 migrants were included. The pooled prevalence of any AMR carriage or AMR infection in migrants was 25·4% (95% CI 19·1-31·8; I2 =98%), including meticillin-resistant Staphylococcus aureus (7·8%, 4·8-10·7; I2 =92%) and antibiotic-resistant Gram-negative bacteria (27·2%, 17·6-36·8; I2 =94%). The pooled prevalence of any AMR carriage or infection was higher in refugees and asylum seekers (33·0%, 18·3-47·6; I2 =98%) than in other migrant groups (6·6%, 1·8-11·3; I2 =92%). The pooled prevalence of antibiotic-resistant organisms was slightly higher in high-migrant community settings (33·1%, 11·1-55·1; I2 =96%) than in migrants in hospitals (24·3%, 16·1-32·6; I2 =98%). We did not find evidence of high rates of transmission of AMR from migrant to host populations. INTERPRETATION: Migrants are exposed to conditions favouring the emergence of drug resistance during transit and in host countries in Europe. Increased antibiotic resistance among refugees and asylum seekers and in high-migrant community settings (such as refugee camps and detention facilities) highlights the need for improved living conditions, access to health care, and initiatives to facilitate detection of and appropriate high-quality treatment for antibiotic-resistant infections during transit and in host countries. Protocols for the prevention and control of infection and for antibiotic surveillance need to be integrated in all aspects of health care, which should be accessible for all migrant groups, and should target determinants of AMR before, during, and after migration. FUNDING: UK National Institute for Health Research Imperial Biomedical Research Centre, Imperial College Healthcare Charity, the Wellcome Trust, and UK National Institute for Health Research Health Protection Research Unit in Healthcare-associated Infections and Antimictobial Resistance at Imperial College London

The EC-Earth3 Earth system model for the Coupled Model Intercomparison Project 6

The Earth system model EC-Earth3 for contributions to CMIP6 is documented here, with its flexible coupling framework, major model configurations, a methodology for ensuring the simulations are comparable across different high-performance computing (HPC) systems, and with the physical performance of base configurations over the historical period. The variety of possible configurations and sub-models reflects the broad interests in the EC-Earth community. EC-Earth3 key performance metrics demonstrate physical behavior and biases well within the frame known from recent CMIP models. With improved physical and dynamic features, new Earth system model (ESM) components, community tools, and largely improved physical performance compared to the CMIP5 version, EC-Earth3 represents a clear step forward for the only European community ESM. We demonstrate here that EC-Earth3 is suited for a range of tasks in CMIP6 and beyond.Peer reviewe

First Latin American clinical practice guidelines for the treatment of systemic lupus erythematosus: Latin American Group for the Study of Lupus (GLADEL, Grupo Latino Americano de Estudio del Lupus)-Pan-American League of Associations of Rheumatology (PANLAR)

Systemic lupus erythematosus (SLE), a complex and heterogeneous autoimmune disease, represents a significant challenge for both diagnosis and treatment. Patients with SLE in Latin America face special problems that should be considered when therapeutic guidelines are developed. The objective of the study is to develop clinical practice guidelines for Latin American patients with lupus. Two independent teams (rheumatologists with experience in lupus management and methodologists) had an initial meeting in Panama City, Panama, in April 2016. They selected a list of questions for the clinical problems most commonly seen in Latin American patients with SLE. These were addressed with the best available evidence and summarised in a standardised format following the Grading of Recommendations Assessment, Development and Evaluation approach. All preliminary findings were discussed in a second face-to-face meeting in Washington, DC, in November 2016. As a result, nine organ/system sections are presented with the main findings; an 'overarching' treatment approach was added. Special emphasis was made on regional implementation issues. Best pharmacologic options were examined for musculoskeletal, mucocutaneous, kidney, cardiac, pulmonary, neuropsychiatric, haematological manifestations and the antiphospholipid syndrome. The roles of main therapeutic options (ie, glucocorticoids, antimalarials, immunosuppressant agents, therapeutic plasma exchange, belimumab, rituximab, abatacept, low-dose aspirin and anticoagulants) were summarised in each section. In all cases, benefits and harms, certainty of the evidence, values and preferences, feasibility, acceptability and equity issues were considered to produce a recommendation with special focus on ethnic and socioeconomic aspects. Guidelines for Latin American patients with lupus have been developed and could be used in similar settings.Fil: Pons Estel, Bernardo A.. Centro Regional de Enfermedades Autoinmunes y Reumáticas; ArgentinaFil: Bonfa, Eloisa. Universidade de Sao Paulo; BrasilFil: Soriano, Enrique R.. Instituto Universitario Hospital Italiano de Buenos Aires. Rectorado.; ArgentinaFil: Cardiel, Mario H.. Centro de Investigación Clínica de Morelia; MéxicoFil: Izcovich, Ariel. Hospital Alemán; ArgentinaFil: Popoff, Federico. Hospital Aleman; ArgentinaFil: Criniti, Juan M.. Hospital Alemán; ArgentinaFil: Vásquez, Gloria. Universidad de Antioquia; ColombiaFil: Massardo, Loreto. Universidad San Sebastián; ChileFil: Duarte, Margarita. Hospital de Clínicas; ParaguayFil: Barile Fabris, Leonor A.. Hospital Angeles del Pedregal; MéxicoFil: García, Mercedes A.. Universidad de Buenos Aires. Facultad de Medicina. Hospital de Clínicas General San Martín; ArgentinaFil: Amigo, Mary Carmen. Centro Médico Abc; MéxicoFil: Espada, Graciela. Gobierno de la Ciudad de Buenos Aires. Hospital General de Niños "Ricardo Gutiérrez"; ArgentinaFil: Catoggio, Luis J.. Hospital Italiano. Instituto Universitario. Escuela de Medicina; ArgentinaFil: Sato, Emilia Inoue. Universidade Federal de Sao Paulo; BrasilFil: Levy, Roger A.. Universidade do Estado de Rio do Janeiro; BrasilFil: Acevedo Vásquez, Eduardo M.. Universidad Nacional Mayor de San Marcos; PerúFil: Chacón Díaz, Rosa. Policlínica Méndez Gimón; VenezuelaFil: Galarza Maldonado, Claudio M.. Corporación Médica Monte Sinaí; EcuadorFil: Iglesias Gamarra, Antonio J.. Universidad Nacional de Colombia; ColombiaFil: Molina, José Fernando. Centro Integral de Reumatología; ColombiaFil: Neira, Oscar. Universidad de Chile; ChileFil: Silva, Clóvis A.. Universidade de Sao Paulo; BrasilFil: Vargas Peña, Andrea. Hospital Pasteur Montevideo; UruguayFil: Gómez Puerta, José A.. Hospital Clinic Barcelona; EspañaFil: Scolnik, Marina. Instituto Universitario Hospital Italiano de Buenos Aires. Rectorado.; ArgentinaFil: Pons Estel, Guillermo J.. Centro Regional de Enfermedades Autoinmunes y Reumáticas; Argentina. Hospital Provincial de Rosario; ArgentinaFil: Ugolini Lopes, Michelle R.. Universidade de Sao Paulo; BrasilFil: Savio, Verónica. Instituto Universitario Hospital Italiano de Buenos Aires. Rectorado.; ArgentinaFil: Drenkard, Cristina. University of Emory; Estados UnidosFil: Alvarellos, Alejandro J.. Hospital Privado Universitario de Córdoba; ArgentinaFil: Ugarte Gil, Manuel F.. Universidad Cientifica del Sur; Perú. Hospital Nacional Guillermo Almenara Irigoyen; PerúFil: Babini, Alejandra. Instituto Universitario Hospital Italiano de Buenos Aires. Rectorado.; ArgentinaFil: Cavalcanti, André. Universidade Federal de Pernambuco; BrasilFil: Cardoso Linhares, Fernanda Athayde. Hospital Pasteur Montevideo; UruguayFil: Haye Salinas, Maria Jezabel. Hospital Privado Universitario de Córdoba; ArgentinaFil: Fuentes Silva, Yurilis J.. Universidad de Oriente - Núcleo Bolívar; VenezuelaFil: Montandon De Oliveira E Silva, Ana Carolina. Universidade Federal de Goiás; BrasilFil: Eraso Garnica, Ruth M.. Universidad de Antioquia; ColombiaFil: Herrera Uribe, Sebastián. Hospital General de Medellin Luz Castro de Gutiérrez; ColombiaFil: Gómez Martín, DIana. Instituto Nacional de la Nutrición Salvador Zubiran; MéxicoFil: Robaina Sevrini, Ricardo. Universidad de la República; UruguayFil: Quintana, Rosana M.. Hospital Provincial de Rosario; Argentina. Centro Regional de Enfermedades Autoinmunes y Reumáticas; ArgentinaFil: Gordon, Sergio. Hospital Interzonal General de Agudos Dr Oscar Alende. Unidad de Reumatología y Enfermedades Autoinmunes Sistémicas; ArgentinaFil: Fragoso Loyo, Hilda. Instituto Nacional de la Nutrición Salvador Zubiran; MéxicoFil: Rosario, Violeta. Hospital Docente Padre Billini; República DominicanaFil: Saurit, Verónica. Hospital Privado Universitario de Córdoba; ArgentinaFil: Appenzeller, Simone. Universidade Estadual de Campinas; BrasilFil: Dos Reis Neto, Edgard Torres. Universidade Federal de Sao Paulo; BrasilFil: Cieza, Jorge. Hospital Nacional Edgardo Rebagliati Martins; PerúFil: González Naranjo, Luis A.. Universidad de Antioquia; ColombiaFil: González Bello, Yelitza C.. Ceibac; MéxicoFil: Collado, María Victoria. Universidad de Buenos Aires. Facultad de Medicina. Instituto de Investigaciones Médicas; ArgentinaFil: Sarano, Judith. Universidad de Buenos Aires. Facultad de Medicina. Instituto de Investigaciones Médicas; ArgentinaFil: Retamozo, Maria Soledad. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Córdoba. Instituto de Investigaciones en Ciencias de la Salud. Universidad Nacional de Córdoba. Instituto de Investigaciones en Ciencias de la Salud; ArgentinaFil: Sattler, María E.. Provincia de Buenos Aires. Ministerio de Salud. Hospital Interzonal de Agudos "Eva Perón"; ArgentinaFil: Gamboa Cárdenas, Rocio V.. Hospital Nacional Guillermo Almenara Irigoyen; PerúFil: Cairoli, Ernesto. Universidad de la República; UruguayFil: Conti, Silvana M.. Hospital Provincial de Rosario; ArgentinaFil: Amezcua Guerra, Luis M.. Instituto Nacional de Cardiologia Ignacio Chavez; MéxicoFil: Silveira, Luis H.. Instituto Nacional de Cardiologia Ignacio Chavez; MéxicoFil: Borba, Eduardo F.. Universidade de Sao Paulo; BrasilFil: Pera, Mariana A.. Hospital Interzonal General de Agudos General San Martín; ArgentinaFil: Alba Moreyra, Paula B.. Universidad Nacional de Córdoba. Facultad de Medicina; ArgentinaFil: Arturi, Valeria. Hospital Interzonal General de Agudos General San Martín; ArgentinaFil: Berbotto, Guillermo A.. Provincia de Buenos Aires. Ministerio de Salud. Hospital Interzonal de Agudos "Eva Perón"; ArgentinaFil: Gerling, Cristian. Hospital Interzonal General de Agudos Dr Oscar Alende. Unidad de Reumatología y Enfermedades Autoinmunes Sistémicas; ArgentinaFil: Gobbi, Carla Andrea. Universidad Nacional de Córdoba. Facultad de Medicina; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; ArgentinaFil: Gervasoni, Viviana L.. Hospital Provincial de Rosario; ArgentinaFil: Scherbarth, Hugo R.. Hospital Interzonal General de Agudos Dr Oscar Alende. Unidad de Reumatología y Enfermedades Autoinmunes Sistémicas; ArgentinaFil: Brenol, João C. Tavares. Hospital de Clinicas de Porto Alegre; BrasilFil: Cavalcanti, Fernando. Universidade Federal de Pernambuco; BrasilFil: Costallat, Lilian T. Lavras. Universidade Estadual de Campinas; BrasilFil: Da Silva, Nilzio A.. Universidade Federal de Goiás; BrasilFil: Monticielo, Odirlei A.. Hospital de Clinicas de Porto Alegre; BrasilFil: Seguro, Luciana Parente Costa. Universidade de Sao Paulo; BrasilFil: Xavier, Ricardo M.. Hospital de Clinicas de Porto Alegre; BrasilFil: Llanos, Carolina. Universidad Católica de Chile; ChileFil: Montúfar Guardado, Rubén A.. Instituto Salvadoreño de la Seguridad Social; El SalvadorFil: Garcia De La Torre, Ignacio. Hospital General de Occidente; MéxicoFil: Pineda, Carlos. Instituto Nacional de Rehabilitación; MéxicoFil: Portela Hernández, Margarita. Umae Hospital de Especialidades Centro Medico Nacional Siglo Xxi; MéxicoFil: Danza, Alvaro. Hospital Pasteur Montevideo; UruguayFil: Guibert Toledano, Marlene. Medical-surgical Research Center; CubaFil: Reyes, Gil Llerena. Medical-surgical Research Center; CubaFil: Acosta Colman, Maria Isabel. Hospital de Clínicas; ParaguayFil: Aquino, Alicia M.. Hospital de Clínicas; ParaguayFil: Mora Trujillo, Claudia S.. Hospital Nacional Edgardo Rebagliati Martins; PerúFil: Muñoz Louis, Roberto. Hospital Docente Padre Billini; República DominicanaFil: García Valladares, Ignacio. Centro de Estudios de Investigación Básica y Clínica; MéxicoFil: Orozco, María Celeste. Instituto de Rehabilitación Psicofísica; ArgentinaFil: Burgos, Paula I.. Pontificia Universidad Católica de Chile; ChileFil: Betancur, Graciela V.. Instituto de Rehabilitación Psicofísica; ArgentinaFil: Alarcón, Graciela S.. Universidad Peruana Cayetano Heredia; Perú. University of Alabama at Birmingahm; Estados Unido