Developing a Machine Learning Algorithm for Outdoor Scene Image Segmentation

Image segmentation is one of the major problems in image processing, computer vision and machine learning fields. The main reason for image segmentation existence is to reduce the gap between computer vision and human vision by training computers with different data. Outdoor image segmentation and classification has become very important in the field of computer vision with its applications in woodland-surveillance, defence and security. The task of assigning an input image to one class from a fixed set of categories seem to be a major problem in image segmentation. The main question that has been addressed in this research is how outdoor image classification algorithms can be improved using Region-based Convolutional Neural Network (R-CNN) architecture. There has been no one segmentation method that works best on any given problem. To determine the best segmentation method for a certain dataset, various tests have to be done in order to achieve the best performance. However deep learning models have often achieved increasing success due to the availability of massive datasets and the expanding model depth and parameterisation. In this research Convolutional Neural Network architecture is used in trying to improve the implementation of outdoor scene image segmentation algorithms, empirical research method was used to answer questions about existing image segmentation algorithms and the techniques used to achieve the best performance. Outdoor scene images were trained on a pre-trained region-based convolutional neural network with Visual Geometric Group-16 (VGG-16) architecture. A pre-trained R-CNN model was retrained on five different sample data, the samples had different sizes. Sample size increased from sample one to five, to increase the size on the last two samples the data was duplicated. 21 test images were used to evaluate all the models. Researchers has shown that deep learning methods perform better in image segmentation because of the increase and availability of datasets. The duplication of images did not yield the best results; however, the model performed well on the first three samples

Plataforma de análisis de imágenes satelitales para el descubrimiento de recursos hídricos mediante la aplicación de técnicas basadas en inteligencia artificial

[ES] España es el segundo país de Europa con más piscinas. Sin embargo, la literatura jurídica estima que el 20% de las piscinas no están declaradas de forma legal o son irregulares. La Administración cuenta con un cuerpo de personas que analizan mediante procedimientos manuales, imágenes de satélite o de drones para detectar estructuras ilegales o irregulares. Este método es costoso en términos de esfuerzo, implicación de recursos humanos y tiempo, además de ser un método basado en la subjetividad de la persona que lo lleva a cabo. La propuesta de este trabajo de investigación pretende diseñar una plataforma basada en sistemas multiagente que incluya técnicas de visión artificial y que permita la detección automática de estructuras ilegales, pudiendo destacar, por ejemplo, la detección de balsas irregulares. Para la consecución exitosa de este trabajo, se emplearán herramientas de información geográfica (SIG) basadas en ortofotografía, combinadas con técnicas avanzadas de visión artificial basadas en redes convolucionales para la detección de objetos. Además, el uso de una arquitectura multiagente permitirá que el sistema diseñado sea modular, con la posibilidad de que las diferentes partes del sistema trabajen conjuntamente, equilibrando la carga de trabajo. El sistema propuesto ha sido validado mediante pruebas en diferentes ciudades de España. El sistema ha mostrado resultados prometedores en la realización de esta tarea, con una tasa de acuerdo superior al 97%. [EN] Spain stands as the second-ranked European nation in terms of the abundance of swimming pools. However, it has come to light in legal circles that a substantial 20% of these aquatic facilities either evade declaration or exist in an irregular manner. To tackle this issue, the governing bodies employ a team of individuals who manually scrutinize satellite and drone imagery. Their objective is to pinpoint structures that run afoul of legality or convention. This approach demands significant expenditure of both labor and time, compounded by the inherent subjectivity associated with human interpretation. This proposal sets forth the ambition to craft a platform capable of autonomously identifying aberrant pools. This endeavor draws upon geographical information systems (GIS) grounded in orthophotography, coupled with cutting-edge machine learning methodologies for precise object detection. Moreover, a multi-agent architecture comes into play, introducing modularity into the system's framework. This modular design facilitates the collaborative functioning of distinct system components, enabling the equitable distribution of workloads. The efficacy of the proposed system has been established through rigorous testing across various municipalities in Spain. Encouragingly, the system has yielded promising outcomes in its execution of this task, boasting an impressive F1-Score of 97.1