Evaluation of Spatial Generalization Characteristics of a Robust Classifier as Applied to Coral Reef Habitats in Remote Islands of the Pacific Ocean

This study was an evaluation of the spectral signature generalization properties of coral across four remote Pacific Ocean reefs. The sites under consideration have not been the subject of previous studies for coral classification using remote sensing data. Previous research regarding using remote sensing to identify reefs has been limited to in-situ assessment, with some researchers also performing temporal analysis of a selected area of interest. This study expanded the previous in-situ analyses by evaluating the ability of a basic predictor, Linear Discriminant Analysis (LDA), trained on Depth Invariant Indices calculated from the spectral signature of coral in one location to generalize to other locations, both within the same scene and in other scenes. Three Landsat 8 scenes were selected and masked for null, land, and obstructed pixels, and corrections for sun glint and atmospheric interference were applied. Depth Invariant Indices (DII) were then calculated according to the method of Lyzenga and an LDA classifier trained on ground truth data from a single scene. The resulting LDA classifier was then applied to other locations and the coral classification accuracy evaluated. When applied to ground truth data from the Palmyra Atoll location in scene path/row 065/056, the initial model achieved an accuracy of 80.3%. However, when applied to ground truth observations from another location within the scene, namely, Kingman Reef, it achieved an accuracy of 78.6%. The model was then applied to two additional scenes (Howland Island and Baker Island Atoll), which yielded an accuracy of 69.2% and 71.4%, respectively. Finally, the algorithm was retrained using data gathered from all four sites, which produced an overall accuracy of 74.1%

Bias Reduction in Machine Learning Classifiers for Spatiotemporal Analysis of Coral Reefs using Remote Sensing Images

This dissertation is an evaluation of the generalization characteristics of machine learning classifiers as applied to the detection of coral reefs using remote sensing images. Three scientific studies have been conducted as part of this research: 1) Evaluation of Spatial Generalization Characteristics of a Robust Classifier as Applied to Coral Reef Habitats in Remote Islands of the Pacific Ocean 2) Coral Reef Change Detection in Remote Pacific Islands using Support Vector Machine Classifiers 3) A Generalized Machine Learning Classifier for Spatiotemporal Analysis of Coral Reefs in the Red Sea. The aim of this dissertation is to propose and evaluate a methodology for developing a robust machine learning classifier that can effectively be deployed to accurately detect coral reefs at scale. The hypothesis is that Landsat data can be used to train a classifier to detect coral reefs in remote sensing imagery and that this classifier can be trained to generalize across multiple sites. Another objective is to identify how well different classifiers perform under the generalized conditions and how unique the spectral signature of coral is as environmental conditions vary across observation sites. A methodology for validating the generalization performance of a classifier to unseen locations is proposed and implemented (Controlled Parameter Cross-Validation,). Analysis is performed using satellite imagery from nine different locations with known coral reefs (six Pacific Ocean sites and three Red Sea sites). Ground truth observations for four of the Pacific Ocean sites and two of the Red Sea sites were used to validate the proposed methodology. Within the Pacific Ocean sites, the consolidated classifier (trained on data from all sites) yielded an accuracy of 75.5% (0.778 AUC). Within the Red Sea sites, the consolidated classifier yielded an accuracy of 71.0% (0.7754 AUC). Finally, long-term change detection analysis is conducted for each of the sites evaluated. In total, over 16,700 km2 was analyzed for benthic cover type and cover change detection analysis. Within the Pacific Ocean sites, decreases in coral cover ranged from 25.3% reduction (Kingman Reef) to 42.7% reduction (Kiritimati Island). Within the Red Sea sites, decrease in coral cover ranged from 3.4% (Umluj) to 13.6% (Al Wajh)

Coral Reef Change Detection in Remote Pacific Islands Using Support Vector Machine Classifiers

Despite the abundance of research on coral reef change detection, few studies have been conducted to assess the spatial generalization principles of a live coral cover classifier trained using remote sensing data from multiple locations. The aim of this study is to develop a machine learning classifier for coral dominated benthic cover-type class (CDBCTC) based on ground truth observations and Landsat images, evaluate the performance of this classifier when tested against new data, then deploy the classifier to perform CDBCTC change analysis of multiple locations. The proposed framework includes image calibration, support vector machine (SVM) training and tuning, statistical assessment of model accuracy, and temporal pixel-based image dierencing. Validation of the methodology was performed by cross-validation and train/test split using ground truth observations of benthic cover from four dierent reefs. These four locations (Palmyra Atoll, Kingman Reef, Baker Island Atoll, and Howland Island) as well as two additional locations (Kiritimati Island and Tabuaeran Island) were then evaluated for CDBCTC change detection. The in-situ training accuracy against ground truth observations for Palmyra Atoll, Kingman Reef, Baker Island Atoll, and Howland Island were 87.9%, 85.7%, 69.2%, and 82.1% respectively. The classifier attained generalized accuracy scores of 78.8%, 81.0%, 65.4%, and 67.9% for the respective locations when trained using ground truth observations from neighboring reefs and tested against the local ground truth observations of each reef. The classifier was trained using the consolidated ground truth data of all four sites and attained a cross-validated accuracy of 75.3%. The CDBCTC change detection analysis showed a decrease in CDBCTC of 32% at Palmyra Atoll, 25% at Kingman Reef, 40% at Baker Island Atoll, 25% at Howland Island, 35% at Tabuaeran Island, and 43% at Kiritimati Island. This research establishes a methodology for developing a robust classifier and the associated Controlled Parameter Cross-Validation (CPCV) process for evaluating how well the model will generalize to new data. It is an important step for improving the scientific understanding of temporal change within coral reefs around the globe

Evaluation of Spatial Generalization Characteristics of a Robust Classifier as Applied to Coral Reef Habitats in Remote Islands of the Pacific Ocean

This study was an evaluation of the spectral signature generalization properties of coral across four remote Pacific Ocean reefs. The sites under consideration have not been the subject of previous studies for coral classification using remote sensing data. Previous research regarding using remote sensing to identify reefs has been limited to in-situ assessment, with some researchers also performing temporal analysis of a selected area of interest. This study expanded the previous in-situ analyses by evaluating the ability of a basic predictor, Linear Discriminant Analysis (LDA), trained on Depth Invariant Indices calculated from the spectral signature of coral in one location to generalize to other locations, both within the same scene and in other scenes. Three Landsat 8 scenes were selected and masked for null, land, and obstructed pixels, and corrections for sun glint and atmospheric interference were applied. Depth Invariant Indices (DII) were then calculated according to the method of Lyzenga and an LDA classifier trained on ground truth data from a single scene. The resulting LDA classifier was then applied to other locations and the coral classification accuracy evaluated. When applied to ground truth data from the Palmyra Atoll location in scene path/row 065/056, the initial model achieved an accuracy of 80.3%. However, when applied to ground truth observations from another location within the scene, namely, Kingman Reef, it achieved an accuracy of 78.6%. The model was then applied to two additional scenes (Howland Island and Baker Island Atoll), which yielded an accuracy of 69.2% and 71.4%, respectively. Finally, the algorithm was retrained using data gathered from all four sites, which produced an overall accuracy of 74.1%