41,677 research outputs found
Region Feature Descriptor Adapted to High Affine Transformations
To address the issue of feature descriptors being ineffective in representing
grayscale feature information when images undergo high affine transformations,
leading to a rapid decline in feature matching accuracy, this paper proposes a
region feature descriptor based on simulating affine transformations using
classification. The proposed method initially categorizes images with different
affine degrees to simulate affine transformations and generate a new set of
images. Subsequently, it calculates neighborhood information for feature points
on this new image set. Finally, the descriptor is generated by combining the
grayscale histogram of the maximum stable extremal region to which the feature
point belongs and the normalized position relative to the grayscale centroid of
the feature point's region. Experimental results, comparing feature matching
metrics under affine transformation scenarios, demonstrate that the proposed
descriptor exhibits higher precision and robustness compared to existing
classical descriptors. Additionally, it shows robustness when integrated with
other descriptors
Scale invariant line matching on the sphere
International audienceThis paper proposes a novel approach of line matching across images captured by different types of cameras, from perspective to omnidirectional ones. Based on the spherical mapping, this method utilizes spherical SIFT point features to boost line matching and searches line correspondences using an affine invariant measure of similarity. It permits to unify the commonest cameras and to process heterogeneous images with the least distortion of visual information
Matching in the Wild: Learning Anatomical Embeddings for Multi-Modality Images
Radiotherapists require accurate registration of MR/CT images to effectively
use information from both modalities. In a typical registration pipeline, rigid
or affine transformations are applied to roughly align the fixed and moving
images before proceeding with the deformation step. While recent learning-based
methods have shown promising results in the rigid/affine step, these methods
often require images with similar field-of-view (FOV) for successful alignment.
As a result, aligning images with different FOVs remains a challenging task.
Self-supervised landmark detection methods like self-supervised Anatomical
eMbedding (SAM) have emerged as a useful tool for mapping and cropping images
to similar FOVs. However, these methods are currently limited to intra-modality
use only. To address this limitation and enable cross-modality matching, we
propose a new approach called Cross-SAM. Our approach utilizes a novel
iterative process that alternates between embedding learning and CT-MRI
registration. We start by applying aggressive contrast augmentation on both CT
and MRI images to train a SAM model. We then use this SAM to identify
corresponding regions on paired images using robust grid-points matching,
followed by a point-set based affine/rigid registration, and a deformable
fine-tuning step to produce registered paired images. We use these registered
pairs to enhance the matching ability of SAM, which is then processed
iteratively. We use the final model for cross-modality matching tasks. We
evaluated our approach on two CT-MRI affine registration datasets and found
that Cross-SAM achieved robust affine registration on both datasets,
significantly outperforming other methods and achieving state-of-the-art
performance
Supersymmetric Gauge Theories with an Affine Quantum Moduli Space
All supersymmetric gauge theories based on simple groups which have an affine
quantum moduli space, i.e. one generated by gauge invariants with no relations,
W=0, and anomaly matching at the origin, are classified. It is shown that the
only theories with no gauge invariants (and moduli space equal to a single
point) are the two known examples, SU(5) with 5-bar + 10 and SO(10) with a
spinor. The index of the matter representation must be at least as big as the
index of the adjoint in theories which have a non-trivial relation among the
gauge invariants.Comment: Incorrect proof that theories with constraints must have mu >=
mu(adj) replaced by a correct one (6 pages, uses revtex, amssymb, array
An Automated Approach for Sub-Pixel Registration of Landsat-8 Operational Land Imager (OLI) and Sentinel-2 Multi Spectral Instrument (MSI) Imagery
Moderate spatial resolution satellite data from the Landsat-8 OLI and Sentinel-2A MSI sensors together offer 10 m to 30 m multi-spectral reflective wavelength global coverage, providing the opportunity for improved combined sensor mapping and monitoring of the Earth’s surface. However, the standard geolocated Landsat-8 OLI L1T and Sentinel-2A MSI L1C data products are currently found to be misaligned. An approach for automated registration of Landsat-8 OLI L1T and Sentinel-2A MSI L1C data is presented and demonstrated using contemporaneous sensor data. The approach is computationally efficient because it implements feature point detection across four image pyramid levels to identify a sparse set of tie-points. Area-based least squares matching around the feature points with mismatch detection across the image pyramid levels is undertaken to provide reliable tie-points. The approach was assessed by examination of extracted tie-point spatial distributions and tie-point mapping transformations (translation, affine and second order polynomial), dense-matching prediction-error assessment, and by visual registration assessment. Two test sites over Cape Town and Limpopo province in South Africa that contained cloud and shadows were selected. A Landsat-8 L1T image and two Sentinel-2A L1C images sensed 16 and 26 days later were registered (Cape Town) to examine the robustness of the algorithm to surface, atmosphere and cloud changes, in addition to the registration of a Landsat-8 L1T and Sentinel-2A L1C image pair sensed 4 days apart (Limpopo province). The automatically extracted tie-points revealed sensor misregistration greater than one 30 m Landsat-8 pixel dimension for the two Cape Town image pairs, and greater than one 10 m Sentinel-2A pixel dimension for the Limpopo image pair. Transformation fitting assessments showed that the misregistration can be effectively characterized by an affine transformation. Hundreds of automatically located tie-points were extracted and had affine-transformation root-mean-square error fits of approximately 0.3 pixels at 10 m resolution and dense-matching prediction errors of similar magnitude. These results and visual assessment of the affine transformed data indicate that the methodology provides sub-pixel registration performance required for meaningful Landsat-8 OLI and Sentinel-2A MSI data comparison and combined data applications
- …