Systems Engineering and Electronics ›› 2023, Vol. 45 ›› Issue (11): 3363-3373.doi: 10.12305/j.issn.1001-506X.2023.11.01

• Electronic Technology • Previous Articles     Next Articles

Image matching algorithm based on attention mechanism of three branch spatial transformation

Yanyan HUANG1,2, Shaoyan GAI1,2,*, Feipeng DA1,2   

  1. 1. School of Automation, Southeast University, Nanjing 210096, China
    2. Key Laboratory of Measurement and Control of Complex Systems of Engineering, Ministry of Education, Southeast University, Nanjing 210096, China
  • Received:2022-08-15 Online:2023-10-25 Published:2023-10-31
  • Contact: Shaoyan GAI

Abstract:

For the image template matching task in which the image to be matched has spatial transformations such as rotation transformation, scale transformation, and translation, the existing algorithms are time-consuming and have low accuracy. In this paper, an image matching algorithm with high accuracy is proposed. Firstly, oriented fast feature detection algorithm is used to find the feature points according to the pixel difference between the center point and the neighboring point in order to detect the feature points. With these feature points taken as the center, patches of a certain size are cropped according to the rotation angle calculated by the fast feauture detection algorithm. These image patches are fed into the feature descriptor extraction network of the spatial transform attention module. Finally, K-nearest neighbor (KNN) algorithm is used to calculate the matched features in the feature descriptors of the two images to be matched. The spatial transformation attention module is introduced into the feature descriptor extraction network. The network focuses on learning spatial information during training, so the entire algorithm improves the accuracy of image matching tasks with large spatial changes. In terms of matching time, the matching algorithm proposed in this paper is second only to the method that uses fast feauture detection algorithm algorithmfor both detection and matching tasks. In terms of matching accuracy, the matching accuracy of the algorithm in this paper is far superior to other algorithms compared in the experiment.

Key words: computer vision, image matching, space transformation invariance, convolutional neural network (CNN), attention mechanism

CLC Number: 

[an error occurred while processing this directive]