Systems Engineering and Electronics ›› 2024, Vol. 46 ›› Issue (5): 1514-1524.doi: 10.12305/j.issn.1001-506X.2024.05.06

• Electronic Technology • Previous Articles    

CSLS-CycleGAN based side-scan sonar sample augmentation method for underwater target image

Yulin TANG1, Liming WANG1,*, Deying YU1, Houpu LI1, Min LIU2, Weidong ZHANG3   

  1. 1. College of Electrical Engineering, Naval University of Engineering, Wuhan 430033, China
    2. Unit 91001 of the PLA, Beijing 100841, China
    3. Unit 31016 of the PLA, Beijing 100088, China
  • Received:2023-03-25 Online:2024-04-30 Published:2024-04-30
  • Contact: Liming WANG

Abstract:

In view of the scarcity, difficulty and high cost of side-scan sonar underwater target images, and the poor performance of deep-learning based target detection model, combined with the abundant target data set in optical domain, a sample augmentation method for underwater target side-scan sonar images based on channel and spatial attention(CSA) module and least squares generative adversarial networks(LSGAN) and cycle generative adversarial networks(CycleGAN) is propesed. Firstly, inspired by CycleGAN, a single cycle network structure based on cycle consistency is designed to ensure the training efficiency of the model. Then, the CSA module is integrated into the generator to reduce information dispersion while enhancing cross-latitude interaction. Finally, a loss function based on LSGAN is designed to improve the quality of the generated image while improving the training stability. Experiments are carried out on ship optical domain data set and side-scan sonar shipwreck data set. The results show that the proposed method achieves efficient and robust conversion of information between optical and side-scan sonar samples and augmentation of a large number of side-scan sonar target samples. At the same time, the underwater target detection is carried out based on the detection model generated after sample training in this paper. The results show that the average precision value of the model after training with sample augmentation data in this paper reachs 84.71% in detecting shipwreck targets with few samples, which proves that the method in this paper achieves high-quality amplification of highly representative underwater target samples with zero samples and small samples. It also provides a new way to construct high-performance underwater target detection model.

Key words: sample augmentation, side-scan sonar, cycle generative adversarial networks (CycleGAN), channel and spatial attention (CSA) module, least squares generative adversarial networks (LSGAN)

CLC Number: 

[an error occurred while processing this directive]