Systems Engineering and Electronics ›› 2024, Vol. 46 ›› Issue (5): 1514-1524.doi: 10.12305/j.issn.1001-506X.2024.05.06
• Electronic Technology • Previous Articles
Yulin TANG1, Liming WANG1,*, Deying YU1, Houpu LI1, Min LIU2, Weidong ZHANG3
Received:
2023-03-25
Online:
2024-04-30
Published:
2024-04-30
Contact:
Liming WANG
CLC Number:
Yulin TANG, Liming WANG, Deying YU, Houpu LI, Min LIU, Weidong ZHANG. CSLS-CycleGAN based side-scan sonar sample augmentation method for underwater target image[J]. Systems Engineering and Electronics, 2024, 46(5): 1514-1524.
Table 2
Performance of images generated using different typical models"
组别 | 模型 | FID↓ | MMD↓ | 1-NN↓0.5 |
1 | pix2pix | 214.77 | 0.315 | 0.97 |
2 | CycleGAN-ResNet-06 | 153.65 | 0.192 | 0.82 |
3 | CycleGAN-ResNet-09 | 148.71 | 0.164 | 0.83 |
4 | CycleGAN-UNet-128 | 155.12 | 0.137 | 0.77 |
5 | CycleGAN-UNet-256 | 133.69 | 0.151 | 0.79 |
6 | DualGAN | 130.17 | 0.160 | 0.74 |
7 | DiscoGAN | 129.98 | 0.149 | 0.75 |
8 | 所提方法 | 123.12 | 0.105 | 0.72 |
1 | HENRIKSE L. Real-time underwater object detection based on an electrically scanned high-resolution sonar[C]//Proc. of the IEEE Symposium on Autonomous Underwater Vehicle Technology, 2002. |
2 | ARSHAD M R . Recent advancement in sensor technology for underwater applications[J]. Indian Journal of Marine Sciences, 2009, 38 (3): 267- 273. |
3 |
GREENE A , RAHMAN A F , KLINE R , et al. Side scan sonar: a cost-efficient alternative method for measuring seagrass cover in shallow environments[J]. Estuarine, Coastal and Shelf Science, 2018,
doi: 10.1016/j.ecss,2018.04.017 |
4 | HURTOS N , PALOMERAS N , CARRERA A , et al. Autonomous detection, following and mapping of an underwater chain using sonar[J]. Ocean Engineering, 2017, 130 (1): 336- 350. |
5 | BUSCOMBE D . Shallow water benthic imaging and substrate characterization using recreational-grade side scan-sonar[J]. Environmental Modelling & Software, 2017, 89, 1- 18. |
6 | FLOWERS H J , HIGHTOWER J E . A novel approach to surveying sturgeon using side-scan sonar and occupancy modeling[J]. Marine & Coastal Fisheries, 2013, 5 (1): 211- 223. |
7 | JOHNSON S G , DEAETT M A . The application of automated recognition techniques to side-scan sonar imagery[J]. IEEE Journal of Oceanic Engineering: a Journal Devoted to the Application of Electrical and Electronics Engineering to the Oceanic Environment, 1994, 19 (1): 138- 144. |
8 |
BURGUERA A , BONIN-FONT F . On-line multi-class segmentation of side-scan sonar imagery using an autonomous underwater vehicle[J]. Journal of Marine Science and Engineering, 2020, 8 (8): 557.
doi: 10.3390/jmse8080557 |
9 |
CHEN E , GUO J . Real time map generation using sidescan sonar scanlines for unmanned underwater vehicles[J]. Ocean Engineering, 2014, 91, 252- 262.
doi: 10.1016/j.oceaneng.2014.09.017 |
10 |
ZHU B Y , WANG X , CHU Z W , et al. Active learning for recognition of shipwreck target in side-scan sonar image[J]. Remote Sensing, 2019, 11 (3): 243.
doi: 10.3390/rs11030243 |
11 | 阳凡林, 独知行, 吴自银, 等. 基于灰度直方图和几何特征的声纳图像目标识别[J]. 海洋通报, 2006, 25 (5): 64- 69. |
YANG F L , DU Z X , WU Z Y , et al. Object recognizing on sonar image based on histogram and geometric feature[J]. Marine Science Bulletin, 2006, 25 (5): 64- 69. | |
12 | LANGNER F, KNAUER C, JANS W, et al. Side scan sonar image resolution and automatic object detection, classification and identification[C]//Proc. of the Oceans-Europe Conference, 2009. |
13 | ISAACS J C. Sonar automatic target recognition for underwater UXO remediation[C]//Proc. of the Computer Vision & Pattern Recognition Workshops, 2015. |
14 |
YUAN F , XIAO F Q , ZHANG K H , et al. Noise reduction for sonar images by statistical analysis and fields of experts[J]. Journal of Visual Communication and Image Representation, 2021, 74, 102995.
doi: 10.1016/j.jvcir.2020.102995 |
15 |
REED S , PETILLOT Y , BELL J . Automated approach to classification of mine-like objects in sidescan sonar using highlight and shadow information[J]. IEE Proceedings—Radar, Sonar and Navigation, 2004, 151 (1): 48- 56.
doi: 10.1049/ip-rsn:20040117 |
16 |
KUMAR N , MITRA U , NARAYANAN S S . Robust object classification in underwater sidescan sonar images by using reliability-aware fusion of shadow features[J]. IEEE Journal of Oceanic Engineering, 2015, 40 (3): 592- 606.
doi: 10.1109/JOE.2014.2344971 |
17 | ZHU P P, ISAACS J, FU B, et al. Deep learning feature extraction for target recognition and classification in underwater sonar images[C]//Proc. of the IEEE 56th Annual Conference on Decision and Control, 2017. |
18 | NEUPANE D , SEOK J . A review on deep learning-based approaches for automatic sonar target recognition[J]. Electronics, 2020, 9 (11): 1972. |
19 | TOPPLE J M , FAWCETT J A . MiNet: efficient deep learning automatic target recognition for small autonomous vehicles[J]. IEEE Geoscience and Remote Sensing Letters, 2021, 18 (6): 1014- 1018. |
20 | HUO G Y , YANG S X , LI Q , et al. A robust and fast method for sidescan sonar image segmentation using nonlocal despeckling and active contour model[J]. IEEE Trans. on Cybernetics, 2016, 47 (4): 855- 872. |
21 | FELDENS P , DARR A , FELDENS A , et al. Detection of boulders in side scan sonar mosaics by a neural network[J]. Geosciences, 2019, 9 (4): 159. |
22 | TANG Y L , JIN S H , BIAN G , et al. Shipwreck target recognition in side-scan sonar images by improved YOLOv3 model based on transfer learning[J]. IEEE Access, 2020, 8, 173450- 173460. |
23 | 汤寓麟, 李厚朴, 张卫东, 等. 侧扫声纳检测沉船目标的轻量化DETR-YOLO法[J]. 系统工程与电子技术, 2022, 44 (8): 2427- 2436. |
TANG Y L , LI H P , ZHANG W D , et al. Lightweight DETR-YOLO method for detecting shipwreck target in side-scan sonar[J]. Systems Engineering and Electronics, 2022, 44 (8): 2427- 2436. | |
24 | NGUYEN H T , LEE E H , LEE S , et al. Study on the classification performance of underwater sonar image classification based on convolutional neural networks for detecting a submerged human body[J]. Sensors, 2019, 20 (1): 94. |
25 | LI A C , YE A X , CAO B D , et al. Zero shot objects classification method of side scan sonar image based on synthesis of pseudo samples-ScienceDirect[J]. Applied Acoustics, 2021, 173, 107691. |
26 | COIRAS E , MIGNOTTE P Y , PETILLOT Y , et al. Supervised target detection and classification by training on augmented reality data[J]. IET Radar, Sonar & Navigation, 2007, 1 (1): 83- 90. |
27 | KAPETANOVI N , MIKOVI N , TAHIROVI A . Saliency and anomaly: transition of concepts from natural images to side-scan sonar images[J]. IFAC-Papers OnLine, 2020, 53 (2): 14558- 14563. |
28 | LEE S J, PARK B, KIM A. Deep learning from shallow dives: sonar image generation and training for underwater object detection[EB/OL]. [2023-03-10]. arxiv. org/pdf/1810.07990. pdf. |
29 | HUO G Y , WU Z Y , LI J B . Underwater object classification in sidescan sonar images using deep transfer learning and semisynthetic training data[J]. IEEE Access, 2020, 8, 47407- 47418. |
30 | HUANG C , ZHAO J H , YU Y C , et al. Comprehensive sample augmentation by fully considering side-scan imaging mechanism and environment for shipwreck detection under zero real samples[J]. IEEE Trans. on Geoscience and Remote Sensing, 2021, 60, 5906814. |
31 | CHAVEZ P S , ISBRECHT J A , GALANIS P , et al. Processing, mosaicking and management of the monterey bay digital sidescan-sonar images[J]. Marine Geology, 2002, 181 (1/3): 305- 315. |
32 | BLONDEL P . The handbook of sidescan sonar[M]. Berlin: Springer, 2010. |
33 | ISOLA P, ZHU J Y, ZHOU T, et al. Image-to-image translation with conditional adversarial networks[C]//Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, 2017: 5967-5976. |
34 | ZHU J Y, PARK T, ISOLA P, et al. Unpaired image-to-image translation using cycle-consistent adversarial networks[C]//Proc. of the IEEE International Conference on Computer Vision, 2017: 2242-2251. |
35 | 李宝奇, 黄海宁, 刘纪元, 等. 基于改进CycleGAN的光学图像迁移生成水下小目标合成孔径声纳图像算法研究[J]. 电子学报, 2021, 49 (9): 1746- 1753. |
LI B Q , HUANG H N , LIU J Y , et al. Optical image-to-underwater small target synthetic aperture sonar image translation algorithm based on improved CycleGAN[J]. Acta Electronica Sinica, 2021, 49 (9): 1746- 1753. | |
36 | ALFARRA M, JUAN C, ANNA F, et al. On the robustness of quality measures for GANs[C]//Proc. of the 17th European Conference on Computer Vision, 2022: 18-33. |
37 | YI Z L, ZHANG H, TAN P L, et al. DualGAN: unsupervised dual learning for image-to-image translation[C]//Proc. of the IEEE International Conference on Computer Vision, 2017: 2868-2876. |
38 | KIM T, CHA M. Learning to discover cross-domain relations with generative adversarial networks[C]//Proc. of the 34th International Conference on Machine Learning, 2017: 1857-1865. |
[1] | Yulin TANG, Houpu LI, Weidong ZHANG, Shaofeng BIAN, Guojun ZHAI, Min LIU, Xiaoping ZHANG. Lightweight DETR-YOLO method for detecting shipwreck target in side-scan sonar [J]. Systems Engineering and Electronics, 2022, 44(8): 2427-2436. |
Viewed | ||||||
Full text |
|
|||||
Abstract |
|
|||||