Similar articles

Abstract: Rod insulators are vital parts of the catenary of high speed railways (HSRs). There are many different catenary insulators, and the background of the insulator image is complicated. It is difficult to recognise insulators and detect defects automatically. In this paper, we propose a catenary intelligent defect detection algorithm based on mask region-convolutional neural network (R-CNN) and an image processing model. Vertical projection technology is used to achieve single shed positioning and precise cutting of the insulator. Gradient, texture, and gray feature fusion (GTGFF) and a k-means clustering analysis model (KCAM) are proposed to detect broken insulators, dirt, foreign bodies, and flashover. Using this model, insulator recognition and defect detection can achieve a high recall rate and accuracy, and generalized defect detection. The algorithm is tested and verified on a dataset of realistic insulator images, and the accuracy and reliability of the algorithm satisfy current requirements for HSR catenary automatic inspection and intelligent maintenance.

基于Mask R-CNN和多特征聚类模型的接触网绝缘子识别和缺陷检测

[1]AdouMW, XuHR, ChenGH, 2019. Insulator faults detection based on deep learning. Proceedings of the IEEE 13th International Conference on Anti-counterfeiting, Security, and Identification, p.173-177.

[2]DaiJF, HeKM, SunJ, 2016. Instance-aware semantic segmentation via multi-task network cascades. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, p.3150-3158.

[3]DalalN, TriggsB, 2005. Histograms of oriented gradients for human detection. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, p.886-893.

[4]HanY, LiuZG, LeeDJ, et al., 2016. High-speed railway rod-insulator detection using segment clustering and deformable part models. Proceedings of the IEEE International Conference on Image Processing, p.3852-3856.

[5]HartiganJA, WongMA, 1979. Algorithm as 136: a K-means clustering algorithm. Journal of the Royal Statistical Society. Series C (Applied Statistics), 28(1):100-108.

[6]HeKM, GkioxariG, DollárP, et al., 2017. Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision, p.2980-2988.

[7]JiangH, QiuXJ, ChenJ, et al., 2019. Insulator fault detection in aerial images based on ensemble learning with multi-level perception. IEEE Access, 7:61797-61810.

[8]KangGQ, GaoSB, YuL, et al., 2019. Deep architecture for high-speed railway insulator surface defect detection: denoising autoencoder with multitask learning. IEEE Transactions on Instrumentation and Measurement, 68(8):2679-2690.

[9]KienDN, ZhuangXY, 2021. A deep neural network-based algorithm for solving structural optimization. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 22(8):609-620.

[10]LeCunY, BengioY, HintonG, 2015. Deep learning. Nature, 521(7553):436-444.

[11]LiY, QiHZ, DaiJF, et al., 2017. Fully convolutional instance-aware semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, p.4438-4446.

[12]LiuT, ZhaoY, WeiYC, et al., 2019. Concealed object detection for activate millimeter wave image. IEEE Transactions on Industrial Electronics, 66(12):9909-9917.

[13]LyuY, HanZW, ZhongJP, et al., 2020. A generic anomaly detection of catenary support components based on generative adversarial networks. IEEE Transactions on Instrumentation and Measurement, 69(5):2439-2448.

[14]NikbakhtS, AnitescuC, RabczukT, 2021. Optimizing the neural network hyperparameters utilizing genetic algorithm. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 22(6):407-426.

[15]OjalaT, PietikäinenM, HarwoodD, 1996. A comparative study of texture measures with classification based on featured distributions. Pattern Recognition, 29(1):‍51-59.

[16]RenSQ, HeKM, GirshickR, et al., 2017. Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(6):1137-1149.

[17]SuM, PengH, LiSF, 2021. Application of an interpretable artificial neural network to predict the interface strength of a near-surface mounted fiber-reinforced polymer to concrete joint. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 22(6):427-440.

[18]TanP, MaJE, ZhouJ, et al., 2016. Sustainability development strategy of China's high speed rail. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 17(12):923-932.

[19]TanP, LiXF, XuJM, et al., 2020. Catenary insulator defect detection based on contour features and gray similarity matching. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 21(1):64-73.

[20]TanP, LiXF, WuZG, et al., 2021. Multialgorithm fusion image processing for high speed railway dropper failure-defect detection. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 51(7):4466-4478.

[21]WangJ, WangTT, LuoQZ, 2019. A practical structural health monitoring system for high-speed train car-body. IEEE Access, 7:168316-168326.

[22]WangL, ZhangZJ, 2017. Automatic detection of wind turbine blade surface cracks based on UAV-taken images. IEEE Transactions on Industrial Electronics, 64(9):7293-7303.

[23]YaoXT, ZhangYP, GaoY, et al., 2017. Research on technology of contact insulator pollution classification and pollution level division based on machine vision. Proceedings of the IEEE 3rd Information Technology and Mechatronics Engineering Conference, p.1264-1268.

[24]YaoXT, ZhangYP, GaoY, et al., 2018. Research on vision-based technology of contamination detection in overhead line insulators. Journal of Lanzhou Jiaotong University, 37(1):65-72 (in Chinese).

[25]YueGH, HouCP, GuK, et al., 2018. Biologically inspired blind quality assessment of tone-mapped images. IEEE Transactions on Industrial Electronics, 65(3):2525-2536.

[26]ZengX, LiZH, GaoW, et al., 2018. A novel virtual sensing with artificial neural network and K-means clustering for IGBT current measuring. IEEE Transactions on Industrial Electronics, 65(9):7343-7352.

[27]ZhaoZB, ZhenZ, ZhangL, et al., 2019. Insulator detection method in inspection image based on improved faster R-CNN. Energies, 12(7):1204.

[28]ZhuQ, LiL, ChenCJ, et al., 2018. A low-cost lateral active suspension system of the high-speed train for ride quality based on the resonant control method. IEEE Transactions on Industrial Electronics, 65(5):4187-4196.