WIND TURBINE TOWER DETECTION USING FEATURE DESCRIPTORS AND DEEP LEARNING

Fereshteh Abedini, Mahdi Bahaghighat, Misak S’hoyan

DOI Number
10.2298/FUEE2001133A
First page
133
Last page
153

Abstract


Wind Turbine Towers (WTTs) are the main structures of wind farms. They are costly devices that must be thoroughly inspected according to maintenance plans. Today, existence of machine vision techniques along with unmanned aerial vehicles (UAVs) enable fast, easy, and intelligent visual inspection of the structures. Our work is aimed towards developing a visionbased system to perform Nondestructive tests (NDTs) for wind turbines using UAVs. In order to navigate the flying machine toward the wind turbine tower and reliably land on it, the exact position of the wind turbine and its tower must be detected. We employ several strong computer vision approaches such as Scale-Invariant Feature Transform (SIFT), Speeded Up Robust Features (SURF), Features from Accelerated Segment Test (FAST), Brute-Force, Fast Library for Approximate Nearest Neighbors (FLANN) to detect the WTT. Then, in order to increase the reliability of the system, we apply the ResNet, MobileNet, ShuffleNet, EffNet, and SqueezeNet pre-trained classifiers in order to verify whether a detected object is indeed a turbine tower or not. This intelligent monitoring system has auto navigation ability and can be used for future goals including intelligent fault diagnosis and maintenance purposes. The simulation results show the accuracy of the proposed model are 89.4% in WTT detection and 97.74% in verification (classification) problems.



Keywords

Machine Vision, Object Detection, Vision Inspection, Wind Turbine, Deep Learning.

Full Text:

PDF

References


S. A. Motamedi, “Psnr enhancement in image streaming over cognitive radio sensor networks,” ETRI Journal, vol. 39, no. 5, pp. 683–694, 2017.

M. A. Dimitrijevi´c, M. Andrejevi´c-Stoˇsovi´c, J. Milojkovi´c, and V. Litovski, “Implementation of artificial neural networks based ai concepts to the smart grid,” Facta Universitatis, Series: Electronics and Energetics, vol. 27, no. 3, pp. 411–424, 2014.

A. Janjic, S. Savic, G. Janackovic, M. Stankovic, and L. Z. Velimirovic, “Multicriteria assesment of the smart grid efficiency using the fuzzy analitical hyerarchy process,” Facta Universitatis, Series: Electronics and Energetics, vol. 29, no. 4, pp. 631–646, 2016.

R. Marta´c, N. Milivojevi´c, V. Milivojevi´c, V. ´Cirovi´c, and D. Bara´c, “Using internet of things in monitoring and management of dams in serbia,” Facta Universitatis, Series: Electronics and Energetics, vol. 29, no. 3, pp. 419–435, 2015.

P. Tchakoua, R. Wamkeue, M. Ouhrouche, F. Slaoui-Hasnaoui, T. Tameghe, and G. Ekemb, “Wind turbine condition monitoring: State-of-the-art review, new trends, and future challenges,” Energies, vol. 7, no. 4, pp. 2595–2630, 2014.

H. Sanati, D. Wood, and Q. Sun, “Condition monitoring of wind turbine blades using active and passive thermography,” Applied Sciences, vol. 8, no. 10, p. 2004, 2018.

F. P. Garc´ıa M´arquez, I. Segovia Ram´ırez, A. Pliego Marug´an, ´ A. Huerta Herr´aiz, and M. Papaelias, “A novel walking robot based system for non-destructive testing in wind turbines,” 2019.

X.-l. Li, J. Sun, N. Tao, L. Feng, J.-l. Shen, Y. He, C. Zhang, and Y.-j. Zhao, “An effective method to inspect adhesive quality of wind turbine blades using transmission thermography,” Journal of Nondestructive Evaluation, vol. 37, no. 2, p. 19, 2018.

C.-S. Tsai, C.-T. Hsieh, and S.-J. Huang, “Enhancement of damage-detection of wind turbine blades via cwt-based approaches,” IEEE Transactions on energy conversion, vol. 21, no. 3, pp. 776–781, 2006.

M. Bahaghighat and S. A. Motamedi, “Vision inspection and monitoring of wind turbine farms in emerging smart grids,” Facta Universitatis, Series: Electronics and Energetics, vol. 31, no. 2, pp. 287–301, 2018.

C. Sampedro, C. Martinez, A. Chauhan, and P. Campoy, “A supervised approach to electric tower detection and classification for power line inspection,” in 2014 International Joint Conference on Neural Networks (IJCNN). IEEE, 2014, pp. 1970–1977.

C. Rudin, D. Waltz, R. N. Anderson, A. Boulanger, A. Salleb-Aouissi, M. Chow, H. Dutta, P. N. Gross, B. Huang, S. Ierome et al., “Machine learning for the new york city power grid,” IEEE transactions on pattern analysis and machine intelligence, vol. 34, no. 2, pp. 328–345, 2011.

R. N. Anderson, A. Boulanger, W. B. Powell, and W. Scott, “Adaptive stochastic control for the smart grid,” pp. 1098–1115, 2011.

Z. M. Fadlullah, M. M. Fouda, N. Kato, X. Shen, and Y. Nozaki, “An early warning system against malicious activities for smart grid communications,” IEEE Network, vol. 25, no. 5, pp. 50–55, 2011.

Y. Zhang, L. Wang, W. Sun, R. C. Green II, and M. Alam, “Distributed intrusion detection system in a multi-layer network architecture of smart grids,” IEEE Transactions on Smart Grid, vol. 2, no. 4, pp. 796–808, 2011.

Z. Zhao, G. Xu, Y. Qi, N. Liu, and T. Zhang, “Multi-patch deep features for power line insulator status classification from aerial images,” in 2016 International Joint Conference on Neural Networks (IJCNN). IEEE, 2016, pp. 3187–3194.

A. G. Howard, M. Zhu, B. Chen, D. Kalenichenko, W. Wang, T. Weyand, M. Andreetto, and H. Adam, “Mobilenets: Efficient convolutional neural networks for mobile vision applications,” arXiv preprint arXiv:1704.04861, 2017.

M. Babaie, M. E. Shiri, and M. Bahaghighat, “A new descriptor for uav images mapping by applying discrete local radon,” in 2018 8th Conference of AI & Robotics and 10th RoboCup Iranopen International Symposium (IRANOPEN). IEEE, 2018, pp. 52–56.

M. Stokkeland, K. Klausen, and T. A. Johansen, “Autonomous visual navigation of unmanned aerial vehicle for wind turbine inspection,” in 2015 International Conference on Unmanned Aircraft Systems (ICUAS). IEEE, 2015, pp. 998–1007.

B. U. T¨oreyin, Y. Dedeo˘glu, U. Gu¨du¨kbay, and A. E. Cetin, “Computer vision based method for real-time fire and flame detection,” Pattern recognition letters, vol. 27, no. 1, pp. 49–58, 2006.

I. Laptev, “Improving object detection with boosted histograms,” Image and Vision Computing, vol. 27, no. 5, pp. 535–544, 2009.

S. Messelodi, C. M. Modena, and M. Zanin, “A computer vision system for the detection and classification of vehicles at urban road intersections,” Pattern analysis and applications, vol. 8, no. 1-2, pp. 17–31, 2005.

J. C. S. J. Junior, S. R. Musse, and C. R. Jung, “Crowd analysis using computer vision techniques,” IEEE Signal Processing Magazine, vol. 27, no. 5, pp. 66–77, 2010.

R. Akbari, M. K. Bahaghighat, and J. Mohammadi, “Legendre moments for face identification based on single image per person,” in 2010 2nd International Conference on Signal Processing Systems, vol. 1. IEEE, 2010, pp. V1–248.

M. K. Bahaghighat, R. Akbari et al., “Fingerprint image enhancement using gwt and dmf,” in 2010 2nd International Conference on Signal Processing Systems, vol. 1. IEEE, 2010, pp. V1–253.

N. Karimimehr, A. A. B. Shirazi et al., “Fingerprint image enhancement using gabor wavelet transform,” in 2010 18th Iranian Conference on Electrical Engineering. IEEE, 2010, pp. 316–320.

M. Bahaghighat, M. Mirfattahi, L. Akbari, and M. Babaie, “Designing quality control system based on vision inspection in pharmaceutical product lines,” in 2018 International Conference on Computing, Mathematics and Engineering Technologies (iCoMET). IEEE, 2018, pp. 1–4.

D. G. Lowe, “Distinctive image features from scale-invariant keypoints,” International journal of computer vision, vol. 60, no. 2, pp. 91–110, 2004.

H. Bay, T. Tuytelaars, and L. Van Gool, “Surf: Speeded up robust features,” in European conference on computer vision. Springer, 2006, pp. 404–417.

E. Rosten, R. Porter, and T. Drummond, “Faster and better: A machine learning approach to corner detection,” IEEE transactions on pattern analysis and machine intelligence, vol. 32, no. 1, pp. 105–119, 2008.

E. Rosten and T. Drummond, “Machine learning for high-speed corner detection,” in European conference on computer vision. Springer, 2006, pp. 430–443.

M. Muja and D. G. Lowe, “Scalable nearest neighbor algorithms for high dimensional data,” IEEE transactions on pattern analysis and machine intelligence, vol. 36, no. 11, pp. 2227–2240, 2014.

M. Bahaghighat, L. Akbari, and Q. Xin, “A machine learning-based approach for counting blister cards within drug packages,” IEEE Access, vol. 7, pp. 83785–83796, 2019.

A. Esmaeili Kelishomi, A. Garmabaki, M. Bahaghighat, and J. Dong, “Mobile user indoor-outdoor detection through physical daily activities,” Sensors, vol. 19, no. 3, p. 511, 2019.

P. Thanh Noi and M. Kappas, “Comparison of random forest, k-nearest neighbor, and support vector machine classifiers for land cover classification using sentinel-2 imagery,” Sensors, vol. 18, no. 1, p. 18, 2018.

H. Al-Shehri, A. Al-Qarni, L. Al-Saati, A. Batoaq, H. Badukhen, S. Alrashed, J. Alhiyafi, and S. O. Olatunji, “Student performance prediction using support vector machine and k-nearest neighbor,” in 2017 IEEE 30th Canadian Conference on Electrical and Computer Engineering (CCECE). IEEE, 2017, pp. 1–4.

F. N. Koutanaei, H. Sajedi, and M. Khanbabaei, “A hybrid data mining model of feature selection algorithms and ensemble learning classifiers for credit scoring,” Journal of Retailing and Consumer Services, vol. 27, pp. 11–23, 2015.

M. B. Stojanovi´c, M. M. Boˇzi´c, and M. M. Stankovi´c, “Mid-term load forecasting using recursive time series prediction strategy with support vector machines,” Facta universitatis-series: Electronics and Energetics, vol. 23, no. 3, pp. 287–298, 2010.

W. Kim, W.-S. Jung, and H. K. Choi, “Lightweight driver monitoring system based on multi-task mobilenets,” Sensors, vol. 19, no. 14, p. 3200, 2019.

B. Siemiatkowska, M. Majewski et al., “A system for weeds and crops identification–reaching over 10 fps on raspberry pi with the usage of mobilenets, densenet and custom modifications.” 2019.

W. Puarungroj and N. Boonsirisumpun, “Recognizing hand-woven fabric pattern designs based on deep learning,” in Advances in Computer Communication and Computational Sciences. Springer, 2019, pp. 325–336.

X. Zhang, X. Zhou, M. Lin, and J. Sun, “Shufflenet: An extremely efficient convolutional neural network for mobile devices,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 6848–6856.

I. Freeman, L. Roese-Koerner, and A. Kummert, “Effnet: An efficient structure for convolutional neural networks,” in 2018 25th IEEE International Conference on Image Processing (ICIP). IEEE, 2018, pp. 6–10.

F. N. Iandola, S. Han, M. W. Moskewicz, K. Ashraf, W. J. Dally, and K. Keutzer, “Squeezenet: Alexnet-level accuracy with 50x fewer parameters and¡ 0.5 mb model size,” arXiv preprint arXiv:1602.07360, 2016.

C. Szegedy, S. Ioffe, V. Vanhoucke, and A. A. Alemi, “Inception-v4, inceptionresnet and the impact of residual connections on learning,” in Thirty-First AAAI Conference on Artificial Intelligence, 2017.

T. Akiba, S. Suzuki, and K. Fukuda, “Extremely large minibatch sgd: training resnet-50 on imagenet in 15 minutes,” arXiv preprint arXiv:1711.04325, 2017.

C. L. Zitnick and P. Doll´ar, “Edge boxes: Locating object proposals from edges,” in European conference on computer vision. Springer, 2014, pp. 391– 405.

Z. Zhong, J. Wen, B. Zhang, and Y. Xu, “A general moving detection method using dual-target nonparametric background model,” Knowledge-Based Systems, vol. 164, pp. 85–95, 2019.

D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980, 2014.

L. Zhang, S. Wang, and B. Liu, “Deep learning for sentiment analysis: A survey,” Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, vol. 8, no. 4, p. e1253, 2018.

G.-B. Huang, D. H. Wang, and Y. Lan, “Extreme learning machines: a survey,” International journal of machine learning and cybernetics, vol. 2, no. 2, pp. 107–122, 2011.

B. Karlik and A. V. Olgac, “Performance analysis of various activation functions in generalized mlp architectures of neural networks,” International Journal of Artificial Intelligence and Expert Systems, vol. 1, no. 4, pp. 111–122, 2011.


Refbacks

  • There are currently no refbacks.


ISSN: 0353-3670 (Print)

ISSN: 2217-5997 (Online)

COBISS.SR-ID 12826626