Search 닫기

Regular paper

Split Viewer

Journal of information and communication convergence engineering 2024; 22(2): 159-164

Published online June 30, 2024

https://doi.org/10.56977/jicce.2024.22.2.159

© Korea Institute of Information and Communication Engineering

Anomaly Detection System for Solar Power Distribution Panels utilizing Thermal Images

Kwang-Seong Shin 1, Jong-Chan Kim 2*, and Seong-Yoon Shin3* , Member, KIICE

1Department of Computer Engineering, Sunchon National University, Sunchon 57922, Republic of Korea
2Department of Computer Engineering, Sunchon National University, Sunchon 57922, Republic of Korea
3School of Computer Science and Engineering, Kunsan National University, Gunsan 54150, Republic of Korea

Correspondence to : Jong-Chan Kim (E-mail: seaghost@scnu.ac.kr, Tel: +82-61-750-3621), Department of Computer Engineering, Sunchon National University, Suncheon 57922, Republic of Korea
Seong-Yoon Shin (E-mail: s3397220@kunsan.ac.kr, Tel: +82-63-469-4860), School of Computer Science and Engineering, Kunsan National University, Gunsan 54150, Republic of Korea

Received: April 29, 2024; Revised: May 9, 2024; Accepted: May 11, 2024

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/3.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

This study aimed to develop an advanced anomaly-detection system tailored for solar power distribution panels using thermal imaging cameras to ensure operational stability. It addresses the imperative shift toward digitalized safety management in electrical facilities, transcending the limitations of conventional empirical methodologies. Our proposed system leverages a faster R-CNN-based artificial intelligence model optimized through meticulous hyperparameter tuning to efficiently detect anomalies in distribution panels. Through comprehensive experimentation, we validated the efficacy of the system in accurately identifying anomalies, thereby propelling safety protocols forward during the fourth industrial revolution. This study signifies a significant stride toward fortifying the integrity and resilience of solar power distribution systems, which is pivotal for adapting to emerging technological paradigms and evolving safety standards in the energy sector. These findings offer valuable insights for enhancing the reliability and efficiency of safety management practices and fostering a safer and more sustainable energy landscape.

Keywords Anomaly Detection, Digitalization of Power Facilities, Faster R-CNN, Object Detection, Thermal Image

Solar power distribution panels play a pivotal role in modern energy systems by ensuring the reliability and safety of power supply. These panels are responsible for converting high- or extra-high-voltage electricity from power plants or substations into usable voltages for consumers, and for distributing power safely throughout the grid. However, maintaining the safety and integrity of these electrical facilities requires effective anomaly detection and response measures. Traditional approaches to safety management often rely on experience and subjectivity, which can be inefficient and may not adequately address the potential risks.

Previous safety management methods have been predominantly reactive and manual, addressing issues only after they occur. This reactive approach makes it challenging to respond to anomalies before escalation, and preventive measures may be limited. As the scale and complexity of power facilities continue to increase, the limitations of traditional methods have become more apparent.

Recent technological advancements have offered new possibilities for the safety management of power facilities. Digital technologies and artificial intelligence (AI) enable realtime data collection and analysis, allowing faster and more accurate anomaly detection. Systems utilizing sensors, such as thermal imaging cameras, to monitor temperature variations within distribution panels, coupled with AI algorithms for anomaly detection, are gaining prominence as innovative solutions for safety management.

In this context, this paper proposes a novel anomaly-detection system to enhance the stability of solar power distribution panels. By utilizing thermal imaging cameras and a faster R-CNN-based AI model, we aim to effectively identify and address anomalies within distribution panels. In this study, we sought to improve the safety and efficiency of safety management practices in power facilities.

Based on these motivations and objectives, this paper discusses the design, implementation, and experimental results of the proposed anomaly-detection system. This study is anticipated to contribute to the advancement of safety management in power facilities, thereby enhancing safety and reliability.

Panthi et al. investigated methods for detecting anomalies in power distribution systems using machine-learning techniques and proposed effective methods for detecting anomalies in power systems by applying various machine-learning algorithms and data mining techniques [1-4].

Furthermore, Imenes et al. combined thermal imaging with deep learning to detect faults in power systems. They used thermal cameras to automatically detect faults in power systems by analyzing images using deep-learning algorithms [5-8].

Syu et al. identified anomalies in power networks using AI algorithms and immediate actions to enhance the safety of power networks [9-11].

Additionally, studies have focused on developing datadriven predictive models to detect equipment faults in power systems in advance and optimize maintenance schedules to enhance system reliability [13,14]. Moreover, notable research involves the utilization of the Internet of things and machine learning for real-time monitoring and anomaly detection in power systems [15].

These related studies have proposed innovative approaches for the safety management and reliability enhancement of power facilities, contributing to strengthening the safety of power systems alongside this study.

In this study, we utilized YOLOv5, which evolved from YOLOv1 to YOLOv8 [16-18]. The YOLOv5 model consists of two main components, the backbone and the head, with the following details:

The backbone extracts feature maps from images; in our case, we employed CSP-Darknet.

YOLOv5 offers four backbone variations ranging from the smallest and lightest YOLOv5s to m, l, and x.

The head is responsible for locating objects based on the extracted feature maps.

Initially, the anchor boxes were set and then utilized to generate the final bounding boxes.

Similar to YOLOv3, the bounding boxes were generated at three scales: small objects with 8-pixel information, medium objects with 16-pixel information, and large objects with 32- pixel information. Each scale employs three anchor boxes, resulting in nine anchor boxes.

In this study, which focused on detecting anomalies in solar power distribution boards using thermal images, we trained the YOLOv5 model to differentiate various parts of the thermal image corresponding to different components of the system. Our study aimed at enhancing object detection rates through hyperparameter tuning using YOLOv5. The following is a summary of the architecture used in our study:

  • Backbone: CSP-Darknet53

  • Neck: SPPF

  • Head: YOLOv3 Head

This study focused on detecting anomalies in solar power distribution boards by training with thermal images. We aimed to classify the different parts of the thermal images corresponding to various components of the system. Accordingly, we utilized YOLOv5 and aimed to enhance the object detection rates through hyperparameter tuning.

Anomaly-detection systems for solar power distribution panels integrate cutting-edge technologies with thermal imaging, AI, and real-time monitoring to enhance the stability, safety, and reliability of solar power distribution panels. The key components and design considerations of the proposed system are outlined below:

1) Thermal Imaging Sensors

High-resolution thermal imaging cameras are strategically positioned to capture thermal data from solar power distribution panels. These sensors continuously monitor temperature variations within the distribution panels, providing valuable thermal images for anomaly detection.

2) Data Acquisition and Preprocessing

Raw thermal images captured by the sensors were transmitted to a central processing unit for data acquisition.

Preprocessing techniques, such as noise reduction, image enhancement, and normalization, were applied to ensure the quality and consistency of the input data.

3) Artificial Intelligence Model Selection

The system utilizes YOLOv5, which was selected for its superior performance in object detection tasks and ability to handle various types of anomalies effectively.

4) Training Data Preparation

To achieve the best learning outcomes, the dataset included a minimum of 1,500 images per class and a minimum of 10,000 instances (labeled objects) per class.

The dataset encompasses diverse thermal images representing different times, angles, and camera configurations to accurately represent real-world scenarios.

5) Model Training and Optimization

The YOLOv5 model was trained on the prepared dataset, starting with pretrained weights to accelerate convergence.

The training settings, including epochs, image size, batch size, and hyperparameters, were carefully selected and optimized to achieve the best performance without overfitting.

6) Real-time Anomaly Detection

Upon completion of training, the trained AI model was deployed for real-time anomaly detection on the incoming thermal images.

The model analyzed each image to identify the regions of interest (ROIs) that exhibited abnormal temperature patterns, indicating potential faults or anomalies within the distribution panels.

7) Alerting and Response Mechanism

The detected anomalies trigger immediate alerts to designated personnel through visual displays or notification systems.

Predefined response protocols, ranging from remote diagnostics to onsite inspection and maintenance, are initiated based on the severity and nature of the anomaly.

8) Continuous Monitoring and Feedback Loop

The system operates in a continuous monitoring mode, regularly updating its anomaly-detection capabilities based on new data and feedback. Feedback mechanisms enable the system to learn from past detections and improve its accuracy over time, enhancing the overall reliability of anomaly detection.

By encompassing these components and design principles, the proposed anomaly-detection system offers a comprehensive solution for enhancing the stability, safety, and reliability of solar power distribution panels.

Fig. 1 illustrates the process used in this study. The system receives thermal images as the input, utilizes the YOLOv5 model to detect objects, displays bounding boxes around the detected objects, and performs pixel mapping. Subsequently, the components where the temperature increased are highlighted.

Fig. 1. Flowchart of object detection system for anomaly detection in solar power distribution panels.

A. Optimization

In this study, optimization was performed to improve the performance and computational efficiency, prevent overfitting, and reduce the model size. The initial hyperparameters in machine learning control various aspects of training, and determining their optimal values can be challenging. Traditional methods, such as grid search, face issues, such as increased computation, owing to the high-dimensional search space, unknown correlations between dimensions, and the cost associated with evaluating fitness at each point. Therefore, genetic algorithms are utilized as suitable candidates for initial hyperparameter searches because of their ability to efficiently navigate complex search spaces.

Table 1 lists the hyperparameters and their respective optimization ranges. Table 2 displays the evolution results of the hyperparameters obtained over five iterations.

Table 1 . Hyperparameter evolution list

No.HyperparametersOptimization domain
1lr: initial learning rate (SGD=1e-2, Adam=1e-3)[1e-5, 1e-1]
2lrf: final OneCycleLR learning rate (lr*lrf)[0.01, 1.0]
3momentum: SGD momentum/Adam beat1[0.6, 0.98]
4weight_decay: optimizer weight decay 5e-4[0.0, 0.001]
5warmup_epochs: warmup epochs (fraction ok)[0.0, 5.0]
6warmup_momentum: warmup initial momentum[0.0, 0.95]
7warmup_bias_lr: warmup initial bias lr[0.0, 0.2]
8box: box loss gain[0.02, 0.2]
9cls: cls loss gain[0.02, 4.0]
10cls_pw: cls BSELoss positive_weight[0.5, 2.0]


Table 2 . Result of hyperparameter evolution

Epochs100
Optimization algorithmGenetic algorithm
Number of evolutions300
FitnessmAP
HyperparametersT1T2T3T4T5
learning rate (lr)0.010.00980.00920.01090.0086
lrf0.010.01030.01070.01120.0108
momentum0.9370.93640.93590.980.9422
weight_decay0.00050.00050.00040.00030.0004
warmup_epochs33.40243.04643.41943.0996
warmup_momentum0.80.86410.89510.950.8457
warmup_bias_lr0.10.10010.10340.10580.1206
box0.050.05780.04420.04780.0496
cls0.50.44260.50060.61770.4831
cls_pw11.0440.97660.81840.9627
mAP0.85720.8690.87190.87740.8797


Fig. 2 shows the results of the training and validation processes using the YOLOv5 model for various loss and performance metrics. The graphs display the results over the epochs, with the horizontal axis representing the epochs and the vertical axis representing the values of the respective metric. These graphs are useful for diagnosing the performance of a machine-learning model and detecting overfitting or other issues.

Fig. 2. Results of training and validation

  • train/box_loss and val/box_loss: These losses measure the accuracy of the bounding box location. Both the training and validation losses tended to decrease as the epochs progressed, indicating that the model was better at predicting the locations of the objects.

  • train/obj_loss and val/obj_loss: The object presence loss indicates how well the model predicts the presence of an object in a certain location. This value also decreased as the number of epochs increased.

  • Train/cls _loss and val/cls_loss: The classification loss shows how accurately the model classifies the class of the object within the bounding box. This loss also exhibited a decreasing trend.

  • Metrics/precision and metrics/recall: Precision is the ratio of correctly included actual objects in the predicted bounding boxes, and recall is the ratio of actual objects that the model correctly detects. Both these metrics maintain high values, indicating that the model performs well in detecting and classifying objects.

  • metrics/mAP_0.5 and metrics/mAP_0.5:0.95: The mean average precision (mAP) is an important indicator that reflects the average precision over several thresholds, evaluating the overall performance of an object detection model. mAP_0.5 refers to the mAP when the intersection over union (IoU) threshold is 0.5, and mAP_0.5:0.95 is the average mAP when the IoU increases from 0.5 to 0.95 in increments of 0.05. Both indicators initially increase sharply and then maintain a stable level, indicating that the model performs at a high level.

Overall, these graphs show that the performance of the YOLOv5 model improved as it progressed through the epochs, particularly through a decrease in loss functions and an increase in mAP, demonstrating good training results. Additionally, the similar values of losses and metrics between the training and validation data suggest minimal signs of overfitting.

Based on the experimental results, it is evident that the proposed anomaly-detection system operates effectively within solar power distribution panels. Object detection using the YOLOv5 model demonstrated high accuracy and rapid processing speed, enabling the identification of various components within distribution panels. Furthermore, the observation of decreasing loss functions and increasing mean accuracy throughout the model training process validated the stability and reliability of the system. An evaluation of the performance of the anomaly-detection system confirmed its applicability and potential benefits in real-world power facilities, indicating significant advancements in safety and reliability enhancement. Therefore, the findings of this study open new horizons for safety management in solar power distribution panels and suggest promising opportunities for future applications in both the business and research domains.

  1. M. Panthi, “Anomaly detection in smart grids using machine learning techniques,” 2020 First International Conference on Power, Control and Computing Technologies (ICPC2T), pp. 220-222, 2020. DOI: 10.1109/ICPC2T48082.2020.9071434.
    CrossRef
  2. J. Mulongo, M. Atemkeng, T. Ansah-Narh, R. R. Rockefeller, G. M. Nguegnang, and M. A. Garuti, “Anomaly detection in power generation plants using machine learning and neural networks,” Applied Artificial Intelligence, vol. 34, no. 1, pp. 64-79, 2020. DOI: https://doi.org/10.1080/08839514.2019.1691839.
    CrossRef
  3. A. Gholami and A. K. Srivastava, “Comparative analysis of ml techniques for data-driven anomaly detection, classification and localization in distribution system,” 2020 52nd North American Power Symposium (NAPS) IEEE, pp. 1-6, 2021. DOI: 10.1109/NAPS50074.2021.9449712.
    KoreaMed CrossRef
  4. M. Ibrahim, A. Alsheikh, F. M. Awaysheh, and M. D. Alshehri, “Machine learning schemes for anomaly detection in solar power plants,” Energies, vol. 15, no. 3, p. 1082, 2022. DOI: https://doi.org/10.3390/en15031082.
    CrossRef
  5. A. G. Imenes, N. S. Noori, O. A. N. Uthaug, R. Kröni, F. Bianchi, and N. Belbachir, “A deep learning approach for automated fault detection on solar modules using image composites,” 2021 IEEE 48th Photovoltaic Specialists Conference (PVSC) IEEE, pp. 1925-1930, 2021. DOI: 10.1109/PVSC43889.2021.9518540.
    CrossRef
  6. N.H. Ishak, M. A. I. Halim, and I. S. Isa, “Detection of Power Distribution Fault in Thermal Images Using CNN,” in Intelligent Multimedia Signal Processing for Smart Ecosystems, Cham: Springer International Publishing, pp. 267-287, 2023. DOI: https://doi.org/10.1007/978-3-031-34873-0_11.
    CrossRef
  7. B. V. Charitha and T. Ananthan, “Machine learning based fault detection in induction motor using thermal imaging,” 2022 3rd International Conference on Electronics and Sustainable Communication Systems (ICESC) IEEE, pp. 929-936, 2022. DOI: 10.1109/ICESC54411.2022.9885282.
  8. C. Wei, “Power grid facility thermal fault diagnosis via object detection with synthetic infrared imagery,” 2021 3rd International Conference on Electrical Engineering and Control Technologies (CEECT) IEEE, pp. 217-221, 2021. DOI: 10.1109/CEECT53198.2021.9672631.
    CrossRef
  9. J. H. Syu, J. C. W. Lin, and G. Srivastava, “AI-Based Electricity Grid Management for Sustainability, Reliability, and Security,” IEEE Consumer Electronics Magazine, 2023. DOI: 10.1109/MCE.2023.3264884.
  10. Y. Himeur, K. Ghanem, A. Alsalemi, F. Bensaali, and A. Amira, “Artificial intelligence-based anomaly detection of energy consumption in buildings: A review, current trends and new perspectives,” Applied Energy, vol. 287, p. 116601, 2021. DOI: https://doi.org/10.1016/j.apenergy.2021.116601.
    CrossRef
  11. C. Park, J. Lee, Y. Kim, J. G. Park, H. Kim, and D. Hong, “An enhanced AI-based network intrusion detection system using generative adversarial networks,” IEEE Internet of Things Journal, vol. 10, no. 3, pp. 2330-2345, 2022. DOI: 10.1109/JIOT.2022.3211346.
    CrossRef
  12. S. Voronov, “Machine learning models for predictive maintenance,” Doctoral dissertation, Linköping University Electronic Press, 2020. DOI: 10.3384/diss.diva-162649.
    CrossRef
  13. V. Vita, G. Fotis, V. Chobanov, C. Pavlatos, and V. Mladenov, “Predictive maintenance for distribution system operators in increasing transformers' reliability,” Electronics, vol. 12, no. 6, p. 1356, 2023. DOI: https://doi.org/10.3390/electronics12061356.
    CrossRef
  14. L. I. Alvarez Quiñones, C. A. Lozano-Moncada, and D. A. Bravo Montenegro, “Machine learning for predictive maintenance scheduling of distribution transformers,” Journal of Quality in Maintenance Engineering, vol. 29, no. 1, pp. 188-202, 2023. DOI: https://doi.org/10.1108/JQME-06-2021-0052.
    CrossRef
  15. R. Bin Mofidul, M. M. Alam, M. H. Rahman, and Y. M. Jang, “Realtime energy data acquisition, anomaly detection, and monitoring system: Implementation of a secured, robust, and integrated global IIoT infrastructure with edge and cloud AI,” Sensors, vol. 22, no. 22, p. 8980, 2022. DOI: https://doi.org/10.3390/s22228980.
    Pubmed KoreaMed CrossRef
  16. A. Vijayakumar and S. Vairavasundaram, “YOLO-based Object Detection Models: A Review and its Applications,” Multimedia Tools and Applications, pp. 1-40, 2024. DOI: https://doi.org/10.1007/s11042-024-18872-y.
    CrossRef
  17. D. G. Choe and D. K. Kim, “Deep learning-based image data processing and archival system for object detection of endangered species,” Journal of Information and Communication Convergence Engineering, vol. 18, no. 4, pp. 267-277, 2020. DOI: https://doi.org/10.6109/jicce.2020.18.4.267.
  18. R. Rijayanti, R. F. Muhammad, and M. Hwang, “Vehicle waiting time information service using vehicle object detection at fuel charging station,” Journal of Information and Communication Convergence Engineering, vol. 18, no. 3, pp. 147-154, 2020. DOI: https://doi.org/10.6109/jicce.2020.18.3.147.

Kwang-Seong Shin

received his M.S. degree from the Dept. of Computer Engineering at Chonbuk National University in 2005 and his Ph.D. degree from Kunsan National University, Gunsan, Republic of Korea, in 2014. Currently, he is an assistant professor in the Department of Computer Engineering at Suncheon National University. His research interests include virtual reality, HCI, immersive virtual environments, and image processing. He can be reached at waver@scnu.ac.kr (e-mail).


Jong-Chan Kim

received his B.S. degree from Sunchon National University in 2000, his M.S. degree from the Department of Computer Science, Sunchon National University in 2002, and his Ph.D. degree from the Department of Computer Science, Sunchon National University in 2007. He worked as a senior researcher professor at the Automation and System Research Institute, Seoul National University in 2013. Currently, he is an assistant professor of the Dept. of Computer Engineering, Sunchon National University, Republic of Korea (Sep. 2021-). His current research interests include image processing, computer graphics, automatic control, deep learning, and computer vision.


Seong-Yoon Shin

received his M.S. and Ph.D. degrees from the Dept. of Computer Information Engineering of Kunsan National University, Gunsan, Republic of Korea, in 1997 and 2003, respectively. Since 2006, he has been a professor in the School of Computer Science and Engineering. His research interests include image processing, computer vision, and virtual reality. He can be contacted at s3397220@kunsan.ac.kr (e-mail).


Article

Regular paper

Journal of information and communication convergence engineering 2024; 22(2): 159-164

Published online June 30, 2024 https://doi.org/10.56977/jicce.2024.22.2.159

Copyright © Korea Institute of Information and Communication Engineering.

Anomaly Detection System for Solar Power Distribution Panels utilizing Thermal Images

Kwang-Seong Shin 1, Jong-Chan Kim 2*, and Seong-Yoon Shin3* , Member, KIICE

1Department of Computer Engineering, Sunchon National University, Sunchon 57922, Republic of Korea
2Department of Computer Engineering, Sunchon National University, Sunchon 57922, Republic of Korea
3School of Computer Science and Engineering, Kunsan National University, Gunsan 54150, Republic of Korea

Correspondence to:Jong-Chan Kim (E-mail: seaghost@scnu.ac.kr, Tel: +82-61-750-3621), Department of Computer Engineering, Sunchon National University, Suncheon 57922, Republic of Korea
Seong-Yoon Shin (E-mail: s3397220@kunsan.ac.kr, Tel: +82-63-469-4860), School of Computer Science and Engineering, Kunsan National University, Gunsan 54150, Republic of Korea

Received: April 29, 2024; Revised: May 9, 2024; Accepted: May 11, 2024

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/3.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

This study aimed to develop an advanced anomaly-detection system tailored for solar power distribution panels using thermal imaging cameras to ensure operational stability. It addresses the imperative shift toward digitalized safety management in electrical facilities, transcending the limitations of conventional empirical methodologies. Our proposed system leverages a faster R-CNN-based artificial intelligence model optimized through meticulous hyperparameter tuning to efficiently detect anomalies in distribution panels. Through comprehensive experimentation, we validated the efficacy of the system in accurately identifying anomalies, thereby propelling safety protocols forward during the fourth industrial revolution. This study signifies a significant stride toward fortifying the integrity and resilience of solar power distribution systems, which is pivotal for adapting to emerging technological paradigms and evolving safety standards in the energy sector. These findings offer valuable insights for enhancing the reliability and efficiency of safety management practices and fostering a safer and more sustainable energy landscape.

Keywords: Anomaly Detection, Digitalization of Power Facilities, Faster R-CNN, Object Detection, Thermal Image

I. INTRODUCTION

Solar power distribution panels play a pivotal role in modern energy systems by ensuring the reliability and safety of power supply. These panels are responsible for converting high- or extra-high-voltage electricity from power plants or substations into usable voltages for consumers, and for distributing power safely throughout the grid. However, maintaining the safety and integrity of these electrical facilities requires effective anomaly detection and response measures. Traditional approaches to safety management often rely on experience and subjectivity, which can be inefficient and may not adequately address the potential risks.

Previous safety management methods have been predominantly reactive and manual, addressing issues only after they occur. This reactive approach makes it challenging to respond to anomalies before escalation, and preventive measures may be limited. As the scale and complexity of power facilities continue to increase, the limitations of traditional methods have become more apparent.

Recent technological advancements have offered new possibilities for the safety management of power facilities. Digital technologies and artificial intelligence (AI) enable realtime data collection and analysis, allowing faster and more accurate anomaly detection. Systems utilizing sensors, such as thermal imaging cameras, to monitor temperature variations within distribution panels, coupled with AI algorithms for anomaly detection, are gaining prominence as innovative solutions for safety management.

In this context, this paper proposes a novel anomaly-detection system to enhance the stability of solar power distribution panels. By utilizing thermal imaging cameras and a faster R-CNN-based AI model, we aim to effectively identify and address anomalies within distribution panels. In this study, we sought to improve the safety and efficiency of safety management practices in power facilities.

Based on these motivations and objectives, this paper discusses the design, implementation, and experimental results of the proposed anomaly-detection system. This study is anticipated to contribute to the advancement of safety management in power facilities, thereby enhancing safety and reliability.

II. RELATED WORKS

Panthi et al. investigated methods for detecting anomalies in power distribution systems using machine-learning techniques and proposed effective methods for detecting anomalies in power systems by applying various machine-learning algorithms and data mining techniques [1-4].

Furthermore, Imenes et al. combined thermal imaging with deep learning to detect faults in power systems. They used thermal cameras to automatically detect faults in power systems by analyzing images using deep-learning algorithms [5-8].

Syu et al. identified anomalies in power networks using AI algorithms and immediate actions to enhance the safety of power networks [9-11].

Additionally, studies have focused on developing datadriven predictive models to detect equipment faults in power systems in advance and optimize maintenance schedules to enhance system reliability [13,14]. Moreover, notable research involves the utilization of the Internet of things and machine learning for real-time monitoring and anomaly detection in power systems [15].

These related studies have proposed innovative approaches for the safety management and reliability enhancement of power facilities, contributing to strengthening the safety of power systems alongside this study.

In this study, we utilized YOLOv5, which evolved from YOLOv1 to YOLOv8 [16-18]. The YOLOv5 model consists of two main components, the backbone and the head, with the following details:

The backbone extracts feature maps from images; in our case, we employed CSP-Darknet.

YOLOv5 offers four backbone variations ranging from the smallest and lightest YOLOv5s to m, l, and x.

The head is responsible for locating objects based on the extracted feature maps.

Initially, the anchor boxes were set and then utilized to generate the final bounding boxes.

Similar to YOLOv3, the bounding boxes were generated at three scales: small objects with 8-pixel information, medium objects with 16-pixel information, and large objects with 32- pixel information. Each scale employs three anchor boxes, resulting in nine anchor boxes.

In this study, which focused on detecting anomalies in solar power distribution boards using thermal images, we trained the YOLOv5 model to differentiate various parts of the thermal image corresponding to different components of the system. Our study aimed at enhancing object detection rates through hyperparameter tuning using YOLOv5. The following is a summary of the architecture used in our study:

  • Backbone: CSP-Darknet53

  • Neck: SPPF

  • Head: YOLOv3 Head

This study focused on detecting anomalies in solar power distribution boards by training with thermal images. We aimed to classify the different parts of the thermal images corresponding to various components of the system. Accordingly, we utilized YOLOv5 and aimed to enhance the object detection rates through hyperparameter tuning.

III. SYSTEM MODEL AND METHODS

Anomaly-detection systems for solar power distribution panels integrate cutting-edge technologies with thermal imaging, AI, and real-time monitoring to enhance the stability, safety, and reliability of solar power distribution panels. The key components and design considerations of the proposed system are outlined below:

1) Thermal Imaging Sensors

High-resolution thermal imaging cameras are strategically positioned to capture thermal data from solar power distribution panels. These sensors continuously monitor temperature variations within the distribution panels, providing valuable thermal images for anomaly detection.

2) Data Acquisition and Preprocessing

Raw thermal images captured by the sensors were transmitted to a central processing unit for data acquisition.

Preprocessing techniques, such as noise reduction, image enhancement, and normalization, were applied to ensure the quality and consistency of the input data.

3) Artificial Intelligence Model Selection

The system utilizes YOLOv5, which was selected for its superior performance in object detection tasks and ability to handle various types of anomalies effectively.

4) Training Data Preparation

To achieve the best learning outcomes, the dataset included a minimum of 1,500 images per class and a minimum of 10,000 instances (labeled objects) per class.

The dataset encompasses diverse thermal images representing different times, angles, and camera configurations to accurately represent real-world scenarios.

5) Model Training and Optimization

The YOLOv5 model was trained on the prepared dataset, starting with pretrained weights to accelerate convergence.

The training settings, including epochs, image size, batch size, and hyperparameters, were carefully selected and optimized to achieve the best performance without overfitting.

6) Real-time Anomaly Detection

Upon completion of training, the trained AI model was deployed for real-time anomaly detection on the incoming thermal images.

The model analyzed each image to identify the regions of interest (ROIs) that exhibited abnormal temperature patterns, indicating potential faults or anomalies within the distribution panels.

7) Alerting and Response Mechanism

The detected anomalies trigger immediate alerts to designated personnel through visual displays or notification systems.

Predefined response protocols, ranging from remote diagnostics to onsite inspection and maintenance, are initiated based on the severity and nature of the anomaly.

8) Continuous Monitoring and Feedback Loop

The system operates in a continuous monitoring mode, regularly updating its anomaly-detection capabilities based on new data and feedback. Feedback mechanisms enable the system to learn from past detections and improve its accuracy over time, enhancing the overall reliability of anomaly detection.

By encompassing these components and design principles, the proposed anomaly-detection system offers a comprehensive solution for enhancing the stability, safety, and reliability of solar power distribution panels.

Fig. 1 illustrates the process used in this study. The system receives thermal images as the input, utilizes the YOLOv5 model to detect objects, displays bounding boxes around the detected objects, and performs pixel mapping. Subsequently, the components where the temperature increased are highlighted.

Figure 1. Flowchart of object detection system for anomaly detection in solar power distribution panels.

IV. RESULTS AND DISCUSSIONS

A. Optimization

In this study, optimization was performed to improve the performance and computational efficiency, prevent overfitting, and reduce the model size. The initial hyperparameters in machine learning control various aspects of training, and determining their optimal values can be challenging. Traditional methods, such as grid search, face issues, such as increased computation, owing to the high-dimensional search space, unknown correlations between dimensions, and the cost associated with evaluating fitness at each point. Therefore, genetic algorithms are utilized as suitable candidates for initial hyperparameter searches because of their ability to efficiently navigate complex search spaces.

Table 1 lists the hyperparameters and their respective optimization ranges. Table 2 displays the evolution results of the hyperparameters obtained over five iterations.

Table 1 . Hyperparameter evolution list.

No.HyperparametersOptimization domain
1lr: initial learning rate (SGD=1e-2, Adam=1e-3)[1e-5, 1e-1]
2lrf: final OneCycleLR learning rate (lr*lrf)[0.01, 1.0]
3momentum: SGD momentum/Adam beat1[0.6, 0.98]
4weight_decay: optimizer weight decay 5e-4[0.0, 0.001]
5warmup_epochs: warmup epochs (fraction ok)[0.0, 5.0]
6warmup_momentum: warmup initial momentum[0.0, 0.95]
7warmup_bias_lr: warmup initial bias lr[0.0, 0.2]
8box: box loss gain[0.02, 0.2]
9cls: cls loss gain[0.02, 4.0]
10cls_pw: cls BSELoss positive_weight[0.5, 2.0]


Table 2 . Result of hyperparameter evolution.

Epochs100
Optimization algorithmGenetic algorithm
Number of evolutions300
FitnessmAP
HyperparametersT1T2T3T4T5
learning rate (lr)0.010.00980.00920.01090.0086
lrf0.010.01030.01070.01120.0108
momentum0.9370.93640.93590.980.9422
weight_decay0.00050.00050.00040.00030.0004
warmup_epochs33.40243.04643.41943.0996
warmup_momentum0.80.86410.89510.950.8457
warmup_bias_lr0.10.10010.10340.10580.1206
box0.050.05780.04420.04780.0496
cls0.50.44260.50060.61770.4831
cls_pw11.0440.97660.81840.9627
mAP0.85720.8690.87190.87740.8797


Fig. 2 shows the results of the training and validation processes using the YOLOv5 model for various loss and performance metrics. The graphs display the results over the epochs, with the horizontal axis representing the epochs and the vertical axis representing the values of the respective metric. These graphs are useful for diagnosing the performance of a machine-learning model and detecting overfitting or other issues.

Figure 2. Results of training and validation

  • train/box_loss and val/box_loss: These losses measure the accuracy of the bounding box location. Both the training and validation losses tended to decrease as the epochs progressed, indicating that the model was better at predicting the locations of the objects.

  • train/obj_loss and val/obj_loss: The object presence loss indicates how well the model predicts the presence of an object in a certain location. This value also decreased as the number of epochs increased.

  • Train/cls _loss and val/cls_loss: The classification loss shows how accurately the model classifies the class of the object within the bounding box. This loss also exhibited a decreasing trend.

  • Metrics/precision and metrics/recall: Precision is the ratio of correctly included actual objects in the predicted bounding boxes, and recall is the ratio of actual objects that the model correctly detects. Both these metrics maintain high values, indicating that the model performs well in detecting and classifying objects.

  • metrics/mAP_0.5 and metrics/mAP_0.5:0.95: The mean average precision (mAP) is an important indicator that reflects the average precision over several thresholds, evaluating the overall performance of an object detection model. mAP_0.5 refers to the mAP when the intersection over union (IoU) threshold is 0.5, and mAP_0.5:0.95 is the average mAP when the IoU increases from 0.5 to 0.95 in increments of 0.05. Both indicators initially increase sharply and then maintain a stable level, indicating that the model performs at a high level.

Overall, these graphs show that the performance of the YOLOv5 model improved as it progressed through the epochs, particularly through a decrease in loss functions and an increase in mAP, demonstrating good training results. Additionally, the similar values of losses and metrics between the training and validation data suggest minimal signs of overfitting.

V. CONCLUSIONS

Based on the experimental results, it is evident that the proposed anomaly-detection system operates effectively within solar power distribution panels. Object detection using the YOLOv5 model demonstrated high accuracy and rapid processing speed, enabling the identification of various components within distribution panels. Furthermore, the observation of decreasing loss functions and increasing mean accuracy throughout the model training process validated the stability and reliability of the system. An evaluation of the performance of the anomaly-detection system confirmed its applicability and potential benefits in real-world power facilities, indicating significant advancements in safety and reliability enhancement. Therefore, the findings of this study open new horizons for safety management in solar power distribution panels and suggest promising opportunities for future applications in both the business and research domains.

Fig 1.

Figure 1.Flowchart of object detection system for anomaly detection in solar power distribution panels.
Journal of Information and Communication Convergence Engineering 2024; 22: 159-164https://doi.org/10.56977/jicce.2024.22.2.159

Fig 2.

Figure 2.Results of training and validation
Journal of Information and Communication Convergence Engineering 2024; 22: 159-164https://doi.org/10.56977/jicce.2024.22.2.159

Table 1 . Hyperparameter evolution list.

No.HyperparametersOptimization domain
1lr: initial learning rate (SGD=1e-2, Adam=1e-3)[1e-5, 1e-1]
2lrf: final OneCycleLR learning rate (lr*lrf)[0.01, 1.0]
3momentum: SGD momentum/Adam beat1[0.6, 0.98]
4weight_decay: optimizer weight decay 5e-4[0.0, 0.001]
5warmup_epochs: warmup epochs (fraction ok)[0.0, 5.0]
6warmup_momentum: warmup initial momentum[0.0, 0.95]
7warmup_bias_lr: warmup initial bias lr[0.0, 0.2]
8box: box loss gain[0.02, 0.2]
9cls: cls loss gain[0.02, 4.0]
10cls_pw: cls BSELoss positive_weight[0.5, 2.0]

Table 2 . Result of hyperparameter evolution.

Epochs100
Optimization algorithmGenetic algorithm
Number of evolutions300
FitnessmAP
HyperparametersT1T2T3T4T5
learning rate (lr)0.010.00980.00920.01090.0086
lrf0.010.01030.01070.01120.0108
momentum0.9370.93640.93590.980.9422
weight_decay0.00050.00050.00040.00030.0004
warmup_epochs33.40243.04643.41943.0996
warmup_momentum0.80.86410.89510.950.8457
warmup_bias_lr0.10.10010.10340.10580.1206
box0.050.05780.04420.04780.0496
cls0.50.44260.50060.61770.4831
cls_pw11.0440.97660.81840.9627
mAP0.85720.8690.87190.87740.8797

References

  1. M. Panthi, “Anomaly detection in smart grids using machine learning techniques,” 2020 First International Conference on Power, Control and Computing Technologies (ICPC2T), pp. 220-222, 2020. DOI: 10.1109/ICPC2T48082.2020.9071434.
    CrossRef
  2. J. Mulongo, M. Atemkeng, T. Ansah-Narh, R. R. Rockefeller, G. M. Nguegnang, and M. A. Garuti, “Anomaly detection in power generation plants using machine learning and neural networks,” Applied Artificial Intelligence, vol. 34, no. 1, pp. 64-79, 2020. DOI: https://doi.org/10.1080/08839514.2019.1691839.
    CrossRef
  3. A. Gholami and A. K. Srivastava, “Comparative analysis of ml techniques for data-driven anomaly detection, classification and localization in distribution system,” 2020 52nd North American Power Symposium (NAPS) IEEE, pp. 1-6, 2021. DOI: 10.1109/NAPS50074.2021.9449712.
    KoreaMed CrossRef
  4. M. Ibrahim, A. Alsheikh, F. M. Awaysheh, and M. D. Alshehri, “Machine learning schemes for anomaly detection in solar power plants,” Energies, vol. 15, no. 3, p. 1082, 2022. DOI: https://doi.org/10.3390/en15031082.
    CrossRef
  5. A. G. Imenes, N. S. Noori, O. A. N. Uthaug, R. Kröni, F. Bianchi, and N. Belbachir, “A deep learning approach for automated fault detection on solar modules using image composites,” 2021 IEEE 48th Photovoltaic Specialists Conference (PVSC) IEEE, pp. 1925-1930, 2021. DOI: 10.1109/PVSC43889.2021.9518540.
    CrossRef
  6. N.H. Ishak, M. A. I. Halim, and I. S. Isa, “Detection of Power Distribution Fault in Thermal Images Using CNN,” in Intelligent Multimedia Signal Processing for Smart Ecosystems, Cham: Springer International Publishing, pp. 267-287, 2023. DOI: https://doi.org/10.1007/978-3-031-34873-0_11.
    CrossRef
  7. B. V. Charitha and T. Ananthan, “Machine learning based fault detection in induction motor using thermal imaging,” 2022 3rd International Conference on Electronics and Sustainable Communication Systems (ICESC) IEEE, pp. 929-936, 2022. DOI: 10.1109/ICESC54411.2022.9885282.
  8. C. Wei, “Power grid facility thermal fault diagnosis via object detection with synthetic infrared imagery,” 2021 3rd International Conference on Electrical Engineering and Control Technologies (CEECT) IEEE, pp. 217-221, 2021. DOI: 10.1109/CEECT53198.2021.9672631.
    CrossRef
  9. J. H. Syu, J. C. W. Lin, and G. Srivastava, “AI-Based Electricity Grid Management for Sustainability, Reliability, and Security,” IEEE Consumer Electronics Magazine, 2023. DOI: 10.1109/MCE.2023.3264884.
  10. Y. Himeur, K. Ghanem, A. Alsalemi, F. Bensaali, and A. Amira, “Artificial intelligence-based anomaly detection of energy consumption in buildings: A review, current trends and new perspectives,” Applied Energy, vol. 287, p. 116601, 2021. DOI: https://doi.org/10.1016/j.apenergy.2021.116601.
    CrossRef
  11. C. Park, J. Lee, Y. Kim, J. G. Park, H. Kim, and D. Hong, “An enhanced AI-based network intrusion detection system using generative adversarial networks,” IEEE Internet of Things Journal, vol. 10, no. 3, pp. 2330-2345, 2022. DOI: 10.1109/JIOT.2022.3211346.
    CrossRef
  12. S. Voronov, “Machine learning models for predictive maintenance,” Doctoral dissertation, Linköping University Electronic Press, 2020. DOI: 10.3384/diss.diva-162649.
    CrossRef
  13. V. Vita, G. Fotis, V. Chobanov, C. Pavlatos, and V. Mladenov, “Predictive maintenance for distribution system operators in increasing transformers' reliability,” Electronics, vol. 12, no. 6, p. 1356, 2023. DOI: https://doi.org/10.3390/electronics12061356.
    CrossRef
  14. L. I. Alvarez Quiñones, C. A. Lozano-Moncada, and D. A. Bravo Montenegro, “Machine learning for predictive maintenance scheduling of distribution transformers,” Journal of Quality in Maintenance Engineering, vol. 29, no. 1, pp. 188-202, 2023. DOI: https://doi.org/10.1108/JQME-06-2021-0052.
    CrossRef
  15. R. Bin Mofidul, M. M. Alam, M. H. Rahman, and Y. M. Jang, “Realtime energy data acquisition, anomaly detection, and monitoring system: Implementation of a secured, robust, and integrated global IIoT infrastructure with edge and cloud AI,” Sensors, vol. 22, no. 22, p. 8980, 2022. DOI: https://doi.org/10.3390/s22228980.
    Pubmed KoreaMed CrossRef
  16. A. Vijayakumar and S. Vairavasundaram, “YOLO-based Object Detection Models: A Review and its Applications,” Multimedia Tools and Applications, pp. 1-40, 2024. DOI: https://doi.org/10.1007/s11042-024-18872-y.
    CrossRef
  17. D. G. Choe and D. K. Kim, “Deep learning-based image data processing and archival system for object detection of endangered species,” Journal of Information and Communication Convergence Engineering, vol. 18, no. 4, pp. 267-277, 2020. DOI: https://doi.org/10.6109/jicce.2020.18.4.267.
  18. R. Rijayanti, R. F. Muhammad, and M. Hwang, “Vehicle waiting time information service using vehicle object detection at fuel charging station,” Journal of Information and Communication Convergence Engineering, vol. 18, no. 3, pp. 147-154, 2020. DOI: https://doi.org/10.6109/jicce.2020.18.3.147.
JICCE
Sep 30, 2024 Vol.22 No.3, pp. 173~266

Stats or Metrics

Share this article on

  • line

Related articles in JICCE

Journal of Information and Communication Convergence Engineering Jouranl of information and
communication convergence engineering
(J. Inf. Commun. Converg. Eng.)

eISSN 2234-8883
pISSN 2234-8255