nach oben

Erschienen in:

16.10.2023

An Improved YOLOv5s Fire Detection Model

verfasst von: Zhan Dou, Hang Zhou, Zhe Liu, Yuanhao Hu, Pengchao Wang, Jianwen Zhang, Qianlin Wang, Liangchao Chen, Xu Diao, Jinghai Li

Erschienen in: Fire Technology | Ausgabe 1/2024

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

It is well-established that contact fire sensors are susceptible to interference from non-fire particles and cannot be applied to fire alarms in both large indoor and outdoor open spaces. On the other hand, the fire detection technology based on the image has several advantages including non-contact, fast response, strong anti-interference, unlimited application space, and comprehensive fire alarm information, which is preferable to fire detection. To this end, in this work, eight existing object detection models were first compared based on convolutional neural networks by autonomously collecting flame smoke datasets. From the acquired results, it was demonstrated that the YOLOv5 network has higher Mean Average Precision (mAP) and Frame Per Second (FPS) than the others. Next, further optimization of the YOLOv5s network was carried out. By introducing Convolutional Block Attention Module (CBAM), replacing PANet with BiFPN, and replacing nearest neighbor interpolation with transposed convolution (TC), the accuracy of the YOLOv5s network was significantly improved. Simultaneously, three lightweight networks, namely MobileNetV3, ShuffleNetV2, and GhostNet, were used to lighten the YOLOv5s network. The validation results indicated that the mAP of the improved YOLOv5s model reached 82.1%, the parameters were as low as 5.9 M and the floating-point operations (FLOPs) dropped to 8.1G. Finally, Single Eye (SiEYE) and Double Eyes (DoEYE) detection networks were proposed for emergency conditions based on the above-mentioned improvements. From the test results, it was indicated that the network has stronger robustness and meets the fire detection requirements, which is of great importance for the next research on smoke diffusion prediction.

Vorheriger Artikel Statistical Distribution of Heat Release Rate Data for Single Household Items

Nächster Artikel Fractal and Spectral Analysis of Recent Wildfire Scars in Greece

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Luo YX, Li Q, Jiang LR et al (2021) Analysis of Chinese fire statistics during the period 1997–2017. Fire Saf J. https://doi.org/10.1016/j.firesaf.2021.103400CrossRef

Girshick R, Donahue J, Darrell T et al (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: 27th IEEE Conference on computer vision and pattern recognition (CVPR), Jun 23–28 2014 Columbus, OH, pp 580–587. https://doi.org/10.1109/cvpr.2014.81

Girshick R et al (2015) Fast R-CNN. IEEE International Conference on computer vision, Dec 11–18 Santiago, Chile, pp 1440–1448. https://doi.org/10.1109/iccv.2015.169

Ren SQ, He KM, Girshick R et al (2017) Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal 39:1137–1149. https://doi.org/10.1109/tpami.2016.2577031CrossRef

Redmon J, Divvala S, Girshick R et al (2016) You only look once: unified, real-time object detection. In: 2016 IEEE Conference on computer vision and pattern recognition (CVPR), Jun 27–30 2016 Seattle, WA, pp 779–788. https://doi.org/10.1109/cvpr.2016.91

Liu W, Anguelov D, Erhan D et al (2016) SSD: single shot multibox detector. In: 14th European Conference on computer vision (ECCV), Oct 08–16 2016 Amsterdam, Netherland, pp 21–37. https://doi.org/10.1007/978-3-319-46448-0_2

Tian Z, Shen CH, Chen H et al (2019) FCOS: fully convolutional one-stage object detection. IEEE/CVF International Conference on computer vision (ICCV), Oct 27-Nov 02 2019 Seoul, South Korea, pp 9626–9635. https://doi.org/10.1109/iccv.2019.00972

Zhang HY, Wang Y, Dayoub F et al (2021) VarifocalNet: an IoU-aware dense object detector. In: IEEE/CVF Conference on computer vision and pattern recognition (CVPR), Jun 19–25 2021 Electr Network, pp 8510–8519. https://doi.org/10.1109/cvpr46437.2021.00841

Krizhevsky A, Sutskever I, Hinton GE (2017) Imagenet classification with deep convolutional neural networks. Commun ACM 60:84–90. https://doi.org/10.1145/3065386CrossRef

10.

Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: International Conference on learning representations (ICLR). 2015, pp 1–14. https://doi.org/10.48550/arXiv.1409.1556

11.

Szegedy C, Liu W, Jia YQ et al (2015) Going Deeper with Convolutions. IEEE Conference on computer vision and pattern recognition (CVPR), Jun 07–12 2015 Boston, MA, pp 1–9. https://doi.org/10.1109/cvpr.2015.7298594

12.

He KM, Zhang XY, Ren SQ et al (2016) Deep residual learning for image recognition. In: 2016 IEEE Conference on computer vision and pattern recognition (CVPR), Jun 27–30 2016 Seattle, WA, pp 770–778. https://doi.org/10.1109/cvpr.2016.90

13.

Tan MX, Le QV (2019) EfficientNet: rethinking model scaling for convolutional neural networks. In: 36th International Conference on machine learning (ICML), Jun 09–15 2019 Long Beach, CA. https://doi.org/10.48550/arXiv.1905.11946

14.

Hu YC, Lu XB (2018) Real-time video fire smoke detection by utilizing spatial-temporal ConvNet features. Multimed Tools Appl 77:29283–29301. https://doi.org/10.1007/s11042-018-5978-5CrossRef

15.

Muhammad K, Rodrigues J, Kozlov S et al (2020) Energy-efficient monitoring of fire scenes for intelligent networks. Ieee Netw 34:108–115. https://doi.org/10.1109/mnet.011.1900257CrossRef

16.

Xu G, Zhang YM, Zhang QX et al (2017) Deep domain adaptation based video smoke detection using synthetic smoke images. Fire Saf J 93:53–59. https://doi.org/10.1016/j.firesaf.2017.08.004CrossRef

17.

Lin GH, Zhang YM, Xu G et al (2019) Smoke detection on video sequences using 3D convolutional neural networks. Fire Technol 55:1827–1847. https://doi.org/10.1007/s10694-019-00832-wCrossRef

18.

Redmon J, Farhadi A, IEEE (2017) YOLO9000: better, faster, stronger. In: 30th IEEE/CVF Conference on computer vision and pattern recognition (CVPR), Jul 21–26 2017 Honolulu, HI, pp 6517–6525. https://doi.org/10.1109/cvpr.2017.690

19.

Redmon J, Farhadi A (2018) YOLOv3: An incremental improvement. arXiv preprint arXiv:1804.02767. https://doi.org/10.48550/arXiv.1804.02767

20.

Bochkovskiy A, Wang CY, Liao H (2020) YOLOv4: Optimal speed and accuracy of object detection. arXiv preprint arXiv:2004.10934. https://doi.org/10.48550/arXiv.2004.10934

21.

Tian YN, Yang GD, Wang Z, Wang H, Li E, Liang ZZ (2019) Apple detection during different growth stages in orchards using the improved YOLO-V3 model. Comput Electron Agric 157:417–426. https://doi.org/10.1016/j.compag.2019.01.012CrossRef

22.

Liu J, Wang XW (2020) Tomato diseases and pests detection based on improved Yolo V3 convolutional neural network. Front Plant Sci. https://doi.org/10.3389/fpls.2020.00898CrossRef

23.

Chen WJ, Huang HB, Peng S, Zhou CS, Zhang CP (2021) YOLO-face: a real-time face detector. Vis Comput 37:805–813. https://doi.org/10.1007/s00371-020-01831-7CrossRef

24.

Al-Masni MA, Al-Antari MA, Park JM, Gi G, Kim TY, Rivera P, Valarezo E, Choi MT, Han SM, Kim TS (2018) Simultaneous detection and classification of breast masses in digital mammograms via a deep learning YOLO-based CAD system. Comput Methods Programs Biomed 157:85–94. https://doi.org/10.1016/j.cmpb.2018.01.017CrossRef

25.

UnverAyan HME (2019) Skin lesion segmentation in dermoscopic images with combination of YOLO and GrabCut algorithm. Diagnostics 9(3):72. https://doi.org/10.3390/diagnostics9030072CrossRef

26.

Cheng LB, Li J, Duan P, Wang MG (2021) A small attentional YOLO model for landslide detection from satellite remote sensing images. Landslides 18:2751–2765. https://doi.org/10.1007/s10346-021-01694-6CrossRef

27.

Zakria Z, Deng JH, Kumar R, Khokhar MS, Cai JY, Kumar J (2022) Multiscale and direction target detecting in remote sensing images via modified YOLO-v4. IEEE J-Stars 15:1039–1048. https://doi.org/10.1109/JSTARS.2022.3140776CrossRef

28.

He D, Xu K, Zhou P (2019) Defect detection of hot rolled steels with a new object detection framework called classification priority network. Comput Ind Eng 128:290–297. https://doi.org/10.1016/j.cie.2018.12.043CrossRef

29.

Jing JF, Zhuo D, Zhang HH, Liang Y, Zheng M (2020) Fabric defect detection using the improved YOLOv3 model. J Eng Fiber Fabr. https://doi.org/10.1177/1558925020908268CrossRef

30.

Xie LL, Ahmad T, Jin LW, Liu YL, Zhang S (2018) A new CNN-based method for multi-directional car license plate detection. IEEE Trans Intell Transp 19:507–517. https://doi.org/10.1109/TITS.2017.2784093CrossRef

31.

Zhang X, Yang W, Tang XL, Liu J (2018) A fast learning method for accurate and robust lane detection using two-stage feature extraction with YOLO v3. Sensors 18(12):4308. https://doi.org/10.3390/s18124308CrossRef

32.

Chen JZ, Jia KK, Chen WQ, Lv ZH, Zhang RH (2022) A real-time and high-precision method for small traffic-signs recognition. Neural Comput Appl 34:2233–2245. https://doi.org/10.1007/s00521-021-06526-1CrossRef

33.

Zhao L, Zhi LQ, Zhao C et al (2022) Fire-YOLO: a small target object detection method for fire inspection. Sustainability 14(9):4930. https://doi.org/10.3390/su14094930CrossRef

34.

dos Reis DH, Welfer D, Cuadros M, Gamarra DFT (2019) Mobile robot navigation using an object recognition software with RGBD images and the YOLO algorithm. Appl Artif Intell 33:1290–1305. https://doi.org/10.1080/08839514.2019.1684778CrossRef

35.

Suo R, Gao FF, Zhou ZX, Fu LS, Song ZZ, Dhupia J, Li R, Cui YJ (2021) Improved multi-classes kiwifruit detection in orchard to avoid collisions during robotic picking. Comput Electron Agric. https://doi.org/10.1016/j.compag.2021.106052CrossRef

36.

Nepal U, Eslamiat H (2022) Comparing YOLOv3, YOLOv4 and YOLOv5 for autonomous landing spot detection in faulty UAVs. Sensors 22(2):464. https://doi.org/10.3390/s22020464CrossRef

37.

Ojala T, Pietikainen M, Harwood D (1996) A comparative study of texture measures with classification based on featured distributions. Pattern recognit 29:51–59. https://doi.org/10.1016/0031-3203(95)00067-4CrossRef

38.

Ojala T, Pietikainen M, Harwood D (1994) Performance evaluation of texture measures with classification based on Kullback discrimination of distributions. In: Proceedings of 12th International Conference on pattern recognition, IEEE, pp 582–585. https://doi.org/10.1109/ICPR.1994.576366

39.

Zhao ZQ, Zheng P, Xu ST et al (2019) Object detection with deep learning: a review. IEEE Trans Neural Netw Learn 30:3212–3232. https://doi.org/10.1109/tnnls.2018.2876865CrossRef

40.

Vaswani A, Shazeer N, Parmar N et al (2017) Attention is all you need. In: 31st Annual Conference on neural information processing systems (NIPS), Dec 04–09 2017 Long Beach, CA. https://doi.org/10.48550/arXiv.1706.03762

41.

Carion N, Massa F, Synnaeve G et al (2020) End-to-end object detection with transformers. In: Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part I 16, Springer, pp 213–229. https://doi.org/10.48550/arXiv.2005.12872

42.

Parmar N, Vaswani A, Uszkoreit J et al (2018) Image transformer. In: 35th International Conference on MACHINE LEARNING (ICML), Jul 10–15 2018 Stockholm, Sweden. https://doi.org/10.48550/arXiv.1802.05751

43.

Dosovitskiy A, Beyer L, Kolesnikov A et al (2020) An image is worth 16 x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929. https://doi.org/10.48550/arXiv.2010.11929

44.

Liu Z, Lin Y T, Cao Y et al (2021) Swin transformer: hierarchical vision transformer using shifted windows. In: 18th IEEE/CVF International Conference on computer vision (ICCV), Oct 11–17 2021 Electr Network, pp 9992–10002. https://doi.org/10.48550/arXiv.2103.14030

45.

Ghali R, Akhloufi MA, Jmal M, Mseddi WS, Attia R (2021) Wildfire segmentation using deep vision transformers. Remote Sens 13(17):3527. https://doi.org/10.3390/rs13173527CrossRef

46.

Li YM, Zhang W, Liu YY, Jing RD, Liu CS (2022) An efficient fire and smoke detection algorithm based on an end-to-end structured network. Eng Appl Artif Intell. https://doi.org/10.1016/j.engappai.2022.105492CrossRef

47.

Zheng Y, Zhang G, Tan SQ, Yang ZG, Wen DX, Xiao HS (2023) A forest fire smoke detection model combining convolutional neural network and vision transformer. Front For Glob Change. https://doi.org/10.3389/ffgc.2023.1136969CrossRef

48.

Cheng GT, Zhou YC, Gao S, Li YY, Yu H (2023) Convolution-enhanced vision transformer network for smoke recognition. Fire Technol 59:925–948. https://doi.org/10.1007/s10694-023-01378-8CrossRef

49.

Wang X, Wang X, Lin H (2022) Review on improvement of typical object detection algorithms in deep learning. Comput Eng Appl 58:42–57. https://doi.org/10.3778/j.issn.1002-8331.2110-0070CrossRef

50.

Tan M, Pang R, Le Q V (2020) EfficientDet: Scalable and efficient object detection. In: Proceedings of the IEEE/CVF Conference on computer vision and pattern recognition, pp 10781–10790. https://doi.org/10.48550/arXiv.1911.09070

51.

Howard A, Sandler M, Chu G et al (2019) Searching for MobileNetV3. In: IEEE/CVF International Conference on computer vision (ICCV), Oct 27-Nov 02 2019 Seoul, South Korea, pp 1314–1324. https://doi.org/10.1109/iccv.2019.00140

52.

Ma N N, Zhang X Y, Zheng H T et al (2018) ShuffleNet V2: practical guidelines for efficient CNN architecture design. In: 15th European Conference on computer vision (ECCV), Sep 08–14 2018 Munich, germany, pp 122–138. https://doi.org/10.1007/978-3-030-01264-9_8

53.

Han K, Wang Y H, Tian Q et al (2020) GhostNet: More Features from Cheap Operations. In: IEEE/CVF Conference on computer vision and pattern recognition (CVPR), Jun 14–19 2020 Electr Network, pp 1577–1586. https://doi.org/10.1109/cvpr42600.2020.00165

54.

Li MJ, Jiang Y, Wu Z et al (2021) Real-time prediction of smoke spread affected by multiple factors in subway tunnel using CAERES-DNN model. Fire Technol 57:2025–2059. https://doi.org/10.1007/s10694-021-01109-xCrossRef

Titel: An Improved YOLOv5s Fire Detection Model
verfasst von: Zhan Dou
Hang Zhou
Zhe Liu
Yuanhao Hu
Pengchao Wang
Jianwen Zhang
Qianlin Wang
Liangchao Chen
Xu Diao
Jinghai Li
Publikationsdatum: 16.10.2023
Verlag: Springer US
Erschienen in: Fire Technology / Ausgabe 1/2024
Print ISSN: 0015-2684
Elektronische ISSN: 1572-8099
DOI: https://doi.org/10.1007/s10694-023-01492-7

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Technik"

Springer Professional "Wirtschaft+Technik"

Weitere Artikel der Ausgabe 1/2024

Flame Spread Behavior Over a Filter Paper Near Extinction Limit Under Microgravity on the ISS/Kibo

Accurate and Fast Fire Alignment Method Based on a Mono-binocular Vision System

Numerical Analysis for Behavior of Stainless-Steel Web Cleat Connections at Elevated Temperatures

Experimental Study on the Generation of Arc Beads from Conductors by Arc Discharge

Flame Spread Experiments on a Horizontal Preheated Cable Layer

Performance-Focused Analysis of Fire-Blocking Blanket for Lithium Ion Battery Fires