Tool Condition Monitoring with Convolutional Neural Network for Milling Tools and Turning Inserts

Authors

  • Achmad Pratama Rifai Universitas Gadjah Mada, Jogjakarta
  • Silvyaniza Briliananda Universitas Gadjah Mada, Jogjakarta
  • Hideki Aoyama Keio University, Yokohama

:

https://doi.org/10.9744/jti.25.1.1-16

Keywords:

Tool condition monitoring , Convolutional neural network, Binary Classification, Milling and turning tools

Abstract

Tool wear is one of the cost drivers in the manufacturing industry because it directly affects the quality of the manufactured workpiece and production efficiency. Identifying the right time to replace the cutting tool is a challenge. If the tool is replaced too soon, the production time can be disrupted, causing unscheduled downtime. Conversely, if it is replaced too late, there will be an additional cost to replace raw materials damaged by broken tools. Therefore, researchers continue to develop tool condition monitoring (TCM) methods to analyze tool wear. A recent popular method is machine vision with convolutional neural networks (CNN). The present research aims to develop classification models that can categorize the image data of milling and turning inserts into GO (suitable for use) and NO GO (not suitable for use). Two approaches are selected for the modeling process, custom learning and transfer learning, with image data input from smartphones and microscope cameras. The experimental results show that the best model is the transfer learning approach using Inception-V3 architecture with a smartphone image. The model reaches 92.2% accuracy, hence demonstrating a relatively good performance in determining whether the tool is suitable for use or not.

Author Biographies

Achmad Pratama Rifai, Universitas Gadjah Mada, Jogjakarta

Achmad Pratama Rifai received his B.Eng. from Gadjah Mada University, and M.Eng. from the University of Malaya. He earned his Ph.D. in integrated design engineering at Keio University. Currently, he is a lecturer in the Department of Mechanical and Industrial Engineering, Gadjah Mada University. His current research interests include optimization, metaheuristics, deep learning, and machine vision for manufacturing and production system.

Silvyaniza Briliananda, Universitas Gadjah Mada, Jogjakarta

Department of Mechanical and Industrial Engineering, Universitas Gadjah Mada, Yogyakarta, Indonesia

Hideki Aoyama, Keio University, Yokohama

School of Integrated Design Engineering, Faculty of Science and Technology, Keio University, Yokohama, Japan

References

F. Aghazadeh, A. Tahan, and M. Thomas, “Tool condition monitoring using spectral subtraction and convolutional neural networks in milling process,” Int. J. Adv. Manuf. Technol., vol. 98, no. 9–12, pp. 3217–3227, Oct. 2018, doi: 10.1007/S00170-018-2420-0/METRICS.

T. Bergs, C. Holst, P. Gupta, and T. Augspurger, “Digital image processing with deep learning for automated cutting tool wear detection,” Procedia Manuf., vol. 48, pp. 947–958, Jan. 2020, doi: 10.1016/J.PROMFG.2020.05.134.

B. Wang and Z. Liu, “Influences of tool structure, tool material and tool wear on machined surface integrity during turning and milling of titanium and nickel alloys: A review,” Int. J. Adv. Manuf. Technol., vol. 98, no. 5–8, pp. 1925–1975, Sep. 2018, doi: 10.1007/S00170-018-2314-1/METRICS.

G. Terrazas, G. Martínez-Arellano, P. Benardos, and S. Ratchev, “Online tool wear classification during dry machining using real time cutting force measurements and a CNN approach,” J. Manuf. Mater. Process., vol. 2, no. 4, pp. 72, Oct. 2018, doi: 10.3390/JMMP2040072.

S. Y. Tanjung, K. Yahya, and S. Halim, “Predicting the readiness of Indonesia manufacturing companies toward Industry 4.0,” Jurnal Teknik Industri: Jurnal Keilmuan dan Aplikasi Teknik Industri, vol. 23, no. 1, pp. 1–10, May 2021, doi: 10.9744/JTI.23.1.1-10.

T. Mohanraj, J. Yerchuru, H. Krishnan, R. S. Nithin Aravind, and R. Yameni, “Development of tool condition monitoring system in end milling process using wavelet features and Hoelder’s exponent with machine learning algorithms,” Measurement, vol. 173, p. 108671, Mar. 2021, doi: 10.1016/J.MEASUREMENT.2020.108671.

X. Zhang, C. Han, M. Luo, and D. Zhang, “Tool wear monitoring for complex part milling based on deep learning,” Appl. Sci., vol. 10, no. 19, p. 6916, Oct. 2020, doi: 10.3390/APP10196916.

S. S. Patil, S. S. Pardeshi, A. D. Patange, and R. Jegadeeshwaran, “Deep learning algorithms for tool condition monitoring in milling: A review,” J. Phys. Conf. Ser., vol. 1969, no. 1, p. 012039, Jul. 2021, doi: 10.1088/1742-6596/1969/1/012039.

K. Han, D. Yu, and I. Tashev, “Speech emotion recognition using deep neural network and extreme learning machine.” Sep. 01, 2014, Accessed: Apr. 10, 2023. [Online]. Available: https://www.microsoft.com/en-us/research/publication/speech-emotion-recognition-using-deep-neural-network-and-extreme-learning-machine/.

G. Serin, B. Sener, A. M. Ozbayoglu, and H. O. Unver, “Review of tool condition monitoring in machining and opportunities for deep learning,” Int. J. Adv. Manuf. Technol., vol. 109, no. 3–4, pp. 953–974, Jul. 2020, doi: 10.1007/S00170-020-05449-W/FIGURES/28.

L. Jing, M. Zhao, P. Li, and X. Xu, “A convolutional neural network based feature learning and fault diagnosis method for the condition monitoring of gearbox,” Measurement, vol. 111, pp. 1–10, Dec. 2017, doi: 10.1016/J.MEASUREMENT.2017.07.017.

A. P. Rifai, R. Fukuda, and H. Aoyama, “Surface roughness estimation and chatter vibration identification using vision-based deep learning,” J. Japan Soc. Precis. Eng., vol. 85, no. 7, pp. 658–666, Jul. 2019, doi: 10.2493/JJSPE.85.658.

A. P. Rifai, R. Fukuda, and H. Aoyama, “Image based identification of cutting tools in turning-milling machines,” J. Japan Soc. Precis. Eng., vol. 85, no. 2, pp. 159–166, Feb. 2019, doi: 10.2493/JJSPE.85.159.

X. Wu, Y. Liu, X. Zhou, and A. Mou, “Automatic identification of tool wear based on convolutional neural network in face milling process,” Sensors, vol. 19, no. 18, p. 3817, Sep. 2019, doi: 10.3390/S19183817.

H. Mamledesai, M. A. Soriano, and R. Ahmad, “A qualitative tool condition monitoring framework using convolution neural network and transfer learning,” Appl. Sci., vol. 10, no. 20, p. 7298, Oct. 2020, doi: 10.3390/APP10207298.

P. K. Ambadekar and C. M. Choudhari, “CNN based tool monitoring system to predict life of cutting tool,” SN Appl. Sci., vol. 2, no. 5, pp. 1–11, May 2020, doi: 10.1007/S42452-020-2598-2/FIGURES/10.

R. Kou, S. wei Lian, N. Xie, B. er Lu, and X. mei Liu, “Image-based tool condition monitoring based on convolution neural network in turning process,” Int. J. Adv. Manuf. Technol., vol. 119, no. 5–6, pp. 3279–3291, Mar. 2022, doi: 10.1007/S00170-021-08282-X/TABLES/7.

A. Kothuru, S. P. Nooka, and R. Liu, “Application of deep visualization in CNN-based tool condition monitoring for end milling,” Procedia Manuf., vol. 34, pp. 995–1004, Jan. 2019, doi: 10.1016/J.PROMFG.2019.06.096.

R. Bazi, T. Benkedjouh, H. Habbouche, S. Rechak, and N. Zerhouni, “A hybrid CNN-BiLSTM approach-based variational mode decomposition for tool wear monitoring,” Int. J. Adv. Manuf. Technol., vol. 119, no. 5–6, pp. 3803–3817, Mar. 2022, doi: 10.1007/S00170-021-08448-7/TABLES/3.

W. Dai, K. Liang, and B. Wang, “State monitoring method for tool wear in aerospace manufacturing processes based on a convolutional neural network (CNN),” Aerosp., vol. 8, no. 11, p. 335, Nov. 2021, doi: 10.3390/AEROSPACE8110335.

Zhao, X. Zhang, Z. Zhan, and Q. Wu, “A robust construction of normalized CNN for online intelligent condition monitoring of rolling bearings considering variable working conditions and sources,” Measurement, vol. 174, p. 108973, Apr. 2021, doi: 10.1016/J.MEASUREMENT.2021.108973.

S. Dutta, S. K. Pal, S. Mukhopadhyay, and R. Sen, “Application of digital image processing in tool condition monitoring: A review,” CIRP J. Manuf. Sci. Technol., vol. 6, no. 3, pp. 212–232, Jan. 2013, doi: 10.1016/J.CIRPJ.2013.02.005.

N. Brili, M. Ficko, and S. Klančnik, “Automatic identification of tool wear based on thermography and a convolutional neural network during the turning process,” Sensors, vol. 21, no. 5, p. 1917, Mar. 2021, doi: 10.3390/S21051917.

Z. R. Himami, A. Bustamam, and P. Anki, “Deep learning in image classification using dense networks and residual networks for pathologic myopia detection,” 2021 Int. Conf. Artif. Intell. Big Data Anal. ICAIBDA 2021, pp. 191–196, 2021, doi: 10.1109/ICAIBDA53487.2021.9689744.

K. Woods and K. W. Bowyer, “Generating ROC curves for artificial neural networks,” IEEE Trans. Med. Imaging, vol. 16, no. 3, pp. 329–337, 1997, doi: 10.1109/42.585767.

J. N. Mandrekar, “Receiver operating characteristic curve in diagnostic test assessment,” J. Thorac. Oncol., vol. 5, no. 9, pp. 1315–1316, Sep. 2010, doi: 10.1097/JTO.0B013E3181EC173D.

Downloads

Published

2023-04-12

How to Cite

[1]
A. P. Rifai, S. . Briliananda, and H. Aoyama, “Tool Condition Monitoring with Convolutional Neural Network for Milling Tools and Turning Inserts”, Jurnal Teknik Industri: Jurnal Keilmuan dan Aplikasi Teknik Industri, vol. 25, no. 1, pp. 1-16, Apr. 2023.

Issue

Section

Articles

Most read articles by the same author(s)