Deep Learning in Product Manufacturing Record System

## Publications

/ Export Citation / / / Text size:

#### International Journal of Advanced Network, Monitoring and Controls

Xi'an Technological University

Subject: Computer Science, Software Engineering

eISSN: 2470-8038

2
2
Visit(s)
0
Comment(s)
0
Share(s)

SEARCH WITHIN CONTENT

FIND ARTICLE

Volume / Issue / page

Archive
Volume 6 (2021)
Volume 5 (2020)
Volume 4 (2019)
Volume 3 (2018)
Volume 2 (2017)
Volume 1 (2016)
Related articles

VOLUME 6 , ISSUE 3 (September 2021) > List of articles

### Deep Learning in Product Manufacturing Record System

Keywords : Deep Learning, Local-Global, INCEPTION-GRU

Citation Information : International Journal of Advanced Network, Monitoring and Controls. Volume 6, Issue 3, Pages 59-65, DOI: https://doi.org/10.21307/ijanmc-2021-028

Published Online: 08-October-2021

### ARTICLE

#### ABSTRACT

Deep learning based data analysis techniques are investigated in the context of product production record systems, using CNN, STACK LSTM, GRU, INCEPTION, ConvLSTM and CasualLSTM techniques to design network models and to study the processing of temporal data. Three network models are proposed for the problem of predicting the pass rate of upcoming product inspection records, namely CNN-STACK LSTM, INCEPTION-GRU and INCEPTION-Casual LSTM, and the structure of each network model follows the learning of local-global features. The experimental results show that the INCEPTION-GRU network model works best among the three models. Based on the prediction results, it is possible to correct in advance the operation of the shop technicians who do not regulate the debugging of the product, so that the initial production efficiency of the product can be improved.

## I. introduction

Since the 21st century, the new generation of industrial revolution, mainly characterized by intelligence, information technology and automation, namely Industrial Revolution 4.0, has emerged and opened the curtain of the “Industry 4.0” era [1]. With the improvement of product quality and safety in the modern industrial production process, increasing amounts of attention is being paid to the quality control of the whole process of product production. In order to improve product quality and production efficiency, enterprises trace the quality of their products, pay attention to the use of products, and improve and control the existing product quality [2]. In recent years, with the development of manufacturing technology and increased supervision, the probability of accidents in industrial products is also decreasing year by year, and the overall safety level is gradually increasing [3-4].

The product production record system records production record data from processing to packaging, provides comprehensive analysis of product production data, and establishes a production record system that focuses on the production process. In the intelligent manufacturing mode, the operator uses the code scanning gun to enter the relevant data of the product. It greatly improves the efficiency of production data collection and facilitates the improvement of product production efficiency. Deep learning has taken off in recent years, making major breakthroughs not only in medical research, energy consumption in life, finance and communications. Features such as face recognition, speech processing and video object detection are derived based on algorithms and extensive training in deep learning. The learned features extracted through different deep networks perform well in prediction. Therefore, learning deep features for prediction is becoming Getting more and more popular. In this paper, inspection records in product manufacturing system are used as training samples, CNN, STACK LSTM, GRU, INCEPTION, ConvLSTM and CasualLSTM techniques are used to design network models and to study the processing of temporal data, after comparing and selecting a comprehensive and high network model to predict the results of the product to be inspected. According to the prediction results, the model can correct the operation of the workshop technicians who do not regulate the debugging of products in advance, and largely improve the efficiency of product testing at the early stage of production.

## II. Related work

A wide variety of time series data exists for various industries, financial time series, electricity consumption time series, coal price time series. It is of great value and significance to spend effort on time series data to study and analyze them. Lots of work has been done by domestic and foreign scholars on time series data analysis and forecasting.

RNN is a traditional recurrent neural network [5], which is a model for processing sequential data. The traditional RNN in solving the association between long sequences, through practice, proved that the classical RNN performs poorly, the reason is that when backpropagation is performed, too long sequences lead to abnormal computation of gradients, and gradient disappearance or explosion occurs. LSTM [6] long short-term memory model is a special kind of RNN neural network and effectively deal with long-term dependence problem, it is compared with RNN in two aspects to do improvement The LSTM gating mechanism has three main gates which are forgetting gate, input gate and output gate respectively. The equation of LSTM network structure at moment t is shown below, ft, it, ot, Ct are forgetting gate, input gate, output gate and cell state respectively, Wt is each gating weight parameter, bt is each gating bias parameter respectively, σ are sigmoid activation function, and tanh is the hyperbolic tangent activation function.

##### (1)
${ft=σ(Wf[ht−1,xt]+bf)it=σ(Wi[ht−1,xt]+bi)C~t=tanh⁡(Wc[ht−1,xt]+bc)ot=σ(Wo[ht−1,xt]+bo)ht=ot⋅tanh⁡(Ct)Ct=ft⋅Ct−1+it⋅C~$

LSTM has the dominant advantage for the prediction of temporal data, but it is not effective in predicting data in spatio-temporal sequences, does not consider spatial correlation and carries redundancy, and cannot portray local features due to the strong local characteristics of spatial data. The ConvLSTM network structure was first proposed in 2015 for precipitation proximity prediction [7], and the experimental results found that ConvLSTM grasps the data spatio-temporal structure, and also proved that ConvLSTM works better than LSTM in obtaining spatio-temporal relationships. The core of ConvLSTM network structure is consistent with LSTM, which also takes the output information of the previous layer as the input information of the next layer. The difference is that the W-weight full link operation is changed to convolution operation, which not only can get the spatio-temporal relationships, but also can extract spatial features like convolution layer thus being able to obtain spatio-temporal features.

GRU [8] is a variant of LSTM network, it inherits the advantages of LSTM network and has a simple structure, LSTM has three gates are forget gate, input gate and output gate, while GRU has only two gates are update gate and reset gate, for memory information transfer, LSTM is passed to the next unit through the output gate, GRU is directly transferred to the next unit without control. t moment GRU unit structure of the equation is shown below, rt, zt, h~t are reset gate, update gate and memory transfer information respectively.

##### (2)
${rt=σ(Wr⋅[ht−1,xt])zt=σ(Wz⋅[ht−1,xt])h~t=tanh⁡(W⋅[rt∗ht−1,xt])ht=(1−zt)∗ht−1+zt∗h~t$

## III. Network model construction

### A. CNN-STACK LSTM detection record prediction model construction

#### 1) Local feature learning

The convolution layer (Conv) is a structure unique to convolutional neural networks and is used to extract local features of the data, the outline of people on pictures, the shape of cars, etc. Due to the specificity of the dataset, the convolution kernel performs the convolution operation on one-dimensional data according to the left-to-right direction, and the convolution operation is shown in Figure 1.

##### Figure 1.

Convolution operation

A BN layer (Batch Normalization) is added after the convolution layer, which sets the increasingly deviated distribution into a normalized distribution by means of normalization, BN layer can make the loss function smoother as well as facilitate gradient descent. to avoid the appearance of “Dead Neuron”. The final local feature learning module is (CBRP) shown in Figure 2, which is composed of a convolutional layer (Conv), a BN layer (Batch Normalization), an activation function (Leaky ReLU) and a pooling layer (Pooling).

##### Figure 2.

CBRP module structure

#### 2) Global feature learning

LSTM has made great breakthroughs in speech recognition, data prediction and financial records, LSTM solves the drawbacks of RNN. Global feature learning is performed using a stacked long and short-term memory model (STACK LSTM), which is a multilayer LSTM network model stacked vertically, thus enhancing the abstraction capability of the network. Article adopt a stacked LSTM network model, as shown in Figure 3, where the first layer is used as the input LSTM network and the output information of the first layer is used as the input information of the second layer.

##### Figure 3.

Stacked LSTM structure

#### 3) CNN-STACK LSTM Network Model

The CNN-STACK LSTM network model is constructed by three CRPs, a fully connected layer, a STACK LSTM layer and a Softmax layer, where the output results are normalized using the Softmax layer. The overall architecture of the CNN-STACK LSTM network model is shown in Figure 4.

##### Figure 4.

CNN-LSTM network model

### B. INCEPTION-GRU detection record prediction model construction

#### 1) Local feature learning

In 2012 AlexNet [10] first used new techniques such as Relu, Dropout in CNN and made a historical breakthrough, the mainstream breakthroughs in network structure are mainly divided into two categories, one is to increase the depth of the network model (number of layers) and the other is to expand the width of the network model (number of neurons). As the number and width of the network model increase, it will bring many negative factors, such as overfitting, gradient disappearance and gradient explosion. Until the emergence of GoogLeNet in 2014, GoogLeNet [11] is composed by inception module, inception is proposed to improve the training results from another perspective, which can use the CPU/GPU computational resources more efficiently and can extract more features with the same computational and weighting parameters, thus improving the training The result.

According to the training data characteristics, the inception basic unit is modified to reduce the convolution of one branch, and the convolution followed by the activation function is modified to add BN (Batch Normalization) layer calculation between the convolution and activation function, and the activation function uses Leaky ReLU, the basic structure of this inception is shown in Figure 5.

##### Figure 5.

Inception module structure

The use of the inception structure for local feature learning and the expansion and deepening of the local feature network model also increases the local feature network model nonlinearity as well as the fusion of local features of different sizes, both to improve accuracy.

#### 2) INCEPTION-GRU network model

The INCEPTION-GRU network model is constructed by a convolutional layer, two INCEPTIONs, a fully connected layer, a GRU layer and a softmax layer, and the overall architecture of the INCEPTION-GRU network model is shown in Figure 6.

##### Figure 6.

INCEPTION-GRU network model

### C. INCEPTION-Casual LSTM Detection Record Prediction Model Construction

#### 1) Global feature learning

Deeper network models can improve nonlinear representation and also learn more complex transformations, which can fit more complex feature inputs [12]. The network layers in the network model each have their own role, and the features learned by each network layer are observed from a classical network ZFNET reverse convolution. The first layer extracts the edges, the second layer extracts the simple shapes, the third layer has extracted the shapes of the targets, and the deeper network layers are able to learn more complex features [13]. If there is only one layer, it means that the transformations to be learned are very complex.

The model uses Casual LSTM as global feature learning. Casual LSTM is a cascade operation of ConvLSTM cells. Casual LSTM adds more nonlinear operations so that the features will be amplified, which is beneficial to capture short-term dynamic changes and emergent situations. The design Casual LSTM is composed of four layers of ConvLSTM units, similar to the four-layer stacked LSTM structure, where the LSTM base unit is replaced with a ConvLSTM.

#### 2) INCEPTION-Casual LSTM Network Model

The INCEPTION-Casual LSTM network model is constructed by a convolutional layer, two INCEPTION, a Casual LSTM layer and a softmax layer. The overall architecture of the network model is shown in Figure 7.

##### Figure 7.

INCEPTION-GRU network model

## IV. Expeeiments

### A. Data set structure and processing

The production records of the product are derived from the system’s data from the relay shop from November 2018 to April 2019. The data of the production records amount to 260,000 records, of which the inspection records occupy 149,800 records. The data structure of the inspection records is detailed in Table 1.

##### TABLE I.

Data structure of test records

Since the data trained by deep learning is the detection record, the fields “primary key identity”, “product process identity”, “product version identity”, “barcode”, “order number”, “creation time” and “creation user” are not considered, and the inspection record has corresponding redundant fields. The material description is an explanation of the material number, so it is also removed, and the process number, debugger, inspector, material number, version number, process name, and description fields are used as training features.

Since the feature values of the training data are limited, a data mapping approach is adopted to process the string type features in the detection records. First, all the different string values in each feature are counted, and these values are assigned according to the Arabic numerals from smallest to largest, for the feature “description”, normal is 0, and fault is 1. The data in Table 2 needs further feature normalization, and the processed data becomes the data with a mean value of 0 and standard deviation of 1. The data is processed in order to allow the model to learn quickly and iteratively optimize to improve the training efficiency.

##### TABLE II.

Results of data processing of test records

### B. Model training

This article uses the Tensorflow framework to build a network model, accompanied by the Adam [14-15] optimization algorithm, which is an optimization algorithm for finding global optima, introducing a quadratic gradient correction. The learning rate is also continuously corrected during training in addition to the correction of the weight parameters and bias parameters using the back propagation algorithm. 140,000 data from the product inspection records were used as training data, 10,000 data were used as test data, and each of the three network models was trained by iterating 500 times.

### C. Experimental results

The test data were verified in each of the three network models to verify the performance and prediction effectiveness of the network models. After three prediction experiments with different network models, Table 3 shows the content of the experimental results. The INCEPTION-GRU network model was compared with the other two models in terms of three aspects: time, stability and prediction effect, with short running time, high stability and accurate prediction effect.

##### TABLE III.

Comparison of network model accuracy (%)

## V. Summary and Prospect

In conclusion, this article propose a research method based on deep learning for product inspection record prediction and design three network models to predict the dataset, each model will have different advantages between both the results and the process, and INCEPTION-GRU network model is considered comprehensively from all aspects as a product inspection record prediction model to provide technical support for new product detection. After studying the three network models, it is found that ConvLSTM is not as stable and efficient as LSTM and GRU in processing temporal data. Future work will focus on improving the GRU model to further improve the accuracy of product inspection pass rate.

## References

1. Li Wenbin. Research on the essence of industrial revolution 4.0 and its impact [D]. China University of Mining and Technology, 2019.
2. Zhu Chun Chuan. The use of product traceability system in automated production [J]. Metallurgical Management, 2020(17):75-76.
3. Dong Yanchao. Research on key technologies of RFID-based industrial product traceability system [D]. Dalian Maritime University, 2017.
4. Xie W, Xie K. Hang A, Wan G, Qu I, Zhang Q, Tang C J. RFID reseraching: Finding a lot tag rather than only detecting its missing[J]. Journal of Network and Computer Applications, 2014, Volume 41:95-120.
5. Cheng Zhaolan, Zhang Xiaoqiang, and Liang Yue. Railway freight volume forecasting based on LSTM networks [J]. Journal of Railways, 2020, v.42; No.277(11):19-25.
6. Wei X, Zhang L, Yang H Q, et al. Machine learning for pore-water pressure time-series prediction: application of recurrent neural networks [J]. Geoscience Frontiers, 2020.
7. Xingjian Shi, Zhourong Chen, Hao Wang, et al. Convolutional LSTM Network: a Machine Learning Approach for Precipitation Nowcasting [J]. NIPS 2015.
8. Hu H, Yang Y. A combined GLQP, and DBN-DRF for face recognition in unconstrained environments[C]. 2nd International Conference on Control, Automation and Artificial Intelligence (CAAI 2017), 2017.
9. LIN M, CHEN Q, YAN S. Network in network [EB/OL]. [2013-12-16]. https://arxiv.org/abs/1312.4400.
10. Goodfellow, I., Bengio, Y., Courville, A.. Deep learning (Vol.1). Cambridge: MIT press, 2016:326-366.
11. Gu J., Wang, Z., Kuen, J., Ma, L., Shahroudy, A., Shuai, B., Liu, T., Wang, X., Wang, L., Wang, G. and Cai [J]. 2015. Recent advances in convolutional neural networks. arXiv preprint arXiv:1512.07108.
12. Raghu M, Poole B, Kleinberg J, et al. On the expressive power of deep neural networks [C]//Proceedings of the 34th International Conference on Machine Learning-Volume 70. jmlr. org, 2017: 2847-2854.
13. Bianchini M, Scarselli F. On the complexity of neural network classifiers: a comparison between shallow and deep architectures [J]. IEEE transactions on neural networks and learning systems, 2014, 25(8): 1553-1565.
[PUBMED] [CROSSREF]
14. Yang Guanci, Yang Jing, Li Shaobo, et al. Modified CNN algorithm based on Dropout and ADAM optimizer [J]. Journal of Huazhong University of Science and Technology (Natural Science Edition), 2018, 46(7): 122-127.
15. Chang Zihan. Electricity Price Prediction Based on Hybrid Model of Adam optimized LSTM Neural Network and Wavelet Transform [D]. Lanzhou: Lanzhou University, 2019.

### FIGURES & TABLES

Figure 1.

Convolution operation

Figure 2.

CBRP module structure

Figure 3.

Stacked LSTM structure

Figure 4.

CNN-LSTM network model

Figure 5.

Inception module structure

Figure 6.

INCEPTION-GRU network model

Figure 7.

INCEPTION-GRU network model

### REFERENCES

1. Li Wenbin. Research on the essence of industrial revolution 4.0 and its impact [D]. China University of Mining and Technology, 2019.
2. Zhu Chun Chuan. The use of product traceability system in automated production [J]. Metallurgical Management, 2020(17):75-76.
3. Dong Yanchao. Research on key technologies of RFID-based industrial product traceability system [D]. Dalian Maritime University, 2017.
4. Xie W, Xie K. Hang A, Wan G, Qu I, Zhang Q, Tang C J. RFID reseraching: Finding a lot tag rather than only detecting its missing[J]. Journal of Network and Computer Applications, 2014, Volume 41:95-120.
5. Cheng Zhaolan, Zhang Xiaoqiang, and Liang Yue. Railway freight volume forecasting based on LSTM networks [J]. Journal of Railways, 2020, v.42; No.277(11):19-25.
6. Wei X, Zhang L, Yang H Q, et al. Machine learning for pore-water pressure time-series prediction: application of recurrent neural networks [J]. Geoscience Frontiers, 2020.
7. Xingjian Shi, Zhourong Chen, Hao Wang, et al. Convolutional LSTM Network: a Machine Learning Approach for Precipitation Nowcasting [J]. NIPS 2015.
8. Hu H, Yang Y. A combined GLQP, and DBN-DRF for face recognition in unconstrained environments[C]. 2nd International Conference on Control, Automation and Artificial Intelligence (CAAI 2017), 2017.
9. LIN M, CHEN Q, YAN S. Network in network [EB/OL]. [2013-12-16]. https://arxiv.org/abs/1312.4400.
10. Goodfellow, I., Bengio, Y., Courville, A.. Deep learning (Vol.1). Cambridge: MIT press, 2016:326-366.
11. Gu J., Wang, Z., Kuen, J., Ma, L., Shahroudy, A., Shuai, B., Liu, T., Wang, X., Wang, L., Wang, G. and Cai [J]. 2015. Recent advances in convolutional neural networks. arXiv preprint arXiv:1512.07108.
12. Raghu M, Poole B, Kleinberg J, et al. On the expressive power of deep neural networks [C]//Proceedings of the 34th International Conference on Machine Learning-Volume 70. jmlr. org, 2017: 2847-2854.
13. Bianchini M, Scarselli F. On the complexity of neural network classifiers: a comparison between shallow and deep architectures [J]. IEEE transactions on neural networks and learning systems, 2014, 25(8): 1553-1565.
[PUBMED] [CROSSREF]
14. Yang Guanci, Yang Jing, Li Shaobo, et al. Modified CNN algorithm based on Dropout and ADAM optimizer [J]. Journal of Huazhong University of Science and Technology (Natural Science Edition), 2018, 46(7): 122-127.
15. Chang Zihan. Electricity Price Prediction Based on Hybrid Model of Adam optimized LSTM Neural Network and Wavelet Transform [D]. Lanzhou: Lanzhou University, 2019.