Svoboda | Graniru | BBC Russia | Golosameriki | Facebook
Next Article in Journal
Study on the Law of Rock Drillability under High-Temperature and High-Pressure Conditions in the Western Margin of the Ordos Basin
Previous Article in Journal
Development and Validation of Ultra-Performance Liquid Chromatography (UPLC) Method for Simultaneous Quantification of Hydrochlorothiazide, Amlodipine Besylate, and Valsartan in Marketed Fixed-Dose Combination Tablet
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Processes
Volume 12
Issue 6
10.3390/pr12061260
processes-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Dynamic Numerical Simulation and Transfer Learning-Based Rapid Rock Identification during Measurement While Drilling (MWD)

by
Yuwei Fang
1,2,3,4,
Zhenjun Wu
2,4,*,
Lianghua Jiang
1,3,
Hua Tang
2,4,
Xiaodong Fu
2,4 and
Junxin Shen
1,3
1
Yunnan Institute of Transport Planning and Design Co., Ltd., Kunming 650200, China
2
State Key Laboratory of Geomechanics and Geotechnical Engineering, Institute of Rock and Soil Mechanics, Chinese Academy of Sciences, Wuhan 430071, China
3
Yunnan Key Laboratory of Digital Communications, Kunming 650103, China
4
University of Chinese Academy of Sciences, Beijing 100049, China
*
Author to whom correspondence should be addressed.
Processes 2024, 12(6), 1260; https://doi.org/10.3390/pr12061260
Submission received: 10 May 2024 / Revised: 28 May 2024 / Accepted: 15 June 2024 / Published: 19 June 2024
(This article belongs to the Section Energy Systems)
Browse Figures
Versions Notes

Abstract

:
In constructing rapid rock identification models for measurement while drilling (MWD) via neural network methods, collecting actual drilling data to train the model is extremely time-consuming and labor-intensive. This requires extensive drilling experiments in various rock types, resulting in limited neural network training data for rock identification that covers a limited range of rock types. To suitably address this issue, a dynamic numerical simulation model for rock drilling is established that generates extensive drilling data. The input parameters for the simulations include torque, drill bit rotation speed, and drilling speed. A neural network model is then developed for rock classification using large datasets from dynamic numerical simulations, specifically those of granite, limestone, and sandstone. Building upon this model, transfer learning is appropriately applied to store the knowledge obtained in the rock identification based on the neural network model. Further training through transfer learning is conducted with smaller datasets obtained during actual drilling, making the model suitable for practical rock identification and prediction in the drilling processes. The neural network rock classification model, incorporating dynamic numerical simulation and transfer learning, achieves a prediction accuracy of 99.36% for granite, 99.53% for sandstone, and 99.82% for limestone. This reveals an enhancement in prediction accuracy of up to 22.94% compared to the models without transfer learning.

1. Introduction

In the field of engineering geological surveying, drilling is the most commonly utilized approach; nevertheless, drilling results are primarily employed for stratigraphic logging and the preparation of rock core samples for laboratory-based testing. Commonly, laboratory-based physical and mechanical property tests are labor-intensive and time-consuming. Martins et al. [1] indicated that the average cost of drilling may reach over USD 100 per meter drilled. During the drilling process, not much information about geotechnical properties remains underutilized. By employing measurement while drilling (MWD) to collect data and establish a quantitative relationship between the MWD data and the geotechnical properties, a larger volume of geotechnical sample data can be obtained, which substantially enhances the efficiency of advanced geological surveying. Horner and Sherrell pioneered the use of MWD technology in 1977 to evaluate layers and rock quality [2]. The subsequent extensive and valuable explorations by many scholars are indicative of the exploitation of MWD technology to examine challenges such as rock layer boundary detection [3,4], mud logging [5], foundation strengthening [6,7], identification of weak layers [8], and rock mass engineering classification [9].
In recent industrial applications, many geological surveying equipment companies have developed MWD systems to address geotechnical survey issues. The main systems include: the MWD module of the RPD series drilling rig by Japan’s KOKEN Company [10], used for predicting geological conditions ahead, such as the hardness of strata, cavities, spatial distances, and water inflow; this system is extensively employed in tunnel engineering; the DEFI geological prediction system by France’s JEAN LUTZ Company [11], which can be integrated into various multifunctional drilling rigs for predicting rock layer geological conditions; and the EXPLOFOR system by France’s Apageo Company [12], which collects drilling parameters to analyze geotechnical profile information. However, despite their advantages, MWD systems also present notable disadvantages. These include complexity and reliability issues, challenges in data interpretation, and susceptibility to interference from other electronic devices and natural sources. Generally, the cost of MWD systems is high, particularly when integrated into multifunctional drilling rigs, making it challenging to directly apply them to ordinary drilling rigs. Additionally, these commercial products can only determine relative hardness and detect cavities and water inflows.
There are three common methods to identify geotechnical properties based on MWD. The first approach involves analyzing the rock failure mechanism of the drilling rig to seek a quantitative relationship between the MWD data and the geotechnical properties. The second approach is essentially based on the statistical analysis of MWD data to suitably realize the relationships between various geotechnical properties and drilling parameters. The last approach utilizes machine learning techniques to discover correlations between the MWD data and the geotechnical properties.
In researching the rock mechanisms of drilling rigs, many investigators have examined the composition of the energy required for drilling to comprehend the relationship between the MWD data and the drilling energy. Teale [13] introduced the concept of rock drilling specific energy, which is influenced by various factors, such as thrust, torque, rotation speed, unconfined rock compressive strength, and drill bit. He demonstrated that the specific energy of rock drilling is closely related to the rock properties. Following Teale’s research, several scholars conducted further investigations. For instance, Simon [14] proposed the exploitation of a mechanical specific energy index, which is based on the drilling energy analysis, to measure drilling efficiency. Hoberrock et al. [15] corroborated the relationship between the drilling specific energy and the rock strength. Hamrick [16] improved the calculation method used for drilling specific energy by appropriately adjusting the weight of the drill bit parameters. Finfinger et al. [17,18] utilized drilling parameters (i.e., thrust, torque, drilling speed, and rotational speed) to perform a series of tests on the characteristics of roof rocks, including fractures, joints, voids, rock layer boundary positions, and rock strength. They employed drilling energy to determine the average unconfined compressive strength. Manzoor et al. [19] examined the relationship between structural data from close-range terrestrial digital photogrammetry and MWD data to characterize rock mass structures. They found that MWD parameters showed significant changes in response to geological features, such as open joints or cavities, providing a method to correlate drilling parameters with rock mass structures. Prasad et al. [20] presented an innovative method for real-time downhole drilling data to identify formation strengths and facies. This method utilizes MWD data to infer rock strength and variability along the wellbore. Bout et al. [21] integrated physics-based observers into MWD systems to estimate bit speed and torque using current and voltage measurements. Their suggested approach demonstrated a strong correlation between MWD data and rock strength properties.
In a statistical analysis of MWD data, Schunnesson et al. [22,23] adopted principal component analysis (PCA) to examine and identify geotechnical conditions based on the drilling parameters, such as drill length, torque pressure, drilling speed, rotational speed, thrust, and percussive pressure. Navarro et al. [24] applied a normalization approach for MWD parameters for a series of data removal and correction analyses, predicting potential collapse zones in tunnel blasts. The obtained results indicated that the MWD data in discontinuous rock masses could display noticeable noise signals that can be utilized in predicting the occurrence of rock voids and fractures. Van Eldert et al. [25] used MWD data to predict rock mass conditions in tunneling, correlating these data with rock mass characteristics using multilinear regression and visual approaches. They demonstrated that MWD data could be used to support rock mass classification and rock support requirements. Lakshminarayana et al. [26] developed a mathematical model to predict uniaxial compressive strength using MWD data. Their model showed promise for estimating rock strength properties based on thrust and torque values collected during drilling. Khoshouei and Bagherpour [27] analyzed acoustic and vibration signals during drilling to predict the geomechanical properties of hard rocks. Their study provided a method for non-destructive, real-time prediction of rock properties using these signals.
MWD data generally show considerable randomness, making it challenging to establish relationships between drilling parameters and rock properties through simple statistical analysis. To examine the complex correspondence between the MWD data and geotechnical properties, therefore, many investigators have incorporated machine learning methods into their research and achieved remarkable results in identifying geotechnical properties during drilling. By adopting the neural networks method, Asadi [28] proceeded with predicting the uniaxial compressive strength of formation rocks in oil fields. Based on laboratory experiments, LaBelle et al. [29] classified lithology using neural network analysis methods and achieved an accuracy rate of 95.5% in stratigraphic identification. By utilizing Gaussian processes and unsupervised clustering approaches based on the MWD data, Zhou et al. [30] could classify suitable rock types. A method based on unsupervised learning was proposed to analyze drilling specific energy and thereby optimize the drilling speed. Klyuchnikov et al. [31] compared various machine learning algorithms for the classification of rock layer types based on borehole data and achieved a maximum classification accuracy of 91%. Vezhapparambu et al. [32] employed multiple methods, including multivariate analysis and advanced machine learning algorithms, to distinguish different lithologies. By adopting machine learning and gradient-boosted decision trees, Romanenkova et al. [33] classified rock layer types based on the MWD data. Fang et al. [34] developed a prediction model based on neural networks and genetic algorithms to predict geological conditions in tunnel excavation, indicating that the suggested methodologies could effectively predict geological conditions, with the accuracy of the predictions increasing as the volume of rock geological data increased. Cheng et al. [35] proposed a BILSTM-based deep neural network for rock mass classification using MWD data, exhibiting high accuracy in predicting rock mass classification and outperforming other machine learning models. Gupta et al. [36] developed a machine learning-based workflow for real-time geosteering by predicting lithology at the bit using MWD variables. This method improved the accuracy of lithology predictions significantly, aiding in cost and time savings during drilling operations. Amadi et al. [37] employed machine learning techniques for real-time prediction of rock properties, such as unconfined compressive strength (UCS), using drilling parameters. Their models achieved high accuracy in predicting UCS, which is critical for drilling performance and wellbore stability.
Research conducted by numerous investigators shows that drilling parameters, including drilling speed, torque, thrust, and rotational speed, measured during the drilling process can be effectively utilized to suitably identify rock. However, the geological conditions at engineering sites are commonly complex. Many factors influence test data, and theoretical drilling models, often based on numerous assumptions, have only been validated under ideal laboratory conditions. Commonly, machine learning-based algorithms lead to good prediction results in MWD data analysis, but the extensive data required for training models affects their practicality. In real-world applications, obtaining sufficient MWD data along with accurate calibration data for rock specimens requires considerable human and time resources. Actually, collecting extensive MWD training data covering a broad range of rock types and diverse drilling scenarios is among the major challenges.
Numerical simulation methods are able to effectively simulate the interactions between the drill bit and the rock during the rock breaking process in drilling rigs, obtain comprehensive experimental data, and provide significant support for rock identification tasks via machine learning methods. Up till now, several scholars have performed dynamic numerical simulations of the drilling process. Chiang and Elias [38] developed a 3D finite element simulation method, which was able to simulate the energy transfer during rock breaking by the drill bit and its interaction with the rock. Liu et al. [39] investigated the rock fracture mechanism caused by drills through numerical simulation and derived a formula to evaluate the extension length of the lateral crack after forming the rock crushing zone under the cutter. Saksala et al. [40] introduced a numerical approach for continuous simulations of the interaction process during rock failure by impact drill bits and rock mass, validating the reasonableness of complex constitutive models that include plastic compression, as well as viscoplastic shear and tensile damage. Han et al. [41] developed a nonlinear dynamic model of the drill string–bit–rock coupling system, which captures the real-time coupling vibrations of the drill string–bit system. This model provides a new approach for studying the drill string–bit interaction and optimizing drilling processes. Zhang et al. [42] used a 3D numerical model to examine the interaction between mesh-like cutting PDC bits and rock, improving the reliability of the bit–rock interaction model through indoor drilling experiments. Houshmand et al. [43] utilized three-dimensional continuum modeling to predict drill bit wear, demonstrating the effect of various parameters like rock type and bit material on wear depth.
This brief survey of the literature reveals that constructing suitable numerical simulation models that reflect the actual process of rock failure in drilling rigs and collecting data such as torque and drilling speed through dynamic simulations is of grave significance. By adopting machine learning algorithms, the development of rock strength parameter identification models will be then effectively facilitated. Utilizing the extensive MWD data obtained from simulations, these models can effectively overcome the challenges of limited test data and model applicability in geotechnical engineering MWD tests. This approach is anticipated to substantially enhance the efficiency of geotechnical property identification and to conquer the lengthy cycles and high costs associated with traditional rock mechanics tests.
In the present investigation, a self-developed miniature laboratory MWD system is employed to conduct laboratory drilling tests on typical rocks, during which data such as torque, drill bit, and drilling speed were appropriately collected through sensors. Suitable simulation models for both the drill bit and the rock are established. Utilizing the results of these laboratory tests, the elastoplastic dynamic numerical simulation experiments of the drilling process in the presence of various confining pressures are performed using ANSYS/LS-DYNA 2022R1 software. The response data are then monitored during the drilling process and compared with the results from laboratory tests to calibrate the numerical simulation model. With the calibrated model, numerical simulations of the drilling process in typical rock masses are carried out to obtain extensive MWD data. Through transfer learning methods, the knowledge obtained from solving rock identification tasks is stored in the dynamic numerical neural network model. The model is then further trained using small-sample drilling data obtained during actual drilling, making it suitable for practical rock identification and prediction tasks in the drilling process.
The study introduces a novel approach to rock identification during MWD by integrating dynamic numerical simulations with transfer learning techniques. It enhances the availability and diversity of training data for rock identification models in MWD. Traditional methods rely heavily on extensive field experiments, which are both time-consuming and costly. The dynamic numerical simulation model generates a large volume of training data under various drilling conditions and rock types, thus providing a more diverse and comprehensive dataset than that which can be typically achieved through field experiments alone. By employing transfer learning, the study leverages the extensive simulated data to train the neural network model and then refine it with smaller, real-world datasets. This significantly enhances the model’s practical applicability and prediction accuracy, making it more suitable for real-world drilling operations.

2. Methodology

2.1. Laboratory Drilling Experiment

2.1.1. Laboratory MWD Platform

The laboratory rock drilling experiments were conducted using a self-developed miniature MWD system. This system appropriately controls the drilling by adjusting rotation and advancement, and by using sensors, the aim is to extract real-time data of various parameters, including thrust, torque, rotation speed, and drilling speed. When drilling in rock and soil samples, parameters such as drilling speed, bit rotation speed, and drill rod torque and thrust can be controlled. This system allows the implementation of the following four distinct combined control modes: constant drilling speed–constant rotational speed mode; constant drilling speed–constant torque mode; constant thrust–constant rotational speed mode; and constant thrust–constant torque mode. The key components of the laboratory MWD system include a servo-controlled drilling system, a servo-controlled confining pressure system, a drilling parameter acquisition system, and a control system (Figure 1). The main technical parameters of the laboratory MWD system are presented in Table 1. The platform, equipped with torque and rotational speed sensors, drill pressure sensors, confining pressure sensors, and drilling speed sensors, continuously gathers drilling parameters in real time. The details of these sensors are presented in Table 2.

2.1.2. Laboratory MWD Method

The drilling experiments employed a three-winged, three-nozzle, flat-toothed, impregnated diamond core drill bit, with an outer diameter of 32 mm, an inner diameter of 24 mm, and a nozzle spacing of 6 mm, as demonstrated in Figure 2.
The present study conducted laboratory drilling tests on three types of rock samples: granite, sandstone, and limestone (Figure 3). The samples were cube-shaped with dimensions of 100 mm × 100 mm × 100 mm and had smooth and intact surfaces without visible cracks. Uniaxial compression tests were performed on cylindrical standard samples made from the same batch of rocks using a rock mechanics testing (RMT) machine (Figure 4). For this purpose, the samples were placed in the center of the press platen, and the pressure plate was adjusted with a spherical seat to ensure that the samples were pressed uniformly. The control mode was displacement loading with a loading rate of 0.0020 mm/s until specimen failure. Each test set was repeated at least three times, and the mechanical parameters of the three types of rocks were obtained, as illustrated in Table 3.
Multiple drilling tests were conducted in constant drilling speed–constant speed mode on three types of rock samples. The basic parameters of the drilling tests are shown in Table 4. The types of rocks used for the drilling tests were the same as those of the compression tests, all of which were obtained from the same batch and location. In each drilling experiment, the drilling depth (D) was continuously set at 100 mm, and the fixed drill rotation speed (N) was set at three different levels: 400, 600, and 800 RPM. For the granite drilling experiments, the constant drilling speed (v) was set at a variable rate from 5 to 40 mm/min, while for limestone and sandstone, the constant drilling speed (v) was set at a variable rate from 20 to 40 mm/min. During drilling, the MWD data were collected at 1 s intervals, and parameters such as torque, actual drilling speed, and actual rotational speed during drilling were recorded.

2.2. MWD Dynamic Numerical Simulation

2.2.1. Construction of Dynamic Numerical Simulation Model

In this study, the initial stage involves constructing a drill bit model of the same dimensions as those used in the laboratory MWD experiments, based on the actual engineering drawings of the diamond core drill bit, using SolidWorks 2021 software (see Figure 5).
The model was then imported into ANSYS 2022R1 Workbench, where the drill bit model was simplified using SpaceClaim 2022R1 and meshed using the LS-PrePost 4.7.7 platform in LS-Dyna 2022R1 (Figure 6). To save CPU computation time for dynamic numerical simulation, only the drilling part of the bit was taken, and it was assumed that the bit did not deform during drilling. The drilling material was defined as rigid body material, the so-called MAT_RIGID.
The drilling speed of the bit in the vertical direction was defined using the keyword PRESCRIBED_MOTION_RIGID, with the specific parameters provided in Table 5.
The rotational speed of the bit in the axial direction was defined using the keyword PRESCRIBED_MOTION_RIGID, with the specific parameters given in Table 6.
Using LS-Dyna, a rock block was constructed and meshed for dynamic numerical simulation of MWD (Figure 7). To improve the CPU computation time of the dynamic numerical model and reduce the mesh data, the rock block was constructed in a cylindrical shape, with the actual contact area with the drill bit being the brown area, as illustrated in Figure 7. The height and radius of the rock block were, respectively, set as 9 cm and 23 cm.
Due to the influence of the test equipment, loading methods, and internal material factors (such as humidity and temperature fields), the dynamic mechanical behavior of the rock materials is quite complex, and currently, there is no constructive model that can accurately and completely describe that. This paper combines the results of numerous laboratory experiments with numerical simulation results and finally adopts the Holmquist–Johnson–Cook (HJC) constitutive model (JOHNSON_HOLMQUIST_CONCRETE) as the constitutive model for the construction of rock materials. This model is capable of accurately describing the nonlinear deformation and fracture characteristics of rocks, which is mainly applied in the simulation of concrete and rock under high strain rates and large deformations. The HJC model basically consists of three aspects: a strength equation, an equation of state, and a damage evolution equation. This study aims to reproduce the research findings of several papers [44,45,46,47,48] and to compare them with actual drilling results to determine the constitutive model parameters for limestone, granite, and sandstone (Table 7, Table 8 and Table 9). In these tables, RO is the mass density, G is the shear modulus, A is the normalized cohesive strength, B is the normalized pressure hardening, C is the strain rate coefficient, N is the pressure hardening exponent, fc is the uniaxial compressive strength, T is the maximum hydrostatic pressure, EPS0 stands for the maximum tensile hydrostatic pressure, Sfmax is the normalized maximum strength, Pc is the crushing pressure, μc is the crushing volumetric strain, PL is the locking pressure, μL is the locking volumetric strain, D1 and D2 are the damage constants, K1–K3 are the pressure constants, and FS is the failure type.
In this research, only the uniaxial compressive strength (fc) of the constitutive model varies within a reasonable range.
To simulate the actual scenario after cutting the rock block and to enhance the CPU computational efficiency of the dynamic numerical model, this study applied the ADD_EROSION failure criterion to the rock block. This criterion automatically removes the rock block after the post-cutting failure condition is reached. The main focus was primarily on setting the maximum effective strain at failure (EFFEPS), based on comparisons and adjustments made with the results of the MWD laboratory tests. As a result, the EFFEPS was determined to be 0.022 for granite, 0.038 for sandstone, and 0.025 for limestone. The initial state of the simulation starts with the direct contact of the drill bit with the rock block, and it is ready to start drilling (Figure 8). The initial positioning of the drill bit is so that its tip is in immediate, direct physical contact with the surface of the rock.

2.2.2. Dynamic Numerical Simulation Process of MWD Experiments

Based on the model developed in Section 2.2.1, this study involves batch modification of LS-Dyna keyword input files to randomly varying parameters, including drilling speed, rotation speed, and uniaxial compressive strength of the rock block during the drilling tests. This process generated a large number of models with various stochastic factors. These models were then batch-processed to generate extensive data from the dynamic numerical simulations of the MWD experiments, providing an important dataset for the subsequent development of a transfer learning-based rock strength parameter prediction model.
In the present research, the range of random production for the drilling speed (V) was set between 5 and 50 mm/min, and the rotation speed of the drill bit (N) was considered to be in the range of 400–800 rpm. The random generation ranges for the uniaxial compressive strength (fc) of granite, sandstone, and limestone were set in the intervals of 100–300, 30–100, and 60–170 (MPa), respectively. The other factors of the HJC block rock model are consistent with those listed in Table 7 and Table 8, and the only change is the uniaxial compressive strength (fc) parameter.
During actual simulation calculations, the drilling depth increases geometrically with simulation time, and when a layer of rock block is removed, the drill bit enters a free travel phase. Because adjusting the drilling speed consumes considerable time, it takes more than 10 h of execution time to complete the drilling a full 9 cm rock block on a computer with a 64-core 4.0 GHz CPU and 512 GB memory. In addition, when the drill reached the next layer of rock, an impact force was generated, which led to anomalies in the drilling data. Therefore, in this study, the drilling time was set to 0.025 s with a data collection interval of 0.0002 s, which is approximately the time required to drill through a simulation layer. With this setup, running a drilling simulation takes just over 2 min.
Herein, data on the torque, drill bit rotational speed, and drilling speed were obtained during the operation of the drilling rig. The rotational speed and drilling speed were set as fixed preset values for each simulation. The torque was determined by obtaining Z_moment data from the lower S2 and S3 levels of the drill while drilling in the RCFORC (Figure 9). The specific parts represented by S2 and S3 are shown in Figure 10. Subsequently, the sum_curves feature in LS-Dyna PLOT was utilized to combine the Z_moment from both surfaces to obtain the sum of the moments (Figure 11). Then, an SAE filter with a C/S cutoff frequency of 60 Hz was utilized to reduce noise and suppress interference in the data. The resulting torque is illustrated in Figure 12. To ensure the automatic acquisition of actual drilling data for various types of rock and to enhance the quality of training data for the parameter prediction model, the study excluded data from the initial and final stages of the drilling process, capturing only the torque data of each simulation between 0.005 and 0.015 s.

2.3. Rapid Rock Identification Method Based on the Transfer Learning

2.3.1. Rapid Prediction Model for Rocks Based on Dynamic Numerical Simulation

Before training in this study, Z-score normalization [49] was first employed to normalize the data, smooth the process of seeking the optimal solution, and enable faster convergence to the best solution. Z-score normalization centralizes each data point x around the mean μ, then scales it by the standard deviation σ, resulting in normalized data x * , which follows a normal distribution with a mean of 0 and a variance of 1. The main normalization formula is as follows:
x * = x − μ σ
To depict the nonlinear mapping relationship between the rock properties and drilling parameters in dynamic numerical simulation, the neural network model structures used in this study are presented in Figure 13 and Figure 14. These figures, respectively, illustrate the prediction models of the rock type and the uniaxial compressive strength. The input layer of the model receives the data of drill torque, rotational speed, and drilling speed obtained based on the approach described in Section 2.2.2. The hidden layers of the model include seven layers, including four batch normalization layers [50] and three layers with the rectified linear unit (ReLU) activation function [51], each with 500 nodes. The output layer of the rock type prediction neural network model uses the softmax activation function [52] and one-hot encoding to convert the rock block classification labels into binary vectors: granite [1,0,0], sandstone [0,1,0], and limestone [0,0,1]. It outputs the classification probability for each rock type and calculates the loss value using the binary_crossentropy loss function, then returns and adjusts the weights and thresholds for each node. The prediction neural network model used for evaluating uniaxial compressive strength uses a sigmoid function as the activation function in the output layer to output the predicted uniaxial compressive strength of each dataset. The model also employs the mean square error (MSE) as the loss function to calculate the loss value, then returns and adjusts the weights and thresholds for each node. The optimizer for both models is set to Adma. Training and prediction of the neural network prediction model are implemented via the Keras framework in Python.

2.3.2. Rapid Prediction for Rocks Using Transfer Learning Method

The establishment and collection of an actual drilling dataset is extremely time-consuming and labor-intensive, requiring a large number of drilling tests on different rock types. In the field of laboratory drilling experiments, it is necessary to prepare or collect a vast array of rock specimens. Taking the laboratory drilling platform used in this project as an example, each drilling operation comprises a series of processes, including setup, drilling, cleaning, and machine cooling. Conducting a complete drilling experiment requires approximately three hours. Similarly, collecting drilling data on actual engineering sites also involves a series of preparation and drilling activities and further calibration of the rock samples obtained during drilling to form usable data for model training, which is even more time-consuming. Hence, obtaining a large number of data samples for model training is challenging. This study uses a transfer learning method based on a large sample dataset of drilling parameters obtained from dynamic numerical simulation, as established in Section 2.3.1. The knowledge obtained from solving the rock classification tasks is appropriately stored in the dynamic numerical simulation neural network model of rock identification. This knowledge is then applied to the transfer training of the model via small-sample drilling data obtained during actual drilling, thereby adapting the model to predict rock classification in the actual drilling process.
Transfer learning is a machine learning methodology [53] that allows the application of knowledge and experience gained in one task to another related yet distinct task. This approach is particularly useful in areas where data acquisition is scarce or expensive. The basic principle of transfer learning lies in the sharing of knowledge between different but related tasks. In traditional machine learning methods, each task usually starts learning from scratch independently of other tasks. However, transfer learning breaks this isolation by leveraging existing knowledge to accelerate and enhance the efficiency of learning new tasks.
The transfer learning process includes the following key components: (1) Source task: This is the initial task on which the model is trained, usually a data-rich task used to learn general features or knowledge. (2) Target task: This represents a new task with the goal of applying the knowledge gained from the source task. The target task is typically characterized by scarce data or high data acquisition costs. (3) Pre-trained model: A model trained on the source task whose weights and parameters contain valuable information and features that can be transferred to the target task. In the current investigation, the source task is the rock classification task based on the dynamic numerical simulation data, and the target task is the rock classification task based on actual drilling data.
The transfer learning process includes the following steps: (1) Selection and training of the source task model: A model is trained on the source task, typically using a dataset that is relevant to the target task. (2) Model transfer: Part or all of the source task model is transferred to the target task. This often involves copying the weights and model architecture. (3) Freezing and adjusting: Part of the model is frozen on the target task to preserve previously learned features while adjusting or adding new layers to adapt to the new task. (4) Fine-tuning: The model undergoes subtle adjustment; some layers are unfrozen and further trained on the target dataset.
In the present investigation, we first loaded the neural network model used for training the dynamic numerical simulation rock classification. This process retained the input layer, hidden layers, and output layer of the original model, which contains the feature extraction capabilities necessary for the original task. After that, a selective layer-freezing strategy was adopted. The first two layers were frozen with the ReLU activation function (Figure 15). Using Adam’s optimizer and the binary_crossentropy loss function, the model was trained on the dataset of the actual drilling process, and finally, an appropriate neural network model was constructed for rock classification during the actual drilling process. The training process of the neural network model took approximately 1 min on a computer with a 64-core 4.0 GHz CPU and 512 GB memory.

3. Results

3.1. Results of the Laboratory MWD Experiments

In this study, multiple drilling tests were conducted on three types of rock samples: granite, limestone, and sandstone, using the constant drilling speed–constant rotational speed mode. The actual torque, drilling speed, and rotational speed of the drill bit were obtained during the drilling process. The settings for the drilling speed and rotational speed are presented in Table 4. The drilling results for 14 granite samples, 6 sandstone samples, and 6 limestone samples collected at 1 s intervals are illustrated in Figure 16; the index (x-axis) refers to the set of parameters obtained from each data collection during drilling. The plotted results reveal that the torque during granite drilling was primarily between 1.4 and 6.4 Nm, for limestone drilling between 1 and 5.9 Nm, and for sandstone drilling between 1.4 and 2.6 Nm. The reason for the gradually decreasing torque according to granite, limestone, and sandstone may be that granite’s interlocked crystalline structure and higher quartz content increase its hardness, while limestone’s calcite composition makes it easier to drill. Sandstone, composed mainly of softer minerals, requires less force to drill through, thus resulting in lower torque. The obtained results indicate that for all three types of rock, the drilling speed is directly proportional to the torque, and the rotational speed of the drilling rig is inversely proportional to the torque and is in line with practical observations. The state of the samples after the test is presented in Figure 17. The rock cores are uniformly cylindrical, intact, and unfractured, with rotational drilling marks on the sides, but no cracks are evident. An endoscope was employed to inspect the walls of the borehole, which were found to be smooth and free of cracks, and overall, the cubic rock specimens were intact, with no significant cracks on any surface.

3.2. Results of the Dynamic Numerical Simulation

In this study, 500 dynamic numerical simulation models for each granite, sandstone, and limestone sample were randomly generated. These models were different in terms of drilling speed, rotational speed, and rock strength. The random generation range of the drilling speed (V) was set as 5–50 mm/min, whereas the range of the rotational speed (N) of the drill was set as 400–800 RPM. For the granite, the uniaxial compressive strength was randomly generated in the range of 100 to 300 MPa, for sandstone from 30 to 100 MPa, and for limestone from 60 to 170 MPa. The change in Mises stress at different times during the initial penetration of the drill into the rock is illustrated in Figure 18. At the beginning of the drilling process, the rock breaking penetration begins with the simultaneous drill teeth approaching and pressing the surface of the rock under the action of vertical pressure. Under the influence of the torque, the rotation of the drill bit drives the drill teeth to cut into the rock. In the subsequent process, as the drill continuously penetrates the rock, it experiences these two primary forces along with other frictional resistances. Simultaneously, the interaction area and forces between the drill bit and the rock are constantly changing.
Figure 19 shows the torque comparison between the laboratory drilling tests and the numerical simulations for granite, limestone, and sandstone at a drilling speed (V) of 20 mm/min and a rotational speed (N) of 400 RPM. The comparison indicates that the torque error between the laboratory tests and the numerical simulations does not exceed 1.5 N∙m, confirming that the dynamic numerical simulation models constructed for this study are very similar to the actual drilling process.
Subjected to the same drilling conditions with a drilling speed of 20 mm/min and a rotational speed of 800 rpm, the simulations were performed for all three types of rock, which yielded the maximum Mises equivalent stress at intervals of 0.0002 s, as illustrated in Figure 20. The stress response range substantially varies among the different rock types in the presence of the same drilling conditions. Limestone exhibits stress levels of about 200 MPa, while granite’s stress level can reach up to 600 MPa. As a general rule, rocks with superior properties show higher maximum Mises equivalent stresses.

3.3. Results of the Rock Prediction

3.3.1. Dynamic Numerical Simulation Rock Prediction Results

In this study, dynamic numerical simulation models were appropriately developed to predict rock strength and classify different types of rock. In the rock strength prediction models, the normalized data were randomized, with 10% allocated to the test dataset, 10% to the validation dataset, and the remaining 80% to the training dataset. The training and validation datasets were utilized for model training, whereas the testing dataset was employed to assess the prediction accuracy of the model. The learning curves for the three rock strength prediction models are depicted in Figure 21. The granite training dataset consisted of 54,540 entries, the limestone dataset comprised 50,400 entries, and the sandstone dataset contained 51,410 entries. These models were trained over 1000 epochs with a batch size of 5000. The analysis of the learning curves reveals that the prediction accuracy curves for the training and validation datasets of the three models exhibit close alignment, indicating no overfitting or underfitting during training. The MSE loss values for the three rock types, as presented in Table 10, emphasize the satisfactory prediction accuracy for all the rock types. This confirms that the data generated by the dynamic numerical simulation models conform to specific patterns. The loss values for all three types of rocks are around 0.04. Figure 22 illustrates the comparison between the predicted and actual values of the uniaxial compressive strength parameters for the three rock types. The plotted results indicate that the predicted values reflect the actual values well, with most of the data points closely approximating the actual values. In summary, the constructed neural network models are capable of successfully establishing a nonlinear mapping relationship between the torque, rotational speed, drilling speed, and uniaxial compressive strength of rocks in dynamic numerical simulations.
In the rock classification models, the data distribution was maintained at 10% for testing, 10% for validation, and 80% for training. The training and validation datasets were employed to train the model, and the test dataset was implemented to evaluate the classification accuracy of the model. The learning curve of the prediction model, as illustrated in Figure 23, contains 104,940 data inputs, which include the numerical simulation data for all three rock types. The model was trained over 1000 epochs with a batch size of 5000. The learning curve shows a continuous decrease in prediction error as training progresses, indicating correct configuration and effective training of the model. The accuracy curves for both the training and validation datasets of the classification models of the three rock types are perfectly aligned, indicating no overfitting or underfitting. The classification accuracy was achieved as 99.25% for the training set, 99.42% for the validation set, and 99.41% for the test set, demonstrating a high level of prediction accuracy in all the rock types.
Figure 24 illustrates the confusion matrix for the test dataset. The confusion matrix shows the number of correct and incorrect predictions for the different rock types. It is a performance measurement tool used in machine learning classification problems where the output can be of two or more classes. The confusion matrix provides insights into the accuracy of the model by showing the true positive (TP), true negative (TN), false positive (FP), and false negative (FN) values. TP is the number of correctly predicted positive samples. TN represents the number of correctly predicted negative samples. FP denotes the number of negative samples incorrectly predicted as positive. FN signifies the number of positive samples incorrectly predicted as negative.
The neural network achieved a prediction accuracy of 99.82% for label 0 (granite), 99.53% for label 1 (sandstone), and 99.36% for label 3 (limestone). As a result, based on the dynamic numerical simulation results, the neural network model exhibits high classification accuracy for all three rock types.

3.3.2. Laboratory Drilling Experiment Rock Prediction Results

In the present investigation, since the uniaxial compressive strength of the same type of rock samples was assumed to be the same in the laboratory drilling tests, we exclusively focused on the rock classification model. The data were distributed as follows: 10% to the test set, 10% to the validation set, and 80% to the training set. The learning curves for the three rock prediction models, as demonstrated in Figure 25, reveal that the training dataset only contains 18,411 data entries, including the numerical simulation data for all three rock types. These models were trained over 1000 epochs with a batch size of 5000. Further analysis of the learning curves indicates a continuous decrease in the value of the loss function during training. However, signs of potential overfitting were observed after 700 epochs. The accuracy was 96.87% for the training set, 80.05% for the validation set, and 77% for the test set. Except for the training set, the accuracy was relatively lower in other sets.
Figure 26 illustrates the confusion matrix of the test dataset of the model. The obtained results reveal that the neural network achieved a prediction accuracy of 91.92% for label 0 (granite), 80.53% for label 1 (sandstone), and 76.42% for label 3 (limestone). As is seen, the prediction accuracy levels for all three rock types in the laboratory drilling tests are relatively lower than those of the dynamic numerical simulation data. In addition, the accuracy of the rock classification is lower for the rocks with smaller dataset sizes. As a result, it can be concluded that constructing neural network models with a limited amount of drilling data does not yield satisfactory predictive performance.

3.3.3. Rock Rapid Identification Results Based on the Transfer Learning

Using a transfer learning approach in conjunction with the dynamic numerical simulation models, the model was appropriately optimized with laboratory drilling test data. This optimization was performed with the aim of aligning with the nonlinear mapping relationship between drilling parameters and rock types in laboratory conditions. In the rock classification model, 10% of the data are set for the test set, 10% for the validation set, and 80% for the training set. The learning curves for the three rock prediction models are illustrated in Figure 27. Further examination of the learning curves reveals a continuous decrease in prediction error during training, indicating the model’s correct setup and readiness for effective training. The accuracy curves for the training and validation datasets of the three rock classification models are perfectly aligned, indicating no overfitting or underfitting during training. The accuracy was 98.40% for the training set, 96.26% for the validation set, and 97.50% for the test set. These accuracies are highly satisfactory for all the rock types. Notably, compared to the predictions of neural network models without transfer learning, the accuracy of the test set is improved by 20.5%. In comparison with other rock identification methodologies based on machine learning, LaBelle et al.’s [29] classified lithology achieved an accuracy rate of 95.5%. Klyuchnikov et al. [31] compared various machine learning algorithms for the classification of rock layer types based on borehole data and achieved a maximum classification accuracy of 91%. The performance of rock identification in this study is similar to or exceeds the classification models of most scholars.
Figure 28 presents the confusion matrix for the test dataset. The obtained results are indicative of the fact that the neural network approach could achieve a prediction accuracy of 99.82% for label 0 (granite), 99.53% for label 1 (sandstone), and 99.36% for label 3 (limestone). Compared to the prediction models without transfer learning, the prediction accuracy of granite is improved by 7.9%, sandstone by 19%, and limestone by 22.94%. These are significant improvements in classification accuracy for all three rock types, demonstrating that the exploitation of transfer learning methods noticeably mitigates the issue of lower prediction accuracy due to insufficient training data for actual drilling parameters.

4. Conclusions

This study addresses the challenges of limited training data, limited coverage of rock types, and the time-consuming and labor-intensive process of data collection in the neural network models used for rock identification. We developed a fast rock identification method for MWD based on dynamic numerical simulation data and transfer learning neural network techniques. This method utilized a dynamic numerical simulation model to generate a large volume of simulated MWD rock test data. We then established a neural network model based on these dynamic numerical simulation data for rock identification. Building upon this model, transfer training was performed using real drilling data. This approach preserves the knowledge gained in the rock identification neural network model of dynamic numerical simulation for rock identification tasks. The model is refined with small-sample drilling data obtained during actual drilling operations, enabling transfer training. This fact enhances the applicability of the proposed model in predicting rock identification in actual drilling processes.
The main findings of the present investigation can be summarized as follows:
(1) A novel approach is established by using a dynamic numerical simulation model and transfer learning to rapidly adapt the neural network model for practical rock identification, reducing the need for extensive actual drilling data.
(2) The accuracy of rock identification during drilling is enhanced, with a notable enhancement in the classification of granite, sandstone, and limestone, reaching 99.36%, 99.53%, and 99.82%, respectively.
(3) The transfer learning is able to improve prediction accuracy by up to 22.94% compared to models without transfer learning, effectively addressing the challenge of limited training data.
(4) By leveraging transfer learning, we significantly improved the model’s prediction accuracy using smaller datasets obtained from actual drilling, demonstrating the model’s practical applicability.
In the future, the exploration of more advanced algorithms and models could further enhance the accuracy and efficiency of rock strength parameter prediction. Techniques such as deep learning and reinforcement learning may provide novel solutions to address issues in current models, enhancing their robustness and adaptability in processing complex data. Furthermore, this research primarily focused on specific types of rocks and a limited range of laboratory test conditions. Future research works are anticipated to expand the applicability of the model to include a broader range of rock types, different drilling techniques, and complex geological environments, thereby improving the universality and applicability of the model.

Author Contributions

Conceptualization, Y.F. and Z.W.; methodology, L.J.; software, L.J.; validation, Y.F.; formal analysis, H.T.; investigation, X.F. and Y.F.; resources, X.F.; data curation, Y.F.; writing—original draft preparation, J.S. and Y.F.; writing—review and editing, Y.F.; visualization, Y.F.; supervision, J.S.; project administration, J.S.; funding acquisition, Z.W. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Science and Technology innovation demonstration project of Yunnan Transportation Department (2022(24-2)), the Key R&D Program of Yunnan Province (202303AA080010), and the Open Research Fund of State Key Laboratory of Geomechanics and Geotechnical Engineering, Institute of Rock and Soil Mechanics, Chinese Academy of Sciences (SKLGME022014).

Data Availability Statement

The data are contained within the article.

Conflicts of Interest

Authors Yuwei Fang, Lianghua Jiang and Junxin Shen were employed by the company Yunnan Institute of Transport Planning and Design Co., Ltd. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest. Yunnan Institute of Transport Planning and Design Co., Ltd. had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

References

  1. Martins, A.C.; Terenci, E.R.; Tomi, G.D.; Tichauer, R.M. Impact of geophysics in small-scale mining. J. Remote Sens. GIS 2016, 5, 2. [Google Scholar] [CrossRef]
  2. Horner, P.C.; Sherrell, F.W. Application of Air-Flush Rotary-Percussion Techniques in Site Investigation. Am. J. Pathol. 1977, 10, 207–220. [Google Scholar] [CrossRef]
  3. Pfister, P. Recording drilling parameters in ground engineering. Ground Eng. 1985, 18, 16–21. [Google Scholar]
  4. Suzuki, Y.; Sasao, H.; Nishi, K.; Takesue, K. Ground Exploration System Using Seismic Cone and Rotary Percussion Drill. J. Technol. Des. Archit. Inst. Jpn. 1995, 1, 180–184. [Google Scholar]
  5. Fortunati, F.; Pelligrino, G. The Use of Electronics in the Management of Site Investigation and Soil Improvement Works: Principles and Applications. In Proceedings of the Geotechnical Site Characterization, Atlanta, Georgia, 19–22 April 1998; pp. 359–364. [Google Scholar]
  6. Colosimo, P. On the Use of Drilling Parameters in Rock Foundations. In Proceedings of the Geotechnical Site Characterization, Atlanta, Georgia, 19–22 April 1998; pp. 347–352. [Google Scholar]
  7. Nishi, K.; Suzuki, Y.; Sasao, H. Estimation of Soil Resistance Using Rotary Percussion Drill. In Proceedings of the Geotechnical Site Characterization, Atlanta, Georgia, 19–22 April 1998; pp. 393–398. [Google Scholar]
  8. Sugawara, J.; Yue, Z.Q.; Tham, L.G.; Law, K.T.; Lee, C.F. Weathered Rock Characterization Using Drilling Parameters. Can. Geotech. J. 2003, 40, 661–668. [Google Scholar] [CrossRef]
  9. Smith, H.J. New Approaches for Determination of Rock and Rock Mass Properties at Dredging Sites; ASCE: Reston, VA, USA, 1994; pp. 259–268. [Google Scholar]
  10. Lu, J.; Guo, W.; Liu, J.; Zhao, R.; Ding, Y.; Shi, S. An Intelligent Advanced Classification Method for Tunnel-Surrounding Rock Mass Based on the Particle Swarm Optimization Least Squares Support Vector Machine. Appl. Sci. 2023, 13, 2068. [Google Scholar] [CrossRef]
  11. Yi, W.; Wang, M.; Tong, J.; Zhao, S.; Li, J.; Gui, D.; Zhang, X. Heterogeneity identification method for surrounding rock of large-section rock tunnel faces based on support vector machine. Railw. Sci. 2023, 2, 48–67. [Google Scholar] [CrossRef]
  12. Alkassis, C.; Nassif, E.; Elhajj, I.; Najjar, S.; Sadek, S. Exploratory Drilling with Recorded Parameters using Wireless Technology. In Proceedings of the Information Technology in Geo-Engineering: Proceedings of the 1st International Conference (ICITG), Shanghai, China, August 2021; pp. 199–206. [Google Scholar]
  13. Teale, R. The Concept of Specific Energy in Rock Drilling. Int. J. Rock Mech. Min. Sci. 1965, 2, 245–250. [Google Scholar] [CrossRef]
  14. Simon, R. Energy Balance in Rock Drilling. Soc. Pet. Eng. J. 1963, 3, 298–306. [Google Scholar] [CrossRef]
  15. Hoberock, L.L.; Bratcher, G.J. A New Approach for Determining In-Situ Rock Strength While Drilling. J. Energy Resour. Technol. 1996, 118, 249–255. [Google Scholar] [CrossRef]
  16. Hamrick, T. Optimization of Operating Parameters for Minimum Mechanical Specific Energy in Drilling. Ph.D. Thesis, West Virginia University, Morgantown, WV, USA, 2011. [Google Scholar]
  17. Finfinger, G.L.; Peng, S.; Gu, Q.; Wilson, G.; Thomas, B. An Approach to Identifying Geological Properties from Roof Bolter Drilling Parameters. In Proceedings of the 19th International Conference on Ground Control in Mining, Morgantown, WV, USA, 8–10 August 2000; pp. 1–11. [Google Scholar]
  18. Finfinger, G.L. A Methodology for Determining the Character of Mine Roof Rocks. Ph.D. Thesis, West Virginia University, Morgantown, WV, USA, 2003. [Google Scholar]
  19. Manzoor, S.; Liaghat, S.; Gustafson, A.; Johansson, D.; Schunnesson, H. Establishing relationships between structural data from close-range terrestrial digital photogrammetry and measurement while drilling data. Eng. Geol. 2020, 267, 105480. [Google Scholar] [CrossRef]
  20. Prasad, U.; Jonsbraten, F.; Holbrough, D.; Saint, C. An Innovative and Independent Method for Formation Strengths and Facies Identification Using Real-Time Downhole Drilling Data, and its Application in Geosteering for Optimal Well Placement. In Proceedings of the SPE Middle East Oil and Gas Show and Conference, Manama, Bahrain, 19–21 February 2023. D021S052R001. [Google Scholar]
  21. Bout, G.; Brito, D.; Gómez, R.; Carvajal, G.; Ramírez, G. Physics-Based Observers for Measurement-While-Drilling System in Down-the-Hole Drills. Mathematics 2022, 10, 4814. [Google Scholar] [CrossRef]
  22. Schunnesson, H. RQD Predictions Based on Drill Performance Parameters. Tunn. Undergr. Space Technol. 1996, 11, 345–351. [Google Scholar] [CrossRef]
  23. Schunnesson, H. Rock Characterisation Using Percussive Drilling. Int. J. Rock Mech. Min. Sci. 1998, 35, 711–725. [Google Scholar] [CrossRef]
  24. Navarro, J.; Sanchidrián, J.A.; Segarra, P.; Castedo, R.; Costamagna, E.; López, L.M. Detection of Potential Overbreak Zones in Tunnel Blasting from MWD Data. Tunn. Undergr. Space Technol. 2018, 82, 504–516. [Google Scholar] [CrossRef]
  25. van Eldert, J.; Funehag, J.; Saiang, D.; Schunnesson, H. Rock support prediction based on measurement while drilling technology. Bull. Eng. Geol. Environ. 2021, 80, 1449–1465. [Google Scholar] [CrossRef]
  26. Lakshminarayana, C.R.; Tripathi, A.K.; Pal, S.K. MWD technique to estimate the uniaxial compressive strength of rocks. AIP Conf. Proc. 2020, 2204, 040011. [Google Scholar]
  27. Khoshouei, M.; Bagherpour, R. Predicting the geomechanical properties of hard rocks using analysis of the acoustic and vibration signals during the drilling operation. Geotech. Geol. Eng. 2021, 39, 2087–2099. [Google Scholar] [CrossRef]
  28. Asadi, A. Application of Artificial Neural Networks in Prediction of Uniaxial Compressive Strength of Rocks Using Well Logs and Drilling Data. Procedia Eng. 2017, 191, 279–286. [Google Scholar] [CrossRef]
  29. Labelle, D. Lithological Classification by Drilling; Thesis Proposal; Carnegie Mellon University: Pittsburgh, PA, USA, 2011. [Google Scholar]
  30. Zhou, H.; Hatherly, P.; Ramos, F.; Nettleton, E. An Adaptive Data Driven Model for Characterizing Rock Properties from Drilling Data. In Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China, 9–13 May 2011; IEEE: New York, NY, USA, 2011; pp. 1909–1915. [Google Scholar]
  31. Klyuchnikov, N.; Zaytsev, A.; Gruzdev, A.; Ovchinnikov, G.; Antipova, K.; Ismailova, L.; Muravleva, E.; Burnaev, E.; Semenikhin, A.; Cherepanov, A. Data-Driven Model for the Identification of the Rock Type at a Drilling Bit. J. Pet. Sci. Eng. 2019, 178, 506–516. [Google Scholar] [CrossRef]
  32. Vezhapparambu, V.S.; Eidsvik, J.; Ellefmo, S.L. Rock Classification Using Multivariate Analysis of Measurement While Drilling Data: Towards a Better Sampling Strategy. Minerals 2018, 8, 384. [Google Scholar] [CrossRef]
  33. Romanenkova, E.; Zaytsev, A.; Klyuchnikov, N.; Gruzdev, A.; Koroteev, D.; Ismailova, L.; Burnaev, E.; Semenikhin, A.; Koryabkin, V.; Simon, I. Real-Time Data-Driven Detection of the Rock-Type Alteration During a Directional Drilling. IEEE Geosci. Remote Sens. Lett. 2020, 17, 1861–1865. [Google Scholar] [CrossRef]
  34. Fang, Y.; Wu, Z.; Sheng, Q.; Tang, H.; Liang, D. Tunnel Geology Prediction Using a Neural Network Based on Instrumented Drilling Test. Appl. Sci. 2020, 11, 217. [Google Scholar] [CrossRef]
  35. Cheng, X.; Tang, H.; Wu, Z.; Liang, D.; Xie, Y. BILSTM-Based Deep Neural Network for Rock-Mass Classification Prediction Using Depth-Sequence MWD Data: A Case Study of a Tunnel in Yunnan. China. Appl. Sci. 2023, 13, 6050. [Google Scholar] [CrossRef]
  36. Gupta, I.; Tran, N.; Devegowda, D.; Jayaram, V.; Rai, C.; Sondergeld, C.; Karami, H. Looking ahead of the bit using surface drilling and petrophysical data: Machine-learning-based real-time geosteering in volve field. SPE J. 2020, 25, 990–1006. [Google Scholar] [CrossRef]
  37. Amadi, K.W.; Alsaba, M.T.; Iyalla, I.; Prabhu, R.; Elgaddafi, R.M. Machine Learning Techniques for Real-Time Prediction of Essential Rock Properties Whilst Drilling. In Proceedings of the SPE Nigeria Annual International Conference and Exhibition, Lagos, Nigeria, 31 July–2 August 2023; p. D031S017R004. [Google Scholar]
  38. Chiang, L.E.; Elías, D.A. A 3D FEM Methodology for Simulating the Impact in Rock-Drilling Hammers. Int. J. Rock Mech. Min. Sci. 2008, 45, 701–711. [Google Scholar] [CrossRef]
  39. Liu, H.Y.; Kou, S.Q.; Lindqvist, P.A. Numerical Studies on Bit-Rock Fragmentation Mechanisms. Int. J. Geomech. 2008, 8, 45–67. [Google Scholar] [CrossRef]
  40. Saksala, T. Numerical Modelling of Bit–Rock Fracture Mechanisms in Percussive Drilling with a Continuum Approach. Int. J. Numer. Anal. Methods Geomech. 2011, 35, 1483–1505. [Google Scholar] [CrossRef]
  41. Han, Y.; Kuang, Y.; Yang, B.; Ai, Z. Nonlinear dynamic modeling of drill string-bit-rock coupling system based on bit/rock interaction simulation. SPE J. 2022, 27, 2161–2182. [Google Scholar] [CrossRef]
  42. Zhang, C.L.; Yang, Y.X.; Qi, Q.L.; Ren, H.T.; Wang, J.C. Research on numerical drilling technology of mesh-like cutting PDC bit. Energy Rep. 2021, 7, 2068–2080. [Google Scholar] [CrossRef]
  43. Houshmand, N.; Mortazavi, A.; Hassani, F.P. Modeling drill bit wear mechanisms during rock drilling. Arab. J. Geosci. 2021, 14, 1970. [Google Scholar] [CrossRef]
  44. Tian, X.; Tao, T.; Lou, Q.; Xie, C. Modification and Application of Limestone HJC Constitutive Model under the Impact Load. Lithosphere 2022, 2021, 6443087. [Google Scholar] [CrossRef]
  45. Fang, Q.; Kong, X.-Z.; Wu, H.; Gong, Z.-M. Determination of Holmquist-Johnson-Cook Consitiutive Model Parameters of Rock. Eng. Mech. 2014, 31, 197–204. [Google Scholar]
  46. Wang, Z.; Wang, H.; Wang, J.; Tian, N. Finite Element Analyses of Constitutive Models Performance in the Simulation of Blast-Induced Rock Cracks. Eng. Mech. 2021, 135, 104172. [Google Scholar] [CrossRef]
  47. Zhang, G.; Qiang, H.; Wang, G.; Huang, Q.; Yang, Y. Numerical Simulation of the Penetration of Granite at Wide-Range Velocities with a New SPH Method. AIP Adv. 2019, 9, 015220. [Google Scholar] [CrossRef]
  48. Tian, X.; Tao, T.; Xie, C. Study of Impact Dynamic Characteristics and Damage Morphology of Layered Rock Mass. Geofluids 2022, 2022, e2835775. [Google Scholar] [CrossRef]
  49. Al-Faiz, M.Z.; Ibrahim, A.A.; Hadi, S.M. The Effect of Z-Score Standardization (Normalization) on Binary Input Due the Speed of Learning in Back-Propagation Neural Network. Ira. J. Inf. Commun. Technol. 2018, 1, 42–48. [Google Scholar] [CrossRef]
  50. Ioffe, S.; Szegedy, C. Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. arXiv 2015, arXiv:1502.03167. [Google Scholar]
  51. Bai, Y. RELU-Function and Derived Function Review. SHS Web Conf. 2022, 144, 02006. [Google Scholar] [CrossRef]
  52. Jap, D.; Won, Y.-S.; Bhasin, S. Fault Injection Attacks on SoftMax Function in Deep Neural Networks. In Proceedings of the 18th ACM International Conference on Computing Frontiers, Virtual, 11–13 May 2021; Association for Computing Machinery: New York, NY, USA, 2021; pp. 238–240. [Google Scholar]
  53. Karimpanal, T.G.; Bouffanais, R. Self-Organizing Maps for Storage and Transfer of Knowledge in Reinforcement Learning. Available online: https://arxiv.org/abs/1811.08318v1 (accessed on 9 January 2024).
Processes 12 01260 g001aProcesses 12 01260 g001b
Figure 1. Main units of the laboratory MWD system: (a) integral construction, (b) bit rotation part, (c) sensor part.
Figure 1. Main units of the laboratory MWD system: (a) integral construction, (b) bit rotation part, (c) sensor part.
Processes 12 01260 g001aProcesses 12 01260 g001b
Processes 12 01260 g002
Figure 2. Cross-sectional view of the diamond drill bit as well as a sideview photo from its fabrication.
Figure 2. Cross-sectional view of the diamond drill bit as well as a sideview photo from its fabrication.
Processes 12 01260 g002
Processes 12 01260 g003
Figure 3. Three types of rock specimens (from left to right: limestone, sandstone, and granite).
Figure 3. Three types of rock specimens (from left to right: limestone, sandstone, and granite).
Processes 12 01260 g003
Processes 12 01260 g004
Figure 4. Uniaxial compression experiment.
Figure 4. Uniaxial compression experiment.
Processes 12 01260 g004
Processes 12 01260 g005
Figure 5. Diamond core drill bit model.
Figure 5. Diamond core drill bit model.
Processes 12 01260 g005
Processes 12 01260 g006
Figure 6. Dynamic numerical simulation drill bit model.
Figure 6. Dynamic numerical simulation drill bit model.
Processes 12 01260 g006
Processes 12 01260 g007
Figure 7. The rock block model used for dynamic numerical simulations.
Figure 7. The rock block model used for dynamic numerical simulations.
Processes 12 01260 g007
Processes 12 01260 g008
Figure 8. Initial state of the dynamic numerical simulation.
Figure 8. Initial state of the dynamic numerical simulation.
Processes 12 01260 g008
Processes 12 01260 g009
Figure 9. Torque data of S2 and S3 in the dynamic numerical simulation.
Figure 9. Torque data of S2 and S3 in the dynamic numerical simulation.
Processes 12 01260 g009
Processes 12 01260 g010
Figure 10. Specific locations of S2 and S3 in the dynamic numerical simulations.
Figure 10. Specific locations of S2 and S3 in the dynamic numerical simulations.
Processes 12 01260 g010
Processes 12 01260 g011
Figure 11. Time history plot of torque data after summation.
Figure 11. Time history plot of torque data after summation.
Processes 12 01260 g011
Processes 12 01260 g012
Figure 12. Time history plot of torque data after filtering.
Figure 12. Time history plot of torque data after filtering.
Processes 12 01260 g012
Processes 12 01260 g013
Figure 13. Structure of the neural network model for predicting the rock type in the dynamic numerical simulation: (a) structure diagram, (b) main code.
Figure 13. Structure of the neural network model for predicting the rock type in the dynamic numerical simulation: (a) structure diagram, (b) main code.
Processes 12 01260 g013
Processes 12 01260 g014
Figure 14. Structure of the neural network model for predicting the uniaxial compressive strength of rocks in the dynamic numerical simulation: (a) structure diagram, (b) main code.
Figure 14. Structure of the neural network model for predicting the uniaxial compressive strength of rocks in the dynamic numerical simulation: (a) structure diagram, (b) main code.
Processes 12 01260 g014
Processes 12 01260 g015
Figure 15. Schematic representation of the layer-by-layer transfer learning model: (a) structure diagram, (b) main code.
Figure 15. Schematic representation of the layer-by-layer transfer learning model: (a) structure diagram, (b) main code.
Processes 12 01260 g015
Processes 12 01260 g016
Figure 16. Results of the laboratory MWD experiments: (a) granite, (b) limestone, (c) sandstone.
Figure 16. Results of the laboratory MWD experiments: (a) granite, (b) limestone, (c) sandstone.
Processes 12 01260 g016
Processes 12 01260 g017
Figure 17. Specimens post-experiment.
Figure 17. Specimens post-experiment.
Processes 12 01260 g017
Processes 12 01260 g018
Figure 18. Mises stress cloud map for the dynamic numerical simulation of granite drilling at various times.
Figure 18. Mises stress cloud map for the dynamic numerical simulation of granite drilling at various times.
Processes 12 01260 g018
Processes 12 01260 g019aProcesses 12 01260 g019b
Figure 19. Comparison of the torques obtained from the drilling experiments and the numerical simulation under constant drilling speed–constant rotational speed mode: (a) granite, (b) limestone, (c) sandstone.
Figure 19. Comparison of the torques obtained from the drilling experiments and the numerical simulation under constant drilling speed–constant rotational speed mode: (a) granite, (b) limestone, (c) sandstone.
Processes 12 01260 g019aProcesses 12 01260 g019b
Processes 12 01260 g020
Figure 20. Equivalent drilling stresses for various rocks.
Figure 20. Equivalent drilling stresses for various rocks.
Processes 12 01260 g020
Processes 12 01260 g021aProcesses 12 01260 g021b
Figure 21. Training learning curves of the dynamic numerical simulation rock strength prediction model: (a) granite, (b) sandstone, (c) limestone.
Figure 21. Training learning curves of the dynamic numerical simulation rock strength prediction model: (a) granite, (b) sandstone, (c) limestone.
Processes 12 01260 g021aProcesses 12 01260 g021b
Processes 12 01260 g022
Figure 22. Comparison of the uniaxial compressive strength prediction results: (a) granite, (b) limestone, (c) sandstone.
Figure 22. Comparison of the uniaxial compressive strength prediction results: (a) granite, (b) limestone, (c) sandstone.
Processes 12 01260 g022
Processes 12 01260 g023
Figure 23. Learning curves for the rock classification of sandstone, granite, and limestone via dynamic numerical simulation.
Figure 23. Learning curves for the rock classification of sandstone, granite, and limestone via dynamic numerical simulation.
Processes 12 01260 g023
Processes 12 01260 g024
Figure 24. Confusion matrix for the test dataset of the dynamic numerical simulation model employed for the rock classification model.
Figure 24. Confusion matrix for the test dataset of the dynamic numerical simulation model employed for the rock classification model.
Processes 12 01260 g024
Processes 12 01260 g025
Figure 25. Learning curves of the laboratory rock classification of sandstone, granite, and limestone.
Figure 25. Learning curves of the laboratory rock classification of sandstone, granite, and limestone.
Processes 12 01260 g025
Processes 12 01260 g026
Figure 26. Confusion matrix of the laboratory rock classification model’s test dataset.
Figure 26. Confusion matrix of the laboratory rock classification model’s test dataset.
Processes 12 01260 g026
Processes 12 01260 g027
Figure 27. Learning curves of the rock classification results based on the transfer learning.
Figure 27. Learning curves of the rock classification results based on the transfer learning.
Processes 12 01260 g027
Processes 12 01260 g028
Figure 28. Confusion matrix of the test dataset of the rock classification model based on the transfer learning.
Figure 28. Confusion matrix of the test dataset of the rock classification model based on the transfer learning.
Processes 12 01260 g028
Table 1. Main technical parameters of the laboratory MWD system.
Table 1. Main technical parameters of the laboratory MWD system.
ParameterTechnical Value
Drilling diameter (mm)0–50
Drilling depth (mm)0–190
Drilling system (drill bit rotation part)
Drilling speed (mm/s)0–100
Maximum drilling torque (N·m)0–±500
Engine modelYS7134
Rated power (W)750
Rated speed (r/min)0–1400
Working frequency (Hz)50
Drilling system (electric push rod part)
Maximum thrust stroke (mm)200
Thrust speed (mm/s)0–200
Maximum pulling force (kg)300
Pulling speed (mm/s)0–200
Maximum oil pressure of hydraulic station (MPa)50
Maximum thrust force (kg)300
Confining pressure system (pressure chamber)
Confining pressure (MPa)0–30
Working pressure of hydraulic system (MPa)50
Mass and dimensions
Total mass of the machine (kg)500
Dimensions (length × width × height) (m × m × m)1.4 × 0.8 × 1.5
Table 2. Sensor specifications.
Table 2. Sensor specifications.
NameTechnical ParametersMeasurable Parameters
Torque and rotational speed sensor
(HY-5005, Beijing Hangyu Zhongrui Measurement and Control Technology Co., Ltd., Beijing, China)		Torque range: 0–±1000 N.m
Rotational speed range: 0–1500 (r/min)
Accuracy: ±0.2% FS
Linearity: ±0.05% FS		Torque,
Rotational speed
Drilling pressure sensor
(HY-A6, Beijing Hangyu Zhongrui Measurement and Control Technology Co., Ltd., Beijing, China)		Range: 0–1 (T) (pressure)
Accuracy: ±0.05% FS
Linearity: ±0.05% FS		Drilling pressure
Confining pressure sensor
(HY-B18, Beijing Hangyu Zhongrui Measurement and Control Technology Co., Ltd., Beijing, China)		Range: 0–47 (T) (pressure)
Accuracy: ±0.05% FS
Linearity: ±0.05% FS		Confining pressure
Electric push rod
(FDR065-S200, Suzhou FDR Automation Equipment Technology Co., Ltd., Suzhou, China)		Travel range: 0–200 (mm)
Thrust range: 0–300 (kg)
Lead: 10 (mm)
Speed range: 0–100 (mm/s)		Drilling speed
Table 3. Mechanical parameters of rock samples.
Table 3. Mechanical parameters of rock samples.
TypeSpecific Gravity (g/cm3)Compressive Strength (MPa)Elastic Modulus (GPa)
Limestone2.6650.225.56
Sandstone2.33136.0023.03
Granite2.57241.4145.00
Table 4. Basic parameters of the drilling experiments.
Table 4. Basic parameters of the drilling experiments.
Experiment IdentificationMaterialDrilling Speed (v; mm/min)Rotational Speed (N; rpm)
G1Granite20800
G220800
G330800
G440800
G525800
G615800
G725800
G815600
G920400
G1020600
G1130600
G125800
G1315800
G1425800
L1Limestone20400
L220600
L330600
L420800
L530800
L640800
S1Sandstone20800
S230800
S340800
S420400
S520600
S630600
Table 5. Drilling speed parameters pertinent to PRESCRIBED_MOTION_RIGID.
Table 5. Drilling speed parameters pertinent to PRESCRIBED_MOTION_RIGID.
DOF †VADSFDEATHBIRTH
3 (z-translational DOF)2 (displacement)100
† Note: DOF stands for applicable degrees of freedom; VAD represents velocity/acceleration/displacement flag; SF represents the load curve scale factor; DEATH denotes that the time-imposed motion/constraint is removed, while BIRTH represents the activation of the time-imposed motion/constraint.
Table 6. Rotational speed parameters pertinent to PRESCRIBED_MOTION_RIGID.
Table 6. Rotational speed parameters pertinent to PRESCRIBED_MOTION_RIGID.
DOF †VADSFDEATHBIRTH
7 (z-rotational DOF)0 (velocity)100
† Note: DOF stands for applicable degrees of freedom; VAD represents velocity/acceleration/displacement flag; SF represents the load curve scale factor; DEATH denotes that the time-imposed motion/constraint is removed, while BIRTH represents the activation of the time-imposed motion/constraint.
Table 7. Limestone HJC model parameters.
Table 7. Limestone HJC model parameters.
RO (kg/m3)
(Mass Density)		G (Pa)
(Shear Modulus)		A
(Normalized Cohesive Strength)		B
(Normalized Pressure Hardening)		C
(Strain Rate Coefficient)		N
(Pressure Hardening Exponent)		fc (MPa)
(Uniaxial Compressive Strength)
27509.230 × 1090.791.60.0070.6150.22
T (Pa)
(Maximum tensile hydrostatic pressure)		EPS0
(Maximum tensile hydrostatic pressure)		εfmin
(Amount of plastic strain before fracture)		Sfmax
(Normalized maximum strength)		Pc (Pa)
(Crushing pressure)		μc
(Crushing volumetric strain)		PL (Pa)
(Locking pressure)
1.215 × 10710.00544.330 × 1070.002781.000 × 109
μL
(Locking volumetric strain)		D1
(Damage constant)		D2
(Damage constant)		K1 (Pa)
(Pressure constant)		K2 (Pa)
(Pressure constant)		K3 (Pa)
(Pressure constant)		FS
(Failure type)
0.10.04518.500 × 1010−1.710 × 10112.080 × 10110.004
Table 8. Granite HJC model parameters.
Table 8. Granite HJC model parameters.
RO (kg/m3)
(Mass Density)		G (Pa)
(Shear Modulus)		A
(Normalized Cohesive Strength)		B
(Normalized Pressure Hardening)		C
(Strain Rate Coefficient)		N
(Pressure Hardening Exponent)		fc (MPa)
(Uniaxial Compressive Strength)
26807.610 × 10100.752.360.0490.78241.41
T (Pa)
(Maximum tensile hydrostatic pressure)		EPS0
(Maximum tensile hydrostatic pressure)		εfmin
(Amount of plastic strain before fracture)		Sfmax
(Normalized maximum strength)		Pc (Pa)
(Crushing pressure)		μc
(Crushing volumetric strain)		PL (Pa)
(Locking pressure)
1.610 × 1072.800 × 10−50.0155.46.300 × 1069.000 × 10−41.040 × 109
μL
(Locking volumetric strain)		D1
(Damage constant)		D2
(Damage constant)		K1 (Pa)
(Pressure constant)		K2 (Pa)
(Pressure constant)		K3 (Pa)
(Pressure constant)		FS
(Failure type)
0.10.0461.028.600 × 1010−1.730 × 10112.100 × 10111000
Table 9. Sandstone HJC model parameters.
Table 9. Sandstone HJC model parameters.
RO (kg/m3)
(Mass Density)		G (Pa)
(Shear Modulus)		A
(Normalized Cohesive Strength)		B
(Normalized Pressure Hardening)		C
(Strain Rate Coefficient)		N
(Pressure Hardening Exponent)		fc (MPa)
(Uniaxial Compressive Strength)
24165.670 × 1090.321.760.01270.79136.00
T (Pa)
(Maximum tensile hydrostatic pressure)		EPS0
(Maximum tensile hydrostatic pressure)		εfmin
(Amount of plastic strain before fracture)		Sfmax
(Normalized maximum strength)		Pc (Pa)
(Crushing pressure)		μc
(Crushing volumetric strain)		PL (Pa)
(Locking pressure)
4.600 × 10610.0171.833 × 1070.0348.000 × 108
μL
(Locking volumetric strain)		D1
(Damage constant)		D2
(Damage constant)		K1 (Pa)
(Pressure constant)		K2 (Pa)
(Pressure constant)		K3 (Pa)
(Pressure constant)		FS
(Failure type)
0.080.04518.100 × 1010−9.100 × 10108.900 × 10101.34
Table 10. Loss values of the prediction model adopted for the dynamic numerical simulation rock strength parameter.
Table 10. Loss values of the prediction model adopted for the dynamic numerical simulation rock strength parameter.
Rock TypeTraining Set LossValidation Set LossTesting Set Loss
Granite0.03930.04020.0396
Sandstone0.04000.41700.0413
Limestone0.03930.04040.0475
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Fang, Y.; Wu, Z.; Jiang, L.; Tang, H.; Fu, X.; Shen, J. Dynamic Numerical Simulation and Transfer Learning-Based Rapid Rock Identification during Measurement While Drilling (MWD). Processes 2024, 12, 1260. https://doi.org/10.3390/pr12061260

AMA Style

Fang Y, Wu Z, Jiang L, Tang H, Fu X, Shen J. Dynamic Numerical Simulation and Transfer Learning-Based Rapid Rock Identification during Measurement While Drilling (MWD). Processes. 2024; 12(6):1260. https://doi.org/10.3390/pr12061260

Chicago/Turabian Style

Fang, Yuwei, Zhenjun Wu, Lianghua Jiang, Hua Tang, Xiaodong Fu, and Junxin Shen. 2024. "Dynamic Numerical Simulation and Transfer Learning-Based Rapid Rock Identification during Measurement While Drilling (MWD)" Processes 12, no. 6: 1260. https://doi.org/10.3390/pr12061260

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop