<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.1 20151215//EN" "http://jats.nlm.nih.gov/publishing/1.1/JATS-journalpublishing1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" xml:lang="en" article-type="research-article" dtd-version="1.1">
<front>
<journal-meta>
<journal-id journal-id-type="pmc">EE</journal-id>
<journal-id journal-id-type="nlm-ta">EE</journal-id>
<journal-id journal-id-type="publisher-id">EE</journal-id>
<journal-title-group>
<journal-title>Energy Engineering</journal-title>
</journal-title-group>
<issn pub-type="epub">1546-0118</issn>
<issn pub-type="ppub">0199-8595</issn>
<publisher>
<publisher-name>Tech Science Press</publisher-name>
<publisher-loc>USA</publisher-loc>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">40743</article-id>
<article-id pub-id-type="doi">10.32604/ee.2023.040743</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Article</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Gated Fusion Based Transformer Model for Crack Detection on Wind Turbine Blade</article-title>
<alt-title alt-title-type="left-running-head">Gated Fusion Based Transformer Model for Crack Detection on Wind Turbine Blade</alt-title>
<alt-title alt-title-type="right-running-head">Gated Fusion Based Transformer Model for Crack Detection on Wind Turbine Blade</alt-title>
</title-group>
<contrib-group>
<contrib id="author-1" contrib-type="author">
<name name-style="western"><surname>Tang</surname><given-names>Wenyang</given-names></name><xref ref-type="aff" rid="aff-1">1</xref><xref ref-type="aff" rid="aff-2">2</xref></contrib>
<contrib id="author-2" contrib-type="author" corresp="yes">
<name name-style="western"><surname>Liu</surname><given-names>Cong</given-names></name><xref ref-type="aff" rid="aff-1">1</xref><email>liucong12601@126.com</email></contrib>
<contrib id="author-3" contrib-type="author">
<name name-style="western"><surname>Zhang</surname><given-names>Bo</given-names></name><xref ref-type="aff" rid="aff-2">2</xref></contrib>
<aff id="aff-1"><label>1</label><institution>School of Mechanical Engineering, Yancheng Institute of Technology</institution>, <addr-line>Yancheng, 224007</addr-line>, <country>China</country></aff>
<aff id="aff-2"><label>2</label><institution>Huaneng Offshore Wind Power Science and Technology Research Co., Ltd.</institution>, <addr-line>Yancheng, 224007</addr-line>, <country>China</country></aff>
</contrib-group>
<author-notes>
<corresp id="cor1"><label>&#x002A;</label>Corresponding Author: Cong Liu. Email: <email>liucong12601@126.com</email></corresp>
</author-notes>
<pub-date date-type="collection" publication-format="electronic"><year>2023</year></pub-date>
<pub-date date-type="pub" publication-format="electronic"><day>31</day><month>10</month><year>2023</year></pub-date>
<volume>120</volume>
<issue>11</issue>
<fpage>2667</fpage>
<lpage>2681</lpage>
<history>
<date date-type="received"><day>29</day><month>3</month><year>2023</year>
</date>
<date date-type="accepted"><day>30</day><month>5</month><year>2023</year>
</date>
</history>
<permissions>
<copyright-statement>&#x00A9; 2023 Tang, Liu and Zhang</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Tang, Liu and Zhang</copyright-holder>
<license xlink:href="https://creativecommons.org/licenses/by/4.0/">
<license-p>This work is licensed under a <ext-link ext-link-type="uri" xlink:type="simple" xlink:href="https://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution 4.0 International License</ext-link>, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
</license>
</permissions>
<self-uri content-type="pdf" xlink:href="TSP_EE_40743.pdf"></self-uri>
<abstract>
<p>Harsh working environments and wear between blades and other unit components can easily lead to cracks and damage on wind turbine blades. The cracks on the blades can endanger the shafting of the generator set, the tower and other components, and even cause the tower to collapse. To achieve high-precision wind blade crack detection, this paper proposes a crack fault-detection strategy that integrates Gated Residual Network (GRN), a fusion module and Transformer. Firstly, GRN can reduce unnecessary noisy inputs that could negatively impact performance while preserving the integrity of feature information. In addition, to gain in-depth information about the characteristics of wind turbine blades, a fusion module is suggested to implement the information fusion of wind turbine features. Specifically, each fan feature is mapped to a one-dimensional vector with the same length, and all one-dimensional vectors are concatenated to obtain a two-dimensional vector. And then, in the fusion module, the information fusion of the same characteristic variables in the different channels is realized through the Channel-mixing MLP, and the information fusion of different characteristic variables in the same channel is realized through the Column-mixing MLP. Finally, the fused feature vector is input into the Transformer for feature learning, which enhances the influence of important feature information and improves the model&#x2019;s anti-noise ability and classification accuracy. Extensive experiments were conducted on the wind turbine supervisory control and data acquisition (SCADA) data from a domestic wind field. The results show that compared with other state-of-the-art models, including XGBoost, LightGBM, TabNet, etc., the F1-score of proposed gated fusion based Transformer model can reach 0.9907, which is 0.4%&#x2013;2.09% higher than the compared models. This method provides a more reliable approach for the condition detection and maintenance of fan blades in wind farms.</p>
</abstract>
<kwd-group kwd-group-type="author">
<kwd>Crack detection</kwd>
<kwd>gated residual network</kwd>
<kwd>fusion</kwd>
<kwd>attention</kwd>
</kwd-group>
<funding-group>
<award-group id="awg1">
<funding-source>Jiangsu Provincial Key R&#x0026;D Programme</funding-source>
<award-id>BE2020034</award-id>
</award-group>
<award-group id="awg2">
<funding-source>China Huaneng Group Science and Technology Project</funding-source>
<award-id>HNKJ20-H72</award-id>
</award-group>
</funding-group>
</article-meta>
</front>
<body>
<sec id="s1">
<label>1</label>
<title>Introduction</title>
<p>With the development of industry and technology, wind energy is widely used for its cleanness, environmental protection and sustainability [<xref ref-type="bibr" rid="ref-1">1</xref>]. Wind power technology has become a new technology growth point and entered a stage of rapid development [<xref ref-type="bibr" rid="ref-2">2</xref>]. However, due to the harsh working environment and the increasingly complex mechanical structure, wind turbines are prone to failure, which not only increases the maintenance cost of the wind power plant, but also seriously affects the power output [<xref ref-type="bibr" rid="ref-3">3</xref>,<xref ref-type="bibr" rid="ref-4">4</xref>].</p>
<p>Blades are one of the main components of wind turbines. Blades working safely and efficiently has an essential impact on the stable operation of the wind turbine. However, the harsh working environment, unceasing working, and the wear between the blades and other unit components will accumulate potential failures, quickly leading to cracks and damage to the wind turbine blades. According to the Global Wind Energy Council statistics during eight years of the wind farm operation, about 30% of the accidents that causing shutting down for more than 7 days are caused by blade faults [<xref ref-type="bibr" rid="ref-5">5</xref>]. Blade crack harms wind turbine shafting, tower cylinder and other unit components, and if not treated, they will lead to accidents [<xref ref-type="bibr" rid="ref-6">6</xref>]. The cost and time required for repairing blade crack are high [<xref ref-type="bibr" rid="ref-7">7</xref>,<xref ref-type="bibr" rid="ref-8">8</xref>]. Therefore, detecting the state of the blade, especially when the blade cracks under complex working conditions, can quickly and accurately judge the fault state of the blade, which is very important for ensuring overall efficiency, safety and reliability of the wind turbine, reducing the loss and improving the economic benefit [<xref ref-type="bibr" rid="ref-9">9</xref>,<xref ref-type="bibr" rid="ref-10">10</xref>].</p>
<p>The traditional fault detection methods on wind turbine blades include acoustic emission detection [<xref ref-type="bibr" rid="ref-11">11</xref>], infrared imaging detection [<xref ref-type="bibr" rid="ref-12">12</xref>], and abnormal vibration detection [<xref ref-type="bibr" rid="ref-13">13</xref>]. Although these traditional fault detection methods have the advantages of fast detection speed and strong real-time, however, they are usually unable to detect the faults of the wind turbine blades in the working state, and have extremely high requirements on the detection environment and equipment, making them unable to be widely used in practice.</p>
<p>In recent years, commonly used wind turbine blade fault detection methods can be classified as model-based and data-driven [<xref ref-type="bibr" rid="ref-14">14</xref>]. Empirical mode decomposition (EMD) and discrete mathematical model are often used in wind turbine blade crack fault detection by using the changes in natural frequencies [<xref ref-type="bibr" rid="ref-15">15</xref>,<xref ref-type="bibr" rid="ref-16">16</xref>]. By applying the residual to describe the deviation degree of each characteristic parameter value, and through progressive parameterization, a blade icing identification model is established [<xref ref-type="bibr" rid="ref-17">17</xref>]. However, in practical applications, due to the difficulty of modeling multiple couplings and unexpected disturbances of system parameters, model-based methods often fail, and fan blade fault detection methods based on data analysis have received more extensive attention. Machine learning based data analysis methods do not need complex physical model construction and can utilize SCADA (supervisory control and data acquisition, SCADA) system data [<xref ref-type="bibr" rid="ref-18">18</xref>]. These methods include support vector machine (SVM) [<xref ref-type="bibr" rid="ref-19">19</xref>,<xref ref-type="bibr" rid="ref-20">20</xref>], XGBoost, deep neural network (DNN), etc. DNN and other methods extract the information from SCADA data to realize the fault detection of fan blades [<xref ref-type="bibr" rid="ref-21">21</xref>]. Bayesian belief networks (BNN) were also adopted for fault detection of wind turbine blades [<xref ref-type="bibr" rid="ref-22">22</xref>,<xref ref-type="bibr" rid="ref-23">23</xref>]. At present, in the field of fault detection, the gradient boosting decision tree (GBDT) algorithm is one of the most widely used algorithms [<xref ref-type="bibr" rid="ref-24">24</xref>,<xref ref-type="bibr" rid="ref-25">25</xref>]. Meanwhile, in unsupervised learning research, a wavelet enhanced autoencoder model (WaveletAE) to identify wind turbine dysfunction by analyzing the multivariate time series monitored [<xref ref-type="bibr" rid="ref-26">26</xref>].</p>
<p>To increase the quality and reliability of data for better analysis and prediction, noise reduction in data mining aims to eliminate extraneous noise and outliers from the data. A prominent feature screening technique is principal component analysis (PCA), which can eliminate noise, reduce dimensionality, and improve model performance [<xref ref-type="bibr" rid="ref-27">27</xref>,<xref ref-type="bibr" rid="ref-28">28</xref>]. However, because PCA is a linear transformation technique, it can only be used with data that can be separated along linear axes. Tree models such as XGBoost and LightGBM are common techniques for reducing unnecessary characteristics in fault detection [<xref ref-type="bibr" rid="ref-29">29</xref>,<xref ref-type="bibr" rid="ref-30">30</xref>]. However, these techniques may overlook some crucial features and cannot ensure the integrity of variable information.</p>
<p>Wind turbine blade fault detection relies heavily on information fusion, which can enhance data quality, increase the accuracy and dependability of mining findings, and so better enable data mining applications. Although XGBoost [<xref ref-type="bibr" rid="ref-31">31</xref>] and LightGBM [<xref ref-type="bibr" rid="ref-32">32</xref>] are frequently employed to handle data mining, the training data can introduce noise and outliers. TabNet [<xref ref-type="bibr" rid="ref-33">33</xref>] is a deep learning model for tabular data that can carry out operations on tabular data such feature selection, regression, and classification. Although TabNet is highly interpretable and performant, it is not suited for processing massive amounts of high-dimensional tabular data because of its great reliance on the quality of the input data. Although TabTransformer [<xref ref-type="bibr" rid="ref-34">34</xref>] performs well in terms of performance and interpretability, it is not suited for processing vast amounts of high-dimensional tabular data because it is very dependent on the quality of the input data. SAINT (Self-Attentive Interactions) [<xref ref-type="bibr" rid="ref-35">35</xref>] is a deep learning model for sequence data. It has large modeling capabilities and high accuracy, but it takes a long time to train and has a strong dependence on hyperparameters. In conclusion, classic data fusion models require a lot of training time and rely heavily on the accuracy of the input data.</p>
<p>To address these issues, this paper proposes a Gated Fusion based Transformer Model for crack detection on wind turbine blades by integrating GRN, a fusion module and a Transformer. GRN is a deep neural network structure that can be used for feature screening [<xref ref-type="bibr" rid="ref-36">36</xref>]. GRN combines a residual network and a gating mechanism, which can effectively extract useful features in input data and remove irrelevant or redundant features while preserving the integrity of feature information. This approach can improve the accuracy and generalization of the model. Meanwhile, this paper proposes a new information fusion module that is changed from the model MLP-Mixer [<xref ref-type="bibr" rid="ref-37">37</xref>]. The fusion module can extract features from the two-dimensional vectors of wind turbine blades to fuse different dimensions of information. Because the MLP in the module shares the weight in the mapping process of different columns and channels, the number of parameters is significantly reduced, and the complexity of the network is reduced.</p>
<p>This method takes the original SCADA data of wind turbine blades as the research object. It uses the SCADA data to detect the fault of wind turbine blade crack to ensure that maintenance personnel can timely and accurately judge whether the fault occurs and give early warning of the defect during the wind turbine operation. The contributions of this paper are summarized as follows:
<list list-type="order">
<list-item>
<p>This paper introduces Gated Residual Network (GRN). GRN, through the gating mechanism, can reduce any unnecessary noisy inputs that could negatively impact performance while preserving the integrity of feature information, enabling efficient information flow.</p></list-item>
<list-item>
<p>This paper proposes a fusion module that consists of Channel-mixing MLP and Column-mixing MLP. By using Channel-mixing MLP and Column-mixing MLP to map the columns acted on the data channel and map the rows acted on the data column of two-dimensional feature data, information fusion between the spatial and channel domains is realized. Because the MLP in the module shares the weight in the mapping process of different columns and channels, the number of parameters is significantly reduced, and the complexity of the network is reduced.</p></list-item>
<list-item>
<p>The experimental results show that the proposed method has a better detection effect and can better meet the actual fan maintenance requirements than the existing methods. At the same time, this paper also provides a new solution for table data processing.</p></list-item>
</list></p>
<p>The rest of this paper is organized as follows. <xref ref-type="sec" rid="s2">Section 2</xref> presents the available SCADA data used in this work. <xref ref-type="sec" rid="s3">Section 3</xref> introduces the model of this paper. <xref ref-type="sec" rid="s4">Section 4</xref> presents the experimental procedure and experiment setup. <xref ref-type="sec" rid="s5">Section 5</xref> introduces and analyzes the experimental results. <xref ref-type="sec" rid="s6">Section 6</xref> is the conclusion, including a summary of the method and future work.</p>
</sec>
<sec id="s2">
<label>2</label>
<title>Data Description</title>
<p>The dataset used in this paper comes from the operation data collected from 300 wind turbines published by State Power Investment Corporation for two consecutive months. SCADA system collects all kinds of information about wind turbines in real-time, including environmental, state, and control parameters. According to the wind turbine blade crack state data collected every 10 min by SCADA for wind farms, 48,339 sample files were recorded. Each file contained about 400 lines of data, and each sample had 75 features. The SCADA system collects two different types of data: discrete characteristic variables and continuous characteristic variables. Continuous variables monitor the operation and progress of each component in real time. Discrete variables indicate the operation status of each fan component. Among them, &#x2018;state of reactive power control&#x2019;, &#x2018;current state value of wind turbine&#x2019;, &#x2018;current state value of wheel&#x2019;, &#x2018;state of yaw value&#x2019; and &#x2018;yaw required value&#x2019; are discrete characteristic variables; the rest characteristics are continuous characteristic variables. An example of the SCADA dataset is provided in <xref ref-type="table" rid="table-1">Table 1</xref>. In addition, more detailed SCADA data can be seen in <xref ref-type="sec" rid="s7">Appendix A</xref>, <xref ref-type="table" rid="table-4">Table A1</xref>.</p>
<table-wrap id="table-1">
<label>Table 1</label>
<caption>
<title>Sample of SCADA data for a limited selection of turbines and signals</title>
</caption>
<table frame="hsides">
<colgroup>
<col align="left"/>
<col align="left"/>
<col align="left"/>
<col align="left"/>
<col align="left"/>
<col align="left"/>
<col align="left"/>
<col align="left"/>
</colgroup>
<thead valign="top">
<tr>
<th rowspan="2">WT</th>
<th rowspan="2">Wheel speed</th>
<th rowspan="2">Wheel angle</th>
<th rowspan="2">Speed measured value of overspeed sensor</th>
<th rowspan="2">State of yaw value</th>
<th colspan="3" align="center">Blade angle</th>
</tr>
<tr>
<th>Blade angle 1</th>
<th>Blade angle 2</th>
<th>Blade angle 3</th>
</tr>
</thead>
<tbody>
<tr>
<td>013</td>
<td>14.73</td>
<td>64</td>
<td>&#x2212;14.57</td>
<td>1</td>
<td>7.1</td>
<td>7.16</td>
<td>7.14</td>
</tr>
<tr>
<td>013</td>
<td>14.51</td>
<td>64</td>
<td>&#x2212;14.6</td>
<td>0</td>
<td>7</td>
<td>7.07</td>
<td>7.05</td>
</tr>
<tr>
<td>013</td>
<td>14.71</td>
<td>64</td>
<td>&#x2212;14.65</td>
<td>0</td>
<td>7.4</td>
<td>7.47</td>
<td>7.45</td>
</tr>
<tr>
<td>013</td>
<td>14.84</td>
<td>64</td>
<td>&#x2212;14.72</td>
<td>1</td>
<td>7.37</td>
<td>7.44</td>
<td>7.42</td>
</tr>
<tr>
<td>013</td>
<td>14.61</td>
<td>64</td>
<td>&#x2212;14.57</td>
<td>0</td>
<td>7.43</td>
<td>7.5</td>
<td>7.48</td>
</tr>
<tr>
<td>013</td>
<td>14.67</td>
<td>64</td>
<td>&#x2212;14.63</td>
<td>0</td>
<td>7.78</td>
<td>7.84</td>
<td>7.82</td>
</tr>
<tr>
<td>013</td>
<td>14.67</td>
<td>64</td>
<td>&#x2212;14.59</td>
<td>0</td>
<td>7.54</td>
<td>7.61</td>
<td>7.58</td>
</tr>
<tr>
<td>013</td>
<td>14.81</td>
<td>64</td>
<td>&#x2212;14.73</td>
<td>1</td>
<td>6.98</td>
<td>7.05</td>
<td>7.03</td>
</tr>
<tr>
<td>013</td>
<td>14.73</td>
<td>64</td>
<td>&#x2212;14.6</td>
<td>1</td>
<td>7.54</td>
<td>7.61</td>
<td>7.59</td>
</tr>
<tr>
<td>013</td>
<td>14.66</td>
<td>64</td>
<td>&#x2212;14.74</td>
<td>1</td>
<td>7.63</td>
<td>7.69</td>
<td>7.68</td>
</tr>
</tbody>
</table>
</table-wrap>
<p><xref ref-type="table" rid="table-1">Table 1</xref> shows an example of data collected by a SCADA system. In the table, &#x2018;WT&#x2019; uniquely identifies each wind turbine in the wind farm. &#x2018;wheel speed&#x2019;, &#x2018;wheel angle&#x2019;, and &#x2018;blade angle&#x2019; are working condition parameters. &#x2018;state of yaw value&#x2019; is a state parameter and is usually a discrete variable.</p>

<p><xref ref-type="fig" rid="fig-1">Fig. 1</xref> compares the kernel density estimation of wheel speed for an identical fan in normal and cracked blade states. Wheel speed is a working condition parameter. The figure shows maxima for both normal and cracked blade data value probability densities. Thus, it is impossible to distinguish between normal and defective fan blades using just one working condition eigenvalue.</p>
<fig id="fig-1">
<label>Figure 1</label>
<caption>
<title>Wheel speed kernel density comparison chart</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="EE_40743-fig-1.tif"/>
</fig>
</sec>
<sec id="s3">
<label>3</label>
<title>Model Structure</title>
<sec id="s3_1">
<label>3.1</label>
<title>Overall Architecture</title>
<p>This paper presents gated fusion based Transformer model for crack detection on wind turbine blade. The proposed model mainly includes Gated Residual Network, fusion module and Transformer. The overall architecture of proposed model is shown in <xref ref-type="fig" rid="fig-2">Fig. 2</xref>. First, each feature of the wind turbine blade is subjected to feature mapping, and the feature vectors are spliced to obtain a two-dimensional vector. Then, the gated residual neural network is used to effectively extract the features of the feature vectors and strengthen the expression of key features. Through the fusion module, the information exchange on different channels of the same feature and the same channel of different features can be realized. Use Transformer for feature learning, enhance the influence of important feature information and improve the anti-noise ability of the model. Finally, the state results of wind turbine blades are output through feature classification to achieve the purpose of crack fault detection.</p>
<fig id="fig-2">
<label>Figure 2</label>
<caption>
<title>Structure of proposed model</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="EE_40743-fig-2.tif"/>
</fig>
</sec>
<sec id="s3_2">
<label>3.2</label>
<title>Feature Mapping</title>
<p>The input of the model includes categorical feature variables and continuous feature variables. The proposed model uses feature embedding to embed each categorical feature variable into a parametric embedding of dimension <inline-formula id="ieqn-1"><mml:math id="mml-ieqn-1"><mml:mi>d</mml:mi></mml:math></inline-formula> and map each continuous feature variable to a parametric embedding of dimension <inline-formula id="ieqn-2"><mml:math id="mml-ieqn-2"><mml:mi>d</mml:mi></mml:math></inline-formula> through MLP. And then, the feature vectors are spliced to obtain a two-dimensional vector. Therefore, after feature mapping, the vector dimension input to GRN is <inline-formula id="ieqn-3"><mml:math id="mml-ieqn-3"><mml:mrow><mml:mo>(</mml:mo><mml:mi>m</mml:mi><mml:mo>+</mml:mo><mml:mi>n</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>&#x2217;</mml:mo><mml:mi>d</mml:mi></mml:math></inline-formula> if there are <inline-formula id="ieqn-4"><mml:math id="mml-ieqn-4"><mml:mi>m</mml:mi></mml:math></inline-formula> discrete feature variables and <inline-formula id="ieqn-5"><mml:math id="mml-ieqn-5"><mml:mi>n</mml:mi></mml:math></inline-formula> continuous feature variables.</p>
</sec>
<sec id="s3_3">
<label>3.3</label>
<title>Gated Residual Network</title>
<p>Due to subjective limitations in selecting input feature variables in commonly used fan blade feature screening methods, the integrity of variable information cannot be guaranteed. This paper uses GRN for feature screening. Gated Residual Network (GRN) enables efficient information flow with gating mechanism and skip connections. The framework of Gated Residual Network is shown in <xref ref-type="fig" rid="fig-3">Fig. 3</xref>. The gating mechanism can reduce unnecessary noisy inputs that could negatively impact performance. Skip connections can provide adaptive depth and network complexity. In order to improve the performance of the model, a Dropout layer and a Swish activation function are simultaneously added to the network. The formula of skip connection is shown in <xref ref-type="disp-formula" rid="eqn-1">Eq. (1)</xref>.</p>
<p><disp-formula id="eqn-1"><label>(1)</label><mml:math id="mml-eqn-1" display="block"><mml:mi>H</mml:mi><mml:mo>=</mml:mo><mml:mi>F</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>x</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>+</mml:mo><mml:mi>G</mml:mi><mml:mi>L</mml:mi><mml:mi>U</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>x</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>&#x2217;</mml:mo><mml:mi>x</mml:mi></mml:math></disp-formula></p><p>where <inline-formula id="ieqn-6"><mml:math id="mml-ieqn-6"><mml:mi>x</mml:mi></mml:math></inline-formula> is the input, <inline-formula id="ieqn-7"><mml:math id="mml-ieqn-7"><mml:mi>F</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>x</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula> is a residual block, <inline-formula id="ieqn-8"><mml:math id="mml-ieqn-8"><mml:mi>G</mml:mi><mml:mi>L</mml:mi><mml:mi>U</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>x</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula> is a gating unit, and <inline-formula id="ieqn-9"><mml:math id="mml-ieqn-9"><mml:mo>&#x2217;</mml:mo></mml:math></inline-formula> represents the dot product operation.</p>
<fig id="fig-3">
<label>Figure 3</label>
<caption>
<title>Structure of gated residual network</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="EE_40743-fig-3.tif"/>
</fig>
<p>The formula of gating unit is shown in <xref ref-type="disp-formula" rid="eqn-2">Eq. (2)</xref>.</p>
<p><disp-formula id="eqn-2"><label>(2)</label><mml:math id="mml-eqn-2" display="block"><mml:mi>G</mml:mi><mml:mi>L</mml:mi><mml:mi>U</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>x</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mi>x</mml:mi><mml:mo>&#x2217;</mml:mo><mml:mrow><mml:mi mathvariant="italic">s</mml:mi><mml:mi mathvariant="italic">i</mml:mi><mml:mi mathvariant="italic">g</mml:mi><mml:mi mathvariant="italic">m</mml:mi><mml:mi mathvariant="italic">o</mml:mi><mml:mi mathvariant="italic">i</mml:mi><mml:mi mathvariant="italic">d</mml:mi></mml:mrow><mml:mrow><mml:mo>(</mml:mo><mml:mi>x</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:math></disp-formula></p><p>where <inline-formula id="ieqn-10"><mml:math id="mml-ieqn-10"><mml:mi>x</mml:mi></mml:math></inline-formula> is the input, the sigmoid function is a typical non-linear activation function that transfers input values to continuous output values ranging from 0 to 1.</p>
<p>The Swish activation function is similar to both ReLU and Sigmoid activation functions. It combines the smoothness of Sigmoid with the nonlinear of ReLU. The formula for the Swish activation function is shown in <xref ref-type="disp-formula" rid="eqn-3">Eq. (3)</xref>.</p>
<p><disp-formula id="eqn-3"><label>(3)</label><mml:math id="mml-eqn-3" display="block"><mml:mi>F</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>x</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mi>x</mml:mi><mml:mo>&#x2217;</mml:mo><mml:mrow><mml:mi mathvariant="italic">s</mml:mi><mml:mi mathvariant="italic">i</mml:mi><mml:mi mathvariant="italic">g</mml:mi><mml:mi mathvariant="italic">m</mml:mi><mml:mi mathvariant="italic">o</mml:mi><mml:mi mathvariant="italic">i</mml:mi><mml:mi mathvariant="italic">d</mml:mi></mml:mrow><mml:mrow><mml:mo>(</mml:mo><mml:mi>b</mml:mi><mml:mi>e</mml:mi><mml:mi>t</mml:mi><mml:mi>a</mml:mi><mml:mo>&#x2217;</mml:mo><mml:mi>x</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:math></disp-formula>where <inline-formula id="ieqn-11"><mml:math id="mml-ieqn-11"><mml:mi>b</mml:mi><mml:mi>e</mml:mi><mml:mi>t</mml:mi><mml:mi>a</mml:mi></mml:math></inline-formula> is a hyperparameter, usually set to 1.</p>
</sec>
<sec id="s3_4">
<label>3.4</label>
<title>Fusion Module</title>
<p>The fusion module in this paper is modified from the MLP-Mixer model [<xref ref-type="bibr" rid="ref-37">37</xref>]. The MLP-Mixer network model simulates the convolution operation and attention mechanism using only the Multi-Layer Perceptron (MLP) architecture. The original MLP-Mixer first separates the image and then uses two MLP blocks to fuse data on each channel. Fusion module uses Channel-mixing MLP and Column-mixing MLP alternately to extract features from the two-dimensional vectors of wind turbine blades to fuse different dimensions of information. The framework of fusion module is shown in <xref ref-type="fig" rid="fig-4">Fig. 4</xref>. The Channel-mixing MLP and Column-mixing MLP carry out mapping transformation of two-dimensional characteristic data in different channels of the same characteristic variables and the same channel of different characteristic variables, thus achieving fusion operations in the spatial domain and channel domain. To be specific, the feature vector is input into the MLP to obtain in-depth information about the same feature in different channels. Then, the processed feature vectors were transposed so that the channels and dimensions of the data were exchanged and then input into the MLP so that it could obtain in-depth information about different features in the same channel, and then the channels and dimensions were transposed. Because the MLP in the module shares the weight in the mapping process of different columns and channels, the number of parameters is significantly reduced, and the complexity of the network is reduced.</p>
<fig id="fig-4">
<label>Figure 4</label>
<caption>
<title>Structure of fusion module</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="EE_40743-fig-4.tif"/>
</fig>
</sec>
</sec>
<sec id="s4">
<label>4</label>
<title>Experiment Setup</title>
<p>In this section, the effectiveness of the proposed method will be evaluated through a case study of wind turbine blade crack fault detection. The experiment of the model in this paper is completed based on Tensorflow.</p>
<sec id="s4_1">
<label>4.1</label>
<title>Overall Experimental Process</title>
<p>To provide a reliable basis for wind farm staff to monitor the status of fan blades and avoid more significant losses caused by blade crack, it is necessary to timely and accurately detect whether there is a crack fault in wind turbines. Therefore, the proposed wind turbine blade fault detection method is as follows.</p>
<sec id="s4_1_1">
<label>4.1.1</label>
<title>Data Preprocessing</title>
<p>SCADA data should be cleaned to solve the problem of missing or unreasonable partial characteristic data caused by sensor errors, line errors and other issues.</p>
</sec>
<sec id="s4_1_2">
<label>4.1.2</label>
<title>Data Segmentation</title>
<p>Four-fold cross-validation was used to divide the cleaned data set into 4 subsamples, one of which was selected as the test set each time, the other 3 subsamples were chosen as the training set to conduct model training, and 10% of the training set was selected as the verification set, which was repeated for a total of 4 times, which was equivalent to using 4 kinds of data sets to train the model.</p>
</sec>
<sec id="s4_1_3">
<label>4.1.3</label>
<title>Model Training and Testing</title>
<p>The experimental flow chart is shown in <xref ref-type="fig" rid="fig-5">Fig. 5</xref>. Appropriate evaluation criteria were used to evaluate the results of each experiment. Each model had a consequence. Finally, the mean value of the four marks of each model was calculated as the final experimental result.</p>
<fig id="fig-5">
<label>Figure 5</label>
<caption>
<title>Flow chart of crack detection on wind turbine blade</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="EE_40743-fig-5.tif"/>
</fig>
</sec>
</sec>
<sec id="s4_2">
<label>4.2</label>
<title>Data Cleaning and Preprocessing</title>
<p>In real life, the database is easily affected by noise and some force majeure external factors, resulting in missing data and errors. Correct data processing can reduce the interference of erroneous data in the experiment and improve the efficiency and accuracy of data mining. In this experiment, the collected SCADA data were preprocessed as follows:
<list list-type="order">
<list-item>
<p>Delete data with integer row 0. Data with an integer value of 0 is obviously due to a sensor or wire error, so it needs to be deleted.</p></list-item>
<list-item>
<p>Delete the last three features where the data is null: &#x2018;Drive outputs torque 1&#x2019;&#x2019;, &#x2018;Drive outputs torque 2&#x2019;, &#x2018;Drive outputs torque 3&#x2019;.</p></list-item>
<list-item>
<p>According to physics knowledge, the atmospheric pressure on the blade under the natural environment cannot be 0, so the row where the characteristic atmospheric pressure is 0 in the data set is deleted. In addition, this paper is to forecast the wind turbine in a working state, so the row where the Wheel Speed is less than 3 m/s is deleted.</p></list-item>
<list-item>
<p>The four-fold cross-validation was used to divide the cleaned data set into 4 subsamples. Each time, one of the subsamples was selected as the test set, and the other 3 subsamples were selected as the training set for model training. 10% of the training set was selected as the verification set, and each model repeated the experiment 4 times.</p></list-item>
</list></p>
</sec>
<sec id="s4_3">
<label>4.3</label>
<title>Performance Evaluation Index of Fault Diagnosis</title>
<p>The model evaluation index can reasonably measure the model&#x2019;s generalization ability and accurately explain the quality of the model. The prediction results of this model belong to the binary problem. Accuracy is the proportion of correctly classified samples in total samples. Precision refers to the proportion of the predicted positive samples to the predicted positive samples. Recall is the proportion of the predicted positive samples out of the actual positive samples. F1-score is mainly used to measure the accuracy of the binary model, taking into account the accuracy rate and recall of the classification model. Accuracy can intuitively see the prediction effect of the model, Precision and Recall can evaluate the prediction effect from different aspects, while F1-score combines Precision and Recall. So with Accuracy, Precision, Recall and F1-score index to evaluate the model is more reasonable.</p>
</sec>
<sec id="s4_4">
<label>4.4</label>
<title>Comparison Models</title>
<p>To verify the proposed model&#x2019;s effectiveness and accuracy in detecting wind turbine blade crack faults, it is compared with state-of-the-art methods such as XGBoost, LightGBM, LSTM, TabNet, TabTransformer, Variable Selection Network, and SAINT.</p>
</sec>
<sec id="s4_5">
<label>4.5</label>
<title>Hyperparameter</title>
<p>The selection of hyper-parameters is of great importance in modeling. For all model training, Adam is used for network optimization for its efficient computation and little memory. The cross entropy loss function is used in all models to train the network. Meanwhile, the initial learning rate of all neural network models is set as 0.01, if the val_loss of the model does not drop 3 times, the learning rate will be halved to help the model converge and make it easier to obtain the best solution. If the val_loss of the model does not drop 10 times, the model will stop early to reduce overfitting. The proposed model has Embedding_dim of 64, GRN_dim of 192, Num_transformer_blocks of 4, Num_heads of 4, Dropout_rate of 0.2, and Learning_rate is 0.01, Epoch is 100 and Batch_size is 256.</p>
<p>For the comparison models, XGBoost has Max_depth of 300, N_estimators of 500, Colsample_bytree of 0.8 and Subsample of 0.7; LightGBM has Num_leaves of 500, N_estimators of 50, Max_depth of 0.8 and Subsample of 0.7; LSTM has Num_input_layers of 256 and Number_hidden_layers of 2; VSN has Encoding_size of 192 and VSN_dim of 72; SAINT has Num_self-attention_heads of 8, Num_intersample_heads of 8 and Embedding_dim of 64; TabNet has N_d of 324, N_a of 256 and N_steps of 2; TabTransformer has Num_transformer_blocks of 4, Num_heads is 4 and Embedding_dim is 64.</p>
</sec>
</sec>
<sec id="s5">
<label>5</label>
<title>Results and Discussions</title>
<sec id="s5_1">
<label>5.1</label>
<title>Comparative Experiment</title>
<p>The proposed model is compared with comparison models in F1-score, Accuracy, Recall and Precision. The experimental results are the mean values of the results of 4-fold cross-validation, as shown in <xref ref-type="table" rid="table-2">Table 2</xref>. The visualization of experimental results is shown in <xref ref-type="fig" rid="fig-6">Fig. 6</xref>.</p>
<table-wrap id="table-2">
<label>Table 2</label>
<caption>
<title>Performance comparison between models</title>
</caption>
<table frame="hsides">
<colgroup>
<col align="left"/>
<col align="left"/>
<col align="left"/>
<col align="left"/>
<col align="left"/>
</colgroup>
<thead valign="top">
<tr>
<th>Model</th>
<th>F1-score</th>
<th>Accuracy</th>
<th>Recall</th>
<th>Precision</th>
</tr>
</thead>
<tbody>
<tr>
<td>XGBoost</td>
<td>0.9835 &#x00B1; 0.0019</td>
<td>0.9838 &#x00B1; 0.0017</td>
<td>0.9779 &#x00B1; 0.0035</td>
<td>0.9891 &#x00B1; 0.0014</td>
</tr>
<tr>
<td>LightGBM</td>
<td>0.9869 &#x00B1; 0.0006</td>
<td>0.9869 &#x00B1; 0.0005</td>
<td>0.9815 &#x00B1; 0.0008</td>
<td>0.9925 &#x00B1; 0.0011</td>
</tr>
<tr>
<td>LSTM</td>
<td>0.9698 &#x00B1; 0.0052</td>
<td>0.9695 &#x00B1; 0.0044</td>
<td>0.9601 &#x00B1; 0.0098</td>
<td>0.9797 &#x00B1; 0.0046</td>
</tr>
<tr>
<td>TabNet</td>
<td>0.9740 &#x00B1; 0.0047</td>
<td>0.9738 &#x00B1; 0.0063</td>
<td>0.9653 &#x00B1; 0.0052</td>
<td>0.9828 &#x00B1; 0.0035</td>
</tr>
<tr>
<td>VSN</td>
<td>0.9827 &#x00B1; 0.0029</td>
<td>0.9826 &#x00B1; 0.0035</td>
<td>0.9757 &#x00B1; 0.0022</td>
<td>0.9898 &#x00B1; 0.0036</td>
</tr>
<tr>
<td>TabTransformer</td>
<td>0.9788 &#x00B1; 0.0025</td>
<td>0.9787 &#x00B1; 0.0023</td>
<td>0.9711 &#x00B1; 0.0039</td>
<td>0.9867 &#x00B1; 0.0022</td>
</tr>
<tr>
<td>SAINT</td>
<td>0.9853 &#x00B1; 0.0035</td>
<td>0.9894 &#x00B1; 0.0034</td>
<td>0.9844 &#x00B1; 0.0043</td>
<td>0.9862 &#x00B1; 0.0037</td>
</tr>
<tr>
<td>Proposed model</td>
<td>0.9907 &#x00B1; 0.0043</td>
<td>0.9907 &#x00B1; 0.0024</td>
<td>0.9853 &#x00B1; 0.0045</td>
<td>0.9961 &#x00B1; 0.0011</td>
</tr>
</tbody>
</table>
</table-wrap><fig id="fig-6">
<label>Figure 6</label>
<caption>
<title>The values of evaluation indicators for models</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="EE_40743-fig-6.tif"/>
</fig>
<p>The result showed that compared with other seven algorithms, the gated fusion based Transformer model works best in F1-score which is around 0.9907, Accuracy which is around 0.9907, Recall which is around 0.9853 and Precision which is around 0.9961. The LSTM algorithm works worst in evaluation indicators, it reaches around 0.9698 in F1-score which is reduced by around 0.0209 compared with proposed model.</p>
<p>Analyzing the overall experimental results, it can be found that the traditional machine learning models such as XGBoost and LightGBM are better than the other deep learning models such as LSTM, TabNet, VSN, TabTransformer. And there is little difference between experimental results of LightGBM and SAINT. The F1-score of LightGBM is around 0.9896, which is increased by around 0.0042&#x2013;0.0171 compared with LSTM, TabNet, VSN and TabTransformer. Compared with XGBoost and LightGBM, the F1-score value of the model used in this paper has increased by 0.0072 and 0.0038, respectively.</p>
<p>From the perspective of stability, it is clear that the fault detecting ability of machine learning models is more stable than other models including the gated fusion based Transformer model. Comparing proposed model and other deep learning models, the fluctuation of Accuracy and Precision range is too small. In conclusion, the Gated Fusion based Transformer Model proposed in this paper has high prediction accuracy and stability.</p>
</sec>
<sec id="s5_2">
<label>5.2</label>
<title>Ablation Experiment</title>
<p>This paper also verifies the impact of each component of the modules including GRN, Fusion Model and Transformer on the fault detection model. The experimental results are shown in <xref ref-type="table" rid="table-3">Table 3</xref>.</p>
<table-wrap id="table-3">
<label>Table 3</label>
<caption>
<title>Ablation on inclusion of submodules</title>
</caption>
<table frame="hsides">
<colgroup>
<col align="left"/>
<col align="left"/>
<col align="left"/>
<col align="left"/>
<col align="left"/>
</colgroup>
<thead valign="top">
<tr>
<th>Model</th>
<th>F1-score</th>
<th>Accuracy</th>
<th>Recall</th>
<th>Precision</th>
</tr>
</thead>
<tbody>
<tr>
<td>Transformer</td>
<td>0.9889</td>
<td>0.9888</td>
<td>0.9827</td>
<td>0.9951</td>
</tr>
<tr>
<td>GRN based transformer</td>
<td>0.9894</td>
<td>0.9894</td>
<td>0.9832</td>
<td>0.9957</td>
</tr>
<tr>
<td>Fusion module based transformer</td>
<td>0.9894</td>
<td>0.9893</td>
<td>0.9835</td>
<td>0.9953</td>
</tr>
<tr>
<td>Proposed model</td>
<td>0.9907</td>
<td>0.9907</td>
<td>0.9853</td>
<td>0.9961</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>As shown in <xref ref-type="table" rid="table-3">Table 3</xref>, the F1-score of Transformer is 0.9889. When GRN is included, the effect of the model is improved, and the F1-score is increased to 0.9894. Experiments prove the effectiveness of GRN. When the fusion module is included with the Transformer, the effect of the model is also improved, and the F1-score is increased to 0.9894. Finally, when the GRN and fusion modules are both included with the Transformer, the proposed model achieves the best performance, with the F1-score of 0.9902. In the summary, the results prove the effectiveness of each submodules.</p>

</sec>
<sec id="s5_3">
<label>5.3</label>
<title>Discussion</title>
<p>This paper proposes a crack fault-detection strategy for high-precision wind blade crack detection. Experiments show that the proposed method outperforms conventional fault detection models. The F1-score of proposed model can reach 0.9907, which is 0.0040&#x2013;0.0209 higher than traditional models. The accuracy of proposed model can also reach 0.9907, which is 0.0013&#x2013;0.0212 higher than traditional models. Its recall can reach 0.9853, which is 0.0009&#x2013;0.0252 higher than traditional models. Its precision can reach 0.9961, which is 0.0036&#x2013;0.0164 higher than traditional models. These results demonstrate the superiority of the proposed model.</p>
<p>The ablation experiment reveal that the model&#x2019;s gated residual neural network, fusion module, and Transformer all contribute to superior experimental outcomes. GRN reduces unnecessary noisy inputs that could negatively impact performance while preserving the integrity of feature information. The fusion module fuses information between the spatial and channel domains to comprehensively obtain the in-depth information of fan features. The proposed model is suitable for structured data with both categorical and continuous feature variables. However, the gated fusion based Transformer model is less stable than XGBoost and LightGBM. The stability and generalization ability of the proposed model should be further improved.</p>
</sec>
</sec>
<sec id="s6">
<label>6</label>
<title>Conclusions</title>
<p>Considering that the data collected by the SCADA system is complex and challenging to obtain the features related to the target information, a new state monitoring Model&#x2013;Gated Fusion based Transformer Model is proposed in this paper, which is used for wind turbine blade crack fault detection. Gated residual network was used for effective feature extraction and enhanced expression of critical features. The fusion module proposed in this paper can map two-dimensional feature data in columns acted on the data channel and rows acted on the data column, realize the information fusion between the spatial domain and the channel domain, and obtain the in-depth information of fan features more comprehensively. Finally, the model can enhance the influence of important feature information and improve the detection accuracy of the model by Transformer. The experimental results show that the model yields state-of-the-art performance.</p>
<p>In summary, the method proposed in this paper outperforms other fault detection methods. The experiments used a dataset with single fault. Future research could study methods for detecting multiple types of faults in fan blade data.</p>
</sec>
</body>
<back>
<ack>
<p>The authors thank the support of Huaneng Offshore Wind Power Science and Technology Research Co., Ltd. and Yancheng Institute of Technology.</p>
</ack>
<sec><title>Funding Statement</title>
<p>This research was supported by the Jiangsu Provincial Key R&#x0026;D Programme (BE2020034) and China Huaneng Group Science and Technology Project (HNKJ20-H72).</p></sec>
<sec><title>Author Contributions</title>
<p>Conceptualization, W.T. and C.L.; formal analysis, W.T. and C.L.; investigation, W.T. and B.Z.; writing, review and editing, W.T. and C.L.; supervision, C.L. and B.Z. All authors have read and agreed to the published version of the manuscript.</p></sec>
<sec sec-type="data-availability"><title>Availability of Data and Materials</title>
<p>The data utilized in this study is available upon request to the corresponding author.</p></sec>
<sec sec-type="COI-statement"><title>Conflicts of Interest</title>
<p>The authors declare that they have no conflicts of interest to report regarding the present study.</p></sec>
<ref-list content-type="authoryear">
<title>References</title>
<ref id="ref-1"><label>1.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Wymore</surname>, <given-names>M. L.</given-names></string-name>, <string-name><surname>Van Dam</surname>, <given-names>J. E.</given-names></string-name>, <string-name><surname>Ceylan</surname>, <given-names>H.</given-names></string-name>, <string-name><surname>Qiao</surname>, <given-names>D. J.</given-names></string-name></person-group> (<year>2015</year>). <article-title>A survey of health monitoring systems for wind turbines</article-title>. <source>Renewable and Sustainable Energy Reviews</source><italic>,</italic> <volume>52</volume><italic>,</italic> <fpage>976</fpage>&#x2013;<lpage>990</lpage></mixed-citation></ref>
<ref id="ref-2"><label>2.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Chang</surname>, <given-names>V.</given-names></string-name>, <string-name><surname>Chen</surname>, <given-names>Y.</given-names></string-name>, <string-name><surname>Zhang</surname>, <given-names>Z. J.</given-names></string-name>, <string-name><surname>Xu</surname>, <given-names>Q. A.</given-names></string-name>, <string-name><surname>Baudier</surname>, <given-names>P.</given-names></string-name></person-group> (<year>2021</year>). <article-title>The market challenge of wind turbine industry-renewable energy in PR China and Germany</article-title>. <source>Technological Forecasting and Social Change</source><italic>,</italic> <volume>166</volume><italic>,</italic> <fpage>120631</fpage>.</mixed-citation></ref>
<ref id="ref-3"><label>3.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Si</surname>, <given-names>Y.</given-names></string-name>, <string-name><surname>Chen</surname>, <given-names>Z.</given-names></string-name>, <string-name><surname>Zeng</surname>, <given-names>W.</given-names></string-name>, <string-name><surname>Sun</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Zhang</surname>, <given-names>D.</given-names></string-name></person-group> (<year>2021</year>). <article-title>The influence of power-take-off control on the dynamic response and power output of combined semi-submersible floating wind turbine and point-absorber wave energy converters</article-title>. <source>Ocean Engineering</source><italic>,</italic> <volume>227</volume><italic>,</italic> <fpage>108835</fpage></mixed-citation></ref>
<ref id="ref-4"><label>4.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Rinaldi</surname>, <given-names>G.</given-names></string-name>, <string-name><surname>Thies</surname>, <given-names>P. R.</given-names></string-name>, <string-name><surname>Johanning</surname>, <given-names>L.</given-names></string-name></person-group> (<year>2021</year>). <article-title>Current status and future trends in the operation and maintenance of offshore wind turbines: A review</article-title>. <source>Energies</source><italic>,</italic> <volume>14</volume><italic>(</italic><issue>9</issue><italic>),</italic> <fpage>2484</fpage>.</mixed-citation></ref>
<ref id="ref-5"><label>5.</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><surname>Wang</surname>, <given-names>Y.</given-names></string-name>, <string-name><surname>Tan</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Qin</surname>, <given-names>X.</given-names></string-name>, <string-name><surname>Hu</surname>, <given-names>Z.</given-names></string-name>, <string-name><surname>Jing</surname>, <given-names>Y.</given-names></string-name> <etal>et al.</etal></person-group> (<year>2021</year>). <article-title>Wind turbine blade fault diagnosis based on MFCC feature optimization strategy</article-title>. <conf-name>IOP Conference Series: Earth and Environmental Science</conf-name>, vol. 675, <fpage>012074</fpage>. <publisher-loc>Xiamen, China</publisher-loc>.</mixed-citation></ref>
<ref id="ref-6"><label>6.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Oh</surname>, <given-names>K. Y.</given-names></string-name>, <string-name><surname>Park</surname>, <given-names>J. Y.</given-names></string-name>, <string-name><surname>Lee</surname>, <given-names>J. S.</given-names></string-name>, <string-name><surname>Epureanu</surname>, <given-names>B. I.</given-names></string-name>, <string-name><surname>Lee</surname>, <given-names>J. K.</given-names></string-name></person-group> (<year>2015</year>). <article-title>A novel method and its field tests for monitoring and diagnosing blade health for wind turbines</article-title>. <source>IEEE Transactions on Instrumentation and Measurement</source><italic>,</italic> <volume>64</volume><italic>(</italic><issue>6</issue><italic>),</italic> <fpage>1726</fpage>&#x2013;<lpage>1733</lpage>.</mixed-citation></ref>
<ref id="ref-7"><label>7.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Liu</surname>, <given-names>Z.</given-names></string-name>, <string-name><surname>Wang</surname>, <given-names>X.</given-names></string-name>, <string-name><surname>Zhang</surname>, <given-names>L.</given-names></string-name></person-group> (<year>2020</year>). <article-title>Fault diagnosis of industrial wind turbine blade bearing using acoustic emission analysis</article-title>. <source>IEEE Transactions on Instrumentation and Measurement</source><italic>,</italic> <volume>69</volume><italic>(</italic><issue>9</issue><italic>),</italic> <fpage>6630</fpage>&#x2013;<lpage>6639</lpage>.</mixed-citation></ref>
<ref id="ref-8"><label>8.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Katsaprakakis</surname>, <given-names>D. A.</given-names></string-name>, <string-name><surname>Papadakis</surname>, <given-names>N.</given-names></string-name>, <string-name><surname>Ntintakis</surname>, <given-names>I.</given-names></string-name></person-group> (<year>2021</year>). <article-title>A comprehensive analysis of wind turbine blade damage</article-title>. <source>Energies</source><italic>,</italic> <volume>14</volume><italic>(</italic><issue>18</issue><italic>),</italic> <fpage>5974</fpage>.</mixed-citation></ref>
<ref id="ref-9"><label>9.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Gao</surname>, <given-names>Z.</given-names></string-name>, <string-name><surname>Liu</surname>, <given-names>X.</given-names></string-name></person-group> (<year>2021</year>). <article-title>An overview on fault diagnosis, prognosis and resilient control for wind turbine systems</article-title>. <source>Processes</source><italic>,</italic> <volume>9</volume><italic>(</italic><issue>2</issue><italic>),</italic> <fpage>300</fpage>.</mixed-citation></ref>
<ref id="ref-10"><label>10.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Cho</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Choi</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Gao</surname>, <given-names>Z.</given-names></string-name>, <string-name><surname>Moan</surname>, <given-names>T.</given-names></string-name></person-group> (<year>2021</year>). <article-title>Fault detection and diagnosis of a blade pitch system in a floating wind turbine based on Kalman filters and artificial neural networks</article-title>. <source>Renewable Energy</source><italic>,</italic> <volume>169</volume><italic>,</italic> <fpage>1</fpage>&#x2013;<lpage>13</lpage>.</mixed-citation></ref>
<ref id="ref-11"><label>11.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Bo</surname>, <given-names>Z.</given-names></string-name>, <string-name><surname>Yanan</surname>, <given-names>Z.</given-names></string-name>, <string-name><surname>Changzheng</surname>, <given-names>C.</given-names></string-name></person-group> (<year>2017</year>). <article-title>Acoustic emission detection of fatigue cracks in wind turbine blades based on blind deconvolution separation</article-title>. <source>Fatigue &#x0026; Fracture of Engineering Materials &#x0026; Structures</source><italic>,</italic> <volume>40</volume><italic>(</italic><issue>6</issue><italic>),</italic> <fpage>959</fpage>&#x2013;<lpage>970</lpage>.</mixed-citation></ref>
<ref id="ref-12"><label>12.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Wang</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Gu</surname>, <given-names>Y.</given-names></string-name></person-group> (<year>2022</year>). <article-title>Research on infrared nondestructive detection of small wind turbine blades</article-title>. <source>Results in Engineering</source><italic>,</italic> <volume>15</volume><italic>,</italic> <fpage>100570</fpage>.</mixed-citation></ref>
<ref id="ref-13"><label>13.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Yu</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Fu</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Gao</surname>, <given-names>Y.</given-names></string-name>, <string-name><surname>Zheng</surname>, <given-names>H.</given-names></string-name>, <string-name><surname>Xu</surname>, <given-names>Y.</given-names></string-name></person-group> (<year>2018</year>). <article-title>Crack detection of fan blade based on natural frequencies</article-title>. <source>International Journal of Rotating Machinery</source><italic>,</italic> <volume>2018</volume><italic>,</italic> <fpage>1</fpage>&#x2013;<lpage>13</lpage>.</mixed-citation></ref>
<ref id="ref-14"><label>14.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Sharma</surname>, <given-names>V. B.</given-names></string-name>, <string-name><surname>Singh</surname>, <given-names>K.</given-names></string-name>, <string-name><surname>Gupta</surname>, <given-names>R.</given-names></string-name>, <string-name><surname>Joshi</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Dubey</surname>, <given-names>R.</given-names></string-name> <etal>et al.</etal></person-group> (<year>2021</year>). <article-title>Review of structural health monitoring techniques in pipeline and wind turbine industries</article-title>. <source>Applied System Innovation</source><italic>,</italic> <volume>4</volume><italic>(</italic><issue>3</issue><italic>),</italic> <fpage>59</fpage>.</mixed-citation></ref>
<ref id="ref-15"><label>15.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Wang</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Liu</surname>, <given-names>Z.</given-names></string-name>, <string-name><surname>Wang</surname>, <given-names>Y.</given-names></string-name>, <string-name><surname>Wen</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Wang</surname>, <given-names>J.</given-names></string-name></person-group> (<year>2023</year>). <article-title>Extraction of strain characteristic signals from wind turbine blades based on EEMD-WT</article-title>. <source>Energy Engineering</source><italic>,</italic> <volume>120</volume><italic>(</italic><issue>5</issue><italic>),</italic> <fpage>1149</fpage>&#x2013;<lpage>1162</lpage>.</mixed-citation></ref>
<ref id="ref-16"><label>16.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Sun</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Wang</surname>, <given-names>T.</given-names></string-name>, <string-name><surname>Yang</surname>, <given-names>H.</given-names></string-name>, <string-name><surname>Chu</surname>, <given-names>F.</given-names></string-name></person-group> (<year>2022</year>). <article-title>Damage identification of wind turbine blades using an adaptive method for compressive beamforming based on the generalized minimax-concave penalty function</article-title>. <source>Renewable Energy</source><italic>,</italic> <volume>181</volume><italic>,</italic> <fpage>59</fpage>&#x2013;<lpage>70</lpage>.</mixed-citation></ref>
<ref id="ref-17"><label>17.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Dong</surname>, <given-names>X.</given-names></string-name>, <string-name><surname>Gao</surname>, <given-names>D.</given-names></string-name>, <string-name><surname>Li</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Zhang</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Zheng</surname>, <given-names>K.</given-names></string-name></person-group> (<year>2020</year>). <article-title>Blades icing identification model of wind turbines based on SCADA data</article-title>. <source>Renewable Energy</source><italic>,</italic> <volume>162</volume><italic>,</italic> <fpage>575</fpage>&#x2013;<lpage>586</lpage>.</mixed-citation></ref>
<ref id="ref-18"><label>18.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Liu</surname>, <given-names>Y.</given-names></string-name>, <string-name><surname>Zheng</surname>, <given-names>Y.</given-names></string-name>, <string-name><surname>Ma</surname>, <given-names>Z.</given-names></string-name>, <string-name><surname>Wu</surname>, <given-names>C.</given-names></string-name></person-group> (<year>2023</year>). <article-title>Wind turbine spindle operating state recognition and early warning driven by SCADA data</article-title>. <source>Energy Engineering</source><italic>,</italic> <volume>120</volume><italic>(</italic><issue>5</issue><italic>),</italic> <fpage>1223</fpage>&#x2013;<lpage>1237</lpage>.</mixed-citation></ref>
<ref id="ref-19"><label>19.</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><surname>Reder</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Melero</surname>, <given-names>J. J.</given-names></string-name></person-group> (<year>2018</year>). <article-title>A Bayesian approach for predicting wind turbine failures based on meteorological conditions</article-title>. <conf-name>Journal of Physics: Conference Series</conf-name>, <issue>1037(6)</issue>, <fpage>062003</fpage>.</mixed-citation></ref>
<ref id="ref-20"><label>20.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Li</surname>, <given-names>X.</given-names></string-name>, <string-name><surname>Cheng</surname>, <given-names>B.</given-names></string-name>, <string-name><surname>Zhang</surname>, <given-names>H.</given-names></string-name>, <string-name><surname>Zhang</surname>, <given-names>X.</given-names></string-name>, <string-name><surname>Yun</surname>, <given-names>Z.</given-names></string-name></person-group> (<year>2021</year>). <article-title>A hybrid model based on back-propagation neural network and optimized support vector machine with particle swarm algorithm for assessing blade icing on wind turbines</article-title>. <source>Energy Engineering</source><italic>,</italic> <volume>118</volume><italic>(</italic><issue>6</issue><italic>),</italic> <fpage>1869</fpage>&#x2013;<lpage>1886</lpage>.</mixed-citation></ref>
<ref id="ref-21"><label>21.</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><surname>Qiang</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Lin</surname>, <given-names>H.</given-names></string-name>, <string-name><surname>Yu</surname>, <given-names>Z.</given-names></string-name></person-group> (<year>2016</year>). <article-title>Online faults diagnosis of wind turbine blades based on support vector machines</article-title>. <conf-name>2016 3rd International Conference on Systems and Informatics (ICSAI)</conf-name>, pp. <fpage>247</fpage>&#x2013;<lpage>250</lpage>. <publisher-loc>Shanghai, China</publisher-loc>.</mixed-citation></ref>
<ref id="ref-22"><label>22.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Santos</surname>, <given-names>P.</given-names></string-name>, <string-name><surname>Villa</surname>, <given-names>L. F.</given-names></string-name>, <string-name><surname>Re&#x00F1;ones</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Bustillo</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Maudes</surname>, <given-names>J.</given-names></string-name></person-group> (<year>2015</year>). <article-title>An SVM-based solution for fault detection in wind turbines</article-title>. <source>Sensors</source><italic>,</italic> <volume>15</volume><italic>(</italic><issue>3</issue><italic>),</italic> <fpage>5627</fpage>&#x2013;<lpage>5648</lpage>; <pub-id pub-id-type="pmid">25760051</pub-id></mixed-citation></ref>
<ref id="ref-23"><label>23.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Pandit</surname>, <given-names>R.</given-names></string-name>, <string-name><surname>Astolfi</surname>, <given-names>D.</given-names></string-name>, <string-name><surname>Hong</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Infield</surname>, <given-names>D.</given-names></string-name>, <string-name><surname>Santos</surname>, <given-names>M.</given-names></string-name></person-group> (<year>2023</year>). <article-title>SCADA data for wind turbine data-driven condition/performance monitoring: A review on state-of-art, challenges and future trends</article-title>. <source>Wind Engineering</source><italic>,</italic> <volume>47</volume><italic>(</italic><issue>2</issue><italic>),</italic> <fpage>422</fpage>&#x2013;<lpage>441</lpage>.</mixed-citation></ref>
<ref id="ref-24"><label>24.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Zhang</surname>, <given-names>L.</given-names></string-name>, <string-name><surname>Liu</surname>, <given-names>K.</given-names></string-name>, <string-name><surname>Wang</surname>, <given-names>Y.</given-names></string-name>, <string-name><surname>Omariba</surname>, <given-names>Z. B.</given-names></string-name></person-group> (<year>2018</year>). <article-title>Ice detection model of wind turbine blades based on random forest classifier</article-title>. <source>Energies</source><italic>,</italic> <volume>11</volume><italic>(</italic><issue>10</issue><italic>),</italic> <fpage>2548</fpage>.</mixed-citation></ref>
<ref id="ref-25"><label>25.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Tao</surname>, <given-names>T.</given-names></string-name>, <string-name><surname>Liu</surname>, <given-names>Y.</given-names></string-name>, <string-name><surname>Qiao</surname>, <given-names>Y.</given-names></string-name>, <string-name><surname>Gao</surname>, <given-names>L.</given-names></string-name>, <string-name><surname>Lu</surname>, <given-names>J.</given-names></string-name> <etal>et al.</etal></person-group> (<year>2021</year>). <article-title>Wind turbine blade icing diagnosis using hybrid features and Stacked-XGBoost algorithm</article-title>. <source>Renewable Energy</source><italic>,</italic> <volume>180</volume><italic>,</italic> <fpage>1004</fpage>&#x2013;<lpage>1013</lpage>.</mixed-citation></ref>
<ref id="ref-26"><label>26.</label><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name><surname>Yuan</surname>, <given-names>B.</given-names></string-name>, <string-name><surname>Wang</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Jiang</surname>, <given-names>F.</given-names></string-name>, <string-name><surname>Long</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Yu</surname>, <given-names>P. S.</given-names></string-name> <etal>et al.</etal></person-group> (<year>1902</year>). <article-title>Waveletfcnn: A deep time series classification model for wind turbine blade icing detection</article-title>. <comment>arXiv preprint arXiv:1902.05625</comment>.</mixed-citation></ref>
<ref id="ref-27"><label>27.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Wen</surname>, <given-names>X.</given-names></string-name>, <string-name><surname>Xu</surname>, <given-names>Z.</given-names></string-name></person-group> (<year>2021</year>). <article-title>Wind turbine fault diagnosis based on ReliefF-PCA and DNN</article-title>. <source>Expert Systems with Applications</source><italic>,</italic> <volume>178</volume><italic>,</italic> <fpage>115016</fpage></mixed-citation></ref>
<ref id="ref-28"><label>28.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Wang</surname>, <given-names>Y.</given-names></string-name>, <string-name><surname>Ma</surname>, <given-names>X.</given-names></string-name>, <string-name><surname>Qian</surname>, <given-names>P.</given-names></string-name></person-group> (<year>2018</year>). <article-title>Wind turbine fault detection and identification through PCA-based optimal variable selection</article-title>. <source>IEEE Transactions on Sustainable Energy</source><italic>,</italic> <volume>9</volume><italic>(</italic><issue>4</issue><italic>),</italic> <fpage>1627</fpage>&#x2013;<lpage>1635</lpage>.</mixed-citation></ref>
<ref id="ref-29"><label>29.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Wu</surname>, <given-names>Z.</given-names></string-name>, <string-name><surname>Wang</surname>, <given-names>X.</given-names></string-name>, <string-name><surname>Jiang</surname>, <given-names>B.</given-names></string-name></person-group> (<year>2020</year>). <article-title>Fault diagnosis for wind turbines based on ReliefF and eXtreme gradient boosting</article-title>. <source>Applied Sciences</source><italic>,</italic> <volume>10</volume><italic>(</italic><issue>9</issue><italic>),</italic> <fpage>3258</fpage></mixed-citation></ref>
<ref id="ref-30"><label>30.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Liu</surname>, <given-names>Y.</given-names></string-name>, <string-name><surname>Yang</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Huang</surname>, <given-names>K.</given-names></string-name>, <string-name><surname>Liu</surname>, <given-names>W.</given-names></string-name></person-group> (<year>2023</year>). <article-title>A multi-factor selection and fusion method through the CNN-LSTM network for dynamic price forecasting</article-title>. <source>Mathematics</source><italic>,</italic> <volume>11</volume><italic>(</italic><issue>5</issue><italic>),</italic> <fpage>1132</fpage>.</mixed-citation></ref>
<ref id="ref-31"><label>31.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Chen</surname>, <given-names>T.</given-names></string-name>, <string-name><surname>He</surname>, <given-names>T.</given-names></string-name>, <string-name><surname>Benesty</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Khotilovich</surname>, <given-names>V.</given-names></string-name>, <string-name><surname>Tang</surname>, <given-names>Y.</given-names></string-name> <etal>et al.</etal></person-group> (<year>2016</year>). <article-title>Xgboost: Extreme gradient boosting</article-title>. <source>R Package Version 0.4-2</source><italic>,</italic> <volume>1</volume><italic>(</italic><issue>4</issue><italic>),</italic> <fpage>1</fpage>&#x2013;<lpage>4</lpage>.</mixed-citation></ref>
<ref id="ref-32"><label>32.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Ke</surname>, <given-names>G.</given-names></string-name>, <string-name><surname>Meng</surname>, <given-names>Q.</given-names></string-name>, <string-name><surname>Finley</surname>, <given-names>T.</given-names></string-name>, <string-name><surname>Wang</surname>, <given-names>T.</given-names></string-name>, <string-name><surname>Chen</surname>, <given-names>W.</given-names></string-name> <etal>et al.</etal></person-group> (<year>2017</year>). <article-title>LightGBM: A highly efficient gradient boosting decision tree</article-title>. <source>Advances in Neural Information Processing Systems</source><italic>,</italic> <volume>30</volume><italic>,</italic> <fpage>3146</fpage>&#x2013;<lpage>3154</lpage>.</mixed-citation></ref>
<ref id="ref-33"><label>33.</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><surname>Arik</surname>, <given-names>S.&#x00D6;.</given-names></string-name>, <string-name><surname>Pfister</surname>, <given-names>T.</given-names></string-name></person-group> (<year>2021</year>). <article-title>TabNet: Attentive interpretable tabular learning</article-title>. <conf-name>Proceedings of the AAAI Conference on Artificial Intelligence</conf-name>, pp. <fpage>6679</fpage>&#x2013;<lpage>6687</lpage>. <publisher-loc>California, USA</publisher-loc>.</mixed-citation></ref>
<ref id="ref-34"><label>34.</label><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name><surname>Huang</surname>, <given-names>X.</given-names></string-name>, <string-name><surname>Khetan</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Cvitkovic</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Karnin</surname>, <given-names>Z.</given-names></string-name></person-group> (<year>2020</year>). <article-title>Tabtransformer: Tabular data modeling using contextual embeddings</article-title>. <comment>arXiv preprint arXiv: 2012.06678</comment>.</mixed-citation></ref>
<ref id="ref-35"><label>35.</label><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name><surname>Somepalli</surname>, <given-names>G.</given-names></string-name>, <string-name><surname>Goldblum</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Schwarzschild</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Bruss</surname>, <given-names>C. B.</given-names></string-name>, <string-name><surname>Goldstein</surname>, <given-names>T.</given-names></string-name></person-group> (<year>2021</year>). <article-title>Saint: Improved neural networks for tabular data via row attention and contrastive pre-training</article-title>. <comment>arXiv preprint arXiv: 2106.01342</comment>.</mixed-citation></ref>
<ref id="ref-36"><label>36.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Lim</surname>, <given-names>B.</given-names></string-name>, <string-name><surname>Ar&#x0131;k</surname>, <given-names>S.&#x00D6;.</given-names></string-name>, <string-name><surname>Loeff</surname>, <given-names>N.</given-names></string-name>, <string-name><surname>Pfister</surname>, <given-names>T.</given-names></string-name></person-group> (<year>2021</year>). <article-title>Temporal fusion transformers for interpretable multi-horizon time series forecasting</article-title>. <source>International Journal of Forecasting</source><italic>,</italic> <volume>37</volume><italic>(</italic><issue>4</issue><italic>),</italic> <fpage>1748</fpage>&#x2013;<lpage>1764</lpage>.</mixed-citation></ref>
<ref id="ref-37"><label>37.</label><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Tolstikhin</surname>, <given-names>I. O.</given-names></string-name>, <string-name><surname>Houlsby</surname>, <given-names>N.</given-names></string-name>, <string-name><surname>Kolesnikov</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Beyer</surname>, <given-names>L.</given-names></string-name>, <string-name><surname>Zhai</surname>, <given-names>X.</given-names></string-name> <etal>et al.</etal></person-group> (<year>2021</year>). <article-title>MLP-Mixer: An all-MLP architecture for vision</article-title>. <source>Advances in Neural Information Processing Systems</source>, vol. <volume>34</volume>, pp. <fpage>24261</fpage>&#x2013;<lpage>24272</lpage>.</mixed-citation></ref>
</ref-list>
<app-group>
<app id="app-1">
<title></title>
<sec id="s7">
<title/>
<p><bold>Appendix A</bold></p>
<table-wrap id="table-4">
<label>Table A1</label>
<caption>
<title>Feature names of SCADA data</title>
</caption>
<table frame="hsides">
<colgroup>
<col align="left"/>
<col align="left"/>
<col align="left"/>
<col align="left"/>
</colgroup>
<thead valign="top">
<tr>
<th>No.</th>
<th>Parameter</th>
<th>No.</th>
<th>Parameter</th>
</tr>
</thead>
<tbody>
<tr>
<td>1</td>
<td>Wheel speed</td>
<td>39</td>
<td>Generator stator temperature 5</td>
</tr>
<tr>
<td>2</td>
<td>Wheel angle</td>
<td>40</td>
<td>Generator stator temperature 6</td>
</tr>
<tr>
<td>3</td>
<td>Blade angle 1</td>
<td>41</td>
<td>Generator air temperature 1</td>
</tr>
<tr>
<td>4</td>
<td>Blade angle 2</td>
<td>42</td>
<td>Generator air temperature 2</td>
</tr>
<tr>
<td>5</td>
<td>Blade angle 3</td>
<td>43</td>
<td>Main bearing temperature 1</td>
</tr>
<tr>
<td>6</td>
<td>Motor current 1</td>
<td>44</td>
<td>Main bearing temperature 2</td>
</tr>
<tr>
<td>7</td>
<td>Motor current 2</td>
<td>45</td>
<td>Wheel temperature</td>
</tr>
<tr>
<td>8</td>
<td>Motor current 3</td>
<td>46</td>
<td>Wheel control cabinet temperature</td>
</tr>
<tr>
<td>9</td>
<td>Speed measured value of overspeed sensor</td>
<td>47</td>
<td>Room temperature</td>
</tr>
<tr>
<td>10</td>
<td>Mean value of yaw against wind in 5 seconds</td>
<td>48</td>
<td>Cabin temperature control cabinet</td>
</tr>
<tr>
<td>11</td>
<td>Vibration in the x direction</td>
<td>49</td>
<td>Inverter INU temperature</td>
</tr>
<tr>
<td>12</td>
<td>Vibration in the y direction</td>
<td>50</td>
<td>Inverter ISU temperature</td>
</tr>
<tr>
<td>13</td>
<td>Hydraulic brake pressure</td>
<td>51</td>
<td>INU RMIO temperature</td>
</tr>
<tr>
<td>14</td>
<td>Cabin weather station wind speed</td>
<td>52</td>
<td>Power estimation of variable propeller motor 1</td>
</tr>
<tr>
<td>15</td>
<td>The wind absolute value</td>
<td>53</td>
<td>Power estimation of variable propeller motor 2</td>
</tr>
<tr>
<td>16</td>
<td>State of reactive power control</td>
<td>54</td>
<td>Power estimation of variable propeller motor 3</td>
</tr>
<tr>
<td>17</td>
<td>The grid side current</td>
<td>55</td>
<td>Current state value of wind turbine</td>
</tr>
<tr>
<td>18</td>
<td>The grid side voltage</td>
<td>56</td>
<td>Current state value of wheel</td>
</tr>
<tr>
<td>19</td>
<td>Active power of inverter grid side</td>
<td>57</td>
<td>State of yaw value</td>
</tr>
<tr>
<td>20</td>
<td>Reactive power of inverter grid side</td>
<td>58</td>
<td>Yaw required value</td>
</tr>
<tr>
<td>21</td>
<td>Generator power of inverter generator side</td>
<td>59</td>
<td>Temperature of the blade battery box 1</td>
</tr>
<tr>
<td>22</td>
<td>Generator operating frequency</td>
<td>60</td>
<td>Temperature of the blade battery box 2</td>
</tr>
<tr>
<td>23</td>
<td>Generator current</td>
<td>61</td>
<td>Temperature of the blade battery box 3</td>
</tr>
<tr>
<td>24</td>
<td>Generator torque</td>
<td>62</td>
<td>Blade rotor motor temperature 1</td>
</tr>
<tr>
<td>25</td>
<td>Gonverter inlet temperature</td>
<td>63</td>
<td>Blade rotor motor temperature 2</td>
</tr>
<tr>
<td>26</td>
<td>Outlet temperature of the frequency converter</td>
<td>64</td>
<td>Blade rotor motor temperature 3</td>
</tr>
<tr>
<td>27</td>
<td>Frequency converter inlet pressure</td>
<td>65</td>
<td>Blade frequency converter box temperature 1</td>
</tr>
<tr>
<td>28</td>
<td>Frequency converter outlet pressure</td>
<td>66</td>
<td>Blade frequency converter box temperature 2</td>
</tr>
<tr>
<td>29</td>
<td>Generator power limiting values</td>
<td>67</td>
<td>Blade frequency converter box temperature 3</td>
</tr>
<tr>
<td>30</td>
<td>Reactive power set point</td>
<td>68</td>
<td>Blade supercapacitor voltage 1</td>
</tr>
<tr>
<td>31</td>
<td>Rated hub speed</td>
<td>69</td>
<td>Blade supercapacitor voltage 2</td>
</tr>
<tr>
<td>32</td>
<td>Wind tower ambient temperature</td>
<td>70</td>
<td>Blade supercapacitor voltage 3</td>
</tr>
<tr>
<td>33</td>
<td>Generator stator temperature 1</td>
<td>71</td>
<td>Drive thyristor temperature 1</td>
</tr>
<tr>
<td>34</td>
<td>Generator stator temperature 2</td>
<td>72</td>
<td>Drive thyristor temperature 2</td>
</tr>
<tr>
<td>35</td>
<td>Generator stator temperature 3</td>
<td>73</td>
<td>Drive thyristor temperature 3</td>
</tr>
<tr>
<td>36</td>
<td>Generator stator temperature 4</td>
<td>74</td>
<td>Atmospheric pressure</td>
</tr>
<tr>
<td>37</td>
<td>Torque 1</td>
<td>75</td>
<td>Torque 3</td>
</tr>
<tr>
<td>38</td>
<td>Torque 2</td>
<td></td>
<td></td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
</app>
</app-group>
</back></article>