<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.1 20151215//EN" "http://jats.nlm.nih.gov/publishing/1.1/JATS-journalpublishing1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" xml:lang="en" article-type="research-article" dtd-version="1.1">
<front>
<journal-meta>
<journal-id journal-id-type="pmc">CMES</journal-id>
<journal-id journal-id-type="nlm-ta">CMES</journal-id>
<journal-id journal-id-type="publisher-id">CMES</journal-id>
<journal-title-group>
<journal-title>Computer Modeling in Engineering &#x0026; Sciences</journal-title>
</journal-title-group>
<issn pub-type="epub">1526-1506</issn>
<issn pub-type="ppub">1526-1492</issn>
<publisher>
<publisher-name>Tech Science Press</publisher-name>
<publisher-loc>USA</publisher-loc>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">73030</article-id>
<article-id pub-id-type="doi">10.32604/cmes.2025.073030</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Article</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Multivariate Lithium-ion Battery State Prediction with Channel-Independent Informer and Particle Filter for Battery Digital Twin</article-title>
<alt-title alt-title-type="left-running-head">Multivariate Lithium-ion Battery State Prediction with Channel-Independent Informer and Particle Filter for Battery Digital Twin</alt-title>
<alt-title alt-title-type="right-running-head">Multivariate Lithium-ion Battery State Prediction with Channel-Independent Informer and Particle Filter for Battery Digital Twin</alt-title>
</title-group>
<contrib-group>
<contrib id="author-1" contrib-type="author">
<name name-style="western"><surname>Jeon</surname><given-names>Changyu</given-names></name></contrib>
<contrib id="author-2" contrib-type="author" corresp="yes">
<name name-style="western"><surname>Kim</surname><given-names>Younghoon</given-names></name><email>y.kim@khu.ac.kr</email></contrib>
<aff id="aff-1">
<institution>Department of Industrial and Management Systems Engineering, Kyung Hee University</institution>, Yongin-si, <addr-line>17104</addr-line>, <country>Republic of Korea</country></aff>
</contrib-group>
<author-notes>
<corresp id="cor1"><label>&#x002A;</label>Corresponding Author: Younghoon Kim. Email: <email>y.kim@khu.ac.kr</email></corresp>
</author-notes>
<pub-date date-type="collection" publication-format="electronic">
<year>2025</year>
</pub-date>
<pub-date date-type="pub" publication-format="electronic">
<day>23</day><month>12</month><year>2025</year>
</pub-date>
<volume>145</volume>
<issue>3</issue>
<fpage>3723</fpage>
<lpage>3745</lpage>
<history>
<date date-type="received">
<day>09</day>
<month>09</month>
<year>2025</year>
</date>
<date date-type="accepted">
<day>13</day>
<month>11</month>
<year>2025</year>
</date>
</history>
<permissions>
<copyright-statement>&#x00A9; 2025 The Authors.</copyright-statement>
<copyright-year>2025</copyright-year>
<copyright-holder>Published by Tech Science Press.</copyright-holder>
<license xlink:href="https://creativecommons.org/licenses/by/4.0/">
<license-p>This work is licensed under a <ext-link ext-link-type="uri" xlink:type="simple" xlink:href="https://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution 4.0 International License</ext-link>, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
</license>
</permissions>
<self-uri content-type="pdf" xlink:href="TSP_CMES_73030.pdf"></self-uri>
<abstract>
<p>Accurate State-of-Health (SOH) prediction is critical for the safe and efficient operation of lithium-ion batteries (LiBs). However, conventional methods struggle with the highly nonlinear electrochemical dynamics and declining accuracy over long-horizon forecasting. To address these limitations, this study proposes CIPF-Informer, a novel digital twin framework that integrates the Informer architecture with Channel Independence (CI) and a Particle Filter (PF). The CI mechanism enhances robustness by decoupling multivariate state dependencies, while the PF captures the complex stochastic variations missed by purely deterministic models. The proposed framework was evaluated using the Massachusetts Institute of Technology (MIT) battery dataset against benchmark deep learning models. Results demonstrate that CIPF-Informer consistently achieves superior performance, in multivariate and long sequence forecasting scenarios. By effectively synergizing a model-based method with a data-driven model, CIPF-Informer provides a more reliable pathway for advancing Battery Management System (BMS) technologies, contributing to the development of safer and more sustainable energy storage systems.</p>
</abstract>
<kwd-group kwd-group-type="author">
<kwd>Digital twin</kwd>
<kwd>battery state prediction</kwd>
<kwd>lithium-ion battery</kwd>
<kwd>informer</kwd>
<kwd>channel independence</kwd>
<kwd>particle filter</kwd>
</kwd-group>
<funding-group>
<award-group id="awg1">
<funding-source>Human Resources Development of the Korea Institute of Energy Technology Evaluation and Planning</funding-source>
<award-id>RS-2023-00244330</award-id>
</award-group>
<award-group id="awg2">
<funding-source>National Research Foundation of Korea</funding-source>
<award-id>RS-2023-00219052</award-id>
</award-group>
</funding-group>
</article-meta>
</front>
<body>
<sec id="s1">
<label>1</label>
<title>Introduction</title>
<p>The proliferation of lithium-ion batteries (LiBs) in critical applications like electric vehicles (EVs) and energy storage systems (ESSs) necessitates advanced Battery Management Systems (BMS) to ensure safety and longevity [<xref ref-type="bibr" rid="ref-1">1</xref>&#x2013;<xref ref-type="bibr" rid="ref-4">4</xref>]. Accurate State-of-Health (SOH) estimation is a cornerstone of BMS for predicting battery degradation and enabling preventive maintenance [<xref ref-type="bibr" rid="ref-5">5</xref>,<xref ref-type="bibr" rid="ref-6">6</xref>], yet it remains a significant challenge due to the battery&#x2019;s complex, nonlinear degradation dynamics influenced by various factors [<xref ref-type="bibr" rid="ref-1">1</xref>].</p>
<p>While many methods exist, they face critical limitations. Model-based approaches struggle with nonlinearities [<xref ref-type="bibr" rid="ref-7">7</xref>], while purely data-driven models often lack generalizability and ignore physical principles [<xref ref-type="bibr" rid="ref-8">8</xref>&#x2013;<xref ref-type="bibr" rid="ref-11">11</xref>]. Hybrid methods show promise [<xref ref-type="bibr" rid="ref-12">12</xref>], but most remain focused on univariate SOH prediction, overlooking the coupled dynamics between voltage, current, and temperature that are vital for a comprehensive Digital Twin (DT) [<xref ref-type="bibr" rid="ref-13">13</xref>]. Furthermore, many deep learning models, including the Transformer [<xref ref-type="bibr" rid="ref-14">14</xref>], suffer from high computational complexity, limiting their utility for long-horizon forecasting of battery lifecycle data.</p>
<p>This paper argues that a truly effective battery DT requires a model that is simultaneously multivariate, robustly hybridized, and computationally efficient for long-term prediction. To this end, we propose CIPF-Informer, a novel framework integrating Channel Independence (CI) and a Particle Filter (PF) with the efficient Informer architecture. This study aims to answer the following key research questions:
<list list-type="bullet">
<list-item>
<p>How can a model simultaneously predict multiple battery state variables (voltage, current, temperature, SOH) without sacrificing the accuracy of the primary SOH prediction task?</p></list-item>
<list-item>
<p>Can the systematic integration of a model-based filter (PF) and a channel-independent deep learning architecture (CI-Informer) yield a synergistic effect that surpasses the performance of each individual component?</p></list-item>
<list-item>
<p>Does the proposed multivariate, hybrid framework (CIPF-Informer) achieve state-of-the-art performance against established deep learning models in long-horizon battery forecasting tasks?</p></list-item>
</list></p>
<p>By addressing these questions, we seek to demonstrate a more holistic and robust pathway for developing next-generation battery digital twins. The remainder of this paper is structured as follows: <xref ref-type="sec" rid="s2">Section 2</xref> reviews related work, <xref ref-type="sec" rid="s3">Section 3</xref> describes our methodology, <xref ref-type="sec" rid="s4">Section 4</xref> details the experimental setup, <xref ref-type="sec" rid="s5">Section 5</xref> reports and analyzes the results, <xref ref-type="sec" rid="s6">Section 6</xref> discusses the practical implications, and <xref ref-type="sec" rid="s7">Section 7</xref> concludes the study by answering our research questions.</p>
</sec>
<sec id="s2">
<label>2</label>
<title>Related Work</title>
<p>State-of-Health (SOH) estimation is a key application of time-series analysis in battery research. Methodologies have evolved from model-based to data-driven and hybrid approaches, each presenting a trade-off between physical interpretability, accuracy, and computational cost. Recently, Digital Twin (DT) technology has emerged as a demanding application area, requiring models that are not only accurate but also computationally efficient for long-term, multivariate forecasting in real-time. This section critically reviews the evolution of prognostic models, analyzing their limitations in the context of these demanding DT requirements to establish the motivation for our proposed approach.</p>
<sec id="s2_1">
<label>2.1</label>
<title>Model-Based, Data-Driven, and Hybrid Methods</title>
<p>Model-based approaches rely on mathematical representations of battery electrochemical processes. The Kalman Filter (KF) is widely used due to its interpretability [<xref ref-type="bibr" rid="ref-15">15</xref>,<xref ref-type="bibr" rid="ref-16">16</xref>], but is limited by linear assumptions. To address this, nonlinear variants such as the Extended Kalman Filter (EKF) [<xref ref-type="bibr" rid="ref-17">17</xref>], Unscented Kalman Filter (UKF) [<xref ref-type="bibr" rid="ref-18">18</xref>], and Particle Filter (PF) [<xref ref-type="bibr" rid="ref-19">19</xref>] were introduced. While the PF excels in modeling highly nonlinear systems, this accuracy comes at a significant computational cost, with a complexity of approximately <inline-formula id="ieqn-1"><mml:math id="mml-ieqn-1"><mml:mi>O</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>N</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:math></inline-formula> per time step for the number of particles <italic>N</italic>, hindering scalability [<xref ref-type="bibr" rid="ref-20">20</xref>].</p>
<p>Data-driven methods emerged to model complex patterns without requiring detailed physical knowledge [<xref ref-type="bibr" rid="ref-21">21</xref>]. Traditional machine learning algorithms such as Gaussian Process Regression (GPR) [<xref ref-type="bibr" rid="ref-8">8</xref>], Support Vector Machines (SVM) [<xref ref-type="bibr" rid="ref-10">10</xref>], Fuzzy Logic [<xref ref-type="bibr" rid="ref-22">22</xref>], and Random Forests [<xref ref-type="bibr" rid="ref-9">9</xref>] have demonstrated robust performance but often depend on manual feature engineering. Deep learning models, particularly Recurrent Neural Networks (RNNs) [<xref ref-type="bibr" rid="ref-23">23</xref>] and Long Short-Term Memory (LSTM) networks [<xref ref-type="bibr" rid="ref-24">24</xref>], automated this process and improved accuracy. However, their sequential nature, with a time complexity of <inline-formula id="ieqn-2"><mml:math id="mml-ieqn-2"><mml:mi>O</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>L</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:math></inline-formula> for a sequence of length <italic>L</italic> [<xref ref-type="bibr" rid="ref-25">25</xref>], makes them inefficient for modeling long-range dependencies. The Transformer architecture [<xref ref-type="bibr" rid="ref-14">14</xref>] marked a significant advancement with its parallel self-attention mechanism. However, this introduced a critical bottleneck: a time and memory complexity of <inline-formula id="ieqn-3"><mml:math id="mml-ieqn-3"><mml:mi>O</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:msup><mml:mi>L</mml:mi><mml:mn>2</mml:mn></mml:msup><mml:mo stretchy="false">)</mml:mo></mml:math></inline-formula>, making the standard Transformer computationally prohibitive for the very long time-series data required in battery lifecycle prognostics, which is a core task for a DT. Efficient architectures like the Informer [<xref ref-type="bibr" rid="ref-26">26</xref>], which reduces complexity to <inline-formula id="ieqn-4"><mml:math id="mml-ieqn-4"><mml:mi>O</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>L</mml:mi><mml:mi>log</mml:mi><mml:mo>&#x2061;</mml:mo><mml:mi>L</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:math></inline-formula>, became necessary to make true Long-Sequence Time-series Forecasting (LSTF) feasible.</p>
<p>A recent innovation that enhances robustness, particularly in multivariate tasks, is Channel Independence. This approach processes each variable independently and has shown strong performance in various backbones, including CNNs [<xref ref-type="bibr" rid="ref-27">27</xref>], linear models [<xref ref-type="bibr" rid="ref-28">28</xref>], and Transformers [<xref ref-type="bibr" rid="ref-29">29</xref>,<xref ref-type="bibr" rid="ref-30">30</xref>].</p>
<p>Hybrid approaches combine the strengths of both paradigms [<xref ref-type="bibr" rid="ref-12">12</xref>]. For instance, Shi [<xref ref-type="bibr" rid="ref-31">31</xref>] used a KF for pre-processing before an Transformer, achieving a 25% improvement in Mean Squared Error. However, a critical analysis reveals two persistent limitations. First, many existing hybrid models create a significant computational bottleneck by naively combining two computationally expensive models, such as a standard Transformer (<inline-formula id="ieqn-5"><mml:math id="mml-ieqn-5"><mml:mi>O</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:msup><mml:mi>L</mml:mi><mml:mn>2</mml:mn></mml:msup><mml:mo stretchy="false">)</mml:mo></mml:math></inline-formula>) and a Particle Filter (<inline-formula id="ieqn-6"><mml:math id="mml-ieqn-6"><mml:mi>O</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>N</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:math></inline-formula>). Second, the vast majority, including the aforementioned study, remain focused on univariate targets such as SOH or State of Charge (SOC) [<xref ref-type="bibr" rid="ref-13">13</xref>,<xref ref-type="bibr" rid="ref-32">32</xref>].</p>
</sec>
<sec id="s2_2">
<label>2.2</label>
<title>Digital Twin for Battery</title>
<p>The Digital Twin (DT) paradigm, originally introduced by NASA [<xref ref-type="bibr" rid="ref-33">33</xref>], aims to create a real-time, virtual replica of a physical battery system for predictive diagnostics and optimized control [<xref ref-type="bibr" rid="ref-34">34</xref>,<xref ref-type="bibr" rid="ref-35">35</xref>]. However, a high-fidelity DT, often integrated into EVs [<xref ref-type="bibr" rid="ref-1">1</xref>], ESSs [<xref ref-type="bibr" rid="ref-4">4</xref>], and smart grids [<xref ref-type="bibr" rid="ref-36">36</xref>] to enhance reliability [<xref ref-type="bibr" rid="ref-3">3</xref>], imposes stricter requirements that reveal limitations in the prognostic models described above.</p>
<p>First, a true DT requires a comprehensive, multivariate understanding of the battery&#x2019;s state. As noted, most studies focus on univariate predictions, a critical shortcoming for a holistic system view. Second, the real-time nature of a DT makes computational efficiency paramount, as high-frequency data updates create significant computational demands [<xref ref-type="bibr" rid="ref-37">37</xref>]. The quadratic complexity of standard Transformers, for example, is often too slow. Finally, the reliability of a DT depends on its physical plausibility. The battery&#x2019;s operational complexity makes accurate modeling difficult [<xref ref-type="bibr" rid="ref-38">38</xref>], and purely data-driven models, even efficient ones, can produce physically unrealistic predictions, reducing the reliability of AI-driven control strategies [<xref ref-type="bibr" rid="ref-39">39</xref>].</p>
</sec>
<sec id="s2_3">
<label>2.3</label>
<title>Limitations</title>
<p>The preceding review highlights a clear research gap for a framework that can satisfy the demanding requirements of a practical battery DT. This gap can be summarized by two key needs:
<list list-type="simple">
<list-item><label>1.</label><p><bold>Computational efficiency for LSTF:</bold> While standard Transformers are too slow (<inline-formula id="ieqn-7"><mml:math id="mml-ieqn-7"><mml:mi>O</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:msup><mml:mi>L</mml:mi><mml:mn>2</mml:mn></mml:msup><mml:mo stretchy="false">)</mml:mo></mml:math></inline-formula>), efficient variants like the Informer exist but have been seldom utilized in hybrid frameworks for battery prognostics.</p></list-item>
<list-item><label>2.</label><p><bold>A shift from univariate to multivariate forecasting:</bold> A comprehensive DT requires moving beyond single-variable SOH prediction to a multivariate approach where multiple key battery state variables are forecasted simultaneously.</p></list-item>
</list></p>
<p>To address these specific gaps, this study makes the following contributions:
<list list-type="bullet">
<list-item>
<p>We propose a multivariate time-series prediction model that extends beyond SOH estimation, enhancing the scope and interpretability of battery digital twins.</p></list-item>
<list-item>
<p>We develop an efficient hybrid architecture that combines a Particle Filter (PF) and Channel Independence (CI) with the computationally efficient Informer (<inline-formula id="ieqn-8"><mml:math id="mml-ieqn-8"><mml:mi>O</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>L</mml:mi><mml:mi>log</mml:mi><mml:mo>&#x2061;</mml:mo><mml:mi>L</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:math></inline-formula>) backbone. This structure is designed to capture nonlinear battery dynamics without the prohibitive computational cost of naive hybrid models.</p></list-item>
<list-item>
<p>We empirically demonstrate the superior performance of our proposed model in both prediction accuracy and robustness compared to state-of-the-art models in multivariate, long-horizon forecasting tasks.</p></list-item>
</list></p>
</sec>
</sec>
<sec id="s3">
<label>3</label>
<title>Methodology</title>
<p>In this study, we propose the CIPF-Informer model for the digital twin of lithium-ion batteries (LiBs). The proposed method integrates Channel Independence (CI) and Particle Filter (PF) into an Informer-based time series forecasting model to effectively capture the nonlinear and dynamic characteristics of batteries. This approach aims to enhance the accuracy of battery state estimation and improve the stability of long-term forecasting. <xref ref-type="fig" rid="fig-1">Fig. 1</xref> illustrates the overall architecture of the CIPF-Informer model, where each component is designed to process input time-series data and optimize battery state prediction performance.</p>
<fig id="fig-1">
<label>Figure 1</label>
<caption>
<title>CIPF-Informer architecture. The backbone, represented by the blue border, is used for training the data. The green border represents the particle filter, and the yellow border represents the informer</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="CMES_73030-fig-1.tif"/>
</fig>
<sec id="s3_1">
<label>3.1</label>
<title>Long Sequence Time-Series Forecasting</title>
<p>This study addresses the Long Sequence Time-series Forecasting (LSTF) problem. Using a fixed-size sliding window approach, the objective is to predict a sequence of <inline-formula id="ieqn-9"><mml:math id="mml-ieqn-9"><mml:msub><mml:mi>L</mml:mi><mml:mi>y</mml:mi></mml:msub></mml:math></inline-formula> future values given an input sequence of length <inline-formula id="ieqn-10"><mml:math id="mml-ieqn-10"><mml:msub><mml:mi>L</mml:mi><mml:mi>x</mml:mi></mml:msub></mml:math></inline-formula> at time <inline-formula id="ieqn-11"><mml:math id="mml-ieqn-11"><mml:mi>t</mml:mi></mml:math></inline-formula>:
<disp-formula id="eqn-1"><label>(1)</label><mml:math id="mml-eqn-1" display="block"><mml:msub><mml:mi>X</mml:mi><mml:mi>t</mml:mi></mml:msub><mml:mo>=</mml:mo><mml:mo fence="false" stretchy="false">{</mml:mo><mml:msubsup><mml:mi>x</mml:mi><mml:mi>t</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mn>1</mml:mn><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:mo>,</mml:mo><mml:mo>&#x2026;</mml:mo><mml:mo>,</mml:mo><mml:msubsup><mml:mi>x</mml:mi><mml:mi>t</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:msub><mml:mi>L</mml:mi><mml:mi>x</mml:mi></mml:msub><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:mrow><mml:mo stretchy="false">|</mml:mo></mml:mrow><mml:msubsup><mml:mi>x</mml:mi><mml:mi>t</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:mo>&#x2208;</mml:mo><mml:msup><mml:mi>R</mml:mi><mml:mrow><mml:msub><mml:mi>d</mml:mi><mml:mi>x</mml:mi></mml:msub></mml:mrow></mml:msup><mml:mo fence="false" stretchy="false">}</mml:mo><mml:mo>,</mml:mo><mml:mspace width="1em" /><mml:msub><mml:mi>Y</mml:mi><mml:mi>t</mml:mi></mml:msub><mml:mo>=</mml:mo><mml:mo fence="false" stretchy="false">{</mml:mo><mml:msubsup><mml:mi>y</mml:mi><mml:mi>t</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mn>1</mml:mn><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:mo>,</mml:mo><mml:mo>&#x2026;</mml:mo><mml:mo>,</mml:mo><mml:msubsup><mml:mi>y</mml:mi><mml:mi>t</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:msub><mml:mi>L</mml:mi><mml:mi>y</mml:mi></mml:msub><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:mrow><mml:mo stretchy="false">|</mml:mo></mml:mrow><mml:msubsup><mml:mi>y</mml:mi><mml:mi>t</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:mo>&#x2208;</mml:mo><mml:msup><mml:mi>R</mml:mi><mml:mrow><mml:msub><mml:mi>d</mml:mi><mml:mi>y</mml:mi></mml:msub></mml:mrow></mml:msup><mml:mo fence="false" stretchy="false">}</mml:mo></mml:math></disp-formula>where <inline-formula id="ieqn-12"><mml:math id="mml-ieqn-12"><mml:msub><mml:mi>L</mml:mi><mml:mi>x</mml:mi></mml:msub></mml:math></inline-formula> is the length of the input sequence, and <inline-formula id="ieqn-13"><mml:math id="mml-ieqn-13"><mml:msub><mml:mi>d</mml:mi><mml:mi>x</mml:mi></mml:msub></mml:math></inline-formula> and <inline-formula id="ieqn-14"><mml:math id="mml-ieqn-14"><mml:msub><mml:mi>d</mml:mi><mml:mi>y</mml:mi></mml:msub></mml:math></inline-formula> are the dimensions of the input and output sequences, respectively. LSTF problems typically involve long prediction horizons (large <inline-formula id="ieqn-15"><mml:math id="mml-ieqn-15"><mml:msub><mml:mi>L</mml:mi><mml:mi>y</mml:mi></mml:msub></mml:math></inline-formula>), and in this study, a multivariate case is considered where <inline-formula id="ieqn-16"><mml:math id="mml-ieqn-16"><mml:msub><mml:mi>d</mml:mi><mml:mi>y</mml:mi></mml:msub><mml:mo>&#x2265;</mml:mo><mml:mn>1</mml:mn></mml:math></inline-formula>.</p>
</sec>
<sec id="s3_2">
<label>3.2</label>
<title>Channel Independence</title>
<p>Multivariate time-series data in batteries consist of multiple independent time-series channels. Given a lookback window:
<disp-formula id="eqn-2"><label>(2)</label><mml:math id="mml-eqn-2" display="block"><mml:mi>X</mml:mi><mml:mo>=</mml:mo><mml:mo fence="false" stretchy="false">{</mml:mo><mml:msub><mml:mi>x</mml:mi><mml:mn>1</mml:mn></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>x</mml:mi><mml:mn>2</mml:mn></mml:msub><mml:mo>,</mml:mo><mml:mo>&#x2026;</mml:mo><mml:mo>,</mml:mo><mml:msub><mml:mi>x</mml:mi><mml:mi>C</mml:mi></mml:msub><mml:mrow><mml:mo stretchy="false">|</mml:mo></mml:mrow><mml:msub><mml:mi>x</mml:mi><mml:mi>c</mml:mi></mml:msub><mml:mo>&#x2208;</mml:mo><mml:msup><mml:mi>R</mml:mi><mml:mi>L</mml:mi></mml:msup><mml:mo fence="false" stretchy="false">}</mml:mo></mml:math></disp-formula>where <italic>C</italic> represents the total number of channels and <italic>L</italic> is the length of the observation window. Each univariate time-series of length <italic>L</italic> for channel <inline-formula id="ieqn-17"><mml:math id="mml-ieqn-17"><mml:mi>i</mml:mi></mml:math></inline-formula> is represented as:
<disp-formula id="eqn-3"><label>(3)</label><mml:math id="mml-eqn-3" display="block"><mml:msubsup><mml:mi>x</mml:mi><mml:mrow><mml:mn>1</mml:mn><mml:mo>:</mml:mo><mml:mi>L</mml:mi></mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:mo>=</mml:mo><mml:mo stretchy="false">(</mml:mo><mml:msubsup><mml:mi>x</mml:mi><mml:mn>1</mml:mn><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:mo>,</mml:mo><mml:mo>&#x2026;</mml:mo><mml:mo>,</mml:mo><mml:msubsup><mml:mi>x</mml:mi><mml:mi>L</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:mo stretchy="false">)</mml:mo><mml:mo>,</mml:mo><mml:mspace width="1em" /><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn><mml:mo>,</mml:mo><mml:mo>&#x2026;</mml:mo><mml:mo>,</mml:mo><mml:mi>C</mml:mi></mml:math></disp-formula></p>
<p>Each input sequence <inline-formula id="ieqn-18"><mml:math id="mml-ieqn-18"><mml:mo stretchy="false">(</mml:mo><mml:msub><mml:mi>x</mml:mi><mml:mn>1</mml:mn></mml:msub><mml:mo>,</mml:mo><mml:mo>&#x2026;</mml:mo><mml:mo>,</mml:mo><mml:msub><mml:mi>x</mml:mi><mml:mi>L</mml:mi></mml:msub><mml:mo stretchy="false">)</mml:mo></mml:math></inline-formula> is split into <italic>C</italic> univariate time-series, where each individual sequence <inline-formula id="ieqn-19"><mml:math id="mml-ieqn-19"><mml:msup><mml:mi>x</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msup></mml:math></inline-formula> is independently fed into the same backbone model. The backbone model then generates the corresponding predictions:
<disp-formula id="eqn-4"><label>(4)</label><mml:math id="mml-eqn-4" display="block"><mml:msup><mml:mrow><mml:mover><mml:mi>x</mml:mi><mml:mo stretchy="false">&#x005E;</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:mo stretchy="false">(</mml:mo><mml:msubsup><mml:mrow><mml:mover><mml:mi>x</mml:mi><mml:mo stretchy="false">&#x005E;</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mi>L</mml:mi><mml:mo>+</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:mo>,</mml:mo><mml:mo>&#x2026;</mml:mo><mml:mo>,</mml:mo><mml:msubsup><mml:mrow><mml:mover><mml:mi>x</mml:mi><mml:mo stretchy="false">&#x005E;</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mi>L</mml:mi><mml:mo>+</mml:mo><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:mo stretchy="false">)</mml:mo></mml:math></disp-formula>where <inline-formula id="ieqn-20"><mml:math id="mml-ieqn-20"><mml:mi>T</mml:mi><mml:mo>&#x003E;</mml:mo><mml:mn>0</mml:mn></mml:math></inline-formula> denotes the length of the prediction window.</p>
<p>In this study, the input variables are set as
<disp-formula id="ueqn-5"><mml:math id="mml-ueqn-5" display="block"><mml:mtable columnalign="right left right left right left right left right left right left" rowspacing="3pt" columnspacing="0em 2em 0em 2em 0em 2em 0em 2em 0em 2em 0em" displaystyle="true"><mml:mtr><mml:mtd /><mml:mtd><mml:mi>X</mml:mi><mml:mo>=</mml:mo><mml:mo fence="false" stretchy="false">{</mml:mo><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>m</mml:mi><mml:mi>e</mml:mi><mml:mi>a</mml:mi><mml:mi>n</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>T</mml:mi><mml:mrow><mml:mi>m</mml:mi><mml:mi>a</mml:mi><mml:mi>x</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>T</mml:mi><mml:mrow><mml:mi>a</mml:mi><mml:mi>v</mml:mi><mml:mi>g</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>T</mml:mi><mml:mrow><mml:mi>m</mml:mi><mml:mi>i</mml:mi><mml:mi>n</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:mi>Q</mml:mi><mml:mi>C</mml:mi><mml:mi>h</mml:mi><mml:mi>a</mml:mi><mml:mi>r</mml:mi><mml:mi>g</mml:mi><mml:mi>e</mml:mi><mml:mo>,</mml:mo><mml:mi>Q</mml:mi><mml:mi>D</mml:mi><mml:mi>i</mml:mi><mml:mi>s</mml:mi><mml:mi>c</mml:mi><mml:mi>h</mml:mi><mml:mi>a</mml:mi><mml:mi>r</mml:mi><mml:mi>g</mml:mi><mml:mi>e</mml:mi><mml:mo>,</mml:mo><mml:mi>I</mml:mi><mml:mi>R</mml:mi><mml:mo>,</mml:mo><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:mi>H</mml:mi><mml:mo fence="false" stretchy="false">}</mml:mo><mml:mo>.</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula></p>
<p>Each univariate time series of length <italic>L</italic> starting from time index 1 is denoted as <inline-formula id="ieqn-21"><mml:math id="mml-ieqn-21"><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mn>1</mml:mn><mml:mo>:</mml:mo><mml:mi>L</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mo stretchy="false">(</mml:mo><mml:msub><mml:mi>V</mml:mi><mml:mn>1</mml:mn></mml:msub><mml:mo>,</mml:mo><mml:mo>&#x2026;</mml:mo><mml:mo>,</mml:mo><mml:msub><mml:mi>V</mml:mi><mml:mi>L</mml:mi></mml:msub><mml:mo stretchy="false">)</mml:mo><mml:mo>,</mml:mo><mml:mo>&#x2026;</mml:mo><mml:mo>,</mml:mo><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:msub><mml:mi>H</mml:mi><mml:mrow><mml:mn>1</mml:mn><mml:mo>:</mml:mo><mml:mi>L</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mo stretchy="false">(</mml:mo><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:msub><mml:mi>H</mml:mi><mml:mn>1</mml:mn></mml:msub><mml:mo>,</mml:mo><mml:mo>&#x2026;</mml:mo><mml:mo>,</mml:mo><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:msub><mml:mi>H</mml:mi><mml:mi>L</mml:mi></mml:msub><mml:mo stretchy="false">)</mml:mo></mml:math></inline-formula>. Each univariate time series is independently input into the same backbone. Finally, the backbone provides prediction results <inline-formula id="ieqn-22"><mml:math id="mml-ieqn-22"><mml:mrow><mml:mover><mml:mi>V</mml:mi><mml:mo stretchy="false">&#x005E;</mml:mo></mml:mover></mml:mrow><mml:mo>=</mml:mo><mml:mo stretchy="false">(</mml:mo><mml:msub><mml:mrow><mml:mover><mml:mi>V</mml:mi><mml:mo stretchy="false">&#x005E;</mml:mo></mml:mover></mml:mrow><mml:mi>L</mml:mi></mml:msub><mml:mo>,</mml:mo><mml:mo>&#x2026;</mml:mo><mml:mo>,</mml:mo><mml:msub><mml:mrow><mml:mover><mml:mi>V</mml:mi><mml:mo stretchy="false">&#x005E;</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mi>L</mml:mi><mml:mo>+</mml:mo><mml:mi>T</mml:mi></mml:mrow></mml:msub><mml:mo stretchy="false">)</mml:mo><mml:mo>,</mml:mo><mml:mo>&#x2026;</mml:mo><mml:mo>,</mml:mo><mml:mrow><mml:mover><mml:mrow><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:mi>H</mml:mi></mml:mrow><mml:mo stretchy="false">&#x005E;</mml:mo></mml:mover></mml:mrow><mml:mo>=</mml:mo><mml:mo stretchy="false">(</mml:mo><mml:msub><mml:mrow><mml:mover><mml:mrow><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:mi>H</mml:mi></mml:mrow><mml:mo stretchy="false">&#x005E;</mml:mo></mml:mover></mml:mrow><mml:mi>L</mml:mi></mml:msub><mml:mo>,</mml:mo><mml:mo>&#x2026;</mml:mo><mml:mo>,</mml:mo><mml:msub><mml:mrow><mml:mover><mml:mrow><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:mi>H</mml:mi></mml:mrow><mml:mo stretchy="false">&#x005E;</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mi>L</mml:mi><mml:mo>+</mml:mo><mml:mi>T</mml:mi></mml:mrow></mml:msub><mml:mo stretchy="false">)</mml:mo></mml:math></inline-formula>.</p>
</sec>
<sec id="s3_3">
<label>3.3</label>
<title>Particle Filter</title>
<p>The Particle Filter (PF) is an algorithm used for state estimation in nonlinear and non-Gaussian systems. In this study, the PF is applied as a preprocessing step to incorporate the physical characteristics of the input data and filter out noise before it is fed into the deep learning model. The main steps of the Particle Filter algorithm, as applied in our framework, are detailed below.</p>
<p>First, a set of <italic>N</italic> weighted particles <inline-formula id="ieqn-23"><mml:math id="mml-ieqn-23"><mml:mo fence="false" stretchy="false">{</mml:mo><mml:msubsup><mml:mi>x</mml:mi><mml:mi>t</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:mo>,</mml:mo><mml:msubsup><mml:mi>w</mml:mi><mml:mi>t</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:msubsup><mml:mo fence="false" stretchy="false">}</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>N</mml:mi></mml:msubsup></mml:math></inline-formula> is used to approximate the posterior probability density. Each particle <inline-formula id="ieqn-24"><mml:math id="mml-ieqn-24"><mml:msubsup><mml:mi>x</mml:mi><mml:mi>t</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup></mml:math></inline-formula> is randomly initialized, and the initial weights are uniformly assigned as <inline-formula id="ieqn-25"><mml:math id="mml-ieqn-25"><mml:msubsup><mml:mi>w</mml:mi><mml:mn>0</mml:mn><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:mo>=</mml:mo><mml:mn>1</mml:mn><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:mi>N</mml:mi></mml:math></inline-formula>.</p>
<p>The state of the system is governed by a state transition model, generally defined as:
<disp-formula id="eqn-5"><label>(5)</label><mml:math id="mml-eqn-5" display="block"><mml:msub><mml:mi>x</mml:mi><mml:mi>t</mml:mi></mml:msub><mml:mo>=</mml:mo><mml:mi>f</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:msub><mml:mi>x</mml:mi><mml:mrow><mml:mi>t</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>u</mml:mi><mml:mrow><mml:mi>t</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:msub><mml:mo stretchy="false">)</mml:mo></mml:math></disp-formula>where <inline-formula id="ieqn-26"><mml:math id="mml-ieqn-26"><mml:mi>f</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mo>&#x22C5;</mml:mo><mml:mo stretchy="false">)</mml:mo></mml:math></inline-formula> is the state transition function and <inline-formula id="ieqn-27"><mml:math id="mml-ieqn-27"><mml:msub><mml:mi>u</mml:mi><mml:mi>t</mml:mi></mml:msub></mml:math></inline-formula> is the process noise. To specifically model the complex, nonlinear degradation path of a Li-ion battery, we define <inline-formula id="ieqn-28"><mml:math id="mml-ieqn-28"><mml:mi>f</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mo>&#x22C5;</mml:mo><mml:mo stretchy="false">)</mml:mo></mml:math></inline-formula> as a Gaussian Mixture state transition model. This function can approximate the multi-modal behaviors seen in different phases of a battery&#x2019;s lifecycle:
<disp-formula id="eqn-6"><label>(6)</label><mml:math id="mml-eqn-6" display="block"><mml:mi>f</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>x</mml:mi><mml:mo stretchy="false">)</mml:mo><mml:mo>=</mml:mo><mml:mi>a</mml:mi><mml:mo>&#x22C5;</mml:mo><mml:mi>exp</mml:mi><mml:mo>&#x2061;</mml:mo><mml:mo stretchy="false">(</mml:mo><mml:mo>&#x2212;</mml:mo><mml:mo stretchy="false">(</mml:mo><mml:mo stretchy="false">(</mml:mo><mml:mi>x</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mi>b</mml:mi><mml:mo stretchy="false">)</mml:mo><mml:mo>&#x22C5;</mml:mo><mml:mi>c</mml:mi><mml:msup><mml:mo stretchy="false">)</mml:mo><mml:mn>2</mml:mn></mml:msup><mml:mo stretchy="false">)</mml:mo><mml:mo>+</mml:mo><mml:mi>d</mml:mi><mml:mo>&#x22C5;</mml:mo><mml:mi>exp</mml:mi><mml:mo>&#x2061;</mml:mo><mml:mo stretchy="false">(</mml:mo><mml:mo>&#x2212;</mml:mo><mml:mo stretchy="false">(</mml:mo><mml:mo stretchy="false">(</mml:mo><mml:mi>x</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mi>e</mml:mi><mml:mo stretchy="false">)</mml:mo><mml:mo>&#x22C5;</mml:mo><mml:mi>f</mml:mi><mml:msup><mml:mo stretchy="false">)</mml:mo><mml:mn>2</mml:mn></mml:msup><mml:mo stretchy="false">)</mml:mo></mml:math></disp-formula>where the parameters <inline-formula id="ieqn-29"><mml:math id="mml-ieqn-29"><mml:mo fence="false" stretchy="false">{</mml:mo><mml:mi>a</mml:mi><mml:mo>,</mml:mo><mml:mi>b</mml:mi><mml:mo>,</mml:mo><mml:mi>c</mml:mi><mml:mo>,</mml:mo><mml:mi>d</mml:mi><mml:mo>,</mml:mo><mml:mi>e</mml:mi><mml:mo>,</mml:mo><mml:mi>f</mml:mi><mml:mo fence="false" stretchy="false">}</mml:mo></mml:math></inline-formula> are hyperparameters tuned to model characteristic degradation patterns. The measurement model maps the system state to the observed sensor measurements <inline-formula id="ieqn-30"><mml:math id="mml-ieqn-30"><mml:msub><mml:mi>y</mml:mi><mml:mi>t</mml:mi></mml:msub></mml:math></inline-formula>:
<disp-formula id="eqn-7"><label>(7)</label><mml:math id="mml-eqn-7" display="block"><mml:msub><mml:mi>y</mml:mi><mml:mi>t</mml:mi></mml:msub><mml:mo>=</mml:mo><mml:mi>h</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:msub><mml:mi>x</mml:mi><mml:mi>t</mml:mi></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>v</mml:mi><mml:mi>t</mml:mi></mml:msub><mml:mo stretchy="false">)</mml:mo></mml:math></disp-formula>where <inline-formula id="ieqn-31"><mml:math id="mml-ieqn-31"><mml:mi>h</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mo>&#x22C5;</mml:mo><mml:mo stretchy="false">)</mml:mo></mml:math></inline-formula> is the measurement function and <inline-formula id="ieqn-32"><mml:math id="mml-ieqn-32"><mml:msub><mml:mi>v</mml:mi><mml:mi>t</mml:mi></mml:msub></mml:math></inline-formula> represents measurement noise.</p>
<p>The PF algorithm then proceeds iteratively. The prediction step propagates each particle forward using the system dynamics. The posterior probability density function <inline-formula id="ieqn-33"><mml:math id="mml-ieqn-33"><mml:mi>p</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:msub><mml:mi>x</mml:mi><mml:mi>t</mml:mi></mml:msub><mml:mrow><mml:mo stretchy="false">|</mml:mo></mml:mrow><mml:msub><mml:mi>y</mml:mi><mml:mrow><mml:mn>1</mml:mn><mml:mo>:</mml:mo><mml:mi>t</mml:mi></mml:mrow></mml:msub><mml:mo stretchy="false">)</mml:mo></mml:math></inline-formula> is estimated via the particle approximation:
<disp-formula id="eqn-8"><label>(8)</label><mml:math id="mml-eqn-8" display="block"><mml:mi>p</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:msub><mml:mi>x</mml:mi><mml:mi>t</mml:mi></mml:msub><mml:mrow><mml:mo stretchy="false">|</mml:mo></mml:mrow><mml:msub><mml:mi>y</mml:mi><mml:mrow><mml:mn>1</mml:mn><mml:mo>:</mml:mo><mml:mi>t</mml:mi></mml:mrow></mml:msub><mml:mo stretchy="false">)</mml:mo><mml:mo>&#x2248;</mml:mo><mml:munderover><mml:mo movablelimits="false">&#x2211;</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>N</mml:mi></mml:munderover><mml:msubsup><mml:mi>w</mml:mi><mml:mi>t</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:mi>&#x03B4;</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:msub><mml:mi>x</mml:mi><mml:mi>t</mml:mi></mml:msub><mml:mo>&#x2212;</mml:mo><mml:msubsup><mml:mi>x</mml:mi><mml:mi>t</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:mo stretchy="false">)</mml:mo></mml:math></disp-formula></p>
<p>The update step adjusts the particle weights based on the new observation <inline-formula id="ieqn-34"><mml:math id="mml-ieqn-34"><mml:msub><mml:mi>y</mml:mi><mml:mi>t</mml:mi></mml:msub></mml:math></inline-formula>. Using importance sampling, the new weight is computed as:
<disp-formula id="eqn-9"><label>(9)</label><mml:math id="mml-eqn-9" display="block"><mml:msubsup><mml:mi>w</mml:mi><mml:mi>t</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:mo>&#x221D;</mml:mo><mml:msubsup><mml:mi>w</mml:mi><mml:mrow><mml:mi>t</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:mo>&#x22C5;</mml:mo><mml:mfrac><mml:mrow><mml:mi>p</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:msub><mml:mi>y</mml:mi><mml:mi>t</mml:mi></mml:msub><mml:mrow><mml:mo stretchy="false">|</mml:mo></mml:mrow><mml:msubsup><mml:mi>x</mml:mi><mml:mi>t</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:mo stretchy="false">)</mml:mo><mml:mo>&#x22C5;</mml:mo><mml:mi>p</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:msubsup><mml:mi>x</mml:mi><mml:mi>t</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:mrow><mml:mo stretchy="false">|</mml:mo></mml:mrow><mml:msubsup><mml:mi>x</mml:mi><mml:mrow><mml:mi>t</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mrow><mml:mi>q</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:msubsup><mml:mi>x</mml:mi><mml:mi>t</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:mrow><mml:mo stretchy="false">|</mml:mo></mml:mrow><mml:msubsup><mml:mi>x</mml:mi><mml:mrow><mml:mn>0</mml:mn><mml:mo>:</mml:mo><mml:mi>t</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:mo>,</mml:mo><mml:msub><mml:mi>y</mml:mi><mml:mi>t</mml:mi></mml:msub><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mfrac></mml:math></disp-formula>where <inline-formula id="ieqn-35"><mml:math id="mml-ieqn-35"><mml:mi>q</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mo>&#x22C5;</mml:mo><mml:mo stretchy="false">)</mml:mo></mml:math></inline-formula> is the importance density function. The weights are then normalized to sum to one: <inline-formula id="ieqn-36"><mml:math id="mml-ieqn-36"><mml:msubsup><mml:mrow><mml:mover><mml:mi>w</mml:mi><mml:mo stretchy="false">&#x005E;</mml:mo></mml:mover></mml:mrow><mml:mi>t</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:mo>=</mml:mo><mml:msubsup><mml:mi>w</mml:mi><mml:mi>t</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:msubsup><mml:mo movablelimits="false">&#x2211;</mml:mo><mml:mrow><mml:mi>j</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>N</mml:mi></mml:msubsup><mml:msubsup><mml:mi>w</mml:mi><mml:mi>t</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>j</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup></mml:math></inline-formula>.</p>
<p>To prevent particle degeneracy where a few particles have all the weight, a resampling step is performed. This step redistributes the particles, eliminating those with low weights and replicating those with high weights, typically resetting all weights to <inline-formula id="ieqn-37"><mml:math id="mml-ieqn-37"><mml:msubsup><mml:mi>w</mml:mi><mml:mi>t</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:mo>=</mml:mo><mml:mn>1</mml:mn><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:mi>N</mml:mi></mml:math></inline-formula>.</p>
<p>Finally, the estimated state at time <inline-formula id="ieqn-38"><mml:math id="mml-ieqn-38"><mml:mi>t</mml:mi></mml:math></inline-formula> is obtained by the weighted average of the resampled particles:
<disp-formula id="eqn-10"><label>(10)</label><mml:math id="mml-eqn-10" display="block"><mml:msub><mml:mrow><mml:mover><mml:mi>x</mml:mi><mml:mo stretchy="false">&#x005E;</mml:mo></mml:mover></mml:mrow><mml:mi>t</mml:mi></mml:msub><mml:mo>=</mml:mo><mml:munderover><mml:mo movablelimits="false">&#x2211;</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>N</mml:mi></mml:munderover><mml:msubsup><mml:mi>w</mml:mi><mml:mi>t</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup><mml:msubsup><mml:mi>x</mml:mi><mml:mi>t</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mi>i</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msubsup></mml:math></disp-formula></p>
<p>In this study, the Particle Filter is applied to the input time-series data <inline-formula id="ieqn-39"><mml:math id="mml-ieqn-39"><mml:mi>X</mml:mi><mml:mo>=</mml:mo><mml:mo fence="false" stretchy="false">{</mml:mo><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mn>1</mml:mn><mml:mo>:</mml:mo><mml:mi>L</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:mo>&#x2026;</mml:mo><mml:mo>,</mml:mo><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:msub><mml:mi>H</mml:mi><mml:mrow><mml:mn>1</mml:mn><mml:mo>:</mml:mo><mml:mi>L</mml:mi></mml:mrow></mml:msub><mml:mo fence="false" stretchy="false">}</mml:mo></mml:math></inline-formula>. After the final estimation step, a refined data sequence, denoted as <inline-formula id="ieqn-40"><mml:math id="mml-ieqn-40"><mml:msup><mml:mi>X</mml:mi><mml:mi mathvariant="normal">&#x2032;</mml:mi></mml:msup><mml:mo>=</mml:mo><mml:mo fence="false" stretchy="false">{</mml:mo><mml:mrow><mml:mover><mml:mi>V</mml:mi><mml:mo stretchy="false">&#x005E;</mml:mo></mml:mover></mml:mrow><mml:mo>,</mml:mo><mml:mo>&#x2026;</mml:mo><mml:mo>,</mml:mo><mml:mrow><mml:mover><mml:mrow><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:mi>H</mml:mi></mml:mrow><mml:mo stretchy="false">&#x005E;</mml:mo></mml:mover></mml:mrow><mml:mo fence="false" stretchy="false">}</mml:mo></mml:math></inline-formula>, is obtained. This processed sequence <italic>X</italic><sup><italic>&#x2032;</italic></sup> is then utilized as the input for the encoder of the Informer model, providing it with a noise-reduced and physically constrained representation of the battery&#x2019;s state.</p>
</sec>
<sec id="s3_4">
<label>3.4</label>
<title>Informer</title>
<p>The processed data, with filtered noise and enhanced physical characteristics, is then fed into the Informer-based data-driven model. The core mechanisms of Informer used in the proposed method are outlined below.</p>
<p><bold>Model Input</bold> The output <inline-formula id="ieqn-41"><mml:math id="mml-ieqn-41"><mml:msub><mml:mi>X</mml:mi><mml:mrow><mml:mi>e</mml:mi><mml:mi>n</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:msup><mml:mi>X</mml:mi><mml:mi mathvariant="normal">&#x2032;</mml:mi></mml:msup><mml:mo>=</mml:mo><mml:mo fence="false" stretchy="false">{</mml:mo><mml:msup><mml:mi>V</mml:mi><mml:mi mathvariant="normal">&#x2032;</mml:mi></mml:msup><mml:mo>,</mml:mo><mml:mo>&#x2026;</mml:mo><mml:mo>,</mml:mo><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:msup><mml:mi>H</mml:mi><mml:mi mathvariant="normal">&#x2032;</mml:mi></mml:msup><mml:mo fence="false" stretchy="false">}</mml:mo></mml:math></inline-formula> obtained from the Particle Filter is combined with the positional encoding matrix <inline-formula id="ieqn-42"><mml:math id="mml-ieqn-42"><mml:mi>P</mml:mi><mml:mi>E</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>p</mml:mi><mml:mi>o</mml:mi><mml:mi>s</mml:mi><mml:mo>,</mml:mo><mml:mi>j</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:math></inline-formula> to create the encoder input sequence <inline-formula id="ieqn-43"><mml:math id="mml-ieqn-43"><mml:msubsup><mml:mi>X</mml:mi><mml:mrow><mml:mi>e</mml:mi><mml:mi>n</mml:mi></mml:mrow><mml:mi mathvariant="normal">&#x2032;</mml:mi></mml:msubsup></mml:math></inline-formula>:
<disp-formula id="eqn-11"><label>(11)</label><mml:math id="mml-eqn-11" display="block"><mml:msubsup><mml:mi>X</mml:mi><mml:mrow><mml:mi>e</mml:mi><mml:mi>n</mml:mi></mml:mrow><mml:mi mathvariant="normal">&#x2032;</mml:mi></mml:msubsup><mml:mo>=</mml:mo><mml:msub><mml:mi>X</mml:mi><mml:mrow><mml:mi>e</mml:mi><mml:mi>n</mml:mi></mml:mrow></mml:msub><mml:mo>+</mml:mo><mml:mi>P</mml:mi><mml:mi>E</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>p</mml:mi><mml:mi>o</mml:mi><mml:mi>s</mml:mi><mml:mo>,</mml:mo><mml:mi>j</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:math></disp-formula></p>
<p>Subsequently, <inline-formula id="ieqn-44"><mml:math id="mml-ieqn-44"><mml:msubsup><mml:mi>X</mml:mi><mml:mrow><mml:mi>e</mml:mi><mml:mi>n</mml:mi></mml:mrow><mml:mi mathvariant="normal">&#x2032;</mml:mi></mml:msubsup></mml:math></inline-formula> is passed to encoder layers and distilling processes.</p>
<p><bold>ProbSparse Self-attention</bold> The Self-attention mechanism in Informer exploits the long-tail distribution property of self-attention scores in Transformers. Instead of computing all attention scores, ProbSparse Self-attention selects only the most dominant queries, reducing computational complexity:
<disp-formula id="eqn-12"><label>(12)</label><mml:math id="mml-eqn-12" display="block"><mml:mi>A</mml:mi><mml:mi>t</mml:mi><mml:mi>t</mml:mi><mml:mi>e</mml:mi><mml:mi>n</mml:mi><mml:mi>t</mml:mi><mml:mi>i</mml:mi><mml:mi>o</mml:mi><mml:mi>n</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>Q</mml:mi><mml:mo>,</mml:mo><mml:mi>K</mml:mi><mml:mo>,</mml:mo><mml:mi>V</mml:mi><mml:mo stretchy="false">)</mml:mo><mml:mo>=</mml:mo><mml:mi>s</mml:mi><mml:mi>o</mml:mi><mml:mspace width="negativethinmathspace" /><mml:mi>f</mml:mi><mml:mspace width="negativethinmathspace" /><mml:mi>t</mml:mi><mml:mi>m</mml:mi><mml:mi>a</mml:mi><mml:mi>x</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mfrac><mml:mrow><mml:mrow><mml:mover><mml:mi>Q</mml:mi><mml:mo stretchy="false">&#x00AF;</mml:mo></mml:mover></mml:mrow><mml:msup><mml:mi>K</mml:mi><mml:mi>T</mml:mi></mml:msup></mml:mrow><mml:msqrt><mml:mi>d</mml:mi></mml:msqrt></mml:mfrac><mml:mo>)</mml:mo></mml:mrow><mml:mi>V</mml:mi></mml:math></disp-formula>where <italic>Q</italic>, <italic>K</italic> and <italic>V</italic> represent the query, key, and value matrices, respectively, and <inline-formula id="ieqn-45"><mml:math id="mml-ieqn-45"><mml:msqrt><mml:mi>d</mml:mi></mml:msqrt></mml:math></inline-formula> is scaling factor. <inline-formula id="ieqn-46"><mml:math id="mml-ieqn-46"><mml:mrow><mml:mover><mml:mi>Q</mml:mi><mml:mo stretchy="false">&#x00AF;</mml:mo></mml:mover></mml:mrow></mml:math></inline-formula> denotes a sparsified set of dominant queries. Kullback-Leibler divergence is used to distinguish important queries, and only the top <inline-formula id="ieqn-47"><mml:math id="mml-ieqn-47"><mml:mi>u</mml:mi></mml:math></inline-formula> queries are selected for <italic>Q</italic> based on sparsity measurement criteria. This enables the creation of different sparse query-key pairs for each head in the multi-head attention mechanism, preventing significant information loss.</p>
<p>Encoder input <inline-formula id="ieqn-48"><mml:math id="mml-ieqn-48"><mml:msubsup><mml:mi>X</mml:mi><mml:mrow><mml:mi>e</mml:mi><mml:mi>n</mml:mi></mml:mrow><mml:mi mathvariant="normal">&#x2032;</mml:mi></mml:msubsup></mml:math></inline-formula> is computed as:
<disp-formula id="eqn-13"><label>(13)</label><mml:math id="mml-eqn-13" display="block"><mml:mi>Q</mml:mi><mml:mo>=</mml:mo><mml:msub><mml:mi>W</mml:mi><mml:mi>Q</mml:mi></mml:msub><mml:msubsup><mml:mi>X</mml:mi><mml:mrow><mml:mi>e</mml:mi><mml:mi>n</mml:mi></mml:mrow><mml:mi mathvariant="normal">&#x2032;</mml:mi></mml:msubsup><mml:mo>,</mml:mo><mml:mi>K</mml:mi><mml:mo>=</mml:mo><mml:msub><mml:mi>W</mml:mi><mml:mi>K</mml:mi></mml:msub><mml:msubsup><mml:mi>X</mml:mi><mml:mrow><mml:mi>e</mml:mi><mml:mi>n</mml:mi></mml:mrow><mml:mi mathvariant="normal">&#x2032;</mml:mi></mml:msubsup><mml:mo>,</mml:mo><mml:mi>V</mml:mi><mml:mo>=</mml:mo><mml:msub><mml:mi>W</mml:mi><mml:mi>V</mml:mi></mml:msub><mml:msubsup><mml:mi>X</mml:mi><mml:mrow><mml:mi>e</mml:mi><mml:mi>n</mml:mi></mml:mrow><mml:mi mathvariant="normal">&#x2032;</mml:mi></mml:msubsup></mml:math></disp-formula>where <inline-formula id="ieqn-49"><mml:math id="mml-ieqn-49"><mml:msub><mml:mi>W</mml:mi><mml:mi>Q</mml:mi></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>W</mml:mi><mml:mi>K</mml:mi></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>W</mml:mi><mml:mi>V</mml:mi></mml:msub></mml:math></inline-formula> are learnable weight matrices. The output <inline-formula id="ieqn-50"><mml:math id="mml-ieqn-50"><mml:msubsup><mml:mi>X</mml:mi><mml:mrow><mml:mi>e</mml:mi><mml:mi>n</mml:mi></mml:mrow><mml:mrow><mml:mi mathvariant="normal">&#x2032;</mml:mi><mml:mi mathvariant="normal">&#x2032;</mml:mi></mml:mrow></mml:msubsup></mml:math></inline-formula> is obtained after ProbSparse Self-Attention and a feed-forward network.
<disp-formula id="eqn-14"><label>(14)</label><mml:math id="mml-eqn-14" display="block"><mml:mi>M</mml:mi><mml:mi>u</mml:mi><mml:mi>l</mml:mi><mml:mi>t</mml:mi><mml:mi>i</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mi>A</mml:mi><mml:mi>t</mml:mi><mml:mi>t</mml:mi><mml:mi>e</mml:mi><mml:mi>n</mml:mi><mml:mi>t</mml:mi><mml:mi>i</mml:mi><mml:mi>o</mml:mi><mml:mi>n</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>Q</mml:mi><mml:mo>,</mml:mo><mml:mi>K</mml:mi><mml:mo>,</mml:mo><mml:mi>V</mml:mi><mml:mo stretchy="false">)</mml:mo><mml:mo>=</mml:mo><mml:mi>C</mml:mi><mml:mi>o</mml:mi><mml:mi>n</mml:mi><mml:mi>c</mml:mi><mml:mi>a</mml:mi><mml:mi>t</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:msub><mml:mi>h</mml:mi><mml:mn>1</mml:mn></mml:msub><mml:mo>,</mml:mo><mml:mo>&#x2026;</mml:mo><mml:mo>,</mml:mo><mml:msub><mml:mi>h</mml:mi><mml:mi>H</mml:mi></mml:msub><mml:mo stretchy="false">)</mml:mo></mml:math></disp-formula>where <inline-formula id="ieqn-51"><mml:math id="mml-ieqn-51"><mml:msub><mml:mi>h</mml:mi><mml:mi>i</mml:mi></mml:msub></mml:math></inline-formula> denotes the ProbSparse self-attention operation of the <inline-formula id="ieqn-52"><mml:math id="mml-ieqn-52"><mml:mi>i</mml:mi></mml:math></inline-formula>th head.</p>
<p><bold>Encoder&#x2019;s Distilling Operation</bold> The distilling operation in the encoder filters out important information from the input sequence. It assigns higher weights to dominant features, reducing the length of the input sequence by half and decreasing spatial complexity. The distilling process propagates from the <inline-formula id="ieqn-53"><mml:math id="mml-ieqn-53"><mml:mi>j</mml:mi></mml:math></inline-formula>th to the <inline-formula id="ieqn-54"><mml:math id="mml-ieqn-54"><mml:mi>j</mml:mi><mml:mo>+</mml:mo><mml:mn>1</mml:mn></mml:math></inline-formula>th layer and is computed as follows:
<disp-formula id="eqn-15"><label>(15)</label><mml:math id="mml-eqn-15" display="block"><mml:msubsup><mml:mi>X</mml:mi><mml:mrow><mml:mi>j</mml:mi><mml:mo>+</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>t</mml:mi></mml:msubsup><mml:mo>=</mml:mo><mml:mi>M</mml:mi><mml:mi>a</mml:mi><mml:mi>x</mml:mi><mml:mi>P</mml:mi><mml:mi>o</mml:mi><mml:mi>o</mml:mi><mml:mi>l</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>E</mml:mi><mml:mi>L</mml:mi><mml:mi>U</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>C</mml:mi><mml:mi>o</mml:mi><mml:mi>n</mml:mi><mml:mi>v</mml:mi><mml:mn>1</mml:mn><mml:mi>d</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mo stretchy="false">[</mml:mo><mml:msubsup><mml:mi>X</mml:mi><mml:mi>j</mml:mi><mml:mi>t</mml:mi></mml:msubsup><mml:msub><mml:mo stretchy="false">]</mml:mo><mml:mrow><mml:mi>A</mml:mi><mml:mi>B</mml:mi></mml:mrow></mml:msub><mml:mo stretchy="false">)</mml:mo><mml:mo stretchy="false">)</mml:mo><mml:mo stretchy="false">)</mml:mo></mml:math></disp-formula>where <inline-formula id="ieqn-55"><mml:math id="mml-ieqn-55"><mml:mo stretchy="false">[</mml:mo><mml:mo>&#x22C5;</mml:mo><mml:msub><mml:mo stretchy="false">]</mml:mo><mml:mrow><mml:mi>A</mml:mi><mml:mi>B</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> includes key operations within the attention block and Multihead-ProbSparse self-attention, <inline-formula id="ieqn-56"><mml:math id="mml-ieqn-56"><mml:mi>C</mml:mi><mml:mi>o</mml:mi><mml:mi>n</mml:mi><mml:mi>v</mml:mi><mml:mn>1</mml:mn><mml:mi>d</mml:mi></mml:math></inline-formula> represents a 1D convolution operation, <italic>ELU</italic> is the activation function, and <inline-formula id="ieqn-57"><mml:math id="mml-ieqn-57"><mml:mi>M</mml:mi><mml:mi>a</mml:mi><mml:mi>x</mml:mi><mml:mi>P</mml:mi><mml:mi>o</mml:mi><mml:mi>o</mml:mi><mml:mi>l</mml:mi></mml:math></inline-formula> is a max-pooling layer with stride &#x003D; 2, which downsamples <inline-formula id="ieqn-58"><mml:math id="mml-ieqn-58"><mml:msub><mml:mi>X</mml:mi><mml:mi>t</mml:mi></mml:msub></mml:math></inline-formula> by half. This ensures that dominant features are prioritized, allowing the next layer to form a focused self-attention feature map.</p>
<p><bold>Decoder&#x2019;s Generating Structure</bold> The output is obtained using the decoder&#x2019;s generating structure, which reduces decoding time and prevents cumulative error propagation during the prediction period. The start token is a sequence of length <inline-formula id="ieqn-59"><mml:math id="mml-ieqn-59"><mml:msub><mml:mi>L</mml:mi><mml:mrow><mml:mi>t</mml:mi><mml:mi>o</mml:mi><mml:mi>k</mml:mi><mml:mi>e</mml:mi><mml:mi>n</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> selected from the input sequence. The decoder input is represented as follows:
<disp-formula id="eqn-16"><label>(16)</label><mml:math id="mml-eqn-16" display="block"><mml:msubsup><mml:mi>X</mml:mi><mml:mrow><mml:mi>d</mml:mi><mml:mi>e</mml:mi></mml:mrow><mml:mi>t</mml:mi></mml:msubsup><mml:mo>=</mml:mo><mml:mi>C</mml:mi><mml:mi>o</mml:mi><mml:mi>n</mml:mi><mml:mi>c</mml:mi><mml:mi>a</mml:mi><mml:mi>t</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:msubsup><mml:mi>X</mml:mi><mml:mrow><mml:mi>t</mml:mi><mml:mi>o</mml:mi><mml:mi>k</mml:mi><mml:mi>e</mml:mi><mml:mi>n</mml:mi></mml:mrow><mml:mi>t</mml:mi></mml:msubsup><mml:mo>,</mml:mo><mml:msubsup><mml:mi>X</mml:mi><mml:mn>0</mml:mn><mml:mi>t</mml:mi></mml:msubsup><mml:mo stretchy="false">)</mml:mo><mml:mo>&#x2208;</mml:mo><mml:msup><mml:mi>R</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:msub><mml:mi>L</mml:mi><mml:mrow><mml:mi>t</mml:mi><mml:mi>o</mml:mi><mml:mi>k</mml:mi><mml:mi>e</mml:mi><mml:mi>n</mml:mi></mml:mrow></mml:msub><mml:mo>+</mml:mo><mml:msub><mml:mi>L</mml:mi><mml:mi>y</mml:mi></mml:msub><mml:mo stretchy="false">)</mml:mo><mml:mo>&#x00D7;</mml:mo><mml:msub><mml:mi>d</mml:mi><mml:mrow><mml:mi>m</mml:mi><mml:mi>o</mml:mi><mml:mi>d</mml:mi><mml:mi>e</mml:mi><mml:mi>l</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:msup></mml:math></disp-formula>where <inline-formula id="ieqn-60"><mml:math id="mml-ieqn-60"><mml:msubsup><mml:mi>X</mml:mi><mml:mrow><mml:mi>t</mml:mi><mml:mi>o</mml:mi><mml:mi>k</mml:mi><mml:mi>e</mml:mi><mml:mi>n</mml:mi></mml:mrow><mml:mi>t</mml:mi></mml:msubsup><mml:mo>&#x2208;</mml:mo><mml:msup><mml:mi>R</mml:mi><mml:mrow><mml:msub><mml:mi>L</mml:mi><mml:mrow><mml:mi>t</mml:mi><mml:mi>o</mml:mi><mml:mi>k</mml:mi><mml:mi>e</mml:mi><mml:mi>n</mml:mi></mml:mrow></mml:msub><mml:mo>&#x00D7;</mml:mo><mml:msub><mml:mi>d</mml:mi><mml:mrow><mml:mi>m</mml:mi><mml:mi>o</mml:mi><mml:mi>d</mml:mi><mml:mi>e</mml:mi><mml:mi>l</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:msup></mml:math></inline-formula> is the start token, and <inline-formula id="ieqn-61"><mml:math id="mml-ieqn-61"><mml:msubsup><mml:mi>X</mml:mi><mml:mn>0</mml:mn><mml:mi>t</mml:mi></mml:msubsup><mml:mo>&#x2208;</mml:mo><mml:msup><mml:mi>R</mml:mi><mml:mrow><mml:msub><mml:mi>L</mml:mi><mml:mi>y</mml:mi></mml:msub><mml:mo>&#x00D7;</mml:mo><mml:msub><mml:mi>d</mml:mi><mml:mrow><mml:mi>m</mml:mi><mml:mi>o</mml:mi><mml:mi>d</mml:mi><mml:mi>e</mml:mi><mml:mi>l</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:msup></mml:math></inline-formula> is a placeholder for the target sequence, initialized with scalar values of zero. The masked multi-head attention and ProbSparse self-attention are applied, with the masked dot product set to &#x2212;1, ensuring that each position does not attend to future positions. Finally, a fully connected layer generates the final output.</p>
<p>In this study, the decoder input is defined as follows:
<disp-formula id="eqn-17"><label>(17)</label><mml:math id="mml-eqn-17" display="block"><mml:mtable columnalign="right left right left right left right left right left right left" rowspacing="3pt" columnspacing="0em 2em 0em 2em 0em 2em 0em 2em 0em 2em 0em" displaystyle="true"><mml:mtr><mml:mtd /><mml:mtd><mml:msubsup><mml:mi>X</mml:mi><mml:mrow><mml:mi>d</mml:mi><mml:mi>e</mml:mi></mml:mrow><mml:mi>t</mml:mi></mml:msubsup><mml:mo>=</mml:mo><mml:mi>C</mml:mi><mml:mi>o</mml:mi><mml:mi>n</mml:mi><mml:mi>c</mml:mi><mml:mi>a</mml:mi><mml:mi>t</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:msubsup><mml:mi>X</mml:mi><mml:mrow><mml:mi>t</mml:mi><mml:mi>o</mml:mi><mml:mi>k</mml:mi><mml:mi>e</mml:mi><mml:mi>n</mml:mi></mml:mrow><mml:mi>t</mml:mi></mml:msubsup><mml:mo>,</mml:mo><mml:msubsup><mml:mi>X</mml:mi><mml:mn>0</mml:mn><mml:mi>t</mml:mi></mml:msubsup><mml:mo stretchy="false">)</mml:mo><mml:mo>,</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<disp-formula id="eqn-18"><label>(18)</label><mml:math id="mml-eqn-18" display="block"><mml:mtable columnalign="right left right left right left right left right left right left" rowspacing="3pt" columnspacing="0em 2em 0em 2em 0em 2em 0em 2em 0em 2em 0em" displaystyle="true"><mml:mtr><mml:mtd /><mml:mtd><mml:msub><mml:mi>X</mml:mi><mml:mrow><mml:mi>t</mml:mi><mml:mi>o</mml:mi><mml:mi>k</mml:mi><mml:mi>e</mml:mi><mml:mi>n</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mrow><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>t</mml:mi><mml:mi>o</mml:mi><mml:mi>k</mml:mi><mml:mi>e</mml:mi><mml:mi>n</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:mo>&#x2026;</mml:mo><mml:mo>,</mml:mo><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:msub><mml:mi>H</mml:mi><mml:mrow><mml:mi>t</mml:mi><mml:mi>o</mml:mi><mml:mi>k</mml:mi><mml:mi>e</mml:mi><mml:mi>n</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo>,</mml:mo><mml:msub><mml:mi>X</mml:mi><mml:mn>0</mml:mn></mml:msub><mml:mo>=</mml:mo><mml:mo fence="false" stretchy="false">{</mml:mo><mml:msub><mml:mi>V</mml:mi><mml:mn>0</mml:mn></mml:msub><mml:mo>,</mml:mo><mml:mo>&#x2026;</mml:mo><mml:mo>,</mml:mo><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:msub><mml:mi>H</mml:mi><mml:mn>0</mml:mn></mml:msub><mml:mo fence="false" stretchy="false">}</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>where <inline-formula id="ieqn-62"><mml:math id="mml-ieqn-62"><mml:mo fence="false" stretchy="false">{</mml:mo><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>t</mml:mi><mml:mi>o</mml:mi><mml:mi>k</mml:mi><mml:mi>e</mml:mi><mml:mi>n</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:mo>&#x2026;</mml:mo><mml:mo>,</mml:mo><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:msub><mml:mi>H</mml:mi><mml:mrow><mml:mi>t</mml:mi><mml:mi>o</mml:mi><mml:mi>k</mml:mi><mml:mi>e</mml:mi><mml:mi>n</mml:mi></mml:mrow></mml:msub><mml:mo fence="false" stretchy="false">}</mml:mo></mml:math></inline-formula> are the label sequences for each variable, and <inline-formula id="ieqn-63"><mml:math id="mml-ieqn-63"><mml:mo fence="false" stretchy="false">{</mml:mo><mml:msub><mml:mi>V</mml:mi><mml:mn>0</mml:mn></mml:msub><mml:mo>,</mml:mo><mml:mo>&#x2026;</mml:mo><mml:mo>,</mml:mo><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:msub><mml:mi>H</mml:mi><mml:mn>0</mml:mn></mml:msub><mml:mo fence="false" stretchy="false">}</mml:mo></mml:math></inline-formula> are placeholders for each variable. Adding positional encoding <inline-formula id="ieqn-64"><mml:math id="mml-ieqn-64"><mml:mi>P</mml:mi><mml:mi>E</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>p</mml:mi><mml:mi>o</mml:mi><mml:mi>s</mml:mi><mml:mo>,</mml:mo><mml:mi>j</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:math></inline-formula>, the decoder input sequence <inline-formula id="ieqn-65"><mml:math id="mml-ieqn-65"><mml:msubsup><mml:mi>X</mml:mi><mml:mrow><mml:mi>d</mml:mi><mml:mi>e</mml:mi></mml:mrow><mml:mi mathvariant="normal">&#x2032;</mml:mi></mml:msubsup></mml:math></inline-formula> is generated as:
<disp-formula id="eqn-19"><label>(19)</label><mml:math id="mml-eqn-19" display="block"><mml:msubsup><mml:mi>X</mml:mi><mml:mrow><mml:mi>d</mml:mi><mml:mi>e</mml:mi></mml:mrow><mml:mi mathvariant="normal">&#x2032;</mml:mi></mml:msubsup><mml:mo>=</mml:mo><mml:msub><mml:mi>X</mml:mi><mml:mrow><mml:mi>d</mml:mi><mml:mi>e</mml:mi></mml:mrow></mml:msub><mml:mo>+</mml:mo><mml:mi>P</mml:mi><mml:mi>E</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>p</mml:mi><mml:mi>o</mml:mi><mml:mi>s</mml:mi><mml:mo>,</mml:mo><mml:mi>j</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:math></disp-formula></p>
<p>Subsequently, <inline-formula id="ieqn-66"><mml:math id="mml-ieqn-66"><mml:msubsup><mml:mi>X</mml:mi><mml:mrow><mml:mi>d</mml:mi><mml:mi>e</mml:mi></mml:mrow><mml:mi mathvariant="normal">&#x2032;</mml:mi></mml:msubsup></mml:math></inline-formula> is passed to the decoder layer. Unlike the encoder layer, the decoder layer applies masked multi-head ProbSparse self-attention to prevent referencing future time steps. This is defined as:
<disp-formula id="eqn-20"><label>(20)</label><mml:math id="mml-eqn-20" display="block"><mml:mi>M</mml:mi><mml:mi>u</mml:mi><mml:mi>l</mml:mi><mml:mi>t</mml:mi><mml:mi>i</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mi>A</mml:mi><mml:mi>t</mml:mi><mml:mi>t</mml:mi><mml:mi>e</mml:mi><mml:mi>n</mml:mi><mml:mi>t</mml:mi><mml:mi>i</mml:mi><mml:mi>o</mml:mi><mml:mi>n</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mover><mml:mi>Q</mml:mi><mml:mo stretchy="false">&#x007E;</mml:mo></mml:mover></mml:mrow><mml:mo>,</mml:mo><mml:mrow><mml:mover><mml:mi>K</mml:mi><mml:mo stretchy="false">&#x007E;</mml:mo></mml:mover></mml:mrow><mml:mo>,</mml:mo><mml:mrow><mml:mover><mml:mi>V</mml:mi><mml:mo stretchy="false">&#x007E;</mml:mo></mml:mover></mml:mrow><mml:mo stretchy="false">)</mml:mo><mml:mo>=</mml:mo><mml:mi>C</mml:mi><mml:mi>o</mml:mi><mml:mi>n</mml:mi><mml:mi>c</mml:mi><mml:mi>a</mml:mi><mml:mi>t</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:msub><mml:mi>h</mml:mi><mml:mn>1</mml:mn></mml:msub><mml:mo>,</mml:mo><mml:mo>&#x2026;</mml:mo><mml:mo>,</mml:mo><mml:msub><mml:mi>h</mml:mi><mml:mi>H</mml:mi></mml:msub><mml:mo stretchy="false">)</mml:mo></mml:math></disp-formula>where <inline-formula id="ieqn-67"><mml:math id="mml-ieqn-67"><mml:mrow><mml:mover><mml:mi>Q</mml:mi><mml:mo stretchy="false">&#x007E;</mml:mo></mml:mover></mml:mrow></mml:math></inline-formula> represents the masked queries, <inline-formula id="ieqn-68"><mml:math id="mml-ieqn-68"><mml:mrow><mml:mover><mml:mi>K</mml:mi><mml:mo stretchy="false">&#x007E;</mml:mo></mml:mover></mml:mrow><mml:mo>,</mml:mo><mml:mrow><mml:mover><mml:mi>V</mml:mi><mml:mo stretchy="false">&#x007E;</mml:mo></mml:mover></mml:mrow></mml:math></inline-formula> are obtained from the encoder layer, and <inline-formula id="ieqn-69"><mml:math id="mml-ieqn-69"><mml:msub><mml:mi>h</mml:mi><mml:mi>i</mml:mi></mml:msub></mml:math></inline-formula> denotes the masked ProbSparse self-attention operation of the <inline-formula id="ieqn-70"><mml:math id="mml-ieqn-70"><mml:mi>i</mml:mi></mml:math></inline-formula>-th head. The output of masked multi-head ProbSparse self-attention passes through a feed-forward network to yield the final decoder output <inline-formula id="ieqn-71"><mml:math id="mml-ieqn-71"><mml:mrow><mml:mover><mml:mi>X</mml:mi><mml:mo stretchy="false">&#x005E;</mml:mo></mml:mover></mml:mrow><mml:mo>=</mml:mo><mml:msubsup><mml:mi>X</mml:mi><mml:mrow><mml:mi>d</mml:mi><mml:mi>e</mml:mi></mml:mrow><mml:mrow><mml:mi mathvariant="normal">&#x2032;</mml:mi><mml:mi mathvariant="normal">&#x2032;</mml:mi></mml:mrow></mml:msubsup></mml:math></inline-formula>, <inline-formula id="ieqn-72"><mml:math id="mml-ieqn-72"><mml:mrow><mml:mover><mml:mi>X</mml:mi><mml:mo stretchy="false">&#x005E;</mml:mo></mml:mover></mml:mrow><mml:mo>=</mml:mo><mml:mo fence="false" stretchy="false">{</mml:mo><mml:mrow><mml:mover><mml:mi>V</mml:mi><mml:mo stretchy="false">&#x005E;</mml:mo></mml:mover></mml:mrow><mml:mo>,</mml:mo><mml:mo>&#x2026;</mml:mo><mml:mo>,</mml:mo><mml:mrow><mml:mover><mml:mrow><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:mi>H</mml:mi></mml:mrow><mml:mo stretchy="false">&#x005E;</mml:mo></mml:mover></mml:mrow><mml:mo fence="false" stretchy="false">}</mml:mo></mml:math></inline-formula>.</p>
</sec>
</sec>
<sec id="s4">
<label>4</label>
<title>Experiments</title>
<sec id="s4_1">
<label>4.1</label>
<title>Definition of SOH</title>
<p>The performance of a battery gradually deteriorates over time, potentially preventing it from fulfilling its expected operational lifespan. Therefore, monitoring the State of Health (SOH) of a battery is essential [<xref ref-type="bibr" rid="ref-40">40</xref>]. SOH is defined as the ratio of the currently available capacity to the initial capacity, serving as an indicator of battery degradation and overall health status over time:
<disp-formula id="eqn-21"><label>(21)</label><mml:math id="mml-eqn-21" display="block"><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:mi>H</mml:mi><mml:mo>=</mml:mo><mml:mfrac><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>p</mml:mi><mml:mi>r</mml:mi><mml:mi>e</mml:mi><mml:mi>s</mml:mi><mml:mi>e</mml:mi><mml:mi>n</mml:mi><mml:mi>t</mml:mi></mml:mrow></mml:msub><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>i</mml:mi><mml:mi>n</mml:mi><mml:mi>i</mml:mi><mml:mi>t</mml:mi><mml:mi>i</mml:mi><mml:mi>a</mml:mi><mml:mi>l</mml:mi></mml:mrow></mml:msub></mml:mfrac><mml:mo>&#x00D7;</mml:mo><mml:mn>100</mml:mn></mml:math></disp-formula>where <inline-formula id="ieqn-73"><mml:math id="mml-ieqn-73"><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>p</mml:mi><mml:mi>r</mml:mi><mml:mi>e</mml:mi><mml:mi>s</mml:mi><mml:mi>e</mml:mi><mml:mi>n</mml:mi><mml:mi>t</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> represents the currently available capacity, and <inline-formula id="ieqn-74"><mml:math id="mml-ieqn-74"><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>i</mml:mi><mml:mi>n</mml:mi><mml:mi>i</mml:mi><mml:mi>t</mml:mi><mml:mi>i</mml:mi><mml:mi>a</mml:mi><mml:mi>l</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> denotes the initial capacity of the battery. Typically, when SOH decreases to 80%, the battery is considered unsuitable for further use.</p>
</sec>
<sec id="s4_2">
<label>4.2</label>
<title>MIT Battery Dataset</title>
<p>The dataset used in this study is obtained from a publicly available dataset provided by MIT [<xref ref-type="bibr" rid="ref-41">41</xref>]. It consists of 124 lithium iron phosphate (LFP) battery cells, which have been cycled under 72 different operating conditions. Among them, 10 battery cells were selected for evaluation of the proposed method. The nominal capacity of these cells is 1.1 Ah, and the batteries were charged using a two-step fast-charging protocol. This charging protocol follows the format C1(Q1)-C2, where C1 and C2 are the first and second constant current (CC) charging phases, respectively, and Q1 represents the state of charge (SOC; %) at which the current transition occurs. The second current phase is terminated at 80% SOC, after which the cells are charged using a 1-C CC-CV mode. A 4-C constant current discharge is applied until the battery reaches its lower cutoff voltage. All battery tests were conducted in a temperature-controlled chamber at <inline-formula id="ieqn-75"><mml:math id="mml-ieqn-75"><mml:msup><mml:mi>30</mml:mi><mml:mrow><mml:mo>&#x2218;</mml:mo></mml:mrow></mml:msup></mml:math></inline-formula>C. The selected battery cells and their respective charging/discharging policies are shown in <xref ref-type="table" rid="table-1">Table 1</xref>.</p>
<table-wrap id="table-1">
<label>Table 1</label>
<caption>
<title>Selected battery cells and their corresponding operating conditions</title>
</caption>
<table>
<colgroup>
<col align="center"/>
<col align="center"/>
<col align="center"/> </colgroup>
<thead>
<tr>
<th>Barcode</th>
<th>Policy</th>
<th>Cycle</th>
</tr>
</thead>
<tbody>
<tr>
<td>EL150800460514</td>
<td>3.6C(80%)-3.6C</td>
<td>1190</td>
</tr>
<tr>
<td>EL150800460486</td>
<td>3.6C(80%)-3.6C</td>
<td>1179</td>
</tr>
<tr>
<td>EL150800463882</td>
<td>5.4C(50%)-3C</td>
<td>788</td>
</tr>
<tr>
<td>EL150800463838</td>
<td>5.4C(60%)-3C</td>
<td>880</td>
</tr>
<tr>
<td>EL150800453113</td>
<td>5.4C(60%)-3C</td>
<td>719</td>
</tr>
<tr>
<td>EL150800460653</td>
<td>5.4C(60%)-3.6C</td>
<td>862</td>
</tr>
<tr>
<td>EL150800460522</td>
<td>5.4C(60%)-3.6C</td>
<td>857</td>
</tr>
<tr>
<td>EL150800453240</td>
<td>5.4C(70%)-3C</td>
<td>691</td>
</tr>
<tr>
<td>EL150800464881</td>
<td>5.4C(70%)-3C</td>
<td>788</td>
</tr>
<tr>
<td>EL150800464002</td>
<td>5.4C(80%)-5.4C</td>
<td>534</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>The dataset provides detailed records of battery degradation trends over different cycles. <xref ref-type="fig" rid="fig-2">Fig. 2</xref> illustrates the aging trends of battery variables over increasing cycles. As the cycle count increases, distinct patterns can be observed across different variables. For instance, temperature-related variables tend to shift toward higher values as the cycle count increases. This indicates that, as the battery degrades, it reaches a higher surface temperature more rapidly during operation. Such trends provide valuable insights into battery dynamics and degradation mechanisms, which can be utilized for battery state estimation and predictive maintenance.</p>
<fig id="fig-2">
<label>Figure 2</label>
<caption>
<title>Aging trends according to the cycle of each variable. (<bold>a</bold>) Represents the temperature over time for each cycle, (<bold>b</bold>) shows the current over time for each cycle, (<bold>c</bold>) illustrates the voltage over time for each cycle, and (<bold>d</bold>) depicts the relationship between voltage and Qdischarge across cycles. The purple color represents earlier cycles, while the yellow color indicates later cycles</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="CMES_73030-fig-2.tif"/>
</fig>
<p><xref ref-type="fig" rid="fig-3">Fig. 3</xref> demonstrates how each battery variable evolves over cycles until the SOH reaches 80%. These observed trends highlight the progressive degradation of lithium-ion batteries, which is crucial for developing accurate SOH estimation models.</p>
<fig id="fig-3">
<label>Figure 3</label>
<caption>
<title>Trends of battery cell variables across cycles. (<bold>a</bold>) charge capacity(Qcharge), (<bold>b</bold>) discharge capacity Qdischarge), (<bold>c</bold>) internal resistance (IR), (<bold>d</bold>) mean voltage (Vmean), (<bold>e</bold>) average (Tavg), minimum (Tmin), and maximum (Tmax) temperatures, and (<bold>f</bold>) state of health (SOH)</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="CMES_73030-fig-3.tif"/>
</fig>
<p>This study analyzed data using the battery dataset provided by MIT, which includes cycle-level information on Qcharge (charge capacity), Qdischarge (discharge capacity), IR (internal resistance), Tavg (average temperature), Tmin (minimum temperature), Tmax (maximum temperature), V (mean voltage per cycle), and SOH (State of Health).</p>
</sec>
<sec id="s4_3">
<label>4.3</label>
<title>Experimental Settings</title>
<p>This study was conducted using data from 10 distinct battery cells. To ensure a rigorous evaluation of the model&#x2019;s generalization capabilities and to prevent any data leakage, we employed a 10-fold cross-validation (CV) scheme based on the battery cell IDs.</p>
<p>Specifically, in each of the 10 folds, one unique battery cell was designated as the test set, while the remaining 9 cells were used for training and validation (maintaining a 6-cell training/3-cell validation split ratio within these 9 cells). This process was repeated 10 times, ensuring that each cell served as the test set exactly once. This cell-level, leave-one-out cross-validation approach guarantees that the model is always evaluated on entirely unseen cells, fundamentally preventing data leakage and providing a robust assessment of generalization performance by capturing variance across different test cells.</p>
<p>The final performance metrics reported in <xref ref-type="sec" rid="s5_1">Section 5.1</xref> (<xref ref-type="table" rid="table-2">Table 2</xref>) represent the mean and standard deviation calculated across these 10 folds.</p>
<table-wrap id="table-2">
<label>Table 2</label>
<caption>
<title>Comparative performance evaluation (MSE, MAE, <inline-formula id="ieqn-76"><mml:math id="mml-ieqn-76"><mml:msup><mml:mi>R</mml:mi><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula>) of CIPF-Informer and baseline models across different prediction lengths, using 10-fold cross-validation. All values are reported as mean <inline-formula id="ieqn-77"><mml:math id="mml-ieqn-77"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> standard deviation across the 10 folds</title>
</caption>
<table>
<colgroup>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/> </colgroup>
<thead>
<tr>
<th>Pred Len</th>
<th>Metric</th>
<th>Transformer</th>
<th>DeepVAR</th>
<th>DLinear</th>
<th>NLinear</th>
<th>Proposed method</th>
</tr>
</thead>
<tbody>
<tr>
<td rowspan="3">16</td>
<td>MSE</td>
<td>0.149 <inline-formula id="ieqn-78"><mml:math id="mml-ieqn-78"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.030</td>
<td>0.190 <inline-formula id="ieqn-79"><mml:math id="mml-ieqn-79"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.032</td>
<td>0.449 <inline-formula id="ieqn-80"><mml:math id="mml-ieqn-80"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.141</td>
<td>0.208 <inline-formula id="ieqn-81"><mml:math id="mml-ieqn-81"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.020</td>
<td><bold>0.116 <inline-formula id="ieqn-82"><mml:math id="mml-ieqn-82"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.015</bold></td>
</tr>
<tr>
   
<td>MAE</td>
<td>0.221 <inline-formula id="ieqn-83"><mml:math id="mml-ieqn-83"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.017</td>
<td>0.261 <inline-formula id="ieqn-84"><mml:math id="mml-ieqn-84"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.023</td>
<td>0.450 <inline-formula id="ieqn-85"><mml:math id="mml-ieqn-85"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.091</td>
<td>0.262 <inline-formula id="ieqn-86"><mml:math id="mml-ieqn-86"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.013</td>
<td><bold>0.166 <inline-formula id="ieqn-87"><mml:math id="mml-ieqn-87"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.013</bold></td>
</tr>
<tr>

<td><inline-formula id="ieqn-88"><mml:math id="mml-ieqn-88"><mml:msup><mml:mi>R</mml:mi><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula></td>
<td>0.831 <inline-formula id="ieqn-89"><mml:math id="mml-ieqn-89"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.084</td>
<td>0.785 <inline-formula id="ieqn-90"><mml:math id="mml-ieqn-90"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.086</td>
<td>0.492 <inline-formula id="ieqn-91"><mml:math id="mml-ieqn-91"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.158</td>
<td>0.765 <inline-formula id="ieqn-92"><mml:math id="mml-ieqn-92"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.021</td>
<td><bold>0.856 <inline-formula id="ieqn-93"><mml:math id="mml-ieqn-93"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.016</bold></td>
</tr>
<tr>
<td rowspan="3">32</td>
<td>MSE</td>
<td>0.205 <inline-formula id="ieqn-94"><mml:math id="mml-ieqn-94"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.032</td>
<td>0.224 <inline-formula id="ieqn-95"><mml:math id="mml-ieqn-95"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.040</td>
<td>0.514 <inline-formula id="ieqn-96"><mml:math id="mml-ieqn-96"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.062</td>
<td>0.259 <inline-formula id="ieqn-97"><mml:math id="mml-ieqn-97"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.024</td>
<td><bold>0.174 <inline-formula id="ieqn-98"><mml:math id="mml-ieqn-98"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.016</bold></td>
</tr>
<tr>

<td>MAE</td>
<td>0.252 <inline-formula id="ieqn-99"><mml:math id="mml-ieqn-99"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.021</td>
<td>0.284 <inline-formula id="ieqn-100"><mml:math id="mml-ieqn-100"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.040</td>
<td>0.489 <inline-formula id="ieqn-101"><mml:math id="mml-ieqn-101"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.064</td>
<td>0.285 <inline-formula id="ieqn-102"><mml:math id="mml-ieqn-102"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.012</td>
<td><bold>0.204 <inline-formula id="ieqn-103"><mml:math id="mml-ieqn-103"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.012</bold></td>
</tr>
<tr>

<td><inline-formula id="ieqn-104"><mml:math id="mml-ieqn-104"><mml:msup><mml:mi>R</mml:mi><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula></td>
<td>0.755 <inline-formula id="ieqn-105"><mml:math id="mml-ieqn-105"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.088</td>
<td>0.731 <inline-formula id="ieqn-106"><mml:math id="mml-ieqn-106"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.044</td>
<td>0.385 <inline-formula id="ieqn-107"><mml:math id="mml-ieqn-107"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.090</td>
<td>0.690 <inline-formula id="ieqn-108"><mml:math id="mml-ieqn-108"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.028</td>
<td><bold>0.818 <inline-formula id="ieqn-109"><mml:math id="mml-ieqn-109"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.017</bold></td>
</tr>
<tr>
<td rowspan="3">64</td>
<td>MSE</td>
<td>0.286 <inline-formula id="ieqn-110"><mml:math id="mml-ieqn-110"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.034</td>
<td>0.296 <inline-formula id="ieqn-111"><mml:math id="mml-ieqn-111"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.039</td>
<td>0.592 <inline-formula id="ieqn-112"><mml:math id="mml-ieqn-112"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.086</td>
<td>0.372 <inline-formula id="ieqn-113"><mml:math id="mml-ieqn-113"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.022</td>
<td><bold>0.221 <inline-formula id="ieqn-114"><mml:math id="mml-ieqn-114"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.019</bold></td>
</tr>
<tr>

<td>MAE</td>
<td>0.314 <inline-formula id="ieqn-115"><mml:math id="mml-ieqn-115"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.026</td>
<td>0.335 <inline-formula id="ieqn-116"><mml:math id="mml-ieqn-116"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.031</td>
<td>0.534 <inline-formula id="ieqn-117"><mml:math id="mml-ieqn-117"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.056</td>
<td>0.350 <inline-formula id="ieqn-118"><mml:math id="mml-ieqn-118"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.013</td>
<td><bold>0.277 <inline-formula id="ieqn-119"><mml:math id="mml-ieqn-119"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.017</bold></td>
</tr>
<tr>

<td><inline-formula id="ieqn-120"><mml:math id="mml-ieqn-120"><mml:msup><mml:mi>R</mml:mi><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula></td>
<td>0.622 <inline-formula id="ieqn-121"><mml:math id="mml-ieqn-121"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.090</td>
<td>0.610 <inline-formula id="ieqn-122"><mml:math id="mml-ieqn-122"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.045</td>
<td>0.218 <inline-formula id="ieqn-123"><mml:math id="mml-ieqn-123"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.098</td>
<td>0.508 <inline-formula id="ieqn-124"><mml:math id="mml-ieqn-124"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.026</td>
<td><bold>0.709 <inline-formula id="ieqn-125"><mml:math id="mml-ieqn-125"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula> 0.021</bold></td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="table-2fn1" fn-type="other">
<p>Note: Bold values indicate the best performance for each metric and prediction length.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<p>To validate the effectiveness of the proposed method, we selected Transformer, DeepVAR, DLinear, and NLinear as benchmark models. All models were trained and evaluated under the same experimental settings, including the 10-fold CV procedure, to ensure a fair comparison.</p>
<sec id="s4_3_1">
<label>4.3.1</label>
<title>Model Parameter Settings</title>
<p>To optimize the performance of the proposed method, we experimented with various hyperparameter settings and adopted the following final configuration: input length &#x003D; 20, predict length &#x003D; <inline-formula id="ieqn-126"><mml:math id="mml-ieqn-126"><mml:mo fence="false" stretchy="false">{</mml:mo><mml:mn>16</mml:mn><mml:mo>,</mml:mo><mml:mn>32</mml:mn><mml:mo>,</mml:mo><mml:mn>64</mml:mn><mml:mo fence="false" stretchy="false">}</mml:mo></mml:math></inline-formula>, dimension of model <inline-formula id="ieqn-127"><mml:math id="mml-ieqn-127"><mml:msub><mml:mi>d</mml:mi><mml:mrow><mml:mi>m</mml:mi><mml:mi>o</mml:mi><mml:mi>d</mml:mi><mml:mi>e</mml:mi><mml:mi>l</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> &#x003D; 128, number of heads &#x003D; 5, number of encoder layers &#x003D; 2, number of decoder layers &#x003D; 1, dimension of feed-forward network: 2048.</p>
</sec>
<sec id="s4_3_2">
<label>4.3.2</label>
<title>Training Parameter Settings</title>
<p>All models were trained using the same training settings to ensure a fair comparison. Additionally, hyperparameter values were fixed to maintain experimental reproducibility. The training settings are as follows: dropout rate &#x003D; 0.05, batch size &#x003D; 50, epoch &#x003D; 100, optimizer &#x003D; Adam, learning rate &#x003D; 0.0001, early stop &#x003D; 3.</p>
</sec>
<sec id="s4_3_3">
<label>4.3.3</label>
<title>Evaluation Metrics</title>
<p>To quantitatively evaluate the predictive performance of the proposed method, we used three commonly employed evaluation metrics: Mean Squared Error (MSE), Mean Absolute Error (MAE), and Coefficient of Determination (<inline-formula id="ieqn-128"><mml:math id="mml-ieqn-128"><mml:msup><mml:mi>R</mml:mi><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula>). These metrics are defined as follows:
<disp-formula id="eqn-22"><label>(22)</label><mml:math id="mml-eqn-22" display="block"><mml:mtable columnalign="right left right left right left right left right left right left" rowspacing="3pt" columnspacing="0em 2em 0em 2em 0em 2em 0em 2em 0em 2em 0em" displaystyle="true"><mml:mtr><mml:mtd /><mml:mtd><mml:mi>M</mml:mi><mml:mi>S</mml:mi><mml:mi>E</mml:mi><mml:mo>=</mml:mo><mml:mfrac><mml:mn>1</mml:mn><mml:mi>n</mml:mi></mml:mfrac><mml:munderover><mml:mo movablelimits="false">&#x2211;</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>n</mml:mi></mml:munderover><mml:mo stretchy="false">(</mml:mo><mml:mi>y</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mrow><mml:mover><mml:mi>y</mml:mi><mml:mo stretchy="false">&#x005E;</mml:mo></mml:mover></mml:mrow><mml:msup><mml:mo stretchy="false">)</mml:mo><mml:mn>2</mml:mn></mml:msup></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<disp-formula id="eqn-23"><label>(23)</label><mml:math id="mml-eqn-23" display="block"><mml:mtable columnalign="right left right left right left right left right left right left" rowspacing="3pt" columnspacing="0em 2em 0em 2em 0em 2em 0em 2em 0em 2em 0em" displaystyle="true"><mml:mtr><mml:mtd /><mml:mtd><mml:mi>M</mml:mi><mml:mi>A</mml:mi><mml:mi>E</mml:mi><mml:mo>=</mml:mo><mml:mfrac><mml:mn>1</mml:mn><mml:mi>n</mml:mi></mml:mfrac><mml:munderover><mml:mo movablelimits="false">&#x2211;</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>n</mml:mi></mml:munderover><mml:mrow><mml:mo stretchy="false">|</mml:mo></mml:mrow><mml:mi>y</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mrow><mml:mover><mml:mi>y</mml:mi><mml:mo stretchy="false">&#x005E;</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mo stretchy="false">|</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<disp-formula id="eqn-24"><label>(24)</label><mml:math id="mml-eqn-24" display="block"><mml:mtable columnalign="right left right left right left right left right left right left" rowspacing="3pt" columnspacing="0em 2em 0em 2em 0em 2em 0em 2em 0em 2em 0em" displaystyle="true"><mml:mtr><mml:mtd /><mml:mtd><mml:msup><mml:mi>R</mml:mi><mml:mn>2</mml:mn></mml:msup><mml:mo>=</mml:mo><mml:mn>1</mml:mn><mml:mo>&#x2212;</mml:mo><mml:mfrac><mml:mrow><mml:mpadded width="0" height="8.6pt" depth="3pt"><mml:mrow /></mml:mpadded><mml:mstyle displaystyle="false" scriptlevel="0"><mml:mrow><mml:msubsup><mml:mo movablelimits="false">&#x2211;</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>n</mml:mi></mml:msubsup><mml:mo stretchy="false">(</mml:mo><mml:mi>y</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mrow><mml:mover><mml:mi>y</mml:mi><mml:mo stretchy="false">&#x005E;</mml:mo></mml:mover></mml:mrow><mml:msup><mml:mo stretchy="false">)</mml:mo><mml:mn>2</mml:mn></mml:msup></mml:mrow></mml:mstyle></mml:mrow><mml:mrow><mml:mpadded width="0" height="8.6pt" depth="3pt"><mml:mrow /></mml:mpadded><mml:mstyle displaystyle="false" scriptlevel="0"><mml:mrow><mml:msubsup><mml:mo movablelimits="false">&#x2211;</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>n</mml:mi></mml:msubsup><mml:mo stretchy="false">(</mml:mo><mml:mi>y</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mrow><mml:mover><mml:mi>y</mml:mi><mml:mo stretchy="false">&#x00AF;</mml:mo></mml:mover></mml:mrow><mml:msup><mml:mo stretchy="false">)</mml:mo><mml:mn>2</mml:mn></mml:msup></mml:mrow></mml:mstyle></mml:mrow></mml:mfrac></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula></p>
<p>Based on these settings, we compared the performance of the proposed method with benchmark models. The experimental results demonstrate the superiority of the proposed method in battery state estimation.</p>
</sec>
</sec>
</sec>
<sec id="s5">
<label>5</label>
<title>Results</title>
<sec id="s5_1">
<label>5.1</label>
<title>Comparison of Overall and Variable-Specific Performance of the Proposed Method and Baselines</title>
<p>To evaluate the performance of the proposed CIPF-Informer model, we compared it with state-of-the-art models (Transformer, DeepVAR, DLinear, NLinear) across various prediction lengths (16, 32, 64). As detailed in <xref ref-type="sec" rid="s4_3">Section 4.3</xref>, we employed a 10-fold cross-validation scheme to ensure a robust evaluation. The results, summarized in <xref ref-type="table" rid="table-2">Table 2</xref>, represent the mean and standard deviation (<inline-formula id="ieqn-129"><mml:math id="mml-ieqn-129"><mml:mi>&#x03BC;</mml:mi><mml:mo>&#x00B1;</mml:mo><mml:mi>&#x03C3;</mml:mi></mml:math></inline-formula>) across the 10 folds.</p>

<p>As shown in <xref ref-type="table" rid="table-2">Table 2</xref>, the proposed model, CIPF-Informer, consistently achieved the lowest mean MSE and MAE values and the highest mean <inline-formula id="ieqn-130"><mml:math id="mml-ieqn-130"><mml:msup><mml:mtext>R</mml:mtext><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula> scores across all prediction lengths. For a prediction length of 16, the proposed model achieved a mean MSE of 0.116, which represents a significant improvement of 22.1%, 38.9%, 74.2%, and 44.2% compared to the mean MSE of Transformer (0.149), DeepVAR (0.190), DLinear (0.449), and NLinear (0.208), respectively. Similarly, for the longest prediction horizon of 64, its mean MSE of 0.221 represents improvements of 22.7%, 25.3%, 62.7%, and 40.6% over Transformer (0.286), DeepVAR (0.296), DLinear (0.592), and NLinear (0.372), respectively.</p>

<p><xref ref-type="fig" rid="fig-4">Fig. 4</xref> presents a plot illustrating the performance of the proposed method for each variable.</p>
<fig id="fig-4">
<label>Figure 4</label>
<caption>
<title>Variable-specific prediction performance of the proposed method. The <italic>x</italic>-axis of the graph represents cycles, while the <italic>y</italic>-axis represents various variables. The blue line represents the actual values of the variable, while the red line represents the predicted values. (<bold>a</bold>) Charge capacity (Qcharge), (<bold>b</bold>) discharge capacity (Qdischarge), (<bold>c</bold>) internal resistance (IR), (<bold>d</bold>) average temperature (Tavg), (<bold>e</bold>) minimum temperature (Tmin), (<bold>f</bold>) maximum temperature (Tmax), (<bold>g</bold>) mean Voltage (Vmean), (<bold>h</bold>) state of health (SOH)</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="CMES_73030-fig-4a.tif"/>
<graphic mimetype="image" mime-subtype="tif" xlink:href="CMES_73030-fig-4b.tif"/>
</fig>
<p><xref ref-type="table" rid="table-3">Table 3</xref> and <xref ref-type="fig" rid="fig-5">Fig. 5</xref> present the variable-specific prediction performance of the proposed method compared to state-of-the-art baselines (Transformer, DeepVAR, DLinear, and NLinear) under a prediction length of 16.</p>
<table-wrap id="table-3">
<label>Table 3</label>
<caption>
<title>Variable-specific performance comparison between the proposed method and baseline models</title>
</caption>
<table>
<colgroup>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/> </colgroup>
<thead>
<tr>
<th></th>
<th colspan="3">Transformer</th>
<th colspan="3">DeepVAR</th>
<th colspan="3">DLinear</th>
<th colspan="3">NLinear</th>
<th colspan="3">Proposed method</th>
</tr>
<tr>
<th align="center">Variables</th>
<th>MSE</th>
<th>MAE</th>
<th><inline-formula id="ieqn-131"><mml:math id="mml-ieqn-131"><mml:msup><mml:mi>R</mml:mi><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula></th>
<th>MSE</th>
<th>MAE</th>
<th><inline-formula id="ieqn-132"><mml:math id="mml-ieqn-132"><mml:msup><mml:mi>R</mml:mi><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula></th>
<th>MSE</th>
<th>MAE</th>
<th><inline-formula id="ieqn-133"><mml:math id="mml-ieqn-133"><mml:msup><mml:mi>R</mml:mi><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula></th>
<th>MSE</th>
<th>MAE</th>
<th><inline-formula id="ieqn-134"><mml:math id="mml-ieqn-134"><mml:msup><mml:mi>R</mml:mi><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula></th>
<th>MSE</th>
<th>MAE</th>
<th><inline-formula id="ieqn-135"><mml:math id="mml-ieqn-135"><mml:msup><mml:mi>R</mml:mi><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula></th>
</tr>
</thead>
<tbody>
<tr>
<td>QDischarge</td>
<td>0.043</td>
<td>0.126</td>
<td>0.954</td>
<td>0.091</td>
<td>0.146</td>
<td>0.901</td>
<td>0.339</td>
<td>0.378</td>
<td>0.633</td>
<td>0.017</td>
<td>0.096</td>
<td><bold>0.981</bold></td>
<td><bold>0.017</bold></td>
<td><bold>0.082</bold></td>
<td>0.977</td>
</tr>
<tr>
<td>QCharge</td>
<td>0.075</td>
<td>0.116</td>
<td>0.918</td>
<td>0.139</td>
<td>0.148</td>
<td>0.850</td>
<td>0.339</td>
<td>0.377</td>
<td>0.633</td>
<td>0.018</td>
<td>0.096</td>
<td>0.981</td>
<td><bold>0.010</bold></td>
<td><bold>0.061</bold></td>
<td><bold>0.981</bold></td>
</tr>
<tr>
<td>IR</td>
<td>0.082</td>
<td>0.188</td>
<td>0.778</td>
<td>0.139</td>
<td>0.234</td>
<td>0.624</td>
<td>0.295</td>
<td>0.314</td>
<td>0.200</td>
<td>0.192</td>
<td>0.227</td>
<td>0.479</td>
<td><bold>0.079</bold></td>
<td><bold>0.165</bold></td>
<td><bold>0.784</bold></td>
</tr>
<tr>
<td>Tavg</td>
<td>0.386</td>
<td>0.414</td>
<td>0.614</td>
<td>0.379</td>
<td>0.396</td>
<td>0.623</td>
<td>0.584</td>
<td>0.533</td>
<td>0.417</td>
<td>0.414</td>
<td>0.405</td>
<td>0.587</td>
<td><bold>0.277</bold></td>
<td><bold>0.281</bold></td>
<td><bold>0.738</bold></td>
</tr>
<tr>
<td>Tmin</td>
<td>0.453</td>
<td>0.446</td>
<td>0.557</td>
<td>0.438</td>
<td>0.453</td>
<td>0.572</td>
<td>0.647</td>
<td>0.561</td>
<td>0.367</td>
<td>0.506</td>
<td>0.444</td>
<td>0.505</td>
<td><bold>0.335</bold></td>
<td><bold>0.316</bold></td>
<td><bold>0.703</bold></td>
</tr>
<tr>
<td>Tmax</td>
<td>0.266</td>
<td>0.329</td>
<td>0.717</td>
<td>0.341</td>
<td>0.374</td>
<td>0.637</td>
<td>0.474</td>
<td>0.475</td>
<td>0.496</td>
<td>0.278</td>
<td>0.339</td>
<td>0.704</td>
<td><bold>0.163</bold></td>
<td><bold>0.221</bold></td>
<td><bold>0.795</bold></td>
</tr>
<tr>
<td>V</td>
<td>0.219</td>
<td>0.333</td>
<td>0.773</td>
<td>0.321</td>
<td>0.406</td>
<td>0.668</td>
<td>0.467</td>
<td>0.469</td>
<td>0.517</td>
<td>0.154</td>
<td>0.304</td>
<td>0.841</td>
<td><bold>0.028</bold></td>
<td><bold>0.128</bold></td>
<td><bold>0.892</bold></td>
</tr>
<tr>
<td>SOH</td>
<td>0.037</td>
<td>0.120</td>
<td>0.960</td>
<td>0.096</td>
<td>0.146</td>
<td>0.896</td>
<td>0.339</td>
<td>0.378</td>
<td>0.633</td>
<td>0.018</td>
<td>0.096</td>
<td><bold>0.981</bold></td>
<td><bold>0.018</bold></td>
<td><bold>0.077</bold></td>
<td>0.976</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="table-3fn1">
<p>Note: Bold values indicate the best result for each variable across models.</p>
</fn>
</table-wrap-foot>
</table-wrap><fig id="fig-5">
<label>Figure 5</label>
<caption>
<title>Comparison of variable-wise prediction results (QCharge, QDischarge, IR, Tavg, etc.) across CIPF-Informer and baseline models. The <italic>x</italic>-axis of the graph represents cycles, while the <italic>y</italic>-axis represents various variables. The colors represent different models: true values are shown in blue, CIPF-Informer in red, Transformer in purple, DLinear in orange, NLinear in light green, and DeepVAR in bright sky blue. (<bold>a</bold>) Charge capacity (Qcharge), (<bold>b</bold>) discharge capacity (Qdischarge), (<bold>c</bold>) internal resistance (IR), (<bold>d</bold>) average temperature (Tavg), (<bold>e</bold>) minimum temperature (Tmin), (<bold>f</bold>) maximum temperature (Tmax), (<bold>g</bold>) mean Voltage (Vmean), (<bold>h</bold>) state of health (SOH)</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="CMES_73030-fig-5.tif"/>
</fig>
<p>The evaluation metrics used are MSE, MAE, and <inline-formula id="ieqn-136"><mml:math id="mml-ieqn-136"><mml:msup><mml:mtext>R</mml:mtext><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula>, and the analysis is conducted across eight key variables: QDischarge, QCharge, IR, Tavg, Tmin, Tmax, V, and SOH. As shown in the table, the proposed method consistently outperforms the baseline models across all variables and evaluation metrics. For instance, in the QCharge variable, the proposed model achieves an MSE of 0.010, which represents improvements of 86.7%, 92.8%, 97.1%, and 44.4% compared to Transformer (0.075), DeepVAR (0.139), DLinear (0.339), and NLinear (0.018), respectively. Similarly, for the Tmax variable, CIPF-Informer achieves an MSE of 0.163, outperforming Transformer (0.266) and DLinear (0.474) by 38.7% and 65.6%, respectively, highlighting the model&#x2019;s superior capability in temperature-related predictions. In the SOH and QDischarge variables, the proposed model achieves performance comparable to NLinear in terms of MSE, but still shows more than 50% improvement compared to Transformer, DeepVAR, and DLinear. Overall, the proposed model demonstrates MSE-based performance gains ranging from 3.7% to 97.1% across all variables, clearly validating the robustness and efficiency of CIPF-Informer in multivariate battery state prediction tasks.</p>
<p>To formally validate the statistical significance of these improvements, we conducted a series of paired <italic>t</italic>-tests on the 10 averaged fold results (one for each fold) for the MSE metric. The Bonferroni correction was applied to account for multiple comparisons, setting the significance level at <inline-formula id="ieqn-137"><mml:math id="mml-ieqn-137"><mml:mi>&#x03B1;</mml:mi><mml:mo>=</mml:mo><mml:mn>0.0125</mml:mn></mml:math></inline-formula> (0.05/4). For the prediction length of 16, the results confirmed that the CIPF-Informer is statistically superior to all four baseline models, with all <italic>p</italic>-values falling well below the adjusted significance level (all <italic>p</italic> &#x003C; 0.0125). The specific <italic>p</italic>-values for each comparison are summarized in <xref ref-type="table" rid="table-4">Table 4</xref>.</p>
<table-wrap id="table-4">
<label>Table 4</label>
<caption>
<title><italic>p</italic>-values from paired <italic>t</italic>-tests on MSE comparing CIPF-Informer against baseline models across different prediction lengths, using the results from 10-fold cross-validation (Bonferroni correction <inline-formula id="ieqn-138"><mml:math id="mml-ieqn-138"><mml:mi>&#x03B1;</mml:mi><mml:mo>=</mml:mo><mml:mn>0.0125</mml:mn></mml:math></inline-formula>). All <italic>p</italic>-values are below the significance level, indicating statistical superiority of CIPF-Informer</title>
</caption>
<table>
<colgroup>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/> </colgroup>
<thead>
<tr>
<th>Prediction length</th>
<th>vs. Transformer</th>
<th>vs. DeepVAR</th>
<th>vs. DLinear</th>
<th>vs. NLinear</th>
</tr>
</thead>
<tbody>
<tr>
<td>16</td>
<td>0.0049</td>
<td>0.0004</td>
<td>0.0026</td>
<td>&#x003C;0.0001</td>
</tr>
<tr>
<td>32</td>
<td>0.0067</td>
<td>0.0010</td>
<td>&#x003C;0.0001</td>
<td>0.0002</td>
</tr>
<tr>
<td>64</td>
<td>&#x003C;0.0001</td>
<td>&#x003C;0.0001</td>
<td>&#x003C;0.0001</td>
<td>&#x003C;0.0001</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>These results, supported by statistical significance testing, demonstrate that CIPF-Informer robustly outperforms all baseline models across all prediction horizons. In particular, the model maintains stable and superior performance in long-term forecasting, demonstrating its effectiveness with significantly less performance degradation compared to existing methods.</p>
</sec>
<sec id="s5_2">
<label>5.2</label>
<title>Ablation Study</title>
<sec id="s5_2_1">
<label>5.2.1</label>
<title>Channel Independence and Particle Filter</title>
<p>To assess the contributions of Channel Independence (CI) and Particle Filter (PF) to the proposed method, an ablation study was conducted. <xref ref-type="table" rid="table-5">Table 5</xref> and <xref ref-type="fig" rid="fig-6">Fig. 6</xref> present the performance of the base Informer model, CI-Informer, PF-Informer, and the proposed method.</p>
<table-wrap id="table-5">
<label>Table 5</label>
<caption>
<title>Ablation study of the channel independence and particle filter (CI, PF)</title>
</caption>
<table>
<colgroup>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/> </colgroup>
<thead>
<tr>
<th></th>
<th></th>
<th colspan="3">Informer</th>
<th colspan="3">CI-Informer</th>
<th colspan="3">PF-Informer</th>
<th colspan="3">Proposed method</th>
</tr>
<tr>
<th colspan="2">Metrics</th>
<th>MSE</th>
<th>MAE</th>
<th><inline-formula id="ieqn-139"><mml:math id="mml-ieqn-139"><mml:msup><mml:mi>R</mml:mi><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula></th>
<th>MSE</th>
<th>MAE</th>
<th><inline-formula id="ieqn-140"><mml:math id="mml-ieqn-140"><mml:msup><mml:mi>R</mml:mi><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula></th>
<th>MSE</th>
<th>MAE</th>
<th><inline-formula id="ieqn-141"><mml:math id="mml-ieqn-141"><mml:msup><mml:mi>R</mml:mi><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula></th>
<th>MSE</th>
<th>MAE</th>
<th><inline-formula id="ieqn-142"><mml:math id="mml-ieqn-142"><mml:msup><mml:mi>R</mml:mi><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula></th>
</tr>
</thead>
<tbody>
<tr>
<td align="center" rowspan="3"><bold>pred len</bold></td>
<td>16</td>
<td>0.338</td>
<td>0.354</td>
<td>0.651</td>
<td>0.232</td>
<td>0.205</td>
<td>0.760</td>
<td>0.138</td>
<td>0.208</td>
<td>0.844</td>
<td><bold>0.116</bold></td>
<td><bold>0.166</bold></td>
<td><bold>0.856</bold></td>
</tr>
<tr>

<td>32</td>
<td>0.431</td>
<td>0.414</td>
<td>0.550</td>
<td>0.305</td>
<td>0.251</td>
<td>0.681</td>
<td>0.199</td>
<td>0.250</td>
<td>0.767</td>
<td><bold>0.174</bold></td>
<td><bold>0.204</bold></td>
<td><bold>0.818</bold></td>
</tr>
<tr>

<td>64</td>
<td>0.568</td>
<td>0.505</td>
<td>0.400</td>
<td>0.413</td>
<td>0.314</td>
<td>0.564</td>
<td>0.252</td>
<td>0.324</td>
<td><bold>0.711</bold></td>
<td><bold>0.221</bold></td>
<td><bold>0.227</bold></td>
<td>0.709</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="table-5fn1" fn-type="other">
<p>Note: Bold values indicate the best result for each prediction length across models.</p>
</fn>
</table-wrap-foot>
</table-wrap><fig id="fig-6">
<label>Figure 6</label>
<caption>
<title>Variable-wise prediction results from the ablation study, comparing four model configurations against the ground truth. The <italic>x</italic>-axis represents cycles, and the <italic>y</italic>-axis represents various variables. The colors represent different models: true values are shown in blue, the final CIPF-Informer in red, the baseline Informer in sky blue, CI-Informer in orange, and PF-Informer in light green. (<bold>a</bold>) Charge capacity (Qcharge), (<bold>b</bold>) discharge capacity (Qdischarge), (<bold>c</bold>) internal resistance (IR), (<bold>d</bold>) average temperature (Tavg), (<bold>e</bold>) minimum temperature (Tmin), (<bold>f</bold>) maximum temperature (Tmax), (<bold>g</bold>) mean Voltage (Vmean), (<bold>h</bold>) state of health (SOH)</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="CMES_73030-fig-6.tif"/>
</fig>
<p><list list-type="simple">
<list-item><label>1.</label><p><bold>Base Model:</bold> Informer</p></list-item>
<list-item><label>2.</label><p><bold>CI-Informer:</bold> Informer with Channel Independence</p></list-item>
<list-item><label>3.</label><p><bold>PF-Informer:</bold> Informer with Particle Filter</p></list-item>
<list-item><label>4.</label><p><bold>Proposed Method:</bold> Informer with both Channel Independence and Particle Filter</p></list-item>
</list></p>
<p><bold>Effect of Channel Independence:</bold> The CI-Informer, which incorporates channel independence, demonstrates an overall improvement compared to the baseline model across all forecast horizons. For instance, when the forecast length is 16, the MSE decreases from 0.338 to 0.232 (31.4% reduction), and the <inline-formula id="ieqn-143"><mml:math id="mml-ieqn-143"><mml:msup><mml:mtext>R</mml:mtext><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula> value improves from 0.651 to 0.760 (16.7% increase). Similarly, for a forecast length of 64, the MSE decreases from 0.568 to 0.413 (27.3% reduction), and the <inline-formula id="ieqn-144"><mml:math id="mml-ieqn-144"><mml:msup><mml:mtext>R</mml:mtext><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula> value improves from 0.400 to 0.564 (41.0% increase). These results suggest that channel independence enhances the prediction performance by reinforcing the independence of variables across different channels.</p>
<p><bold>Effect of Particle Filter:</bold> The PF-Informer, which integrates a particle filter, shows significant improvements, particularly in longer forecast horizons. For example, at a forecast length of 64, the MSE decreases from 0.568 to <bold>0.252 (55.6% reduction)</bold>, and the <inline-formula id="ieqn-145"><mml:math id="mml-ieqn-145"><mml:msup><mml:mtext>R</mml:mtext><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula> value improves from 0.400 to <bold>0.711 (77.8% increase)</bold>. These results confirm that the Particle Filter enhances prediction stability and ensures robust performance, particularly in long-term time-series forecasting.</p>
<p><bold>Superiority of the Proposed Method:</bold> By combining CI and PF, the proposed CIPF-Informer achieves the best performance in most cases. At prediction length 16, it records an MSE of 0.116, reducing error by 50.0% and 15.9% compared to CI-Informer and PF-Informer, respectively. Its <inline-formula id="ieqn-146"><mml:math id="mml-ieqn-146"><mml:msup><mml:mtext>R</mml:mtext><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula> score of <bold>0.856</bold> is <bold>12.6%</bold> and <bold>1.4%</bold> higher than those models. Even at prediction length 64, CIPF-Informer maintains strong performance with MSE 0.221 and MAE 0.227. While its <inline-formula id="ieqn-147"><mml:math id="mml-ieqn-147"><mml:msup><mml:mi>R</mml:mi><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula> of 0.709 is marginally lower than PF-Informer&#x2019;s 0.711, it still significantly outperforms the baseline and CI-Informer. This overall performance highlights CIPF-Informer&#x2019;s balanced and reliable prediction capability.</p>
<p>In summary, ablation studies verify that both CI and PF components significantly contribute to performance gains, and their integration is essential for maximizing accuracy. CIPF-Informer demonstrates robust and consistent forecasting, making it a powerful tool for battery state prediction and intelligent BMS deployment.</p>
</sec>
<sec id="s5_2_2">
<label>5.2.2</label>
<title>Univariate vs. Multivariate</title>
<p><xref ref-type="table" rid="table-6">Table 6</xref> presents a comparative analysis of SOH prediction performance between existing univariate approaches and the proposed multivariate method.</p>
<table-wrap id="table-6">
<label>Table 6</label>
<caption>
<title>Comparison of SOH performance between univariate forecasting and the proposed method</title>
</caption>
<table>
<colgroup>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/> </colgroup>
<thead>
<tr>
<th></th>
<th></th>
<th colspan="3">Univariate</th>
<th colspan="3">Proposed method</th>
</tr>
<tr>
<th colspan="2">Metrics</th>
<th>MSE</th>
<th>MAE</th>
<th><inline-formula id="ieqn-148"><mml:math id="mml-ieqn-148"><mml:msup><mml:mi>R</mml:mi><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula></th>
<th>MSE</th>
<th>MAE</th>
<th><inline-formula id="ieqn-149"><mml:math id="mml-ieqn-149"><mml:msup><mml:mi>R</mml:mi><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula></th>
</tr>
</thead>
<tbody>
<tr>
<td align="center" rowspan="3"><bold>pred len</bold></td>
<td>16</td>
<td>0.116</td>
<td>0.152</td>
<td>0.870</td>
<td><bold>0.041</bold></td>
<td><bold>0.089</bold></td>
<td><bold>0.969</bold></td>
</tr>
<tr>

<td>32</td>
<td>0.163</td>
<td>0.182</td>
<td>0.810</td>
<td><bold>0.106</bold></td>
<td><bold>0.151</bold></td>
<td><bold>0.910</bold></td>
</tr>
<tr>

<td>64</td>
<td>0.261</td>
<td>0.255</td>
<td>0.680</td>
<td><bold>0.130</bold></td>
<td><bold>0.155</bold></td>
<td><bold>0.867</bold></td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="table-6fn1" fn-type="other">
<p>Note: Bold values indicate the best result for each prediction length across models.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<p>Conventional studies typically predict SOH as a single target variable using features such as current, voltage, and temperature. In contrast, the proposed method utilizes the same input variables to predict not only SOH but also all relevant state variables. This enables a direct and fair comparison of SOH prediction accuracy under equivalent input conditions. According to <xref ref-type="table" rid="table-6">Table 6</xref>, the proposed method consistently achieved the lowest MSE and MAE across all prediction lengths, while also exhibiting higher <inline-formula id="ieqn-150"><mml:math id="mml-ieqn-150"><mml:msup><mml:mtext>R</mml:mtext><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula> scores in every case. For a prediction length of 16, the MSE of the proposed method (0.041) decreased by 64.7% compared to the univariate baseline (0.116), with the <inline-formula id="ieqn-151"><mml:math id="mml-ieqn-151"><mml:msup><mml:mtext>R</mml:mtext><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula> improving from 0.870 to 0.969. Even in longer-term forecasting, the proposed model outperformed existing methods: for a prediction length of 32, the MSE decreased from 0.163 to 0.106 (a 34.9% reduction), while the <inline-formula id="ieqn-152"><mml:math id="mml-ieqn-152"><mml:msup><mml:mtext>R</mml:mtext><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula> increased from 0.810 to 0.910. Similarly, at a prediction length of 64, the proposed method achieved an MSE of 0.130&#x2013;50.2% lower than the univariate method (0.261)&#x2014;and an <inline-formula id="ieqn-153"><mml:math id="mml-ieqn-153"><mml:msup><mml:mtext>R</mml:mtext><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula> improvement from 0.680 to 0.867. These results demonstrate that the proposed approach provides significantly higher predictive accuracy than traditional SOH prediction methods, maintaining robust and reliable performance even in long-term forecasting. Moreover, by extending beyond simple univariate prediction to a comprehensive multivariate prediction framework, the proposed model enables holistic analysis of battery state variables, enhancing its applicability for digital twin-based battery management systems.</p>

</sec>
<sec id="s5_2_3">
<label>5.2.3</label>
<title>Predict Length</title>
<p><xref ref-type="table" rid="table-7">Table 7</xref> presents a comparison of the predictive performance of the proposed method for different forecast lengths across various variables.</p>
<table-wrap id="table-7">
<label>Table 7</label>
<caption>
<title>Performance comparison of the proposed method for different prediction lengths across variables</title>
</caption>
<table>
<colgroup>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/> </colgroup>
<thead>
<tr>
<th align="center">Pred len</th>
<th colspan="3">16</th>
<th colspan="3">32</th>
<th colspan="3">64</th>
</tr>
<tr>
<th>Variables</th>
<th>MSE</th>
<th>MAE</th>
<th><inline-formula id="ieqn-154"><mml:math id="mml-ieqn-154"><mml:msup><mml:mi>R</mml:mi><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula></th>
<th>MSE</th>
<th>MAE</th>
<th><inline-formula id="ieqn-155"><mml:math id="mml-ieqn-155"><mml:msup><mml:mi>R</mml:mi><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula></th>
<th>MSE</th>
<th>MAE</th>
<th><inline-formula id="ieqn-156"><mml:math id="mml-ieqn-156"><mml:msup><mml:mi>R</mml:mi><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula></th>
</tr>
</thead>
<tbody>
<tr>
<td>QDischarge</td>
<td>0.017</td>
<td>0.082</td>
<td>0.977</td>
<td>0.017</td>
<td>0.088</td>
<td>0.975</td>
<td>0.013</td>
<td>0.093</td>
<td>0.978</td>
</tr>
<tr>
<td>QCharge</td>
<td>0.010</td>
<td>0.061</td>
<td>0.981</td>
<td>0.033</td>
<td>0.132</td>
<td>0.930</td>
<td>0.015</td>
<td>0.086</td>
<td>0.962</td>
</tr>
<tr>
<td>IR</td>
<td>0.079</td>
<td>0.165</td>
<td>0.784</td>
<td>0.088</td>
<td>0.209</td>
<td>0.717</td>
<td>0.088</td>
<td>0.222</td>
<td>0.670</td>
</tr>
<tr>
<td>Tavg</td>
<td>0.277</td>
<td>0.281</td>
<td>0.784</td>
<td>0.495</td>
<td>0.428</td>
<td>0.531</td>
<td>0.553</td>
<td>0.503</td>
<td>0.473</td>
</tr>
<tr>
<td>Tmin</td>
<td>0.335</td>
<td>0.316</td>
<td>0.703</td>
<td>0.600</td>
<td>0.493</td>
<td>0.471</td>
<td>0.698</td>
<td>0.596</td>
<td>0.390</td>
</tr>
<tr>
<td>Tmax</td>
<td>0.163</td>
<td>0.221</td>
<td>0.795</td>
<td>0.275</td>
<td>0.336</td>
<td>0.643</td>
<td>0.299</td>
<td>0.379</td>
<td>0.599</td>
</tr>
<tr>
<td>V</td>
<td>0.028</td>
<td>0.128</td>
<td>0.892</td>
<td>0.040</td>
<td>0.147</td>
<td>0.835</td>
<td>0.069</td>
<td>0.176</td>
<td>0.663</td>
</tr>
<tr>
<td>SOH</td>
<td>0.018</td>
<td>0.077</td>
<td>0.976</td>
<td>0.078</td>
<td>0.249</td>
<td>0.885</td>
<td>0.035</td>
<td>0.162</td>
<td>0.940</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="table-7fn1" fn-type="other">
<p>Note: Bold values (if any) indicate the best result across prediction lengths for each variable.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<p>In general, as the prediction length increases, MSE and MAE tend to increase, while <inline-formula id="ieqn-157"><mml:math id="mml-ieqn-157"><mml:msup><mml:mtext>R</mml:mtext><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula> decreases. For QDischarge, the prediction performance slightly deteriorates as the forecast length increases; however, the model maintains a relatively stable <inline-formula id="ieqn-158"><mml:math id="mml-ieqn-158"><mml:msup><mml:mtext>R</mml:mtext><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula> value of 0.978, even for long-term predictions. Similarly, QCharge exhibits a decline in accuracy with increasing forecast length, but it still retains a stable <inline-formula id="ieqn-159"><mml:math id="mml-ieqn-159"><mml:msup><mml:mtext>R</mml:mtext><mml:mn>2</mml:mn></mml:msup></mml:math></inline-formula> value of 0.962 for long-term predictions. These results indicate that the proposed method effectively preserves robustness in forecasting battery charge and discharge capacities, ensuring reliable long-term predictions. SOH follows a similar pattern to QDischarge and QCharge, maintaining stable predictive performance even as the forecast length increases. This suggests that the proposed method can effectively capture long-term trends in battery health while providing robust predictive capabilities. Given that SOH is a critical metric for evaluating battery health, these findings highlight the potential applicability of the proposed method in real-world battery health monitoring and battery management systems.</p>
</sec>
</sec>
</sec>
<sec id="s6">
<label>6</label>
<title>Discussion</title>
<p>This study introduced CIPF-Informer, a hybrid multivariate prediction model. To address its real-world applicability beyond theoretical performance, this section details the specific Digital Twin (DT) architecture our model is designed for, explains the mechanism for bidirectional feedback as illustrated in <xref ref-type="fig" rid="fig-7">Fig. 7</xref>, and analyzes its computational cost.</p>
<fig id="fig-7">
<label>Figure 7</label>
<caption>
<title>Digital twin architecture. The physical system (left) transmits &#x2018;Real-time data&#x2019; to the Virtual Twin (right) for prediction and simulation, which in turn sends &#x2018;Control&#x2019; commands back to the Onboard BMS for operational optimization</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="CMES_73030-fig-7.tif"/>
</fig>
<sec id="s6_1">
<label>6.1</label>
<title>Digital Twin Architecture</title>
<p>Our proposed framework operates within a DT ecosystem composed of two main domains, as shown in <xref ref-type="fig" rid="fig-7">Fig. 7</xref>: a Physical System (the real-world asset, including the battery pack, sensors, and the Onboard BMS) and a Virtual Digital Twin (a cloud-based computational environment containing Cloud Storage, the CIPF-Informer predictive engine, and a Simulation and Decision Logic module). The true value of the DT is realized through a continuous, bidirectional feedback loop between these physical and virtual twins.</p>

<p>This process begins with the Physical-to-Virtual (&#x2018;Real-time data&#x2019;) flow, where the Onboard BMS collects real-time sensor data and transmits it to the Cloud Storage. This allows for early detection of degradation patterns and anomalies [<xref ref-type="bibr" rid="ref-42">42</xref>] and provides the CIPF-Informer model with the necessary information for both real-time predictions and periodic retraining to adapt to the battery&#x2019;s aging characteristics. The loop is completed by the Virtual-to-Physical (&#x2018;Control&#x2019;) flow, which is the action-oriented part where intelligence from the virtual twin optimizes the operation of the physical asset. For instance, in an intelligent charging scenario, the CIPF-Informer might predict that a standard fast-charging profile will cause excessive future temperatures. The Simulation and Decision Logic module would then determine an optimal, safer charging current to prevent thermal risks [<xref ref-type="bibr" rid="ref-43">43</xref>] and even assess risks for extreme conditions like thermal runaway [<xref ref-type="bibr" rid="ref-44">44</xref>]. This is translated into a Control command, which is sent from the cloud back to the Onboard BMS to adjust the charging process in real-time.</p>
</sec>
<sec id="s6_2">
<label>6.2</label>
<title>Computational Cost and Practicality</title>
<p>A critical aspect for practical deployment is the model&#x2019;s computational cost. All experiments were conducted on a single NVIDIA RTX 3090 GPU. The average training time for the proposed CIPF-Informer was approximately 42.7 min per epoch. While this introduces a significant overhead compared to a non-PF baseline, we argue it represents a highly favorable trade-off between cost and performance, as the PF&#x2019;s contribution to accuracy and stability is substantial (see <xref ref-type="sec" rid="s5_2">Section 5.2</xref>). In terms of inference, a single prediction can be processed in approximately 76.2 milliseconds, which is sufficient for many near-real-time monitoring applications in a cloud-based DT.</p>
</sec>
</sec>
<sec id="s7">
<label>7</label>
<title>Conclusion</title>
<p>This study proposed CIPF-Informer, a hybrid prediction model that integrates a model-based approach (Particle Filter) and a data-driven approach (Informer) to support digital twin applications for lithium-ion batteries. By incorporating Channel Independence and multivariate time-series forecasting, the model effectively captures complex battery dynamics and enhances long-term predictive performance.</p>
<p>Our primary goal was to answer the research questions posed in the introduction. We conclude by providing direct answers based on our experimental findings.</p>
<p><bold>Answers to the Research Questions:</bold>
<list list-type="bullet">
<list-item>
<p>Multivariate Prediction): Our results confirm that a multivariate approach is not only feasible but beneficial. The CIPF-Informer, by modeling key variables concurrently, achieved a lower SOH prediction error than its univariate counterpart (see <xref ref-type="sec" rid="s5_2_2">Section 5.2.2</xref>). This suggests that contextual information from other variables provides valuable constraints for more accurate degradation modeling.</p></list-item>
<list-item>
<p>Synergistic Integration): The ablation studies (<xref ref-type="sec" rid="s5_2_1">Section 5.2.1</xref>) provided a clear affirmative answer. Removing either the Particle Filter (PF) or the Channel Independence (CI) mechanism resulted in a significant performance drop. This demonstrates a true synergistic effect.</p></list-item>
<list-item>
<p>Performance Comparison): The proposed CIPF-Informer consistently outperformed state-of-the-art models (Transformer, DeepVAR, DLinear, NLinear) across all evaluation metrics, as shown in <xref ref-type="sec" rid="s5_1">Section 5.1</xref>. Its performance, validated by statistical significance testing (<italic>p</italic> &#x003C; 0.0125), was particularly dominant in long-horizon forecasting scenarios.</p></list-item>
</list></p>
<p>In summary, this research successfully demonstrates that the proposed hybrid architecture offers a superior solution for comprehensive battery digital twins. By moving beyond univariate SOH prediction and creating a synergistic fusion of probabilistic filtering and efficient deep learning, CIPF-Informer provides a robust and scalable framework.</p>
<p>Despite strong results, several challenges remain:
<list list-type="simple">
<list-item><label>1.</label><p>Generalizability: The model was tested only on the MIT dataset, and its performance on other battery types remains uncertain.</p></list-item>
<list-item><label>2.</label><p>Computational Cost: Particle Filter adds computational burden, requiring optimization for real-time deployment.</p></list-item>
<list-item><label>3.</label><p>Inter-variable Correlation: While CI improves performance, real-world BMS often exhibit inter-variable dependencies that must be better modeled.</p></list-item>
</list></p>
<p>Future work will focus on improving generalization, optimizing real-time performance, and adapting to diverse battery systems, moving toward more reliable digital twin-based BMS.</p>
</sec>
</body>
<back>
<ack>
<p>None.</p>
</ack>
<sec>
<title>Funding Statement</title>
<p>This work was supported by the Human Resources Development of the Korea Institute of Energy Technology Evaluation and Planning (KETEP) grant funded by the Korea government Ministry of Knowledge Economy (No. RS-2023-00244330) and the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) (No. NRF RS-2023-00219052).</p>
</sec>
<sec>
<title>Author Contributions</title>
<p>The authors confirm contribution to the paper as follows: Conceptualization, Changyu Jeon; Methodology, Changyu Jeon; Software, Changyu Jeon; Formal analysis, Changyu Jeon; Data Curation, Changyu Jeon; Writing&#x2014;original draft preparation, Changyu Jeon; Visualization, Changyu Jeon; Supervision, Younghoon Kim; Writing&#x2014;review and editing, Younghoon Kim; Project administration, Younghoon Kim; Funding acquisition, Younghoon Kim. All authors reviewed the results and approved the final version of the manuscript.</p>
</sec>
<sec sec-type="data-availability">
<title>Availability of Data and Materials</title>
<p>The dataset that supports the findings of this study is openly available at the MIT Battery Dataset repository [<xref ref-type="bibr" rid="ref-41">41</xref>].</p>
</sec>
<sec>
<title>Ethics Approval</title>
<p>Not applicable.</p>
</sec>
<sec sec-type="COI-statement">
<title>Conflicts of Interest</title>
<p>The authors declare no conflicts of interest to report regarding the present study.</p>
</sec>
<ref-list content-type="authoryear">
<title>References</title>
<ref id="ref-1"><label>[1]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Lipu</surname> <given-names>MH</given-names></string-name>, <string-name><surname>Hannan</surname> <given-names>MA</given-names></string-name>, <string-name><surname>Hussain</surname> <given-names>A</given-names></string-name>, <string-name><surname>Hoque</surname> <given-names>M</given-names></string-name>, <string-name><surname>Ker</surname> <given-names>PJ</given-names></string-name>, <string-name><surname>Saad</surname> <given-names>MHM</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>A review of state of health and remaining useful life estimation methods for lithium-ion battery in electric vehicles: challenges and recommendations</article-title>. <source>J Clean Prod</source>. <year>2018</year>;<volume>205</volume>:<fpage>115</fpage>&#x2013;<lpage>33</lpage>. doi:<pub-id pub-id-type="doi">10.1016/j.jclepro.2018.09.065</pub-id>.</mixed-citation></ref>
<ref id="ref-2"><label>[2]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Cuma</surname> <given-names>MU</given-names></string-name>, <string-name><surname>Koroglu</surname> <given-names>T</given-names></string-name></person-group>. <article-title>A comprehensive review on estimation strategies used in hybrid and battery electric vehicles</article-title>. <source>Renew Sustain Energy Rev</source>. <year>2015</year>;<volume>42</volume>:<fpage>517</fpage>&#x2013;<lpage>31</lpage>. doi:<pub-id pub-id-type="doi">10.1016/j.rser.2014.10.047</pub-id>.</mixed-citation></ref>
<ref id="ref-3"><label>[3]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Safavi</surname> <given-names>V</given-names></string-name>, <string-name><surname>Bazmohammadi</surname> <given-names>N</given-names></string-name>, <string-name><surname>Vasquez</surname> <given-names>JC</given-names></string-name>, <string-name><surname>Guerrero</surname> <given-names>JM</given-names></string-name></person-group>. <article-title>Battery state-of-health estimation: a step towards battery digital twins</article-title>. <source>Electronics</source>. <year>2024</year>;<volume>13</volume>(<issue>3</issue>):<fpage>587</fpage>. doi:<pub-id pub-id-type="doi">10.3390/electronics13030587</pub-id>.</mixed-citation></ref>
<ref id="ref-4"><label>[4]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Mitali</surname> <given-names>J</given-names></string-name>, <string-name><surname>Dhinakaran</surname> <given-names>S</given-names></string-name>, <string-name><surname>Mohamad</surname> <given-names>A</given-names></string-name></person-group>. <article-title>Energy storage systems: a review</article-title>. <source>Energy Storage Sav</source>. <year>2022</year>;<volume>1</volume>(<issue>3</issue>):<fpage>166</fpage>&#x2013;<lpage>216</lpage>. doi:<pub-id pub-id-type="doi">10.1016/j.enss.2022.07.002</pub-id>.</mixed-citation></ref>
<ref id="ref-5"><label>[5]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Xia</surname> <given-names>G</given-names></string-name>, <string-name><surname>Cao</surname> <given-names>L</given-names></string-name>, <string-name><surname>Bi</surname> <given-names>G</given-names></string-name></person-group>. <article-title>A review on battery thermal management in electric vehicle application</article-title>. <source>J Power Sources</source>. <year>2017</year>;<volume>367</volume>(<issue>3</issue>):<fpage>90</fpage>&#x2013;<lpage>105</lpage>. doi:<pub-id pub-id-type="doi">10.1016/j.jpowsour.2017.09.046</pub-id>.</mixed-citation></ref>
<ref id="ref-6"><label>[6]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Zhou</surname> <given-names>X</given-names></string-name>, <string-name><surname>Stein</surname> <given-names>JL</given-names></string-name>, <string-name><surname>Ersal</surname> <given-names>T</given-names></string-name></person-group>. <article-title>Battery state of health monitoring by estimation of the number of cyclable Li-ions</article-title>. <source>Control Eng Pract</source>. <year>2017</year>;<volume>66</volume>(<issue>7</issue>):<fpage>51</fpage>&#x2013;<lpage>63</lpage>. doi:<pub-id pub-id-type="doi">10.1016/j.conengprac.2017.05.009</pub-id>.</mixed-citation></ref>
<ref id="ref-7"><label>[7]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><surname>Singirikonda</surname> <given-names>S</given-names></string-name>, <string-name><surname>Obulesu</surname> <given-names>Y</given-names></string-name></person-group>. <article-title>Advanced SOC and SOH estimation methods for EV batteries&#x2014;a review</article-title>. In: <conf-name>International Conference on Automation, Signal Processing, Instrumentation and Control</conf-name>. <publisher-loc>Cham, Switzerland</publisher-loc>: <publisher-name>Springer</publisher-name>; <year>2020</year>. p. <fpage>1963</fpage>&#x2013;<lpage>77</lpage>.</mixed-citation></ref>
<ref id="ref-8"><label>[8]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Fei</surname> <given-names>Z</given-names></string-name>, <string-name><surname>Yang</surname> <given-names>F</given-names></string-name>, <string-name><surname>Tsui</surname> <given-names>KL</given-names></string-name>, <string-name><surname>Li</surname> <given-names>L</given-names></string-name>, <string-name><surname>Zhang</surname> <given-names>Z</given-names></string-name></person-group>. <article-title>Early prediction of battery lifetime via a machine learning based framework</article-title>. <source>Energy</source>. <year>2021</year>;<volume>225</volume>(<issue>4</issue>):<fpage>120205</fpage>. doi:<pub-id pub-id-type="doi">10.1016/j.energy.2021.120205</pub-id>.</mixed-citation></ref>
<ref id="ref-9"><label>[9]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Yang</surname> <given-names>N</given-names></string-name>, <string-name><surname>Song</surname> <given-names>Z</given-names></string-name>, <string-name><surname>Hofmann</surname> <given-names>H</given-names></string-name>, <string-name><surname>Sun</surname> <given-names>J</given-names></string-name></person-group>. <article-title>Robust state of health estimation of lithium-ion batteries using convolutional neural network and random forest</article-title>. <source>J Energy Storage</source>. <year>2022</year>;<volume>48</volume>(<issue>4</issue>):<fpage>103857</fpage>. doi:<pub-id pub-id-type="doi">10.1016/j.est.2021.103857</pub-id>.</mixed-citation></ref>
<ref id="ref-10"><label>[10]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Nuhic</surname> <given-names>A</given-names></string-name>, <string-name><surname>Terzimehic</surname> <given-names>T</given-names></string-name>, <string-name><surname>Soczka-Guth</surname> <given-names>T</given-names></string-name>, <string-name><surname>Buchholz</surname> <given-names>M</given-names></string-name>, <string-name><surname>Dietmayer</surname> <given-names>K</given-names></string-name></person-group>. <article-title>Health diagnosis and remaining useful life prognostics of lithium-ion batteries using data-driven methods</article-title>. <source>J Power Sources</source>. <year>2013</year>;<volume>239</volume>(<issue>3</issue>):<fpage>680</fpage>&#x2013;<lpage>8</lpage>. doi:<pub-id pub-id-type="doi">10.1016/j.jpowsour.2012.11.146</pub-id>.</mixed-citation></ref>
<ref id="ref-11"><label>[11]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Eleftheriadis</surname> <given-names>P</given-names></string-name>, <string-name><surname>Giazitzis</surname> <given-names>S</given-names></string-name>, <string-name><surname>Leva</surname> <given-names>S</given-names></string-name>, <string-name><surname>Ogliari</surname> <given-names>E</given-names></string-name></person-group>. <article-title>Data-driven methods for the state of charge estimation of lithium-ion batteries: an overview</article-title>. <source>Forecasting</source>. <year>2023</year>;<volume>5</volume>(<issue>3</issue>):<fpage>576</fpage>&#x2013;<lpage>99</lpage>. doi:<pub-id pub-id-type="doi">10.3390/forecast5030032</pub-id>.</mixed-citation></ref>
<ref id="ref-12"><label>[12]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Yang</surname> <given-names>B</given-names></string-name>, <string-name><surname>Qian</surname> <given-names>Y</given-names></string-name>, <string-name><surname>Li</surname> <given-names>Q</given-names></string-name>, <string-name><surname>Chen</surname> <given-names>Q</given-names></string-name>, <string-name><surname>Wu</surname> <given-names>J</given-names></string-name>, <string-name><surname>Luo</surname> <given-names>E</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Critical summary and perspectives on state-of-health of lithium-ion battery</article-title>. <source>Renew Sustain Energy Rev</source>. <year>2024</year>;<volume>190</volume>(<issue>40</issue>):<fpage>114077</fpage>. doi:<pub-id pub-id-type="doi">10.1016/j.rser.2023.114077</pub-id>.</mixed-citation></ref>
<ref id="ref-13"><label>[13]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Li</surname> <given-names>W</given-names></string-name>, <string-name><surname>Rentemeister</surname> <given-names>M</given-names></string-name>, <string-name><surname>Badeda</surname> <given-names>J</given-names></string-name>, <string-name><surname>J&#x00F6;st</surname> <given-names>D</given-names></string-name>, <string-name><surname>Schulte</surname> <given-names>D</given-names></string-name>, <string-name><surname>Sauer</surname> <given-names>DU</given-names></string-name></person-group>. <article-title>Digital twin for battery systems: cloud battery management system with online state-of-charge and state-of-health estimation</article-title>. <source>J Energy Storage</source>. <year>2020</year>;<volume>30</volume>(<issue>1&#x2013;2</issue>):<fpage>101557</fpage>. doi:<pub-id pub-id-type="doi">10.1016/j.est.2020.101557</pub-id>.</mixed-citation></ref>
<ref id="ref-14"><label>[14]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Hannan</surname> <given-names>MA</given-names></string-name>, <string-name><surname>How</surname> <given-names>DN</given-names></string-name>, <string-name><surname>Lipu</surname> <given-names>MH</given-names></string-name>, <string-name><surname>Mansor</surname> <given-names>M</given-names></string-name>, <string-name><surname>Ker</surname> <given-names>PJ</given-names></string-name>, <string-name><surname>Dong</surname> <given-names>Z</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Deep learning approach towards accurate state of charge estimation for lithium-ion batteries using self-supervised transformer model</article-title>. <source>Sci Rep</source>. <year>2021</year>;<volume>11</volume>(<issue>1</issue>):<fpage>19541</fpage>. doi:<pub-id pub-id-type="doi">10.21203/rs.3.rs-687515/v1</pub-id>.</mixed-citation></ref>
<ref id="ref-15"><label>[15]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Demirci</surname> <given-names>O</given-names></string-name>, <string-name><surname>Taskin</surname> <given-names>S</given-names></string-name>, <string-name><surname>Schaltz</surname> <given-names>E</given-names></string-name>, <string-name><surname>Demirci</surname> <given-names>BA</given-names></string-name></person-group>. <article-title>Review of battery state estimation methods for electric vehicles-Part II: SOH estimation</article-title>. <source>J Energy Storage</source>. <year>2024</year>;<volume>96</volume>:<fpage>112703</fpage>. doi:<pub-id pub-id-type="doi">10.1016/j.est.2024.112703</pub-id>.</mixed-citation></ref>
<ref id="ref-16"><label>[16]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Andre</surname> <given-names>D</given-names></string-name>, <string-name><surname>Appel</surname> <given-names>C</given-names></string-name>, <string-name><surname>Soczka-Guth</surname> <given-names>T</given-names></string-name>, <string-name><surname>Sauer</surname> <given-names>DU</given-names></string-name></person-group>. <article-title>Advanced mathematical methods of SOC and SOH estimation for lithium-ion batteries</article-title>. <source>J Power Sources</source>. <year>2013</year>;<volume>224</volume>(<issue>1&#x2013;2</issue>):<fpage>20</fpage>&#x2013;<lpage>7</lpage>. doi:<pub-id pub-id-type="doi">10.1016/j.jpowsour.2012.10.001</pub-id>.</mixed-citation></ref>
<ref id="ref-17"><label>[17]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Plett</surname> <given-names>GL</given-names></string-name></person-group>. <article-title>Extended Kalman filtering for battery management systems of LiPB-based HEV battery packs: part 3. State and parameter estimation</article-title>. <source>J Power Sources</source>. <year>2004</year>;<volume>134</volume>(<issue>2</issue>):<fpage>277</fpage>&#x2013;<lpage>92</lpage>. doi:<pub-id pub-id-type="doi">10.1016/j.jpowsour.2004.02.033</pub-id>.</mixed-citation></ref>
<ref id="ref-18"><label>[18]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Zhu</surname> <given-names>F</given-names></string-name>, <string-name><surname>Fu</surname> <given-names>J</given-names></string-name></person-group>. <article-title>A novel state-of-health estimation for lithium-ion battery via unscented Kalman filter and improved unscented particle filter</article-title>. <source>IEEE Sens J</source>. <year>2021</year>;<volume>21</volume>(<issue>22</issue>):<fpage>25449</fpage>&#x2013;<lpage>56</lpage>. doi:<pub-id pub-id-type="doi">10.1109/jsen.2021.3102990</pub-id>.</mixed-citation></ref>
<ref id="ref-19"><label>[19]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Elfring</surname> <given-names>J</given-names></string-name>, <string-name><surname>Torta</surname> <given-names>E</given-names></string-name>, <string-name><surname>Van De Molengraft</surname> <given-names>R</given-names></string-name></person-group>. <article-title>Particle filters: a hands-on tutorial</article-title>. <source>Sensors</source>. <year>2021</year>;<volume>21</volume>(<issue>2</issue>):<fpage>438</fpage>. doi:<pub-id pub-id-type="doi">10.3390/s21020438</pub-id>; <pub-id pub-id-type="pmid">33435468</pub-id></mixed-citation></ref>
<ref id="ref-20"><label>[20]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Gustafsson</surname> <given-names>F</given-names></string-name></person-group>. <article-title>Particle filter theory and practice with positioning applications</article-title>. <source>IEEE Aerosp Electron Syst Mag</source>. <year>2010</year>;<volume>25</volume>(<issue>7</issue>):<fpage>53</fpage>&#x2013;<lpage>82</lpage>. doi:<pub-id pub-id-type="doi">10.1109/maes.2010.5546308</pub-id>.</mixed-citation></ref>
<ref id="ref-21"><label>[21]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Wang</surname> <given-names>S</given-names></string-name>, <string-name><surname>Jin</surname> <given-names>S</given-names></string-name>, <string-name><surname>Bai</surname> <given-names>D</given-names></string-name>, <string-name><surname>Fan</surname> <given-names>Y</given-names></string-name>, <string-name><surname>Shi</surname> <given-names>H</given-names></string-name>, <string-name><surname>Fernandez</surname> <given-names>C</given-names></string-name></person-group>. <article-title>A critical review of improved deep learning methods for the remaining useful life prediction of lithium-ion batteries</article-title>. <source>Energy Rep</source>. <year>2021</year>;<volume>7</volume>:<fpage>5562</fpage>&#x2013;<lpage>74</lpage>. doi:<pub-id pub-id-type="doi">10.1016/j.egyr.2021.08.182</pub-id>.</mixed-citation></ref>
<ref id="ref-22"><label>[22]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Li</surname> <given-names>SG</given-names></string-name>, <string-name><surname>Sharkh</surname> <given-names>SM</given-names></string-name>, <string-name><surname>Walsh</surname> <given-names>FC</given-names></string-name>, <string-name><surname>Zhang</surname> <given-names>CN</given-names></string-name></person-group>. <article-title>Energy and battery management of a plug-in series hybrid electric vehicle using fuzzy logic</article-title>. <source>IEEE Trans Veh Technol</source>. <year>2011</year>;<volume>60</volume>(<issue>8</issue>):<fpage>3571</fpage>&#x2013;<lpage>85</lpage>. doi:<pub-id pub-id-type="doi">10.1109/tvt.2011.2165571</pub-id>.</mixed-citation></ref>
<ref id="ref-23"><label>[23]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><surname>Raman</surname> <given-names>M</given-names></string-name>, <string-name><surname>Champa</surname> <given-names>V</given-names></string-name>, <string-name><surname>Prema</surname> <given-names>V</given-names></string-name></person-group>. <article-title>State of health estimation of lithium ion batteries using recurrent neural network and its variants</article-title>. In: <conf-name>2021 IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT)</conf-name>. <publisher-loc>New York, NY, USA</publisher-loc>: <publisher-name>IEEE</publisher-name>; <year>2021</year>. p. <fpage>1</fpage>&#x2013;<lpage>6</lpage>.</mixed-citation></ref>
<ref id="ref-24"><label>[24]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Ma</surname> <given-names>Y</given-names></string-name>, <string-name><surname>Shan</surname> <given-names>C</given-names></string-name>, <string-name><surname>Gao</surname> <given-names>J</given-names></string-name>, <string-name><surname>Chen</surname> <given-names>H</given-names></string-name></person-group>. <article-title>A novel method for state of health estimation of lithium-ion batteries based on improved LSTM and health indicators extraction</article-title>. <source>Energy</source>. <year>2022</year>;<volume>251</volume>(<issue>2</issue>):<fpage>123973</fpage>. doi:<pub-id pub-id-type="doi">10.1016/j.energy.2022.123973</pub-id>.</mixed-citation></ref>
<ref id="ref-25"><label>[25]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><surname>Kong</surname> <given-names>Y</given-names></string-name>, <string-name><surname>Wang</surname> <given-names>Z</given-names></string-name>, <string-name><surname>Nie</surname> <given-names>Y</given-names></string-name>, <string-name><surname>Zhou</surname> <given-names>T</given-names></string-name>, <string-name><surname>Zohren</surname> <given-names>S</given-names></string-name>, <string-name><surname>Liang</surname> <given-names>Y</given-names></string-name>, <etal>et al.</etal></person-group> <article-title>Unlocking the power of LSTM for long term time series forecasting</article-title>. In: <conf-name>Proceedings of the AAAI Conference on Artificial Intelligence. Palo Alto, CA, USA: AAAI Press; 2025</conf-name>. Vol. <volume>39</volume>. p. <fpage>11968</fpage>&#x2013;<lpage>76</lpage>.</mixed-citation></ref>
<ref id="ref-26"><label>[26]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><surname>Zhou</surname> <given-names>H</given-names></string-name>, <string-name><surname>Zhang</surname> <given-names>S</given-names></string-name>, <string-name><surname>Peng</surname> <given-names>J</given-names></string-name>, <string-name><surname>Zhang</surname> <given-names>S</given-names></string-name>, <string-name><surname>Li</surname> <given-names>J</given-names></string-name>, <string-name><surname>Xiong</surname> <given-names>H</given-names></string-name>, <etal>et al.</etal></person-group> <article-title>Informer: beyond efficient transformer for long sequence time-series forecasting</article-title>. In: <conf-name>Proceedings of the AAAI conference on artificial intelligence. Palo Alto, CA, USA: AAAI Press; 2021</conf-name>. Vol. <volume>35</volume>. p. <fpage>11106</fpage>&#x2013;<lpage>15</lpage>.</mixed-citation></ref>
<ref id="ref-27"><label>[27]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><surname>Zheng</surname> <given-names>Y</given-names></string-name>, <string-name><surname>Liu</surname> <given-names>Q</given-names></string-name>, <string-name><surname>Chen</surname> <given-names>E</given-names></string-name>, <string-name><surname>Ge</surname> <given-names>Y</given-names></string-name>, <string-name><surname>Zhao</surname> <given-names>JL</given-names></string-name></person-group>. <article-title>Time series classification using multi-channels deep convolutional neural networks</article-title>. In: <conf-name>International Conference on Web-Age Information Management</conf-name>. <publisher-loc>Cham, Switzerland</publisher-loc>: <publisher-name>Springer</publisher-name>; <year>2014</year>. p. <fpage>298</fpage>&#x2013;<lpage>310</lpage>.</mixed-citation></ref>
<ref id="ref-28"><label>[28]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><surname>Zeng</surname> <given-names>A</given-names></string-name>, <string-name><surname>Chen</surname> <given-names>M</given-names></string-name>, <string-name><surname>Zhang</surname> <given-names>L</given-names></string-name>, <string-name><surname>Xu</surname> <given-names>Q</given-names></string-name></person-group>. <article-title>Are transformers effective for time series forecasting?</article-title> In: <conf-name>Proceedings of the AAAI Conference on Artificial Intelligence. Palo Alto, CA, USA: AAAI Press; 2023</conf-name>. Vol. <volume>37</volume>. p. <fpage>11121</fpage>&#x2013;<lpage>8</lpage>.</mixed-citation></ref>
<ref id="ref-29"><label>[29]</label><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name><surname>Nie</surname> <given-names>Y</given-names></string-name>, <string-name><surname>Nguyen</surname> <given-names>NH</given-names></string-name>, <string-name><surname>Sinthong</surname> <given-names>P</given-names></string-name>, <string-name><surname>Kalagnanam</surname> <given-names>J</given-names></string-name></person-group>. <article-title>A time series is worth 64 words: long-term forecasting with transformers. arXiv:2211.14730</article-title>. <year>2023</year>.</mixed-citation></ref>
<ref id="ref-30"><label>[30]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Han</surname> <given-names>L</given-names></string-name>, <string-name><surname>Ye</surname> <given-names>HJ</given-names></string-name>, <string-name><surname>Zhan</surname> <given-names>DC</given-names></string-name></person-group>. <article-title>The capacity and robustness trade-off: revisiting the channel independent strategy for multivariate time series forecasting</article-title>. <source>IEEE Trans Knowl Data Eng</source>. <year>2024</year>;<volume>36</volume>(<issue>11</issue>):<fpage>7129</fpage>&#x2013;<lpage>42</lpage>. doi:<pub-id pub-id-type="doi">10.1109/tkde.2024.3400008</pub-id>.</mixed-citation></ref>
<ref id="ref-31"><label>[31]</label><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name><surname>Shi</surname> <given-names>Z</given-names></string-name></person-group>. <article-title>Incorporating transformer and LSTM to Kalman filter with EM algorithm for state estimation. arXiv:2105.00250</article-title>. <year>2021</year>.</mixed-citation></ref>
<ref id="ref-32"><label>[32]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Zhao</surname> <given-names>H</given-names></string-name>, <string-name><surname>Chen</surname> <given-names>Z</given-names></string-name>, <string-name><surname>Shu</surname> <given-names>X</given-names></string-name>, <string-name><surname>Shen</surname> <given-names>J</given-names></string-name>, <string-name><surname>Lei</surname> <given-names>Z</given-names></string-name>, <string-name><surname>Zhang</surname> <given-names>Y</given-names></string-name></person-group>. <article-title>State of health estimation for lithium-ion batteries based on hybrid attention and deep learning</article-title>. <source>Reliab Eng Syst Saf</source>. <year>2023</year>;<volume>232</volume>(<issue>8</issue>):<fpage>109066</fpage>. doi:<pub-id pub-id-type="doi">10.1016/j.ress.2022.109066</pub-id>.</mixed-citation></ref>
<ref id="ref-33"><label>[33]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><surname>Glaessgen</surname> <given-names>E</given-names></string-name>, <string-name><surname>Stargel</surname> <given-names>D</given-names></string-name></person-group>. <article-title>The digital twin paradigm for future NASA and US air force vehicles</article-title>. In: <conf-name>53rd AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference 20th AIAA/ASME/AHS Adaptive Structures conference 14th AIAA; 2012 April 23-26; Honolulu, HI, USA. No. AIAA 2012-1818</conf-name>.</mixed-citation></ref>
<ref id="ref-34"><label>[34]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Wu</surname> <given-names>B</given-names></string-name>, <string-name><surname>Widanage</surname> <given-names>WD</given-names></string-name>, <string-name><surname>Yang</surname> <given-names>S</given-names></string-name>, <string-name><surname>Liu</surname> <given-names>X</given-names></string-name></person-group>. <article-title>Battery digital twins: perspectives on the fusion of models, data and artificial intelligence for smart battery management systems</article-title>. <source>Energy AI</source>. <year>2020</year>;<volume>1</volume>:<fpage>100016</fpage>. doi:<pub-id pub-id-type="doi">10.1016/j.egyai.2020.100016</pub-id>.</mixed-citation></ref>
<ref id="ref-35"><label>[35]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Tao</surname> <given-names>F</given-names></string-name>, <string-name><surname>Zhang</surname> <given-names>H</given-names></string-name>, <string-name><surname>Liu</surname> <given-names>A</given-names></string-name>, <string-name><surname>Nee</surname> <given-names>AY</given-names></string-name></person-group>. <article-title>Digital twin in industry: state-of-the-art</article-title>. <source>IEEE Trans Ind Inform</source>. <year>2018</year>;<volume>15</volume>(<issue>4</issue>):<fpage>2405</fpage>&#x2013;<lpage>15</lpage>.</mixed-citation></ref>
<ref id="ref-36"><label>[36]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Jafari</surname> <given-names>M</given-names></string-name>, <string-name><surname>Kavousi-Fard</surname> <given-names>A</given-names></string-name>, <string-name><surname>Chen</surname> <given-names>T</given-names></string-name>, <string-name><surname>Karimi</surname> <given-names>M</given-names></string-name></person-group>. <article-title>A review on digital twin technology in smart grid, transportation system and smart city: challenges and future</article-title>. <source>IEEE Access</source>. <year>2023</year>;<volume>11</volume>:<fpage>17471</fpage>&#x2013;<lpage>84</lpage>. doi:<pub-id pub-id-type="doi">10.1109/access.2023.3241588</pub-id>.</mixed-citation></ref>
<ref id="ref-37"><label>[37]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Chen</surname> <given-names>Z</given-names></string-name>, <string-name><surname>Mi</surname> <given-names>CC</given-names></string-name>, <string-name><surname>Fu</surname> <given-names>Y</given-names></string-name>, <string-name><surname>Xu</surname> <given-names>J</given-names></string-name>, <string-name><surname>Gong</surname> <given-names>X</given-names></string-name></person-group>. <article-title>Online battery state of health estimation based on Genetic Algorithm for electric and hybrid vehicle applications</article-title>. <source>J Power Sources</source>. <year>2013</year>;<volume>240</volume>:<fpage>184</fpage>&#x2013;<lpage>92</lpage>. doi:<pub-id pub-id-type="doi">10.1016/j.jpowsour.2013.03.158</pub-id>.</mixed-citation></ref>
<ref id="ref-38"><label>[38]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><surname>Zhang</surname> <given-names>Y</given-names></string-name>, <string-name><surname>Wu</surname> <given-names>J</given-names></string-name>, <string-name><surname>Sun</surname> <given-names>S</given-names></string-name>, <string-name><surname>Ye</surname> <given-names>T</given-names></string-name></person-group>. <article-title>Research on modeling method of digital twin of lithium battery based on data-model hybrid drive</article-title>. In: <conf-name>2024 IEEE 4th International Conference on Power, Electronics and Computer Applications (ICPECA)</conf-name>. <publisher-loc>Piscataway, NJ, USA</publisher-loc>: <publisher-name>IEEE</publisher-name>; <year>2024</year>. p. <fpage>716</fpage>&#x2013;<lpage>20</lpage>.</mixed-citation></ref>
<ref id="ref-39"><label>[39]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><surname>Alamin</surname> <given-names>KSS</given-names></string-name>, <string-name><surname>Chen</surname> <given-names>Y</given-names></string-name>, <string-name><surname>Macii</surname> <given-names>E</given-names></string-name>, <string-name><surname>Poncino</surname> <given-names>M</given-names></string-name>, <string-name><surname>Vinco</surname> <given-names>S</given-names></string-name></person-group>. <article-title>A machine learning-based digital twin for electric vehicle battery modeling</article-title>. In: <conf-name>2022 IEEE International Conference on Omni-layer Intelligent Systems (COINS)</conf-name>. <publisher-loc>Piscataway, NJ, USA</publisher-loc>: <publisher-name>IEEE</publisher-name>; <year>2022</year>. p. <fpage>1</fpage>&#x2013;<lpage>6</lpage>.</mixed-citation></ref>
<ref id="ref-40"><label>[40]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Tao</surname> <given-names>T</given-names></string-name>, <string-name><surname>Ji</surname> <given-names>C</given-names></string-name>, <string-name><surname>Dai</surname> <given-names>J</given-names></string-name>, <string-name><surname>Rao</surname> <given-names>J</given-names></string-name>, <string-name><surname>Wang</surname> <given-names>J</given-names></string-name>, <string-name><surname>Sun</surname> <given-names>W</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Data-based health indicator extraction for battery SOH estimation via deep learning</article-title>. <source>J Energy Storage</source>. <year>2024</year>;<volume>78</volume>(<issue>3</issue>):<fpage>109982</fpage>. doi:<pub-id pub-id-type="doi">10.1016/j.est.2023.109982</pub-id>.</mixed-citation></ref>
<ref id="ref-41"><label>[41]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Severson</surname> <given-names>KA</given-names></string-name>, <string-name><surname>Attia</surname> <given-names>PM</given-names></string-name>, <string-name><surname>Jin</surname> <given-names>N</given-names></string-name>, <string-name><surname>Perkins</surname> <given-names>N</given-names></string-name>, <string-name><surname>Jiang</surname> <given-names>B</given-names></string-name>, <string-name><surname>Yang</surname> <given-names>Z</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Data-driven prediction of battery cycle life before capacity degradation</article-title>. <source>Nat Energy</source>. <year>2019</year>;<volume>4</volume>(<issue>5</issue>):<fpage>383</fpage>&#x2013;<lpage>91</lpage>. doi:<pub-id pub-id-type="doi">10.1038/s41560-019-0356-8</pub-id>.</mixed-citation></ref>
<ref id="ref-42"><label>[42]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Tao</surname> <given-names>F</given-names></string-name>, <string-name><surname>Cheng</surname> <given-names>J</given-names></string-name>, <string-name><surname>Qi</surname> <given-names>Q</given-names></string-name>, <string-name><surname>Zhang</surname> <given-names>M</given-names></string-name>, <string-name><surname>Zhang</surname> <given-names>H</given-names></string-name>, <string-name><surname>Sui</surname> <given-names>F</given-names></string-name></person-group>. <article-title>Digital twin-driven product design, manufacturing and service with big data</article-title>. <source>Int J Adv Manuf Technol</source>. <year>2018</year>;<volume>94</volume>(<issue>9&#x2013;12</issue>):<fpage>3563</fpage>&#x2013;<lpage>76</lpage>. doi:<pub-id pub-id-type="doi">10.1007/s00170-017-0233-1</pub-id>.</mixed-citation></ref>
<ref id="ref-43"><label>[43]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Naseri</surname> <given-names>F</given-names></string-name>, <string-name><surname>Gil</surname> <given-names>S</given-names></string-name>, <string-name><surname>Barbu</surname> <given-names>C</given-names></string-name>, <string-name><surname>Cetkin</surname> <given-names>E</given-names></string-name>, <string-name><surname>Yarimca</surname> <given-names>G</given-names></string-name>, <string-name><surname>Jensen</surname> <given-names>A</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Digital twin of electric vehicle battery systems: comprehensive review of the use cases, requirements, and platforms</article-title>. <source>Renew Sustain Energy Rev</source>. <year>2023</year>;<volume>179</volume>(<issue>4</issue>):<fpage>113280</fpage>. doi:<pub-id pub-id-type="doi">10.1016/j.rser.2023.113280</pub-id>.</mixed-citation></ref>
<ref id="ref-44"><label>[44]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Liu</surname> <given-names>K</given-names></string-name>, <string-name><surname>Li</surname> <given-names>K</given-names></string-name>, <string-name><surname>Peng</surname> <given-names>Q</given-names></string-name>, <string-name><surname>Zhang</surname> <given-names>C</given-names></string-name></person-group>. <article-title>A brief review on key technologies in the battery management system of electric vehicles</article-title>. <source>Front Mech Eng</source>. <year>2019</year>;<volume>14</volume>(<issue>1</issue>):<fpage>47</fpage>&#x2013;<lpage>64</lpage>. doi:<pub-id pub-id-type="doi">10.1007/s11465-018-0516-8</pub-id>.</mixed-citation></ref>
</ref-list>
</back></article>











