<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.1 20151215//EN" "http://jats.nlm.nih.gov/publishing/1.1/JATS-journalpublishing1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" xml:lang="en" article-type="research-article" dtd-version="1.1">
<front>
<journal-meta>
<journal-id journal-id-type="pmc">JAI</journal-id>
<journal-id journal-id-type="nlm-ta">JAI</journal-id>
<journal-id journal-id-type="publisher-id">JAI</journal-id>
<journal-title-group>
<journal-title>Journal on Artificial Intelligence</journal-title>
</journal-title-group>
<issn pub-type="epub">2579-003X</issn>
<issn pub-type="ppub">2579-0021</issn>
<publisher>
<publisher-name>Tech Science Press</publisher-name>
<publisher-loc>USA</publisher-loc>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">66067</article-id>
<article-id pub-id-type="doi">10.32604/jai.2025.066067</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Article</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Machine Learning-Optimized Energy Management for Resilient Residential Microgrids with Dynamic Electric Vehicle Integration</article-title>
<alt-title alt-title-type="left-running-head">Machine Learning-Optimized Energy Management for Resilient Residential Microgrids with Dynamic Electric Vehicle Integration</alt-title>
<alt-title alt-title-type="right-running-head">Machine Learning-Optimized Energy Management for Resilient Residential Microgrids with Dynamic Electric Vehicle Integration</alt-title>
</title-group>
<contrib-group>
<contrib id="author-1" contrib-type="author" corresp="yes">
<name name-style="western"><surname>Alenazi</surname><given-names>Mohammed Moawad</given-names></name><email>m-alenazi@ut.edu.sa</email></contrib>
<aff id="aff-1"><institution>Faculty of Computers and Information Technology, Department of Computer Engineering, University of Tabuk</institution>, <addr-line>Tabuk, 71421</addr-line>, <country>Saudi Arabia</country></aff>
</contrib-group>
<author-notes>
<corresp id="cor1"><label>&#x002A;</label>Corresponding Author: Mohammed Moawad Alenazi. Email: <email>m-alenazi@ut.edu.sa</email></corresp>
</author-notes>
<pub-date date-type="collection" publication-format="electronic">
<year>2025</year>
</pub-date>
<pub-date date-type="pub" publication-format="electronic">
<day>27</day><month>06</month><year>2025</year>
</pub-date>
<volume>7</volume>
<issue>1</issue>
<fpage>143</fpage>
<lpage>176</lpage>
<history>
<date date-type="received">
<day>28</day>
<month>3</month>
<year>2025</year>
</date>
<date date-type="accepted">
<day>29</day>
<month>5</month>
<year>2025</year>
</date>
</history>
<permissions>
<copyright-statement>&#x00A9; 2025 The Author.</copyright-statement>
<copyright-year>2025</copyright-year>
<copyright-holder>Published by Tech Science Press.</copyright-holder>
<license xlink:href="https://creativecommons.org/licenses/by/4.0/">
<license-p>This work is licensed under a <ext-link ext-link-type="uri" xlink:type="simple" xlink:href="https://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution 4.0 International License</ext-link>, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
</license>
</permissions>
<self-uri content-type="pdf" xlink:href="TSP_JAI_66067.pdf"></self-uri>
<abstract>
<p>This paper presents a novel machine learning (ML) enhanced energy management framework for residential microgrids. It dynamically integrates solar photovoltaics (PV), wind turbines, lithium-ion battery energy storage systems (BESS), and bidirectional electric vehicle (EV) charging. The proposed architecture addresses the limitations of traditional rule-based controls by incorporating ConvLSTM for real-time forecasting, a Twin Delayed Deep Deterministic Policy Gradient (TD3) reinforcement learning agent for optimal BESS scheduling, and federated learning for EV charging prediction&#x2014;ensuring both privacy and efficiency. Simulated in a high-fidelity MATLAB/Simulink environment, the system achieves 98.7% solar/wind forecast accuracy and 98.2% Maximum Power Point Tracking (MPPT) tracking efficiency, while reducing torque oscillations by 41% and peak demand by 22%. Compared to baseline methods, the solution improves voltage and frequency stability (maintaining 400 V &#x00B1;2%, 50 Hz &#x00B1;0.015 Hz) and achieves a 70% reduction in battery State of Charge (SOC) management error. The EV scheduler, informed by data from over 500 households, reduces charging costs by 31% with rapid failover to critical loads during outages. The architecture is validated using ISO 8528-8 transient tests, demonstrating 99.98% uptime. These results confirm the feasibility of transitioning microgrids from reactive systems to adaptive, cognitive infrastructures capable of self-optimization under highly variable renewable generation and EV behaviors.</p>
</abstract>
<kwd-group kwd-group-type="author">
<kwd>Microgrid</kwd>
<kwd>energy</kwd>
<kwd>management</kwd>
<kwd>EV</kwd>
<kwd>control</kwd>
</kwd-group>
<funding-group>
<award-group id="awg1">
<funding-source>University of Tabuk</funding-source>
<award-id>UT-2024-CIT-0527</award-id>
</award-group>
</funding-group>
</article-meta>
</front>
<body>
<sec id="s1">
<label>1</label>
<title>Introduction</title>
<p>The global transition to electric vehicles (EVs) is accelerating, with projections indicating 145 million EVs on roads by 2030 [<xref ref-type="bibr" rid="ref-1">1</xref>,<xref ref-type="bibr" rid="ref-2">2</xref>]. While this shift reduces transportation-related emissions, it introduces unprecedented strain on power infrastructure [<xref ref-type="bibr" rid="ref-3">3</xref>,<xref ref-type="bibr" rid="ref-4">4</xref>], particularly residential microgrids designed for localized renewable energy generation and storage [<xref ref-type="bibr" rid="ref-5">5</xref>,<xref ref-type="bibr" rid="ref-6">6</xref>]. Modern microgrids integrate solar PV [<xref ref-type="bibr" rid="ref-7">7</xref>], wind turbines [<xref ref-type="bibr" rid="ref-8">8</xref>], and battery energy storage systems (BESS) to achieve energy independence [<xref ref-type="bibr" rid="ref-9">9</xref>]. However, the stochastic nature of EV charging patterns&#x2014;coupled with weather-dependent renewable generation&#x2014;threatens grid stability through voltage fluctuations, frequency deviations, and imbalanced supply-demand cycles [<xref ref-type="bibr" rid="ref-10">10</xref>,<xref ref-type="bibr" rid="ref-11">11</xref>].</p>
<p>Prior research has focused on static optimization of EV charging schedules [<xref ref-type="bibr" rid="ref-12">12</xref>,<xref ref-type="bibr" rid="ref-13">13</xref>] or rule-based battery management [<xref ref-type="bibr" rid="ref-14">14</xref>&#x2013;<xref ref-type="bibr" rid="ref-16">16</xref>], often neglecting the dynamic interplay between real-time renewable availability, EV mobility behaviors, and load variations. For instance, Refs. [<xref ref-type="bibr" rid="ref-17">17</xref>&#x2013;<xref ref-type="bibr" rid="ref-20">20</xref>] demonstrated cost reduction via off-peak EV charging but overlooked transient grid disturbances during solar irradiance drops. Similarly, Refs. [<xref ref-type="bibr" rid="ref-21">21</xref>&#x2013;<xref ref-type="bibr" rid="ref-23">23</xref>] employed PID controllers for BESS regulation but reported inefficiencies during abrupt load surges from simultaneous EV charging [<xref ref-type="bibr" rid="ref-24">24</xref>&#x2013;<xref ref-type="bibr" rid="ref-26">26</xref>]. These gaps highlight the need for adaptive control mechanisms capable of learning from historical data and anticipating future states [<xref ref-type="bibr" rid="ref-27">27</xref>].</p>
<p>Machine learning (ML) has emerged as a transformative tool for microgrid energy management. Reinforcement learning (RL) algorithms, in particular, enable systems to iteratively optimize decisions under uncertainty [<xref ref-type="bibr" rid="ref-28">28</xref>]. Recent studies, such as [<xref ref-type="bibr" rid="ref-29">29</xref>], applied RL to commercial microgrids, achieving a 12% reduction in diesel generator usage. However, residential microgrids present unique challenges due to smaller inertia, tighter voltage tolerance (&#x00B1;5%), and diverse EV user behaviors. Additionally, few works have explored the synergy between ML-driven renewable forecasting and EV dispatch&#x2014;a critical requirement for minimizing grid reliance during cloudy or low-wind periods.</p>
<p>In this paper, we propose a novel ML-augmented energy management system (EMS) that addresses these limitations through three key innovations:
<list list-type="simple">
<list-item><label>(a)</label><p>Hybrid Forecasting Model: A convolutional long short-term memory (ConvLSTM) network trained on historical weather and load data to predict solar/wind generation at 15-min intervals.</p></list-item>
<list-item><label>(b)</label><p>Reinforcement Learning-Based Scheduler: A Q-learning agent that dynamically allocates power between EVs, BESS, and household loads while prioritizing SOC thresholds and grid constraints.</p></list-item>
<list-item><label>(c)</label><p>Fault-Tolerant Control Architecture: An ensemble of PID and ML regulators that ensures fallback stability during ML model retraining or communication failures.</p></list-item>
</list></p>
<p>Our contributions are validated through a detailed case study involving a 400 V microgrid with 300 kW solar PV, 50 kW wind turbines, 50 Ah lithium-ion BESS, and five EVs with bidirectional charging capabilities. By integrating real-world irradiation, wind speed, and EV usage datasets, we demonstrate superior performance in load balancing, renewable utilization, and fault recovery compared to existing strategies [<xref ref-type="bibr" rid="ref-30">30</xref>].</p>
<sec id="s1_1">
<label>1.1</label>
<title>Limitations</title>
<p>While the proposed ML-enhanced energy management system demonstrates significant improvements in load balancing, renewable integration, and EV charging efficiency, several limitations are recognized, corresponding directly to the contributions:
<list list-type="order">
<list-item>
<p><bold>Hybrid Forecasting Model (ConvLSTM for Solar/Wind Prediction)</bold>
<list list-type="bullet">
<list-item>
<p><italic>Limitation</italic>: The forecasting accuracy is highly dependent on the quality and completeness of historical weather data. Unexpected meteorological events or sensor inaccuracies can affect prediction reliability.</p></list-item>
<list-item>
<p><italic>Future Solution</italic>: Integration of real-time satellite-based weather updates and multi-sensor fusion techniques to improve forecasting precision.</p></list-item>
</list></p></list-item>
<list-item>
<p><bold>Reinforcement Learning-Based Scheduler (TD3 for BESS Optimization)</bold>
<list list-type="bullet">
<list-item>
<p><italic>Limitation</italic>: The reinforcement learning model requires extensive training time and large datasets to achieve optimal performance. Moreover, it may not adapt instantly to abrupt changes in load demand or renewable generation.</p></list-item>
<list-item>
<p><italic>Future Solution</italic>: Employ online learning methods and transfer learning strategies to minimize retraining time and improve adaptability during sudden load variations.</p></list-item>
</list></p></list-item>
<list-item>
<p><bold>Fault-Tolerant Control Architecture (PID and ML Regulators)</bold>
<list list-type="bullet">
<list-item>
<p><italic>Limitation</italic>: The fallback PID controllers may not be efficient enough during large-scale load disruptions or extended communication losses. Their static nature contrasts with the adaptive ML-based controllers, resulting in minor oscillations during fallback.</p></list-item>
<list-item>
<p><italic>Future Solution</italic>: Introduce adaptive PID tuning algorithms and hybrid fuzzy-PID controllers to enhance stability during communication failures.</p></list-item>
</list></p></list-item>
<list-item>
<p><bold>Federated Learning for EV Scheduling</bold>
<list list-type="bullet">
<list-item>
<p><italic>Limitation</italic>: Federated learning, while effective for privacy preservation, introduces latency in model synchronization and may suffer from convergence issues when edge devices have non-IID (non-Independent and Identically Distributed) data.</p></list-item>
<list-item>
<p><italic>Future Solution</italic>: Implement asynchronous federated updates and hierarchical federated learning to mitigate latency and improve scalability.</p></list-item>
</list></p></list-item>
<list-item>
<p><bold>Simulink-Based Validation</bold>
<list list-type="bullet">
<list-item>
<p><italic>Limitation</italic>: The proposed model is primarily validated through MATLAB/Simulink simulations. Although detailed, real-world testing in an actual microgrid environment has not been performed.</p></list-item>
<list-item>
<p><italic>Future Solution</italic>: Future work should focus on deploying the system in real-world residential microgrids to validate its performance and robustness in practical scenarios.</p></list-item>
</list></p></list-item>
<list-item>
<p><bold>Renewable Resource Variability and Hardware Limitations</bold>
<list list-type="bullet">
<list-item>
<p><italic>Limitation</italic>: The system&#x2019;s effectiveness is constrained by the intermittency of solar and wind energy and the capacity of local BESS installations.</p></list-item>
<list-item>
<p><italic>Future Solution</italic>: Hybrid microgrids with supplementary energy sources like biomass or fuel cells can be explored to enhance stability during low renewable production.</p></list-item>
</list></p></list-item>
</list></p>
<p>The remainder of this paper is organized as follows: <xref ref-type="sec" rid="s2">Section 2</xref> details the ML-enhanced microgrid architecture and Simulink implementation. <xref ref-type="sec" rid="s3">Section 3</xref> evaluates the system under variable renewable generation and EV load scenarios. <xref ref-type="sec" rid="s4">Section 4</xref> concludes with policy implications and future directions.</p>
</sec>
</sec>
<sec id="s2">
<label>2</label>
<title>System Model</title>
<p>The proposed machine learning (ML)-enhanced residential microgrid integrates four core components: solar photovoltaic (PV) arrays, wind turbines, a lithium-ion battery energy storage system (BESS), and a bidirectional electric vehicle (EV) charging station. These subsystems are coordinated via an integrated Energy Management System (EMS) that leverages both physics-based modeling and machine learning (ML) algorithms to adaptively respond to fluctuations in generation, demand, and EV mobility patterns. The microgrid is modeled and validated in a high-fidelity Simulink environment, ensuring system-level coherence and real-time feasibility The EMS not only handles dynamic energy balancing but also optimizes economic dispatch, peak shaving, and system resilience during faults or blackouts. <xref ref-type="fig" rid="fig-1">Fig. 1</xref> illustrates the model architecture of the proposed ML-Enhanced Microgrid Management System, which consists of several interconnected components, each playing a vital role in energy optimization and load balancing.</p>
<fig id="fig-1">
<label>Figure 1</label>
<caption>
<title>Integrated renewable energy system architecture</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="JAI_66067-fig-1.tif"/>
</fig>
<sec id="s2_1">
<label>2.1</label>
<title>Solar PV System with Adaptive MPPT</title>
<p>The solar generation subsystem consists of 72 monocrystalline Shenzhen Topray TPS105S-295W PV panels configured in a 12 &#x00D7; 6 series-parallel array. The array is capable of producing a peak power output of approximately 300 kW under standard test conditions (STC). Each PV module operates at a nominal voltage of 38.7 V and is modeled using the single-diode equivalent circuit, which accurately replicates nonlinear I&#x2013;V characteristics under variable irradiance and temperature conditions.</p>
<p><italic>Single-diode model representation of a PV panel</italic></p>
<p>The electrical behavior of each panel is governed by the following nonlinear equation:
<disp-formula id="eqn-1"><label>(1)</label><mml:math id="mml-eqn-1" display="block"><mml:mi>I</mml:mi><mml:mo>=</mml:mo><mml:msub><mml:mi>I</mml:mi><mml:mrow><mml:mi>p</mml:mi><mml:mi>h</mml:mi></mml:mrow></mml:msub><mml:mo>&#x2212;</mml:mo><mml:msub><mml:mi>I</mml:mi><mml:mrow><mml:mn>0</mml:mn></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>exp</mml:mi><mml:mo>&#x2061;</mml:mo><mml:mrow><mml:mo>(</mml:mo><mml:mfrac><mml:mrow><mml:mi>V</mml:mi><mml:mo>+</mml:mo><mml:mi>I</mml:mi><mml:msub><mml:mi>R</mml:mi><mml:mrow><mml:mi>s</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mrow><mml:mi>n</mml:mi><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:mfrac><mml:mo>)</mml:mo></mml:mrow><mml:mo>&#x2212;</mml:mo><mml:mn>1</mml:mn><mml:mo>)</mml:mo></mml:mrow><mml:mo>&#x2212;</mml:mo><mml:mfrac><mml:mrow><mml:mi>V</mml:mi><mml:mo>+</mml:mo><mml:mi>I</mml:mi><mml:msub><mml:mi>R</mml:mi><mml:mrow><mml:mi>s</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:msub><mml:mi>R</mml:mi><mml:mrow><mml:mi>s</mml:mi><mml:mi>h</mml:mi></mml:mrow></mml:msub></mml:mfrac></mml:math></disp-formula>where:
<list list-type="bullet">
<list-item>
<p><inline-formula id="ieqn-1"><mml:math id="mml-ieqn-1"><mml:msub><mml:mi>I</mml:mi><mml:mrow><mml:mi>p</mml:mi><mml:mi>h</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula>: Photocurrent (A), directly proportional to solar irradiance,</p></list-item>
<list-item>
<p><inline-formula id="ieqn-2"><mml:math id="mml-ieqn-2"><mml:msub><mml:mi>I</mml:mi><mml:mrow><mml:mn>0</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula>: Reverse saturation current of the diode (A),</p></list-item>
<list-item>
<p><inline-formula id="ieqn-3"><mml:math id="mml-ieqn-3"><mml:msub><mml:mi>R</mml:mi><mml:mrow><mml:mi>s</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula>, <inline-formula id="ieqn-4"><mml:math id="mml-ieqn-4"><mml:msub><mml:mi>R</mml:mi><mml:mrow><mml:mi>s</mml:mi><mml:mi>h</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula>: Series and shunt resistances (<inline-formula id="ieqn-5"><mml:math id="mml-ieqn-5"><mml:mrow><mml:mi mathvariant="normal">&#x03A9;</mml:mi></mml:mrow></mml:math></inline-formula>),</p></list-item>
<list-item>
<p><inline-formula id="ieqn-6"><mml:math id="mml-ieqn-6"><mml:mi>n</mml:mi></mml:math></inline-formula>: Diode ideality factor,</p></list-item>
<list-item>
<p><inline-formula id="ieqn-7"><mml:math id="mml-ieqn-7"><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula>: Thermal voltage given by <inline-formula id="ieqn-8"><mml:math id="mml-ieqn-8"><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mi>k</mml:mi><mml:mi>T</mml:mi></mml:mrow><mml:mi>q</mml:mi></mml:mfrac></mml:math></inline-formula>,</p></list-item>
<list-item>
<p><inline-formula id="ieqn-9"><mml:math id="mml-ieqn-9"><mml:mi>V</mml:mi></mml:math></inline-formula>: Terminal voltage of the PV module (V),</p></list-item>
<list-item>
<p><inline-formula id="ieqn-10"><mml:math id="mml-ieqn-10"><mml:mi>I</mml:mi></mml:math></inline-formula>: Output current (A).</p></list-item>
</list></p>
<p>Traditional MPPT techniques such as Perturb and Observe (P&#x0026;O) and Incremental Conductance often exhibit poor dynamic tracking and may become unstable under rapidly changing weather conditions or partial shading scenarios. To address this limitation, a data-driven adaptive MPPT controller is implemented using a Convolutional Long Short-Term Memory (ConvLSTM) neural network.</p>
<p>The ConvLSTM network is trained on a 5-year dataset of historical solar irradiance (<inline-formula id="ieqn-11"><mml:math id="mml-ieqn-11"><mml:mi>G</mml:mi></mml:math></inline-formula>), ambient temperature (<inline-formula id="ieqn-12"><mml:math id="mml-ieqn-12"><mml:mi>T</mml:mi></mml:math></inline-formula>), and voltage-current operating points collected from a local meteorological station. The network takes a sequence of recent environmental and operational inputs and predicts the optimal maximum power point voltage (<inline-formula id="ieqn-13"><mml:math id="mml-ieqn-13"><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>M</mml:mi><mml:mi>P</mml:mi><mml:mi>P</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula>) as follows:
<disp-formula id="eqn-2"><label>(2)</label><mml:math id="mml-eqn-2" display="block"><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>M</mml:mi><mml:mi>P</mml:mi><mml:mi>P</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:msub><mml:mi>f</mml:mi><mml:mrow><mml:mrow><mml:mtext>ConvLSTM</mml:mtext></mml:mrow></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>G</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mrow><mml:mi mathvariant="normal">&#x0394;</mml:mi></mml:mrow><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>,</mml:mo><mml:mi>T</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mi mathvariant="normal">&#x0394;</mml:mi><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>,</mml:mo><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>M</mml:mi><mml:mi>P</mml:mi><mml:mi>P</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mrow><mml:mi mathvariant="normal">&#x0394;</mml:mi></mml:mrow><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>)</mml:mo></mml:mrow></mml:math></disp-formula>here, <inline-formula id="ieqn-14"><mml:math id="mml-ieqn-14"><mml:msub><mml:mi>f</mml:mi><mml:mrow><mml:mrow><mml:mtext>ConvLSTM</mml:mtext></mml:mrow></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mo>&#x22C5;</mml:mo><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula> denotes the mapping function learned by the deep network, incorporating both spatial and temporal dependencies in weather data and PV system dynamics. The prediction is updated every 15 min to accommodate real-world microgrid update rates, and the output voltage reference is fed to a DC&#x2013;DC boost converter for real-time regulation.</p>
<p>The MPPT controller&#x2019;s performance is benchmarked against a conventional PID-based strategy. Under diverse irradiance profiles including partial shading conditions, the ConvLSTM controller significantly outperforms its PID counterpart across all major metrics, as shown in <xref ref-type="table" rid="table-1">Table 1</xref>.</p>
<table-wrap id="table-1">
<label>Table 1</label>
<caption>
<title>MPPT performance comparison</title>
</caption>
<table>
<colgroup>
<col/>
<col/>
<col/>
<col/>
</colgroup>
<thead>
<tr>
<th>Metric</th>
<th>PID controller</th>
<th>ConvLSTM hybrid</th>
<th>Improvement</th>
</tr>
</thead>
<tbody>
<tr>
<td>Tracking efficiency</td>
<td>92.5%</td>
<td>98.7%</td>
<td>&#x002B;6.2%</td>
</tr>
<tr>
<td>Response time</td>
<td>2.1 s</td>
<td>0.8 s</td>
<td>&#x2212;61.9%</td>
</tr>
<tr>
<td>Partial shading loss</td>
<td>18.3%</td>
<td>5.1%</td>
<td>&#x2212;72.1%</td>
</tr>
<tr>
<td>Voltage ripple (V)</td>
<td>4.2 V</td>
<td>1.5 V</td>
<td>&#x2212;64.2%</td>
</tr>
<tr>
<td>Energy loss (per day)</td>
<td>2.8 kWh</td>
<td>0.7 kWh</td>
<td>&#x2212;75.0%</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>The ConvLSTM-based controller also features noise robustness and adaptability to unseen irradiance patterns, as verified using cross-validation with a 2022 test dataset. The model demonstrates generalization capability in diverse weather conditions such as overcast skies and intermittent cloud coverage. Moreover, a fallback PID loop is included in the system to ensure control stability during ConvLSTM retraining phases or sensor communication failures, thus enhancing overall system reliability.</p>
</sec>
<sec id="s2_2">
<label>2.2</label>
<title>Wind Turbine System with Turbulence Compensation</title>
<p>The 50 kW permanent magnet synchronous generator (PMSG)-based horizontal axis wind turbine (HAWT) is a critical component of the microgrid, contributing renewable energy during moderate to high wind periods (<xref ref-type="fig" rid="fig-2">Fig. 2</xref>). It converts wind energy into electrical energy via aerodynamic rotation and electromagnetic induction.</p>
<fig id="fig-2">
<label>Figure 2</label>
<caption>
<title>Visualization of the 50 kW permanent magnet synchronous generator (PMSG)-based horizontal axis wind turbine (HAWT)</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="JAI_66067-fig-2.tif"/>
</fig>
<p>The power output of the wind turbine is defined as:
<disp-formula id="eqn-3"><label>(3)</label><mml:math id="mml-eqn-3" display="block"><mml:msub><mml:mi>P</mml:mi><mml:mrow><mml:mi>w</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mfrac><mml:mn>1</mml:mn><mml:mn>2</mml:mn></mml:mfrac><mml:mi>&#x03C1;</mml:mi><mml:mi>A</mml:mi><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>p</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>&#x03BB;</mml:mi><mml:mo>,</mml:mo><mml:mi>&#x03B2;</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:msup><mml:mi>v</mml:mi><mml:mrow><mml:mn>3</mml:mn></mml:mrow></mml:msup></mml:math></disp-formula>where:
<list list-type="bullet">
<list-item>
<p><inline-formula id="ieqn-15"><mml:math id="mml-ieqn-15"><mml:mi>&#x03C1;</mml:mi></mml:math></inline-formula> &#x003D; air density (1.225 kg/m<sup>3</sup>),</p></list-item>
<list-item>
<p><inline-formula id="ieqn-16"><mml:math id="mml-ieqn-16"><mml:mi>A</mml:mi></mml:math></inline-formula> &#x003D; swept rotor area (254 m<sup>2</sup>),</p></list-item>
<list-item>
<p><inline-formula id="ieqn-17"><mml:math id="mml-ieqn-17"><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>p</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> &#x003D; power coefficient (function of tip-speed ratio <inline-formula id="ieqn-18"><mml:math id="mml-ieqn-18"><mml:mi>&#x03BB;</mml:mi></mml:math></inline-formula> and pitch angle <inline-formula id="ieqn-19"><mml:math id="mml-ieqn-19"><mml:mi>&#x03B2;</mml:mi></mml:math></inline-formula>),</p></list-item>
<list-item>
<p><inline-formula id="ieqn-20"><mml:math id="mml-ieqn-20"><mml:mi>v</mml:mi></mml:math></inline-formula> &#x003D; wind speed (m/s),</p></list-item>
<list-item>
<p><inline-formula id="ieqn-21"><mml:math id="mml-ieqn-21"><mml:mi>&#x03BB;</mml:mi></mml:math></inline-formula> &#x003D; tip-speed ratio &#x003D; <inline-formula id="ieqn-22"><mml:math id="mml-ieqn-22"><mml:mfrac><mml:mrow><mml:mi>&#x03C9;</mml:mi><mml:mi>R</mml:mi></mml:mrow><mml:mi>v</mml:mi></mml:mfrac></mml:math></inline-formula>, with <inline-formula id="ieqn-23"><mml:math id="mml-ieqn-23"><mml:mi>R</mml:mi></mml:math></inline-formula> being the rotor radius and <inline-formula id="ieqn-24"><mml:math id="mml-ieqn-24"><mml:mi>&#x03C9;</mml:mi></mml:math></inline-formula> the angular velocity.</p></list-item>
</list></p>
<p>The turbine&#x2019;s <inline-formula id="ieqn-25"><mml:math id="mml-ieqn-25"><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>p</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> curve is nonlinear and reaches a maximum of approximately 0.48 under optimal <inline-formula id="ieqn-26"><mml:math id="mml-ieqn-26"><mml:mi>&#x03BB;</mml:mi></mml:math></inline-formula> and <inline-formula id="ieqn-27"><mml:math id="mml-ieqn-27"><mml:mi>&#x03B2;</mml:mi></mml:math></inline-formula>. However, turbulence and gust-induced wind speed variability can induce torque oscillations, which degrade generator lifetime and reduce energy yield. To address these issues, a Gradient Boosted Regression Tree (GBRT) algorithm is used for real-time turbulence compensation.</p>
<p>The GBRT model is trained on 10 Hz Supervisory Control and Data Acquisition (SCADA) datasets capturing wind speed, power output, and pitch response. The control goal is to adjust the blade pitch angle <inline-formula id="ieqn-28"><mml:math id="mml-ieqn-28"><mml:mi>&#x03B2;</mml:mi></mml:math></inline-formula> dynamically to smooth power output while minimizing mechanical stress:
<disp-formula id="eqn-4"><label>(4)</label><mml:math id="mml-eqn-4" display="block"><mml:mi>&#x03B2;</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:munder><mml:mrow><mml:mtext>argmin</mml:mtext></mml:mrow><mml:mi>&#x03B2;</mml:mi></mml:munder><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mo>|</mml:mo><mml:msub><mml:mi>P</mml:mi><mml:mrow><mml:mi>r</mml:mi><mml:mi>e</mml:mi><mml:mi>f</mml:mi></mml:mrow></mml:msub><mml:mo>&#x2212;</mml:mo><mml:msub><mml:mi>P</mml:mi><mml:mrow><mml:mi>w</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>|</mml:mo></mml:mrow><mml:mo>+</mml:mo><mml:msub><mml:mi>&#x03BB;</mml:mi><mml:mrow><mml:mn>1</mml:mn></mml:mrow></mml:msub><mml:mrow><mml:mo>|</mml:mo><mml:mi>&#x03B2;</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>&#x2212;</mml:mo><mml:mi>&#x03B2;</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mn>1</mml:mn><mml:mo>)</mml:mo></mml:mrow><mml:mo>|</mml:mo></mml:mrow><mml:mo>)</mml:mo></mml:mrow></mml:math></disp-formula>where <inline-formula id="ieqn-29"><mml:math id="mml-ieqn-29"><mml:msub><mml:mi>&#x03BB;</mml:mi><mml:mrow><mml:mn>1</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula> is a regularization coefficient that penalizes abrupt pitch movements to avoid actuator wear.</p>
<p>Compared to a traditional Proportional-Integral (PI) controller, the GBRT-based pitch optimizer achieves:
<list list-type="bullet">
<list-item>
<p>41% reduction in generator torque oscillations,</p></list-item>
<list-item>
<p>17% higher energy yield during turbulent wind events,</p></list-item>
<list-item>
<p>Faster adaptation to gusts and lulls (&#x003C;0.5 s response time),</p></list-item>
<list-item>
<p>Lower mechanical stress on gearbox and bearings.</p></list-item>
</list></p>
<p><xref ref-type="fig" rid="fig-3">Fig. 3</xref> illustrates the comparative torque ripple under different controllers. The GBRT system also incorporates fallback PI control to ensure robust operation during network loss or model unavailability.</p>
<fig id="fig-3">
<label>Figure 3</label>
<caption>
<title>Torque oscillation comparison between PI and GBRT-based pitch control</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="JAI_66067-fig-3a.tif"/>
<graphic mimetype="image" mime-subtype="tif" xlink:href="JAI_66067-fig-3b.tif"/>
</fig>
</sec>
<sec id="s2_3">
<label>2.3</label>
<title>Battery Energy Storage System (BESS) with RL-Driven Optimization</title>
<p>The microgrid integrates a 50 Ah lithium-ion Battery Energy Storage System (BESS) connected to a DC link at 400 V. The BESS functions as a buffer to mitigate power imbalances, reduce peak grid imports, and support voltage stability. Its operation is governed by a reinforcement learning (RL) controller based on the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm, which handles continuous action spaces efficiently.</p>
<p>The state-space representation used for the TD3 agent includes:
<disp-formula id="eqn-5"><label>(5)</label><mml:math id="mml-eqn-5" display="block"><mml:mrow><mml:mtext>State</mml:mtext></mml:mrow><mml:msub><mml:mi>s</mml:mi><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mrow><mml:mo>[</mml:mo><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:mi>C</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>,</mml:mo><mml:msub><mml:mi>P</mml:mi><mml:mrow><mml:mi>l</mml:mi><mml:mi>o</mml:mi><mml:mi>a</mml:mi><mml:mi>d</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>,</mml:mo><mml:msub><mml:mi>P</mml:mi><mml:mrow><mml:mi>P</mml:mi><mml:mi>V</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>,</mml:mo><mml:msub><mml:mi>P</mml:mi><mml:mrow><mml:mi>w</mml:mi><mml:mi>i</mml:mi><mml:mi>n</mml:mi><mml:mi>d</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>,</mml:mo><mml:mi>t</mml:mi><mml:mo>]</mml:mo></mml:mrow></mml:math></disp-formula></p>
<p>The agent&#x2019;s action space:
<disp-formula id="eqn-6"><label>(6)</label><mml:math id="mml-eqn-6" display="block"><mml:mrow><mml:mtext>Action</mml:mtext></mml:mrow><mml:msub><mml:mi>a</mml:mi><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mo>&#x00B1;</mml:mo><mml:msub><mml:mi>P</mml:mi><mml:mrow><mml:mi>B</mml:mi><mml:mi>E</mml:mi><mml:mi>S</mml:mi><mml:mi>S</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>,</mml:mo><mml:msub><mml:mi>P</mml:mi><mml:mrow><mml:mi>B</mml:mi><mml:mi>E</mml:mi><mml:mi>S</mml:mi><mml:mi>S</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>&#x2208;</mml:mo><mml:mrow><mml:mo>[</mml:mo><mml:mo>&#x2212;</mml:mo><mml:mn>50</mml:mn><mml:mspace width="thinmathspace" /><mml:mrow><mml:mtext>kW</mml:mtext></mml:mrow><mml:mo>,</mml:mo><mml:mo>+</mml:mo><mml:mn>50</mml:mn><mml:mspace width="thinmathspace" /><mml:mrow><mml:mtext>kW</mml:mtext></mml:mrow><mml:mo>]</mml:mo></mml:mrow></mml:math></disp-formula></p>
<p>The reward function incentivizes grid stability, battery health, and demand management:
<disp-formula id="eqn-7"><label>(7)</label><mml:math id="mml-eqn-7" display="block"><mml:msub><mml:mi>r</mml:mi><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mo>&#x2212;</mml:mo><mml:mn>0.5</mml:mn><mml:mrow><mml:mo>|</mml:mo><mml:mrow><mml:mi mathvariant="normal">&#x0394;</mml:mi></mml:mrow><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>D</mml:mi><mml:mi>C</mml:mi></mml:mrow></mml:msub><mml:mo>|</mml:mo></mml:mrow><mml:mo>&#x2212;</mml:mo><mml:mn>0.3</mml:mn><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>d</mml:mi><mml:mi>e</mml:mi><mml:mi>g</mml:mi></mml:mrow></mml:msub><mml:mo>+</mml:mo><mml:mn>0.2</mml:mn><mml:mo movablelimits="true" form="prefix">min</mml:mo><mml:mrow><mml:mo>(</mml:mo><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:mi>C</mml:mi><mml:mo>,</mml:mo><mml:mn>100</mml:mn><mml:mo>&#x2212;</mml:mo><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:mi>C</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:math></disp-formula>where the degradation cost is estimated by:
<disp-formula id="eqn-8"><label>(8)</label><mml:math id="mml-eqn-8" display="block"><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>d</mml:mi><mml:mi>e</mml:mi><mml:mi>g</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:msup><mml:mi>e</mml:mi><mml:mrow><mml:mn>0.02</mml:mn><mml:mrow><mml:mo>|</mml:mo><mml:msub><mml:mi>I</mml:mi><mml:mrow><mml:mi>B</mml:mi><mml:mi>E</mml:mi><mml:mi>S</mml:mi><mml:mi>S</mml:mi></mml:mrow></mml:msub><mml:mo>|</mml:mo></mml:mrow></mml:mrow></mml:msup></mml:math></disp-formula></p>
<p>The controller:
<list list-type="bullet">
<list-item>
<p>Reduces peak load by 22% during critical demand periods,</p></list-item>
<list-item>
<p>Maintains State of Charge (SOC) between 20%&#x2013;80% to prolong battery life,</p></list-item>
<list-item>
<p>Ensures voltage deviation (<inline-formula id="ieqn-30"><mml:math id="mml-ieqn-30"><mml:mrow><mml:mo>|</mml:mo><mml:mrow><mml:mi mathvariant="normal">&#x0394;</mml:mi></mml:mrow><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>D</mml:mi><mml:mi>C</mml:mi></mml:mrow></mml:msub><mml:mo>|</mml:mo></mml:mrow></mml:math></inline-formula>) remains under 2% during transitions.</p></list-item>
</list></p>
<p><xref ref-type="fig" rid="fig-4">Fig. 4</xref> shows SOC profiles over a 24-h cycle with varying loads and renewable inputs.</p>
<fig id="fig-4">
<label>Figure 4</label>
<caption>
<title>BESS state of charge management under TD3 control</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="JAI_66067-fig-4.tif"/>
</fig>
</sec>
<sec id="s2_4">
<label>2.4</label>
<title>ML-Optimized EV Charging Station</title>
<p>The microgrid includes five bidirectional EV chargers, each supporting 22 kW charging/discharging via CCS/CHAdeMO standards. The EV charging subsystem supports both Vehicle-to-Grid (V2G) and Vehicle-to-Home (V2H) operations, optimizing load shifting and energy arbitrage.</p>
<p>The scheduling optimization is framed as a multi-objective constrained minimization problem:
<disp-formula id="eqn-9"><label>(9)</label><mml:math id="mml-eqn-9" display="block"><mml:mtable columnalign="left left left" rowspacing="4pt" columnspacing="1em"><mml:mtr><mml:mtd><mml:munder><mml:mrow><mml:mtext>minimize</mml:mtext></mml:mrow><mml:msub><mml:mi>u</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:munder></mml:mtd><mml:mtd><mml:munderover><mml:mo movablelimits="false">&#x2211;</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mn>5</mml:mn></mml:mrow></mml:munderover><mml:mrow><mml:mo>(</mml:mo><mml:mi>&#x03B1;</mml:mi><mml:mfrac><mml:msup><mml:mrow><mml:mo>(</mml:mo><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:msubsup><mml:mi>C</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>d</mml:mi><mml:mi>e</mml:mi><mml:mi>s</mml:mi></mml:mrow></mml:msubsup><mml:mo>&#x2212;</mml:mo><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup><mml:msubsup><mml:mi>t</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>d</mml:mi><mml:mi>e</mml:mi><mml:mi>p</mml:mi><mml:mi>a</mml:mi><mml:mi>r</mml:mi><mml:mi>t</mml:mi></mml:mrow></mml:msubsup></mml:mfrac><mml:mo>+</mml:mo><mml:mi>&#x03B2;</mml:mi><mml:msubsup><mml:mi>P</mml:mi><mml:mrow><mml:mi>g</mml:mi><mml:mi>r</mml:mi><mml:mi>i</mml:mi><mml:mi>d</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup><mml:mo>)</mml:mo></mml:mrow></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mrow><mml:mtext>subject to</mml:mtext></mml:mrow></mml:mtd><mml:mtd><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:msubsup><mml:mi>C</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi><mml:mi>i</mml:mi><mml:mi>n</mml:mi></mml:mrow></mml:msubsup><mml:mo>&#x2264;</mml:mo><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>&#x2264;</mml:mo><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:msubsup><mml:mi>C</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi><mml:mi>a</mml:mi><mml:mi>x</mml:mi></mml:mrow></mml:msubsup><mml:mo>,</mml:mo><mml:mi mathvariant="normal">&#x2200;</mml:mi><mml:mi>i</mml:mi></mml:mtd></mml:mtr><mml:mtr><mml:mtd /><mml:mtd><mml:munderover><mml:mo movablelimits="false">&#x2211;</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mn>5</mml:mn></mml:mrow></mml:munderover><mml:msub><mml:mi>P</mml:mi><mml:mrow><mml:mi>E</mml:mi><mml:mi>V</mml:mi><mml:mo>,</mml:mo><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>&#x2264;</mml:mo><mml:msubsup><mml:mi>P</mml:mi><mml:mrow><mml:mi>m</mml:mi><mml:mi>i</mml:mi><mml:mi>c</mml:mi><mml:mi>r</mml:mi><mml:mi>o</mml:mi><mml:mi>g</mml:mi><mml:mi>r</mml:mi><mml:mi>i</mml:mi><mml:mi>d</mml:mi></mml:mrow><mml:mrow><mml:mi>a</mml:mi><mml:mi>v</mml:mi><mml:mi>a</mml:mi><mml:mi>i</mml:mi><mml:mi>l</mml:mi></mml:mrow></mml:msubsup></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>where:
<list list-type="bullet">
<list-item>
<p><inline-formula id="ieqn-31"><mml:math id="mml-ieqn-31"><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:msubsup><mml:mi>C</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>d</mml:mi><mml:mi>e</mml:mi><mml:mi>s</mml:mi></mml:mrow></mml:msubsup></mml:math></inline-formula> is the target state-of-charge at departure,</p></list-item>
<list-item>
<p><inline-formula id="ieqn-32"><mml:math id="mml-ieqn-32"><mml:msub><mml:mi>P</mml:mi><mml:mrow><mml:mi>g</mml:mi><mml:mi>r</mml:mi><mml:mi>i</mml:mi><mml:mi>d</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> is the net grid power exchange,</p></list-item>
<list-item>
<p><inline-formula id="ieqn-33"><mml:math id="mml-ieqn-33"><mml:mi>&#x03B1;</mml:mi></mml:math></inline-formula>, <inline-formula id="ieqn-34"><mml:math id="mml-ieqn-34"><mml:mi>&#x03B2;</mml:mi></mml:math></inline-formula> are weighting coefficients.</p></list-item>
</list></p>
<p>A federated learning (FL) framework aggregates EV usage and departure data across 500 households without centralizing sensitive user information. The prediction accuracy of <inline-formula id="ieqn-35"><mml:math id="mml-ieqn-35"><mml:msubsup><mml:mi>t</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>d</mml:mi><mml:mi>e</mml:mi><mml:mi>p</mml:mi><mml:mi>a</mml:mi><mml:mi>r</mml:mi><mml:mi>t</mml:mi></mml:mrow></mml:msubsup></mml:math></inline-formula> reaches 89%, enabling predictive charging while preserving privacy.</p>
<p>During grid outages or islanded mode, the system enforces a priority-based discharge schedule for critical loads (medical devices, refrigeration, lighting), with a failover response time of less than 200 ms.</p>
</sec>
<sec id="s2_5">
<label>2.5</label>
<title>Integrated Energy Management Architecture</title>
<p>The microgrid&#x2019;s energy management architecture is centralized around a 400 V DC bus, regulated via a hybrid control scheme combining conventional PID and TD3-based correction for dynamic load adaptation.</p>
<p>The voltage deviation is controlled using:
<disp-formula id="eqn-10"><label>(10)</label><mml:math id="mml-eqn-10" display="block"><mml:mrow><mml:mi mathvariant="normal">&#x0394;</mml:mi></mml:mrow><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>D</mml:mi><mml:mi>C</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:msub><mml:mi>K</mml:mi><mml:mrow><mml:mi>p</mml:mi></mml:mrow></mml:msub><mml:mi>e</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>+</mml:mo><mml:msub><mml:mi>K</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:msubsup><mml:mo>&#x222B;</mml:mo><mml:mrow><mml:mn>0</mml:mn></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msubsup><mml:mi>e</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>&#x03C4;</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mi>d</mml:mi><mml:mi>&#x03C4;</mml:mi><mml:mo>+</mml:mo><mml:msub><mml:mi>K</mml:mi><mml:mrow><mml:mi>d</mml:mi></mml:mrow></mml:msub><mml:mfrac><mml:mrow><mml:mi>d</mml:mi><mml:mi>e</mml:mi></mml:mrow><mml:mrow><mml:mi>d</mml:mi><mml:mi>t</mml:mi></mml:mrow></mml:mfrac><mml:mo>+</mml:mo><mml:mrow><mml:mtext>TD</mml:mtext></mml:mrow><mml:mn>3</mml:mn><mml:mi mathvariant="normal">&#x005F;</mml:mi><mml:mrow><mml:mtext>Correction</mml:mtext></mml:mrow><mml:mrow><mml:mo>(</mml:mo><mml:mi>e</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>)</mml:mo></mml:mrow></mml:math></disp-formula>where <inline-formula id="ieqn-36"><mml:math id="mml-ieqn-36"><mml:mi>e</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>r</mml:mi><mml:mi>e</mml:mi><mml:mi>f</mml:mi></mml:mrow></mml:msub><mml:mo>&#x2212;</mml:mo><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>D</mml:mi><mml:mi>C</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula> and <inline-formula id="ieqn-37"><mml:math id="mml-ieqn-37"><mml:msub><mml:mi>K</mml:mi><mml:mrow><mml:mi>p</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula>, <inline-formula id="ieqn-38"><mml:math id="mml-ieqn-38"><mml:msub><mml:mi>K</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula>, <inline-formula id="ieqn-39"><mml:math id="mml-ieqn-39"><mml:msub><mml:mi>K</mml:mi><mml:mrow><mml:mi>d</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> are tuned empirically through a Ziegler-Nichols-based auto-tuning process. The PID provides baseline stability, while the TD3 agent offers fast corrections during high-variability events such as EV plug-ins or renewable surges.</p>
<p>This ensemble controller:
<list list-type="bullet">
<list-item>
<p>Maintains voltage within <inline-formula id="ieqn-40"><mml:math id="mml-ieqn-40"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula>2% of 400 V setpoint,</p></list-item>
<list-item>
<p>Keeps AC frequency deviations below <inline-formula id="ieqn-41"><mml:math id="mml-ieqn-41"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula>0.015 Hz during 100 kW step loads,</p></list-item>
<list-item>
<p>Prioritizes renewable dispatch while minimizing grid import/export penalties.</p></list-item>
</list></p>
<p><xref ref-type="fig" rid="fig-5">Fig. 5</xref> shows the ML-Enhanced Microgrid Control Architecture. <xref ref-type="table" rid="table-2">Table 2</xref> shows the System Parameters. In summary, this ML-driven microgrid architecture fuses physics-based models with intelligent forecasting, decision-making, and actuation, delivering resilient, scalable, and efficient performance. The next section presents detailed validation results using ISO 8528-8 transient protocols under varying load and generation conditions.</p>
<fig id="fig-5">
<label>Figure 5</label>
<caption>
<title>ML-enhanced microgrid control architecture</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="JAI_66067-fig-5.tif"/>
</fig><table-wrap id="table-2">
<label>Table 2</label>
<caption>
<title>System parameters</title>
</caption>
<table>
<colgroup>
<col align="center"/>
<col align="center"/>
</colgroup>
<thead>
<tr>
<th align="center">Component</th>
<th align="center">Specification</th>
</tr>
</thead>
<tbody>
<tr>
<td>Solar PV array</td>
<td>300 kW, 38.7 V/module (72 panels)</td>
</tr>
<tr>
<td>Wind turbine</td>
<td>50 kW PMSG, Rated speed: 11 m/s</td>
</tr>
<tr>
<td>Battery storage</td>
<td>50 Ah Li-ion, 400 V DC</td>
</tr>
<tr>
<td>EV charging</td>
<td>5 &#x00D7; 22 kW CCS/CHAdeMO</td>
</tr>
<tr>
<td>DC bus voltage</td>
<td>400 V, <inline-formula id="ieqn-42"><mml:math id="mml-ieqn-42"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula>2%</td>
</tr>
<tr>
<td>AC frequency</td>
<td>50 Hz, <inline-formula id="ieqn-43"><mml:math id="mml-ieqn-43"><mml:mo>&#x00B1;</mml:mo></mml:math></inline-formula>0.015 Hz</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s2_6">
<label>2.6</label>
<title>Real-Time Performance Evaluation</title>
<p>Regarding the lack of empirical data on real-time operational demands, a thorough performance evaluation was conducted. This assessment focuses on three critical aspects: algorithmic complexity, memory footprint, and processing latency. These factors are crucial for deploying the ML-enhanced energy management system in real-world microgrid environments.</p>
<sec id="s2_6_1">
<label>2.6.1</label>
<title>Algorithmic Complexity</title>
<p>The algorithmic complexity of the key ML components was evaluated to estimate the computational load during real-time execution.</p>
<list list-type="simple">
<list-item><label>&#x2022;</label>
<p><bold>ConvLSTM (Solar/Wind Forecasting):</bold>
<list list-type="bullet">
<list-item>
<p>Complexity: O (n &#x00D7; d &#x00D7; t) O (n &#x02216;times d &#x02216;times t) O (n &#x00D7; d &#x00D7; t)</p></list-item>
<list-item>
<p>Explanation: The model processes n sequences, each of length t with d features.</p></list-item>
<list-item>
<p>Application: Efficiently captures temporal patterns in solar irradiance and wind speed data.</p></list-item>
</list></p></list-item>
<list-item><label>&#x2022;</label>
<p><bold>TD3 (Battery SOC Management):</bold>
<list list-type="bullet">
<list-item>
<p>Complexity: O (n &#x00D7; a &#x00D7; d) O (n &#x02216;times a &#x02216;times d) O (n &#x00D7; a &#x00D7; d)</p></list-item>
<list-item>
<p>Explanation: The agent updates the actor and critic networks with n samples, a actions, and d dimensions.</p></list-item>
<list-item>
<p>Application: Real-time battery charge/discharge scheduling.</p></list-item>
</list></p></list-item>
<list-item><label>&#x2022;</label>
<p><bold>Federated Learning (EV Scheduling):</bold>
<list list-type="bullet">
<list-item>
<p>Complexity: O (n &#x00D7; m &#x00D7; t) O (n &#x02216;times m &#x02216;times t) O (n &#x00D7; m &#x00D7; t)</p></list-item>
<list-item>
<p>Explanation: n devices share m model updates over t iterations.</p></list-item>
<list-item>
<p>Application: Aggregates EV charging data without centralized data collection.</p></list-item>
</list></p></list-item>
</list>
</sec>
<sec id="s2_6_2">
<label>2.6.2</label>
<title>Memory Footprint</title>
<p>The memory usage was measured during peak load conditions, considering the execution of all three models simultaneously.
<list list-type="simple">
<list-item><label>&#x2022;</label>
<p><bold>ConvLSTM:</bold>
<list list-type="bullet">
<list-item>
<p>RAM Usage: 512 MB</p></list-item>
<list-item>
<p>GPU Usage: 1.2 GB</p></list-item>
<list-item>
<p>Reason: High memory demand due to temporal sequence processing.</p></list-item>
</list></p></list-item>
<list-item><label>&#x2022;</label>
<p><bold>TD3:</bold>
<list list-type="bullet">
<list-item>
<p>RAM Usage: 256 MB</p></list-item>
<list-item>
<p>GPU Usage: 800 MB</p></list-item>
<list-item>
<p>Reason: Requires storing state-action pairs and training two networks (actor and critic).</p></list-item>
</list></p></list-item>
<list-item><label>&#x2022;</label>
<p><bold>Federated Learning:</bold>
<list list-type="bullet">
<list-item>
<p>RAM Usage: 300 MB per device</p></list-item>
<list-item>
<p>GPU Usage: 900 MB per device</p></list-item>
<list-item>
<p>Reason: The aggregation process and local model training are memory-intensive, particularly during synchronous updates.</p></list-item>
</list></p></list-item>
</list></p>
</sec>
<sec id="s2_6_3">
<label>2.6.3</label>
<title>Processing Latency</title>
<p>Latency was measured as the time between data acquisition and action execution. The analysis was conducted using a NVIDIA Tesla T4 GPU and an Intel Xeon CPU.
<list list-type="simple">
<list-item><label>&#x2022;</label>
<p><bold>ConvLSTM Prediction:</bold>
<list list-type="bullet">
<list-item>
<p>Average Latency: 20 ms per prediction</p></list-item>
<list-item>
<p>Peak Latency: 35 ms during multi-tasking</p></list-item>
<list-item>
<p>Reason: High due to sequence-to-sequence prediction.</p></list-item>
</list></p></list-item>
<list-item><label>&#x2022;</label>
<p><bold>TD3 Inference:</bold>
<list list-type="bullet">
<list-item>
<p>Average Latency: 15 ms per action</p></list-item>
<list-item>
<p>Peak Latency: 25 ms during high load scenarios</p></list-item>
<list-item>
<p>Reason: Computationally efficient due to parallel actor-critic updates.</p></list-item>
</list></p></list-item>
<list-item><label>&#x2022;</label>
<p><bold>Federated Update (per Device):</bold>
<list list-type="bullet">
<list-item>
<p>Average Latency: 50 ms per update</p></list-item>
<list-item>
<p>Peak Latency: 100 ms during aggregation</p></list-item>
<list-item>
<p>Reason: Increased when multiple EVs update simultaneously. <xref ref-type="table" rid="table-3">Table 3</xref> shows the real-time performance metrics.</p>
</list-item>
</list></p></list-item>
</list><table-wrap id="table-3">
<label>Table 3</label>
<caption>
<title>Real-time performance metrics</title>
</caption>
<table>
<colgroup>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
</colgroup>
<thead>
<tr>
<th>Metric</th>
<th>ConvLSTM</th>
<th>TD3</th>
<th align="center">Federated learning</th>
</tr>
</thead>
<tbody>
<tr>
<td>Algorithmic complexity</td>
<td>O (n &#x00D7; d &#x00D7; t) O (n &#x02216;times d &#x02216;times t) O (n &#x00D7; d &#x00D7; t)</td>
<td>O (n &#x00D7; a &#x00D7; d) O (n &#x02216;times a &#x02216;times d) O (n &#x00D7; a &#x00D7; d)</td>
<td>O (n &#x00D7; m &#x00D7; t) O (n &#x02216;times m &#x02216;times t) O (n &#x00D7; m &#x00D7; t)</td>
</tr>
<tr>
<td>RAM usage (MB)</td>
<td>512</td>
<td>256</td>
<td>300 per device</td>
</tr>
<tr>
<td>GPU usage (MB)</td>
<td>1200</td>
<td>800</td>
<td>900 per device</td>
</tr>
<tr>
<td>Average latency (ms)</td>
<td>20</td>
<td>15</td>
<td>50</td>
</tr>
<tr>
<td>Peak latency (ms)</td>
<td>35</td>
<td>25</td>
<td>100</td>
</tr>
</tbody>
</table>
</table-wrap>
</p>
</sec>
<sec id="s2_6_4">
<label>2.6.4</label>
<title>Interpretation of Results</title>
<p>The TD3 agent demonstrates the lowest latency and moderate memory consumption, making it suitable for real-time control tasks such as battery management. ConvLSTM exhibits slightly higher latency due to the computational demands of sequence processing. The Federated Learning setup incurs the most significant delay, especially during synchronous aggregation when multiple EVs update simultaneously. To mitigate this, the study suggests implementing asynchronous update protocols to enhance responsiveness.</p>
</sec>
<sec id="s2_6_5">
<label>2.6.5</label>
<title>Optimization Strategies</title>
<p><list list-type="order">
<list-item>
<p><bold>Batch Processing for ConvLSTM:</bold> Reducing batch size during real-time inference can decrease latency by approximately 10%&#x2013;15%.</p></list-item>
<list-item>
<p><bold>Actor-Critic Parallelism for TD3:</bold> Utilizing dual-thread execution for actor and critic networks improves response time by around 20%.</p></list-item>
<list-item>
<p><bold>Hierarchical Aggregation for Federated Learning:</bold> Grouping devices by proximity and aggregating in sub-clusters can cut synchronization time by 30%.</p></list-item>
</list></p>
</sec>
<sec id="s2_6_6">
<label>2.6.6</label>
<title>Summary</title>
<p>The real-time performance analysis confirms that the proposed system meets the latency requirements for dynamic microgrid management, especially under high variability conditions. However, optimizing federated updates and ConvLSTM predictions could further improve efficiency. Future work may involve deploying lightweight model variants for edge-based applications, reducing memory footprint and latency.</p>
</sec>
</sec>
</sec>
<sec id="s3">
<label>3</label>
<title>Results and Discussion</title>
<p>The hybrid microgrid system serves a dual function, meeting the energy needs of both AC and DC loads, while also acting as a charging and discharging hub for multiple electric vehicles. It incorporates various renewable energy sources such as solar, wind, and batteries to ensure a sustainable and dependable energy supply, even in the face of power grid failures. The solar component, utilizing Solar panel TPS105S-295W (72) cells and managed by MATLAB Simulink&#x2019;s power system toolbox, can generate a peak output of 300 kW thanks to Maximum Power Point Tracking (MPPT) controllers. In tandem with solar panels, Permanent Magnet Synchronous Generators (PMSM) are employed for harnessing wind energy, optimizing power up to 45 kW via DC/DC converters. The system&#x2019;s Lithium-ion batteries (50 Ah capacity) are regulated by a DC/DC converter to ensure efficient charging and discharging, kicking in during power shortages. It can accommodate a 100 kW DC load, a 100 kW AC load, and utilize surplus energy for electric vehicle charging. <xref ref-type="table" rid="table-4">Table 4</xref> provides a detailed breakdown of the system&#x2019;s components and functionalities.</p>
<table-wrap id="table-4">
<label>Table 4</label>
<caption>
<title>System&#x2019;s components and functionalities</title>
</caption>
<table>
<colgroup>
<col align="center"/>
<col align="center"/>
</colgroup>
<thead>
<tr>
<th>Component</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td>System functionality</td>
<td>Hybrid microgrid system catering to AC/DC loads and serving as an EV charging station</td>
</tr>
<tr>
<td>Energy sources</td>
<td>Solar, wind, and Lithium-ion batteries</td>
</tr>
<tr>
<td>Solar system</td>
<td>Shenzhen Topray Solar TPS105S-295W (72) with MPPT controllers for 300 kW peak output</td>
</tr>
<tr>
<td>Wind energy</td>
<td>Permanent Magnet Synchronous Generators (PMSM) with DC/DC converters for up to 50 kW</td>
</tr>
<tr>
<td>Battery system</td>
<td>50 Ah capacity Lithium-ion batteries, regulated by DC/DC converter</td>
</tr>
<tr>
<td>Backup power</td>
<td>Activates during power grid failures or insufficient renewable energy supply</td>
</tr>
<tr>
<td>Load requirements</td>
<td>100 kW DC load, 100 kW AC load</td>
</tr>
<tr>
<td>Excess energy utilization for EV charging</td>
<td>100 kW for electric vehicle charging</td>
</tr>
<tr>
<td>Energy management system (EMS)</td>
<td>Ensures stable voltage&#x2014;400 V, frequency&#x2014;50 Hz</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>In this power system simulation, <xref ref-type="fig" rid="fig-6">Figs. 6</xref> and <xref ref-type="fig" rid="fig-7">7</xref> depict the scenarios for solar irradiation and wind speed, respectively.</p>
<fig id="fig-6">
<label>Figure 6</label>
<caption>
<title>Solar irradiance changes in simulation</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="JAI_66067-fig-6.tif"/>
</fig><fig id="fig-7">
<label>Figure 7</label>
<caption>
<title>Wind speed changes in simulation</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="JAI_66067-fig-7.tif"/>
</fig>
<p>Based on <xref ref-type="fig" rid="fig-8">Figs. 8</xref> and <xref ref-type="fig" rid="fig-9">9</xref>, it is evident that there is a need to increase the current renewable energy resources in order to meet the immediate power demand of 250 kW. Specifically, during the time interval from t &#x003D; 0.5 s to t &#x003D; 1 s, the Microgrid experiences a surplus of power, as the output from renewable sources exceeds 100 kW. Recognizing the crucial role of the battery storage system in maintaining stability within the Microgrid, it is essential to implement an energy management system. This system is vital for achieving a balance between the varying demands placed on the Microgrid and the fluctuating availability of power from renewable sources. At the outset of the simulation, the batteries provide the initial power injection to bridge any gaps in the Microgrids balance. The battery storage system acts as a key mechanism for ensuring stability amid the intermittent nature of renewable energy production. <xref ref-type="fig" rid="fig-10">Fig. 10</xref> illustrates the battery state of charge, showing a fluctuating pattern where the batteries discharge during periods of insufficient renewable power supply to the Microgrid and recharge during times of power surplus through carefully orchestrated management processes.</p>
<fig id="fig-8">
<label>Figure 8</label>
<caption>
<title>Generated solar power</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="JAI_66067-fig-8.tif"/>
</fig><fig id="fig-9">
<label>Figure 9</label>
<caption>
<title>Generated wind power</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="JAI_66067-fig-9.tif"/>
</fig><fig id="fig-10">
<label>Figure 10</label>
<caption>
<title>Measured battery state of charge</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="JAI_66067-fig-10.tif"/>
</fig>
<p><xref ref-type="fig" rid="fig-11">Fig. 11</xref> shows the AC Bus power measurements. Our energy management system is built around a sophisticated battery storage system that is dynamically coupled to the microgrid bus via a bidirectional DC-DC converter. The PID controller effectively regulates the charging and discharging operations, ensuring that the microgrid&#x2019;s energy requirements are easily met. Through an intensive temporal study spanning t &#x003D; 0 s to t &#x003D; 0.5 s, we determined that the microgrid bus was consuming power, resulting in a decrease in the battery&#x2019;s state of charge and serving as a signal of its discharge mode. Following this, power generation grew dramatically from t &#x003D; 0.5 s to t &#x003D; 1 s, resulting in an energy surplus greater than the capacity needs. As a result, the battery went into charging mode, absorbing the excess energy. The primary goal of this research is to create a viable technique for seamlessly integrating electric vehicles into the microgrid while maintaining its dependability. During the preliminary stage, the microgrid&#x2019;s reliability was tested in the absence of plug-in automobiles. The major goal of our energy management system is to keep power levels, voltage, and frequency constant across both microgrid vehicles. To underline the importance of these essential criteria and assist a complete examination, a supplementary figure will be provided alongside this discussion.</p>
<fig id="fig-11">
<label>Figure 11</label>
<caption>
<title>AC bus power measurement</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="JAI_66067-fig-11.tif"/>
</fig>
<p>As stated previously, the principal objective of this investigation was to achieve a state of equilibrium pertaining to power and voltage across the DC bus. It is worth mentioning that the DC bus maintains a consistent power level of 50 kW, which establishes a stable foundation. Conversely, the AC bus displays dynamic fluctuations in power, fluctuating between 50 kW and 100 kW. The voltage measurements consistently uphold a value of 400 V, which functions as the foundational reference condition for the entirety of the simulation. Ensuring comprehensive monitoring and regulation of power and voltage attributes is imperative for sustaining the reliable and effective functioning of the micro grid. <xref ref-type="fig" rid="fig-12">Fig. 12</xref> shows the DC Bus Power Measurement. <xref ref-type="fig" rid="fig-13">Fig. 13</xref> shows the DC Bus Voltage Measurement</p>
<fig id="fig-12">
<label>Figure 12</label>
<caption>
<title>DC bus power measurement</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="JAI_66067-fig-12.tif"/>
</fig><fig id="fig-13">
<label>Figure 13</label>
<caption>
<title>DC bus voltage measurement</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="JAI_66067-fig-13.tif"/>
</fig>
<p><xref ref-type="fig" rid="fig-14">Fig. 14</xref> shows the AC Bus Frequency Measurement. The frequency variation falls within the range of &#x00B1;0.02 Hz, which aligns with the acceptable margin for frequency fluctuations. This demonstrates the robustness of the proposed energy management system in effectively maintaining the balance between energy production and consumption.</p>
<fig id="fig-14">
<label>Figure 14</label>
<caption>
<title>AC bus frequency measurement</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="JAI_66067-fig-14.tif"/>
</fig>
<p>The <xref ref-type="fig" rid="fig-15">Fig. 15</xref> provides a visual representation of available power, which serves as a comparative analysis between renewable energy production and load consumption. At the simulation&#x2019;s outset, the available power registers below zero, indicating a deficit in the microgrid&#x2019;s energy supply. In response, electric cars with a state of charge exceeding 50% are eligible for discharge when connected to the microgrid. Conversely, during other intervals, the inverse holds true, where discharge is not required due to improved power availability. It takes a dynamic approach to optimize resource utilization for efficient energy management in the micro grid.</p>
<fig id="fig-15">
<label>Figure 15</label>
<caption>
<title>Available microgrid power</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="JAI_66067-fig-15.tif"/>
</fig>
<p><xref ref-type="fig" rid="fig-16">Fig. 16</xref> illustrates the state of charge (SOC) for the first electric vehicle during system simulation. Initially, the available power is below zero, indicating an energy shortfall in the microgrid. At 0.18 s, the available power rises above zero, prompting the start of charging for electric car 1, as evident by the increase in SOC. At 0.9 s, the available power falls below zero once more, leading to the cessation of charging for the electric vehicle.</p>
<fig id="fig-16">
<label>Figure 16</label>
<caption>
<title>State of charge for electric 1 car 1</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="JAI_66067-fig-16.tif"/>
</fig>
<p>For the second electric vehicle, it discharges when the available power is less than zero, with an initial state of charge of 70%. Between 0.18 and 0.9 s, the rate of discharge decreases as available power increases above zero. After 0.9 s when the available power again drops below zero, the electric car starts to discharge again. <xref ref-type="fig" rid="fig-17">Fig. 17</xref> shows the State of Charge for Electric Car 2.</p>
<fig id="fig-17">
<label>Figure 17</label>
<caption>
<title>State of charge for electric car 2</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="JAI_66067-fig-17.tif"/>
</fig>
<sec id="s3_1">
<label>3.1</label>
<title>Integration of ML</title>
<p>The ML-enhanced hybrid microgrid system demonstrates superior performance in balancing AC/DC loads and managing electric vehicle (EV) charging/discharging operations while maintaining grid stability under dynamic conditions. By integrating a ConvLSTM-based renewable energy forecaster, the system achieves 98.7% accuracy in predicting solar irradiance and wind speed fluctuations 15 min ahead, enabling proactive energy allocation. This predictive capability, combined with a Twin Delayed DDPG (TD3) reinforcement learning agent, reduces peak demand by 22% compared to conventional PID-controlled systems. The TD3 agent optimizes power flows through the following reward function:
<disp-formula id="eqn-11"><label>(11)</label><mml:math id="mml-eqn-11" display="block"><mml:msub><mml:mi>r</mml:mi><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mo>&#x2212;</mml:mo><mml:mn>0.5</mml:mn><mml:mo>&#x2223;</mml:mo><mml:mi mathvariant="normal">&#x0394;</mml:mi><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>D</mml:mi><mml:mi>C</mml:mi></mml:mrow></mml:msub><mml:mo>&#x2223;</mml:mo><mml:mo>&#x2212;</mml:mo><mml:mn>0.3</mml:mn><mml:msup><mml:mrow><mml:mtext>e</mml:mtext></mml:mrow><mml:mrow><mml:mrow><mml:msup><mml:mn>0.02</mml:mn><mml:mrow><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mo stretchy="false">|</mml:mo></mml:mrow><mml:mrow><mml:mo stretchy="false">|</mml:mo></mml:mrow><mml:mi>I</mml:mi><mml:mi>B</mml:mi><mml:mi>E</mml:mi><mml:mi>S</mml:mi><mml:mi>S</mml:mi><mml:mrow><mml:mo stretchy="false">|</mml:mo></mml:mrow><mml:mrow><mml:mo stretchy="false">|</mml:mo></mml:mrow><mml:mo>)</mml:mo></mml:mrow></mml:mrow></mml:msup></mml:mrow></mml:mrow></mml:msup><mml:mo>+</mml:mo><mml:mn>0.2</mml:mn><mml:mi>m</mml:mi><mml:mi>i</mml:mi><mml:mi>n</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:mi>C</mml:mi><mml:mo>,</mml:mo><mml:mn>1</mml:mn><mml:mo>&#x2212;</mml:mo><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:mi>C</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:math></disp-formula>where &#x0394;<italic>V</italic><sub><italic>DC</italic></sub> represents <italic>DC</italic> bus voltage deviations and <italic>IBESS</italic> is the battery current.</p>
<p>The 300 kW solar array, governed by our hybrid ConvLSTM-MPPT controller, maintains 98.2% tracking efficiency under partial shading&#x2014;a 6.5% improvement over traditional perturb-and-observe methods. Concurrently, the 50 kW PMSM wind turbine, regulated by a gradient-boosted pitch control system, reduces torque oscillations by 41% during turbulent wind conditions, enhancing gearbox longevity.</p>
<p><xref ref-type="fig" rid="fig-18">Fig. 18</xref> highlights the torque oscillation comparison between the conventional PI controller and the proposed GBRT-based pitch control system. Under identical turbulent wind conditions, the GBRT approach reduces torque ripple by approximately 41%, lowering mechanical stress on the wind turbine drivetrain. This results in smoother rotational dynamics and extends the operational lifespan of critical components such as the gearbox and bearings. <xref ref-type="fig" rid="fig-19">Fig. 19</xref> presents the State of Charge (SOC) management profile of the battery under TD3 reinforcement learning control. The model successfully maintains SOC within the optimal operational window (20%&#x2013;80%) and demonstrates a 50% reduction in SOC prediction error compared to baseline rule-based or PID systems. This enhances battery health by limiting depth-of-discharge (DoD) and prevents overcharging, thereby improving long-term storage efficiency and reliability. <xref ref-type="fig" rid="fig-20">Fig. 20</xref> illustrates the forecasting accuracy of the ConvLSTM-based solar irradiance predictor and its impact on MPPT efficiency. The predicted irradiance closely follows actual measurements with a root mean square error (RMSE) of 38 W/m<sup>2</sup> and an R<sup>2</sup> of 0.992, enabling the hybrid MPPT controller to achieve 98.2% tracking efficiency. This marks a 6.5% improvement over traditional Perturb and Observe (P&#x0026;O) methods, significantly reducing daily energy loss and improving energy yield during partial shading and variable cloud conditions.</p>
<fig id="fig-18">
<label>Figure 18</label>
<caption>
<title>Torque oscillation reduction 41% improvement</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="JAI_66067-fig-18.tif"/>
</fig><fig id="fig-19">
<label>Figure 19</label>
<caption>
<title>TD3 battery soc management 50% error reduction</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="JAI_66067-fig-19.tif"/>
</fig><fig id="fig-20">
<label>Figure 20</label>
<caption>
<title>Solar irradiance forecasting and MPPT efficiency comparison</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="JAI_66067-fig-20.tif"/>
</fig>
<p>Key performance metrics include:</p>
<p>Renewable utilization rate: 92.4% (&#x002B;18% vs. rule-based systems)</p>
<p>Frequency stability: Maintained within &#x00B1;0.015 Hz during 100 kW load steps</p>
<p>EV charging efficiency: 94.7% through federated learning-driven scheduling. <xref ref-type="table" rid="table-5">Table 5</xref> shows the Key performance.</p>
<table-wrap id="table-5">
<label>Table 5</label>
<caption>
<title>Key performance</title>
</caption>
<table>
<colgroup>
<col/>
<col/>
<col/>
<col/>
</colgroup>
<thead>
<tr>
<th>Metric</th>
<th>Conventional system</th>
<th>ML-enhanced system</th>
<th>Improvement</th>
</tr>
</thead>
<tbody>
<tr>
<td>Peak demand (kW)</td>
<td>128</td>
<td>100</td>
<td>22% &#x2193;</td>
</tr>
<tr>
<td>Voltage deviation (%)</td>
<td>4.2</td>
<td>1.8</td>
<td>57% &#x2193;</td>
</tr>
<tr>
<td>SOC management error</td>
<td>12.5%</td>
<td>3.8%</td>
<td>70% &#x2193;</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>The lithium-ion BESS (50 Ah capacity) demonstrates adaptive cycling under TD3 control, restricting depth-of-discharge to 60% during grid outages while prioritizing critical loads. The federated EV scheduler reduces charging costs by 31% by leveraging distributed learning across 500&#x002B; households, solving:
<disp-formula id="eqn-12"><label>(12)</label><mml:math id="mml-eqn-12" display="block"><mml:mi>m</mml:mi><mml:mi>i</mml:mi><mml:mi>n</mml:mi><mml:munderover><mml:mo movablelimits="false">&#x2211;</mml:mo><mml:mrow><mml:mrow><mml:mo>(</mml:mo><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn><mml:mo>)</mml:mo></mml:mrow></mml:mrow><mml:mrow><mml:mi>N</mml:mi></mml:mrow></mml:munderover><mml:mi>t</mml:mi><mml:mi>i</mml:mi><mml:mi>d</mml:mi><mml:mi>e</mml:mi><mml:mi>p</mml:mi><mml:mi>a</mml:mi><mml:mi>r</mml:mi><mml:mi>t</mml:mi><mml:msup><mml:mrow><mml:mo>(</mml:mo><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:msubsup><mml:mi>C</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>d</mml:mi><mml:mi>e</mml:mi><mml:mi>s</mml:mi><mml:mi>i</mml:mi><mml:mi>r</mml:mi><mml:mi>e</mml:mi><mml:mi>d</mml:mi></mml:mrow></mml:msubsup><mml:mo>&#x2212;</mml:mo><mml:mi>S</mml:mi><mml:mi>O</mml:mi><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup><mml:mo>+</mml:mo><mml:mi>&#x03BB;</mml:mi><mml:mo>&#x2225;</mml:mo><mml:mi>P</mml:mi><mml:mi>g</mml:mi><mml:mi>r</mml:mi><mml:mi>i</mml:mi><mml:mi>d</mml:mi><mml:msup><mml:mo stretchy="false">&#x2225;</mml:mo><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup></mml:math></disp-formula></p>
<p>Real-time hardware-in-loop simulations confirm the system sustains 400 V &#x00B1;2% DC bus voltage during simultaneous 100 kW AC/DC loading and 50 kW EV fast-charging, with seamless fallback to PID control during ML model updates. This dual-layer architecture ensures 99.98% uptime&#x2014;critical for residential healthcare applications requiring uninterrupted power.</p>
<p>These results validate that machine learning transforms microgrids from passive energy systems into cognitive infrastructures capable of self-optimization under the &#x201C;triple uncertainty&#x201D; of renewable generation, EV mobility patterns, and load volatility.</p>
</sec>
<sec id="s3_2">
<label>3.2</label>
<title>ML Model Configuration and Preprocessing</title>
<p>This section details the machine learning (ML) configuration and preprocessing steps employed to optimize the energy management system for resilient residential microgrids.</p>
<sec id="s3_2_1">
<label>3.2.1</label>
<title>Dataset Description</title>
<p>The ML models for solar and wind forecasting, battery energy storage optimization, and EV charging management are trained using the following datasets:
<list list-type="simple">
<list-item><label>&#x2022;</label>
<p><bold>Solar Irradiance Data:</bold>
<list list-type="bullet">
<list-item>
<p>Data collected over five years from local meteorological stations, capturing hourly solar irradiance (W/m<sup>2</sup>), ambient temperature (&#x00B0;C), and cloud coverage.</p></list-item>
<list-item>
<p>Utilized for training the ConvLSTM forecasting model to predict solar power generation at 15-min intervals.</p></list-item>
</list></p></list-item>
<list-item><label>&#x2022;</label>
<p><bold>Wind Turbine Data:</bold>
<list list-type="bullet">
<list-item>
<p>Real-time wind speed measurements (m/s) and turbine rotational speeds from a 50 kW wind turbine system.</p></list-item>
<list-item>
<p>Integrated with the Gradient Boosted Regression Tree (GBRT) model for turbulence compensation and torque oscillation reduction.</p></list-item>
</list></p></list-item>
<list-item><label>&#x2022;</label>
<p><bold>Battery Energy Storage Data:</bold>
<list list-type="bullet">
<list-item>
<p>Historical charge/discharge cycles, state of charge (SOC) variations, and voltage levels from a 50 Ah lithium-ion battery system.</p></list-item>
<list-item>
<p>Optimized through a Twin Delayed Deep Deterministic Policy Gradient (TD3) reinforcement learning agent to balance microgrid loads.</p></list-item>
</list></p></list-item>
<list-item><label>&#x2022;</label>
<p><bold>Electric Vehicle Charging Data:</bold>
<list list-type="simple">
<list-item><label>&#x25CB;</label>
<p>Federated learning is applied to data collected from 500 residential EVs.</p></list-item>
<list-item>
<p>&#x2013; Parameters include charging time, initial SOC, energy consumption, and discharge rates during Vehicle-to-Grid (V2G) operations.</p></list-item>
</list></p></list-item>
</list></p>
</sec>
<sec id="s3_2_2">
<label>3.2.2</label>
<title>Data Preprocessing</title>
<p>To enhance the accuracy and performance of ML algorithms, the following preprocessing steps are performed:
<list list-type="order">
<list-item>
<p><bold>Data Normalization:</bold>
<list list-type="simple">
<list-item><label>&#x2022;</label>
<p>All features are scaled between [0, 1] using Min-Max scaling to prevent model bias towards higher numerical ranges.</p></list-item>
<list-item><label>&#x2022;</label>
<p>The normalization is applied as follows:</p></list-item>
</list></p></list-item>
</list></p>
<p><disp-formula id="eqn-13"><label>(13)</label><mml:math id="mml-eqn-13" display="block"><mml:msub><mml:mi>X</mml:mi><mml:mrow><mml:mi>n</mml:mi><mml:mi>o</mml:mi><mml:mi>r</mml:mi><mml:mi>m</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mi>X</mml:mi><mml:mo>&#x2212;</mml:mo><mml:msub><mml:mi>X</mml:mi><mml:mrow><mml:mi>m</mml:mi><mml:mi>i</mml:mi><mml:mi>n</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mrow><mml:msub><mml:mi>X</mml:mi><mml:mrow><mml:mi>m</mml:mi><mml:mi>a</mml:mi><mml:mi>x</mml:mi></mml:mrow></mml:msub><mml:mo>&#x2212;</mml:mo><mml:msub><mml:mi>X</mml:mi><mml:mrow><mml:mi>m</mml:mi><mml:mi>i</mml:mi><mml:mi>n</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:mfrac></mml:math></disp-formula>where <inline-formula id="ieqn-44"><mml:math id="mml-ieqn-44"><mml:mi>X</mml:mi></mml:math></inline-formula> represents the feature vector, <inline-formula id="ieqn-45"><mml:math id="mml-ieqn-45"><mml:msub><mml:mi>X</mml:mi><mml:mrow><mml:mi>m</mml:mi><mml:mi>i</mml:mi><mml:mi>n</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> and <inline-formula id="ieqn-46"><mml:math id="mml-ieqn-46"><mml:msub><mml:mi>X</mml:mi><mml:mrow><mml:mi>m</mml:mi><mml:mi>a</mml:mi><mml:mi>x</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> are the minimum and maximum values of the feature set, respectively.
<list list-type="order">
<list-item>
<p><bold>Temporal Slicing and Windowing:</bold>
<list list-type="simple">
<list-item><label>&#x2022;</label>
<p>For the ConvLSTM model, a sliding window of 24 h is applied to the time series data to predict the next 15-min interval.</p></list-item>
<list-item><label>&#x2022;</label>
<p>Wind speed and solar irradiance are captured in overlapping windows of <bold>5 min</bold> to enhance prediction accuracy.</p></list-item>
</list></p></list-item>
<list-item>
<p><bold>Outlier Detection and Removal:</bold>
<list list-type="simple">
<list-item><label>&#x2022;</label>
<p>Outliers in wind speed (&#x003E;20 m/s) and solar irradiance (&#x003E;1000 W/m<sup>2</sup>) are removed to avoid skewed model training.</p></list-item>
<list-item><label>&#x2022;</label>
<p>Extreme SOC values outside the operational range of 20% to 80% are discarded for battery life preservation.</p></list-item>
</list></p></list-item>
<list-item>
<p><bold>Handling Missing Data:</bold>
<list list-type="simple">
<list-item><label>&#x2022;</label>
<p>Missing entries are filled using linear interpolation for continuous features and mode imputation for categorical variables.</p></list-item>
</list></p></list-item>
</list></p>
</sec>
<sec id="s3_2_3">
<label>3.2.3</label>
<title>Feature Selection</title>
<p>The ML models utilize the following features:</p>
<p>This <xref ref-type="table" rid="table-6">Table 6</xref> summarizes the key datasets used for training the machine learning models. Each dataset is associated with specific features, collection intervals, and the primary application within the microgrid system.</p>
<table-wrap id="table-6">
<label>Table 6</label>
<caption>
<title>Dataset description</title>
</caption>
<table>
<colgroup>
<col/>
<col/>
</colgroup>
<thead>
<tr>
<th>Model</th>
<th>Selected features</th>
</tr>
</thead>
<tbody>
<tr>
<td><bold>ConvLSTM</bold></td>
<td>Solar irradiance, ambient temperature, cloud coverage, panel voltage and current</td>
</tr>
<tr>
<td><bold>GBRT</bold></td>
<td>Wind speed, blade pitch angle, rotor speed, power output</td>
</tr>
<tr>
<td><bold>TD3 Agent</bold></td>
<td>Battery SOC, grid voltage, load demand, discharge rate</td>
</tr>
<tr>
<td><bold>Federated EV</bold></td>
<td>EV SOC, charging time, grid state, V2G availability</td>
</tr>
</tbody>
</table>
<table-wrap-foot><fn id="table-6fn1" fn-type="other"><p>Note: <xref ref-type="table" rid="table-6">Table 6</xref> provides a comprehensive overview of the datasets utilized for training the various machine learning models within the proposed ML-enhanced microgrid system. This table categorizes the essential features required for each specific model component, ensuring optimal forecasting and load management capabilities. The ConvLSTM model relies on solar-related parameters including solar irradiance, ambient temperature, cloud coverage, and electrical characteristics (panel voltage and current). These features are crucial for accurate solar power generation forecasting, as they capture both meteorological conditions and the electrical response of the photovoltaic system. The temporal nature of these parameters makes them ideal for the ConvLSTM&#x2019;s sequence-to-sequence prediction capability.</p></fn></table-wrap-foot>
</table-wrap>
<p>The features are selected based on their correlation with energy generation and consumption patterns, ensuring optimal forecasting and load management.</p>
</sec>
<sec id="s3_2_4">
<label>3.2.4</label>
<title>Hyperparameter Configuration</title>
<p>The ML models are fine-tuned with the following hyperparameters:</p>
<p>This <xref ref-type="table" rid="table-7">Table 7</xref> compares the performance of the proposed ML models against traditional baseline methods. The proposed configurations show marked improvements in accuracy, prediction reliability, and error minimization.</p>
<p><list list-type="bullet">
<list-item>
<p><bold>ConvLSTM:</bold> Tuned for 15-min interval predictions with temporal dependencies.</p></list-item>
<list-item>
<p><bold>GBRT:</bold> Configured for real-time pitch angle adjustments and torque oscillation minimization.</p></list-item>
<list-item>
<p><bold>TD3 Agent:</bold> Adjusted for real-time battery optimization and microgrid load balancing.</p></list-item>
<list-item>
<p><bold>Federated EV Scheduler:</bold> Optimized for minimal latency and privacy-preserving model synchronization.</p></list-item>
</list></p>

<table-wrap id="table-7">
<label>Table 7</label>
<caption>
<title>Data preprocessing techniques</title>
</caption>
<table>
<colgroup>
<col/>
<col/>
<col/>
<col/>
<col/>
<col/>
</colgroup>
<thead>
<tr>
<th>Model</th>
<th>Learning rate</th>
<th>Batch size</th>
<th>Epochs</th>
<th>Optimizer</th>
<th>Activation function</th>
</tr>
</thead>
<tbody>
<tr>
<td><bold>ConvLSTM</bold></td>
<td>0.001</td>
<td>64</td>
<td>100</td>
<td>Adam</td>
<td>ReLU</td>
</tr>
<tr>
<td><bold>GBRT</bold></td>
<td>0.01</td>
<td>32</td>
<td>200</td>
<td>Gradient boosting</td>
<td>N/A (Decision Tree-based)</td>
</tr>
<tr>
<td><bold>TD3 Agent</bold></td>
<td>0.0005</td>
<td>64</td>
<td>150</td>
<td>Adam with polyak avg</td>
<td>Tanh</td>
</tr>
<tr>
<td><bold>Federated EV</bold></td>
<td>0.001</td>
<td>128</td>
<td>100</td>
<td>SGD with momentum</td>
<td>ReLU</td>
</tr>
</tbody>
</table>
<table-wrap-foot><fn id="table-7fn1" fn-type="other"><p>Note: <xref ref-type="table" rid="table-7">Table 7</xref> outlines the critical hyperparameter configurations and preprocessing techniques employed for each machine learning model in the energy management system. This table demonstrates the systematic approach taken to optimize model performance while ensuring real-time operational feasibility. The ConvLSTM model is configured with a learning rate of 0.001 and batch size of 64, trained over 100 epochs using the Adam optimizer with ReLU activation functions. This configuration is specifically tuned for 15-minute interval predictions with temporal dependencies, balancing training stability with convergence speed. The relatively moderate batch size ensures efficient memory utilization while maintaining sufficient gradient estimation accuracy. The GBRT model employs a higher learning rate of 0.01 with a smaller batch size of 32, requiring 200 epochs for optimal performance. As a decision tree-based ensemble method, GBRT doesn&#x2019;t utilize traditional activation functions but relies on gradient boosting optimization. The increased epoch count compensates for the smaller batch size and ensures thorough exploration of the feature space for turbulence compensation.</p></fn></table-wrap-foot>
</table-wrap>
</sec>
<sec id="s3_2_5">
<label>3.2.5</label>
<title>Model Validation and Evaluation</title>
<p>Each ML model is evaluated using the following metrics:
<list list-type="bullet">
<list-item>
<p>MAE (Mean Absolute Error) for solar and wind forecasting.</p></list-item>
<list-item>
<p>RMSE (Root Mean Square Error) for battery SOC prediction.</p></list-item>
<list-item>
<p>F1 Score and Accuracy for EV load forecasting.</p></list-item>
<list-item>
<p>MSE (Mean Squared Error) for torque oscillation prediction.</p></list-item>
</list></p>
<p>The results show that each model consistently outperforms traditional methods by at least 15% in accuracy and 20% in response time, ensuring real-time adaptability in the microgrid environment.</p>
</sec>
</sec>
<sec id="s3_3">
<label>3.3</label>
<title>Comparative Analysis of RL Algorithms</title>
<p>Regarding the absence of horizontal performance comparisons, a detailed analysis was conducted to benchmark the proposed Twin Delayed Deep Deterministic Policy Gradient (TD3) against three state-of-the-art RL algorithms: Deep Q-Network (DQN), Proximal Policy Optimization (PPO), and Soft Actor-Critic (SAC). These algorithms were selected based on their established efficacy in energy optimization and microgrid applications. The comparison focused on key performance metrics, namely convergence speed, battery state-of-charge (SoC) management error, energy utilization efficiency, and peak load reduction.</p>
<p><list list-type="simple">
<list-item><label>1.</label><p><bold>Convergence Speed:</bold></p>
<p>The convergence speed of each algorithm was evaluated by measuring the number of training epochs required to stabilize the policy. The results indicate that:
<list list-type="simple">
<list-item><label>&#x2022;</label>
<p>TD3 converged after 150 epochs, demonstrating the fastest adaptation to changing load demands and renewable fluctuations.</p></list-item>
<list-item><label>&#x2022;</label>
<p>DQN converged after 200 epochs, requiring more time to learn optimal policies due to its discrete action space.</p></list-item>
<list-item><label>&#x2022;</label>
<p>PPO stabilized at around 180 epochs, showing moderate adaptability but slightly slower than TD3.</p></list-item>
<list-item><label>&#x2022;</label>
<p>SAC required 220 epochs, primarily due to its entropy-based exploration, which prolongs stabilization.</p></list-item>
</list></p></list-item>
<list-item><label>2.</label>
<p><bold>Battery SoC Management Error:</bold></p></list-item>
<list-item>
<p>To assess the precision of battery SoC management, the Mean Absolute Error (MAE) of predicted vs. actual SoC values was recorded.
<list list-type="simple">
<list-item><label>&#x2022;</label>
<p><bold>TD3:</bold> Achieved the lowest error of 3.8%, benefiting from its deterministic policy gradient and continuous action space.</p></list-item>
<list-item><label>&#x2022;</label>
<p><bold>DQN:</bold> Reported a higher error of 6.4%, as its discrete actions limited fine-grained control over charge cycles.</p></list-item>
<list-item><label>&#x2022;</label>
<p><bold>PPO:</bold> Showed an error rate of 5.2%, primarily influenced by its gradient clipping mechanism.</p></list-item>
<list-item><label>&#x2022;</label>
<p><bold>SAC:</bold> Measured at 4.9%, slightly outperforming PPO but not as effective as TD3.</p></list-item>
</list></p></list-item>
<list-item><label>3.</label>
<p><bold>Energy Utilization Efficiency:</bold></p></list-item>
<list-item>
<p>Energy utilization efficiency was measured as the ratio of renewable energy consumed to total generated energy.
<list list-type="simple">
<list-item><label>&#x2022;</label>
<p><bold>TD3:</bold> Demonstrated the highest efficiency of 92.4%, optimizing both load distribution and battery usage.</p></list-item>
<list-item><label>&#x2022;</label>
<p><bold>DQN:</bold> Managed 85.1%, reflecting its limited capability to handle high-frequency variations in renewable generation.</p></list-item>
<list-item><label>&#x2022;</label>
<p><bold>PPO:</bold> Attained 88.3%, showing improved load balancing but with occasional overshoot during peak load.</p></list-item>
<list-item><label>&#x2022;</label>
<p><bold>SAC:</bold> Achieved 89.6%, indicating better energy capture than DQN but still lagging behind TD3.</p></list-item>
</list></p></list-item>
<list-item><label>4.</label>
<p><bold>Peak Load Reduction:</bold></p></list-item>
<list-item>
<p>The algorithms were tested for their ability to manage load surges and reduce peak demands.
<list list-type="simple">
<list-item><label>&#x2022;</label>
<p><bold>TD3:</bold> Reduced peak load by 22%, leveraging real-time adjustments in BESS and EV discharge.</p></list-item>
<list-item><label>&#x2022;</label>
<p><bold>DQN:</bold> Achieved only a 15% reduction due to its slower reaction time to rapid load changes.</p></list-item>
<list-item><label>&#x2022;</label>
<p><bold>PPO:</bold> Reduced peaks by 18%, adapting reasonably well to demand spikes.</p></list-item>
<list-item><label>&#x2022;</label>
<p><bold>SAC:</bold> Recorded a 20% reduction, benefiting from its continuous action updates but slower than TD3.</p></list-item>
</list></p></list-item>
</list></p>
<p><bold>Summary of Comparative Analysis:</bold></p>
<p>The evaluation clearly shows that TD3 outperforms DQN, PPO, and SAC in all key metrics. Its deterministic policy gradient approach, coupled with fine-tuned continuous action control, allows it to excel in energy optimization tasks, particularly in SoC management, renewable utilization, and peak load reduction. Furthermore, its rapid convergence speed makes it highly suitable for real-time energy management in dynamic microgrid environments. <xref ref-type="table" rid="table-8">Table 8</xref> shows the Comparative Analysis of RL Algorithms.</p>
<table-wrap id="table-8">
<label>Table 8</label>
<caption>
<title>Comparative analysis of RL algorithms</title>
</caption>
<table>
<colgroup>
<col/>
<col/>
<col/>
<col/>
<col/>
</colgroup>
<thead>
<tr>
<th>Metric</th>
<th>DQN</th>
<th>PPO</th>
<th>SAC</th>
<th>TD3 (Proposed)</th>
</tr>
</thead>
<tbody>
<tr>
<td>Convergence epochs</td>
<td>200</td>
<td>180</td>
<td>220</td>
<td><bold>150</bold></td>
</tr>
<tr>
<td>SoC management error (%)</td>
<td>6.4%</td>
<td>5.2%</td>
<td>4.9%</td>
<td><bold>3.8%</bold></td>
</tr>
<tr>
<td>Energy utilization (%)</td>
<td>85.1%</td>
<td>88.3%</td>
<td>89.6%</td>
<td><bold>92.4%</bold></td>
</tr>
<tr>
<td>Peak load reduction (%)</td>
<td>15%</td>
<td>18%</td>
<td>20%</td>
<td><bold>22%</bold></td>
</tr>
</tbody>
</table>
<table-wrap-foot><fn id="table-8fn1" fn-type="other"><p>Note: <xref ref-type="table" rid="table-8">Table 8</xref> presents a comprehensive performance comparison between the proposed Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm and three established reinforcement learning approaches: Deep Q-Network (DQN), Proximal Policy Optimization (PPO), and Soft Actor-Critic (SAC). This comparison validates the superiority of TD3 for microgrid energy management applications.</p></fn></table-wrap-foot>
</table-wrap>
</sec>
<sec id="s3_4">
<label>3.4</label>
<title>Stress Testing and Peak Demand Analysis</title>
<p>Regarding the lack of modeling for extreme load peaks and renewable generation perturbations, a comprehensive stress testing analysis was conducted. The objective was to evaluate the robustness and adaptability of the proposed ML-enhanced microgrid management system when subjected to sudden demand spikes and fluctuations in solar and wind energy production.</p>
<sec id="s3_4_1">
<label>3.4.1</label>
<title>Stress Testing Scenarios</title>
<p>The stress testing focused on three critical scenarios that represent realistic yet challenging operational conditions for residential microgrids:
<list list-type="order">
<list-item>
<p><bold>Sudden Load Surge (30% Increase within 5 min):</bold>
<list list-type="simple">
<list-item><label>&#x2022;</label>
<p>This scenario replicates a situation where multiple EVs begin charging simultaneously, or high-power appliances are activated during peak hours.</p></list-item>
<list-item><label>&#x2022;</label>
<p>The test aims to evaluate the system&#x2019;s ability to stabilize voltage and prevent overloading.</p></list-item>
</list></p></list-item>
<list-item>
<p><bold>Solar Irradiance Drop (60% Decrease in 2 min):</bold>
<list list-type="simple">
<list-item><label>&#x2022;</label>
<p>Represents cloudy conditions or rapid changes in solar exposure, challenging the solar MPPT control.</p></list-item>
<list-item><label>&#x2022;</label>
<p>Tests the adaptability of the ConvLSTM-based forecasting model in maintaining energy output.</p></list-item>
</list></p></list-item>
<list-item>
<p><bold>Wind Speed Variability (&#x00B1;20% within 5 min):</bold>
<list list-type="simple">
<list-item><label>&#x2022;</label>
<p>Models turbulent wind conditions affecting the wind turbine&#x2019;s energy production.</p></list-item>
<list-item><label>&#x2022;</label>
<p>Evaluates the GBRT-based pitch control system&#x2019;s ability to maintain consistent power output.</p></list-item>
</list></p></list-item>
</list></p>
</sec>
<sec id="s3_4_2">
<label>3.4.2</label>
<title>Evaluation Metrics</title>
<p>To quantitatively assess the system&#x2019;s response, the following metrics were recorded:
<list list-type="bullet">
<list-item>
<p><bold>Voltage Stability (&#x00B1;2% of 400 V):</bold> Measuring the voltage deviation during peak demand and renewable fluctuations.</p></list-item>
<list-item>
<p><bold>Battery SOC Management:</bold> Maintaining SOC between 20% and 80% under stress conditions.</p></list-item>
<list-item>
<p><bold>Renewable Utilization Efficiency:</bold> The ratio of energy captured during perturbation to the potential available energy.</p></list-item>
<list-item>
<p><bold>Peak Load Mitigation:</bold> The reduction in peak load stress due to BESS and EV discharging.</p></list-item>
</list></p>
</sec>
<sec id="s3_4_3">
<label>3.4.3</label>
<title>Results and Analysis</title>
<p><bold>Scenario 1: Sudden Load Surge</bold></p>
<p>During the simulated load surge, the system experienced a voltage drop of 1.5%, well within the acceptable range of &#x00B1;2%. The TD3-based controller efficiently balanced the load by dynamically discharging the BESS and prioritizing EV discharges. As a result, the peak demand was reduced by 22%, effectively preventing grid overload.</p>
<p>This <xref ref-type="fig" rid="fig-21">Fig. 21</xref> illustrates the voltage behavior of the microgrid during a sudden load surge of 30% within a 5-min window. The red line represents the voltage deviation during the surge event, while the dotted green line indicates the nominal voltage of 400 V. Despite the spike, the TD3-based controller maintains voltage stability within a &#x00B1;2% margin, ensuring grid reliability.</p>
<fig id="fig-21">
<label>Figure 21</label>
<caption>
<title>Voltage stability under load surge</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="JAI_66067-fig-21.tif"/>
</fig>
<p><bold>Scenario 2: Solar Irradiance Drop</bold></p>
<p>The ConvLSTM-based solar MPPT controller adapted to the rapid drop in irradiance, maintaining an MPPT tracking efficiency of 96.8% compared to 92.5% in traditional PID controllers. The voltage deviation remained under 1.2%, indicating robust control despite the sudden reduction in solar input.</p>
<p>This <xref ref-type="fig" rid="fig-22">Fig. 22</xref> shows the solar power generation under normal conditions (dotted line) and during a rapid 60% drop in irradiance (orange line). Despite the sharp decrease in sunlight, the ConvLSTM-based MPPT controller successfully maintains an average output close to normal levels, demonstrating its adaptability to fluctuating solar input.</p>
<fig id="fig-22">
<label>Figure 22</label>
<caption>
<title>Solar power output during irradiance drop</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="JAI_66067-fig-22.tif"/>
</fig>
<p><bold>Scenario 3: Wind Speed Variability</bold></p>
<p>The GBRT-based pitch control system dynamically adjusted the blade pitch angle to mitigate torque oscillations, achieving a 41% reduction compared to conventional PI control. The voltage stability remained consistent at &#x00B1;1.0%, and the overall energy output from the wind turbine was reduced by only 5.5%, highlighting the system&#x2019;s resilience.</p>
<p>This <xref ref-type="fig" rid="fig-23">Fig. 23</xref> represents the wind power output under stable conditions (dotted line) and turbulent wind events (blue line) with &#x00B1;20% fluctuations. The GBRT-based pitch control mitigates torque oscillations, ensuring consistent power output even during high wind variability. This highlights the system&#x2019;s robustness against unpredictable wind patterns. <xref ref-type="table" rid="table-9">Table 9</xref> shows the Stress Testing Results Summary.</p>
<fig id="fig-23">
<label>Figure 23</label>
<caption>
<title>Wind power output during turbulence</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="JAI_66067-fig-23.tif"/>
</fig><table-wrap id="table-9">
<label>Table 9</label>
<caption>
<title>Stress testing results summary</title>
</caption>
<table>
<colgroup>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
</colgroup>
<thead>
<tr>
<th align="center">Scenario</th>
<th align="center">Voltage deviation (%)</th>
<th align="center">SOC stability (%)</th>
<th align="center">Energy utilization efficiency (%)</th>
<th align="center">Peak load reduction (%)</th>
</tr>
</thead>
<tbody>
<tr>
<td>Sudden load surge (30%)</td>
<td>1.5%</td>
<td>78%</td>
<td>92.1%</td>
<td>22%</td>
</tr>
<tr>
<td>Solar irradiance drop (60%)</td>
<td>1.2%</td>
<td>75%</td>
<td>96.8%</td>
<td>N/A</td>
</tr>
<tr>
<td>Wind speed variability (&#x00B1;20%)</td>
<td>1.0%</td>
<td>80%</td>
<td>94.5%</td>
<td>N/A</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
</sec>
<sec id="s3_5">
<label>3.5</label>
<title>Latency and Data Privacy Impact Analysis</title>
<p>Regarding the lack of discussion on network latency and data privacy issues in the multi-vehicle federated learning setup, a detailed analysis was performed. The objective was to evaluate how communication delays and privacy-preserving mechanisms affect the convergence of the federated learning model and the efficiency of EV charging management.</p>
<p>In federated learning for EV scheduling, model updates from multiple vehicles are aggregated to form a global model without sharing raw data. However, latency during model synchronization can impact convergence and lead to inconsistent charging schedules. Moreover, the risk of data leakage during aggregation necessitates robust privacy measures.</p>
<sec id="s3_5_1">
<label>3.5.1</label>
<title>Latency Simulation</title>
<p>To quantify the impact of network latency, three delay scenarios were tested:
<list list-type="order">
<list-item>
<p><bold>Low Latency (50 ms):</bold> Typical of high-speed fiber networks.</p></list-item>
<list-item>
<p><bold>Moderate Latency (100 ms):</bold> Representative of standard wireless networks.</p></list-item>
<list-item>
<p><bold>High Latency (200 ms):</bold> Simulates congested or distant network connections.</p></list-item>
</list></p>
<p><bold>Impact on Model Convergence:</bold></p>
<list list-type="bullet">
<list-item>
<p>The federated learning model was trained under each latency scenario.</p></list-item>
<list-item>
<p>The key metric was convergence time, measured as the number of communication rounds needed to stabilize model accuracy.</p></list-item>
<list-item><p>The results indicate that:</p>
<list list-type="bullet">
<list-item><p><bold>Low Latency (50 ms):</bold> Achieved convergence in 20 rounds, maintaining charging efficiency at 94.7%.</p></list-item>
<list-item><p><bold>Moderate Latency (100 ms):</bold> Converged in <bold>30 rounds</bold>, reducing charging efficiency to 92.3%.</p></list-item>
<list-item><p><bold>High Latency (200 ms):</bold> Required 45 rounds to converge, dropping charging efficiency to 89.1%.</p></list-item></list></list-item>
<list-item><p>This indicates that increased latency directly impacts the convergence speed, causing delays in charging decision updates.</p></list-item>
</list>
</sec>
<sec id="s3_5_2">
<label>3.5.2</label>
<title>Data Privacy Assessment</title>
<p>Federated learning enhances privacy by keeping data local, but risks persist during model aggregation.</p>
<p><bold>Privacy Measures Implemented:</bold>
<list list-type="order">
<list-item>
<p><bold>Differential Privacy (DP):</bold>
<list list-type="bullet">
<list-item>
<p>Gaussian noise was added to model updates to mask individual contributions.</p></list-item>
<list-item>
<p>Privacy loss (epsilon) was maintained at <bold>0.5</bold>, achieving a trade-off between accuracy and privacy.</p></list-item>
</list></p></list-item>
<list-item>
<p><bold>Homomorphic Encryption (HE):</bold>
<list list-type="bullet">
<list-item>
<p>Used to encrypt model gradients before transmission.</p></list-item>
<list-item>
<p>The decryption occurs only after aggregation, ensuring that intermediate results remain private.</p></list-item>
</list></p></list-item>
<list-item>
<p><bold>Asynchronous Federated Updates:</bold>
<list list-type="bullet">
<list-item>
<p>Reduces the risk of data exposure by allowing each vehicle to update asynchronously, rather than waiting for a global synchronization.</p></list-item>
</list></p></list-item>
</list></p>
</sec>
<sec id="s3_5_3">
<label>3.5.3</label>
<title>Performance Metrics</title>
<p>The following metrics were evaluated to assess the impact of latency and privacy mechanisms:
<list list-type="bullet">
<list-item>
<p><bold>Model Accuracy (%):</bold> The prediction accuracy of EV charging needs.</p></list-item>
<list-item>
<p><bold>Communication Overhead (kB):</bold> Data size per aggregation round.</p></list-item>
<list-item>
<p><bold>Convergence Speed (Rounds):</bold> Number of rounds required to stabilize accuracy.</p></list-item>
<list-item>
<p><bold>Privacy Loss (Epsilon):</bold> Degree of data leakage risk.</p></list-item>
</list></p>
<p><xref ref-type="table" rid="table-10">Table 10</xref> shows that increased latency significantly affects model accuracy and convergence speed. While differential privacy and homomorphic encryption secure the model aggregation process, they also add computational overhead, slightly affecting the charging efficiency.</p>
<p><list list-type="bullet">
<list-item>
<p><bold>Low latency scenarios (50 ms)</bold> maintain both high accuracy and rapid convergence, making them ideal for real-time EV scheduling.</p></list-item>
<list-item>
<p><bold>Moderate latency (100 ms)</bold> shows a minor drop in efficiency but remains operationally viable.</p></list-item>
<list-item>
<p><bold>High latency (200 ms)</bold> poses a substantial challenge, suggesting the need for asynchronous update mechanisms and more efficient encryption protocols to reduce overhead.</p></list-item>
</list></p>
<table-wrap id="table-10">
<label>Table 10</label>
<caption>
<title>Latency and privacy impact analysis</title>
</caption>
<table>
<colgroup>
<col/>
<col/>
<col/>
<col/>
</colgroup>
<thead>
<tr>
<th>Metric</th>
<th align="center">Low latency<break/>(50 ms)</th>
<th align="center">Moderate latency<break/>(100 ms)</th>
<th align="center">High latency<break/>(200 ms)</th>
</tr>
</thead>
<tbody>
<tr>
<td>Model accuracy</td>
<td>94.7%</td>
<td>92.3%</td>
<td>89.1%</td>
</tr>
<tr>
<td>Communication overhead (kB)</td>
<td>120</td>
<td>150</td>
<td>200</td>
</tr>
<tr>
<td>Convergence speed (Rounds)</td>
<td>20</td>
<td>30</td>
<td>45</td>
</tr>
<tr>
<td>Privacy loss (Epsilon)</td>
<td>0.5</td>
<td>0.5</td>
<td>0.5</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s3_5_4">
<label>3.5.4</label>
<title>Summary</title>
<p>Federated learning for EV scheduling proves robust under low to moderate latency conditions but degrades with high latency. Integrating asynchronous updates and efficient encryption can mitigate some of these issues, ensuring data privacy without sacrificing convergence speed or charging efficiency. Future work should explore edge computing integration to minimize latency and enhance privacy.</p>
</sec>
</sec>
<sec id="s3_6">
<label>3.6</label>
<title>Post-Hoc Interpretability Analysis</title>
<p>Regarding the lack of interpretability in the RL agent&#x2019;s charge/discharge decisions, this section introduces post-hoc explanation methods. By integrating SHAP (SHapley Additive exPlanations) and LIME (Local Interpretable Model-Agnostic Explanations), the analysis aims to clarify how the TD3 agent arrives at optimal battery management strategies.</p>
<sec id="s3_6_1">
<label>3.6.1</label>
<title>Motivation for Interpretability</title>
<p>While the TD3 reinforcement learning agent demonstrated superior performance in managing the battery state of charge (SOC) and minimizing peak loads, the underlying decision-making process remains a &#x201C;black box&#x201D;. Understanding why certain charging or discharging actions are taken under specific conditions is essential for both model validation and stakeholder confidence.</p>
</sec>
<sec id="s3_6_2">
<label>3.6.2</label>
<title>SHAP Analysis</title>
<p>SHAP values quantify the contribution of each feature to the TD3 model&#x2019;s output, offering global interpretability.
<list list-type="simple">
<list-item><label>&#x2022;</label>
<p><bold>Key Features Analyzed:</bold>
<list list-type="bullet">
<list-item>
<p><bold>Battery SOC (%)</bold></p></list-item>
<list-item>
<p><bold>Grid Voltage (V)</bold></p></list-item>
<list-item>
<p><bold>Renewable Generation (kW)</bold></p></list-item>
<list-item>
<p><bold>Load Demand (kW)</bold></p></list-item>
<list-item>
<p><bold>Electric Vehicle SOC (%)</bold></p></list-item>
</list></p></list-item>
<list-item><label>&#x2022;</label>
<p><bold>SHAP Value Calculation:</bold>
<disp-formula id="eqn-14"><label>(14)</label><mml:math id="mml-eqn-14" display="block"><mml:mi>S</mml:mi><mml:mi>H</mml:mi><mml:mi>A</mml:mi><mml:mi>P</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:msub><mml:mi>x</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mi>E</mml:mi><mml:mrow><mml:mo>[</mml:mo><mml:mi>f</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>X</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>]</mml:mo></mml:mrow><mml:mo>&#x2212;</mml:mo><mml:mi>E</mml:mi><mml:mrow><mml:mo>[</mml:mo><mml:mi>f</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>X</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mrow><mml:mo stretchy="false">|</mml:mo></mml:mrow><mml:msub><mml:mi>X</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>]</mml:mo></mml:mrow></mml:math></disp-formula>where <inline-formula id="ieqn-47"><mml:math id="mml-ieqn-47"><mml:mi>E</mml:mi><mml:mo stretchy="false">[</mml:mo><mml:mi>f</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>X</mml:mi><mml:mo stretchy="false">)</mml:mo><mml:mo stretchy="false">]</mml:mo></mml:math></inline-formula> represents the expected model output, and <inline-formula id="ieqn-48"><mml:math id="mml-ieqn-48"><mml:mi>E</mml:mi><mml:mo stretchy="false">[</mml:mo><mml:mi>f</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>X</mml:mi><mml:mo stretchy="false">)</mml:mo><mml:mo>&#x2223;</mml:mo><mml:msub><mml:mi>X</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo stretchy="false">]</mml:mo></mml:math></inline-formula> is the output conditional on feature <inline-formula id="ieqn-49"><mml:math id="mml-ieqn-49"><mml:msub><mml:mi>X</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula>.</p></list-item>
</list></p>
<p><bold>Key Findings from SHAP Analysis:</bold></p>
<list list-type="bullet">
<list-item>
<p><bold>Battery SOC (40% contribution):</bold> The most influential factor, directly impacting whether to charge or discharge.</p></list-item>
<list-item>
<p><bold>Load Demand (30% contribution):</bold> High demand triggers discharging actions.</p></list-item>
<list-item>
<p><bold>Renewable Generation (20% contribution):</bold> High generation prompts charging to store surplus.</p></list-item>
<list-item>
<p><bold>Grid Voltage (7% contribution):</bold> Ensures voltage stability during high demand.</p></list-item>
<list-item>
<p><bold>EV SOC (3% contribution):</bold> Prioritizes V2G (Vehicle-to-Grid) charging when SOC is above 70%. <xref ref-type="fig" rid="fig-24">Fig. 24</xref> shows the SHAP Summary Plot.</p>
</list-item>
</list>
<fig id="fig-24">
<label>Figure 24</label>
<caption>
<title>SHAP summary plot</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="JAI_66067-fig-24.tif"/>
</fig>
</sec>
<sec id="s3_6_3">
<label>3.6.3</label>
<title>LIME Analysis</title>
<p>LIME provides local interpretability by approximating the complex TD3 model with a simpler, interpretable model (like linear regression) around a specific prediction.
<list list-type="simple">
<list-item><label>&#x2022;</label>
<p><bold>Scenario Analyzed:</bold>
<list list-type="bullet">
<list-item>
<p>High Load Demand (100 kW) combined with Low Renewable Generation (20 kW).</p></list-item>
</list></p></list-item>
<list-item><label>&#x2022;</label>
<p><bold>LIME Explanation:</bold>
<list list-type="bullet">
<list-item>
<p>Shows that the TD3 agent&#x2019;s decision to discharge is driven by the combination of low generation and high load, with SOC contributing as a secondary factor.</p></list-item>
</list></p></list-item>
<list-item><label>&#x2022;</label>
<p><bold>LIME Visualization:</bold>
<list list-type="bullet">
<list-item>
<p>A bar chart showing feature weights, highlighting that Load Demand (60%) and Battery SOC (30%) dominate the decision to discharge.</p></list-item>
</list></p></list-item>
</list></p>
</sec>
<sec id="s3_6_4">
<label>3.6.4</label>
<title>Interpretation of Results</title>
<p><list list-type="simple">
<list-item><label>&#x2022;</label><p><bold>Consistency in Interpretability:</bold> SHAP confirms the global importance of Battery SOC and Load Demand, while LIME explains local decisions based on immediate conditions.</p></list-item>
<list-item><label>&#x2022;</label><p><bold>Decision Rationalization:</bold>
<list list-type="bullet">
<list-item><p>The RL agent prioritizes maintaining grid stability by using the BESS to counteract high demand when renewable input is low.</p></list-item>
<list-item><p>During surplus renewable generation, the agent opts to charge the battery, anticipating future high-demand periods.</p></list-item>
</list></p></list-item>
<list-item><label>&#x2022;</label><p><bold>Action Validation:</bold>
<list list-type="bullet">
<list-item><p>By correlating SHAP and LIME outputs, it is clear that the TD3 agent consistently prioritizes grid stability and battery health, confirming the rationality of its charge/discharge decisions.</p></list-item>
</list></p></list-item>
</list></p>
</sec>
<sec id="s3_6_5">
<label>3.6.5</label>
<title>Summary</title>
<p>The combined use of SHAP and LIME provides a clear explanation of the TD3 agent&#x2019;s decision-making process. By revealing the relative contributions of features in both global and local contexts, these methods validate that the RL agent makes logical and consistent decisions aligned with operational goals, such as voltage stability and peak load reduction. This interpretability enhances the model&#x2019;s reliability and makes it more transparent for stakeholders, fostering trust in automated microgrid management.</p>
</sec>
</sec>
<sec id="s3_7">
<label>3.7</label>
<title>Limitations of the Study</title>
<p>Despite the promising results achieved by the proposed ML-enhanced energy management framework for resilient residential microgrids, several limitations are identified that warrant attention. These limitations are primarily associated with real-world scalability, latency issues in federated learning, model retraining complexities, and dependency on high-quality data streams. Addressing these challenges can significantly improve the robustness and deployment readiness of the system.</p>
<p>One of the main limitations is the scalability of hardware and communication infrastructure. The current simulation and evaluation were conducted within a MATLAB/Simulink environment that optimally handles up to five electric vehicles (EVs), a 50 kW wind turbine, and a 300 kW solar PV system. However, real-world deployment would require scaling this architecture to accommodate larger microgrids with higher renewable capacity and a greater number of EVs. This expansion would necessitate enhanced data transmission protocols, robust communication networks, and higher computational power to maintain real-time energy balancing and predictive control. Future improvements could focus on distributed ledger technologies or edge computing frameworks to decentralize data processing, thereby reducing communication bottlenecks.</p>
<p>Another limitation is related to communication latency in federated learning, particularly during synchronization of model updates across decentralized nodes. Federated learning allows EVs to optimize charging schedules without sharing raw data, preserving user privacy. However, latency issues arise during model aggregation, especially when edge devices experience network instability or bandwidth limitations. This can lead to asynchronous updates, which may impact prediction accuracy and load scheduling. To address this, future implementations could consider asynchronous federated optimization and hierarchical model updates to better synchronize learning across nodes, minimizing latency-induced disruptions.</p>
<p>The model retraining overhead is also a critical consideration. The reinforcement learning agent (TD3) and ConvLSTM-based forecaster require periodic retraining to adapt to dynamic energy loads and fluctuating renewable outputs. This retraining process is computationally expensive and time-consuming, potentially hindering real-time decision-making during peak load periods or sudden weather changes. Optimizing retraining cycles through incremental learning and adaptive transfer learning strategies can alleviate this overhead, enabling smoother model adaptation without compromising energy optimization.</p>
<p>Additionally, the dependency on high-quality data streams for forecasting and optimization introduces vulnerability to sensor failures and data inaccuracies. The ConvLSTM and GBRT models are trained on historical datasets of solar irradiance, wind speed, and EV usage patterns. Any deviation or sensor anomaly in these streams could propagate errors through the optimization pipeline, affecting battery storage management and EV load scheduling. To mitigate this, real-time anomaly detection mechanisms and multi-sensor fusion can be integrated to cross-verify sensor outputs and filter corrupted data before it reaches the learning models.</p>
<p>Finally, the system&#x2019;s validation through MATLAB/Simulink simulations, while effective for controlled testing, limits the understanding of real-world hardware interactions and unexpected load behaviors. Future studies should emphasize Hardware-in-the-Loop (HIL) simulations and field deployments to evaluate the robustness of the architecture under practical conditions, such as grid outages, hardware malfunctions, and extreme weather events.</p>
<p>In conclusion, while the proposed system demonstrates significant improvements in energy optimization and load balancing, addressing these limitations through scalable infrastructure, enhanced communication protocols, adaptive learning strategies, and real-world validation would further solidify its reliability and performance in practical microgrid deployments.</p>
</sec>
</sec>
<sec id="s4">
<label>4</label>
<title>Conclusion</title>
<p>This study demonstrates the successful integration of electric vehicles (EVs) and advanced machine learning (ML) techniques into a hybrid microgrid architecture designed for resilient, sustainable, and intelligent energy management. By incorporating a ConvLSTM-based forecasting model, a TD3 reinforcement learning agent, and federated EV scheduling, the proposed system effectively addresses the limitations of conventional control methods. The ML-enhanced microgrid dynamically balances AC/DC loads, reduces peak demand, and maintains grid stability under highly variable conditions, including renewable fluctuations and EV charging behaviors. Simulation results confirm significant performance improvements: 98.2% MPPT efficiency, 22% peak demand reduction, 41% torque oscillation reduction, and 70% improvement in SOC error management. Additionally, the system sustains voltage and frequency within tight bounds (400 V &#x00B1;2%, 50 Hz &#x00B1;0.015 Hz), ensuring reliable operation even under stress scenarios such as grid outages and high-load events. The federated EV scheduler further contributes to cost savings and user privacy, demonstrating 31% reduced charging costs through distributed learning across real-world usage patterns. Overall, the proposed architecture represents a scalable and intelligent solution for future-ready microgrids. It enables seamless integration of EVs, enhances renewable energy utilization, and ensures uninterrupted power for critical services. Future work may focus on extending the system to industrial-scale applications, increasing the number of integrated EVs, and leveraging real-time hardware-in-loop experimentation for deployment validation.</p>
</sec>
</body>
<back>
<ack>
<p>The author would like to express sincere gratitude to the Faculty of Computers and Information Technology at the University of Tabuk for providing the necessary resources and supportive environment for conducting this research. Special thanks to the research assistants who helped with data collection and simulation validation. The author also acknowledges the valuable feedback from colleagues in the Department of Computer Engineering that significantly improved the quality of this work.</p>
</ack>
<sec>
<title>Funding Statement</title>
<p>This research was supported by a grant from the University of Tabuk, Saudi Arabia (Grant No. UT-2024-CIT-0527). Additional funding was provided by the Saudi Arabian Ministry of Education through the Scientific Research Support Program.</p>
</sec>
<sec sec-type="data-availability">
<title>Availability of Data and Materials</title>
<p>The datasets generated and analyzed during the current study are available from the corresponding author upon reasonable request. Code for the machine learning models and simulation environment will be made available in a public repository after publication.</p>
</sec>
<sec>
<title>Ethics Approval</title>
<p>Not applicable.</p>
</sec>
<sec sec-type="COI-statement">
<title>Conflicts of Interest</title>
<p>The author declares no conflicts of interest to report regarding the present study.</p>
</sec>
<ref-list content-type="authoryear">
<title>References</title>
<ref id="ref-1"><label>[1]</label><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name><surname>Busch</surname> <given-names>C</given-names></string-name>, <string-name><surname>Gopal</surname> <given-names>A</given-names></string-name></person-group>. <article-title>Electric vehicles will soon lead global auto markets, but too slow to hit climate goals without new policy</article-title>. <year>[cited 2025 May 1]</year>.<year> Available from: </year><ext-link ext-link-type="uri" xlink:href="https://energyinnovation.org/report/electric-vehicles-will-soon-lead-global-auto-markets-but-too-slow-to-hit-climate-goals-without-new-policy/">https://energyinnovation.org/report/electric-vehicles-will-soon-lead-global-auto-markets-but-too-slow-to-hit-climate-goals-without-new-policy/</ext-link>.</mixed-citation></ref>
<ref id="ref-2"><label>[2]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Shao</surname> <given-names>J</given-names></string-name>, <string-name><surname>Mi&#x0161;i&#x0107;</surname> <given-names>M</given-names></string-name></person-group>. <article-title>Why does electric vehicle deployment vary so much within a nation? Comparing Chinese provinces by policy, economics, and socio-demographics</article-title>. <source>Energy Res Soc Sci</source>. <year>2023</year>;<volume>102</volume>(<issue>2</issue>):<fpage>103196</fpage>. doi:<pub-id pub-id-type="doi">10.1016/j.erss.2023.103196</pub-id>.</mixed-citation></ref>
<ref id="ref-3"><label>[3]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Muratori</surname> <given-names>M</given-names></string-name>, <string-name><surname>Alexander</surname> <given-names>M</given-names></string-name>, <string-name><surname>Arent</surname> <given-names>D</given-names></string-name>, <string-name><surname>Bazilian</surname> <given-names>M</given-names></string-name>, <string-name><surname>Cazzola</surname> <given-names>P</given-names></string-name>, <string-name><surname>Dede</surname> <given-names>EM</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>The rise of electric vehicles&#x2014;2020 status and future expectations</article-title>. <source>Prog Energy</source>. <year>2021</year>;<volume>3</volume>(<issue>2</issue>):<fpage>022002</fpage>. doi:<pub-id pub-id-type="doi">10.1088/2516-1083/abe0ad</pub-id>.</mixed-citation></ref>
<ref id="ref-4"><label>[4]</label><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Wakefield</surname> <given-names>EH</given-names></string-name></person-group>. <source>History of the electric automobile: battery-only powered cars</source>. <publisher-loc>Warrendale, PA, USA</publisher-loc>: <publisher-name>SAE International</publisher-name>; <year>1993</year>.</mixed-citation></ref>
<ref id="ref-5"><label>[5]</label><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Santini</surname> <given-names>DJ</given-names></string-name></person-group>. <chapter-title>Electric vehicle waves of history: lessons learned about market deployment of electric vehicles</chapter-title>. In: <source>Electric vehicles&#x2014;the benefits and barriers</source>. <publisher-loc>London, UK</publisher-loc>: <publisher-name>InTechOpen</publisher-name>; <year>2011</year>. doi:<pub-id pub-id-type="doi">10.5772/22411</pub-id>.</mixed-citation></ref>
<ref id="ref-6"><label>[6]</label><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Tillemann</surname> <given-names>L</given-names></string-name></person-group>. <source>The great race: the global quest for the car of the future</source>. <publisher-loc>New York, NY, USA</publisher-loc>: <publisher-name>Simon and Schuster</publisher-name>; <year>2016</year>.</mixed-citation></ref>
<ref id="ref-7"><label>[7]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Karthikeyan</surname> <given-names>M</given-names></string-name>, <string-name><surname>Manimegalai</surname> <given-names>D</given-names></string-name>, <string-name><surname>Rajagopal</surname> <given-names>K</given-names></string-name></person-group>. <article-title>Enhancing voltage control and regulation in smart micro-grids through deep learning-optimized EV reactive power management</article-title>. <source>Energy Rep</source>. <year>2025</year>;<volume>13</volume>(<issue>4</issue>):<fpage>1095</fpage>&#x2013;<lpage>107</lpage>. doi:<pub-id pub-id-type="doi">10.1016/j.egyr.2024.12.072</pub-id>.</mixed-citation></ref>
<ref id="ref-8"><label>[8]</label><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Becker</surname> <given-names>TA</given-names></string-name>, <string-name><surname>Sidhu</surname> <given-names>I</given-names></string-name>, <string-name><surname>Tenderich</surname> <given-names>B</given-names></string-name></person-group>. <source>Electric vehicles in the United States: a new model with forecasts to 2030</source>. <publisher-loc>Berkeley, CA, USA</publisher-loc>: <publisher-name>University of California</publisher-name>; <year>2009</year>. <fpage>24</fpage> p.</mixed-citation></ref>
<ref id="ref-9"><label>[9]</label><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Singh</surname> <given-names>H</given-names></string-name>, <string-name><surname>Ambikapathy</surname> <given-names>A</given-names></string-name>, <string-name><surname>Logavani</surname> <given-names>K</given-names></string-name>, <string-name><surname>Arun Prasad</surname> <given-names>G</given-names></string-name>, <string-name><surname>Thangavel</surname> <given-names>S</given-names></string-name></person-group>. <chapter-title>Plug-in hybrid electric vehicles (PHEVs)</chapter-title>. In: <source>Electric vehicles: modern technologies and trends</source>. <publisher-loc>Singapore</publisher-loc>: <publisher-name>Springer</publisher-name>; <year>2021</year>. p. <fpage>53</fpage>&#x2013;<lpage>72</lpage>. doi:<pub-id pub-id-type="doi">10.1007/978-981-15-9251-5_3</pub-id>.</mixed-citation></ref>
<ref id="ref-10"><label>[10]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Aljamali</surname> <given-names>NM</given-names></string-name>, <string-name><surname>Mohsein</surname> <given-names>HF</given-names></string-name>, <string-name><surname>Wannas</surname> <given-names>FA</given-names></string-name></person-group>. <article-title>Review on engineering designs for batteries</article-title>. <source>J Electr Power Syst Eng</source>. <year>2021</year>;<volume>7</volume>(<issue>2</issue>):<fpage>25</fpage>&#x2013;<lpage>31</lpage>.</mixed-citation></ref>
<ref id="ref-11"><label>[11]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Cano</surname> <given-names>ZP</given-names></string-name>, <string-name><surname>Banham</surname> <given-names>D</given-names></string-name>, <string-name><surname>Ye</surname> <given-names>S</given-names></string-name>, <string-name><surname>Hintennach</surname> <given-names>A</given-names></string-name>, <string-name><surname>Lu</surname> <given-names>J</given-names></string-name>, <string-name><surname>Fowler</surname> <given-names>M</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Batteries and fuel cells for emerging electric vehicle markets</article-title>. <source>Nat Energy</source>. <year>2018</year>;<volume>3</volume>(<issue>4</issue>):<fpage>279</fpage>&#x2013;<lpage>89</lpage>. doi:<pub-id pub-id-type="doi">10.1038/s41560-018-0108-1</pub-id>.</mixed-citation></ref>
<ref id="ref-12"><label>[12]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Balali</surname> <given-names>Y</given-names></string-name>, <string-name><surname>Stegen</surname> <given-names>S</given-names></string-name></person-group>. <article-title>Review of energy storage systems for vehicles based on technology, environmental impacts, and costs</article-title>. <source>Renew Sustain Energy Rev</source>. <year>2021</year>;<volume>135</volume>(<issue>4</issue>):<fpage>110185</fpage>. doi:<pub-id pub-id-type="doi">10.1016/j.rser.2020.110185</pub-id>.</mixed-citation></ref>
<ref id="ref-13"><label>[13]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Berkeley</surname> <given-names>N</given-names></string-name>, <string-name><surname>Bailey</surname> <given-names>D</given-names></string-name>, <string-name><surname>Jones</surname> <given-names>A</given-names></string-name>, <string-name><surname>Jarvis</surname> <given-names>D</given-names></string-name></person-group>. <article-title>Assessing the transition towards battery electric vehicles: a multi-level perspective on drivers of, and barriers to, take up</article-title>. <source>Transp Res Part A Policy Pract</source>. <year>2017</year>;<volume>106</volume>(<issue>3</issue>):<fpage>320</fpage>&#x2013;<lpage>32</lpage>. doi:<pub-id pub-id-type="doi">10.1016/j.tra.2017.10.004</pub-id>.</mixed-citation></ref>
<ref id="ref-14"><label>[14]</label><mixed-citation publication-type="other"><person-group person-group-type="author"><collab>Supply NTFOE</collab></person-group>. <article-title>Modernizing the electric grid</article-title>. <year>[cited 2025 Jan 1]</year>.<year> Available from: </year><ext-link ext-link-type="uri" xlink:href="https://gridwise.org/wp-content/uploads/2020/01/NCSL_-Modernizing-the-Electri-Grid_112519_34226.pdf">https://gridwise.org/wp-content/uploads/2020/01/NCSL_-Modernizing-the-Electri-Grid_112519_34226.pdf</ext-link>.</mixed-citation></ref>
<ref id="ref-15"><label>[15]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Romero-Lankao</surname> <given-names>P</given-names></string-name>, <string-name><surname>Wilson</surname> <given-names>A</given-names></string-name>, <string-name><surname>Sperling</surname> <given-names>J</given-names></string-name>, <string-name><surname>Miller</surname> <given-names>C</given-names></string-name>, <string-name><surname>Zimny-Schmitt</surname> <given-names>D</given-names></string-name>, <string-name><surname>Sovacool</surname> <given-names>B</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Of actors, cities and energy systems: advancing the transformative potential of urban electrification</article-title>. <source>Prog Energy</source>. <year>2021</year>;<volume>3</volume>(<issue>3</issue>):<fpage>032002</fpage>. doi:<pub-id pub-id-type="doi">10.1088/2516-1083/abfa25</pub-id>.</mixed-citation></ref>
<ref id="ref-16"><label>[16]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Soares</surname> <given-names>N</given-names></string-name>, <string-name><surname>Martins</surname> <given-names>AG</given-names></string-name>, <string-name><surname>Carvalho</surname> <given-names>AL</given-names></string-name>, <string-name><surname>Caldeira</surname> <given-names>C</given-names></string-name>, <string-name><surname>Du</surname> <given-names>C</given-names></string-name>, <string-name><surname>Castanheira</surname> <given-names>&#x00C9;</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>The challenging paradigm of interrelated energy systems towards a more sustainable future</article-title>. <source>Renew Sustain Energy Rev</source>. <year>2018</year>;<volume>95</volume>(<issue>2</issue>):<fpage>171</fpage>&#x2013;<lpage>93</lpage>. doi:<pub-id pub-id-type="doi">10.1016/j.rser.2018.07.023</pub-id>.</mixed-citation></ref>
<ref id="ref-17"><label>[17]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Afrakhte</surname> <given-names>H</given-names></string-name>, <string-name><surname>Bayat</surname> <given-names>P</given-names></string-name></person-group>. <article-title>A contingency based energy management strategy for multi-microgrids considering battery energy storage systems and electric vehicles</article-title>. <source>J Energy Storage</source>. <year>2020</year>;<volume>27</volume>(<issue>2</issue>):<fpage>101087</fpage>. doi:<pub-id pub-id-type="doi">10.1016/j.est.2019.101087</pub-id>.</mixed-citation></ref>
<ref id="ref-18"><label>[18]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Wang</surname> <given-names>W</given-names></string-name>, <string-name><surname>Yuan</surname> <given-names>B</given-names></string-name>, <string-name><surname>Sun</surname> <given-names>Q</given-names></string-name>, <string-name><surname>Wennersten</surname> <given-names>R</given-names></string-name></person-group>. <article-title>Application of energy storage in integrated energy systems&#x2014;a solution to fluctuation and uncertainty of renewable energy</article-title>. <source>J Energy Storage</source>. <year>2022</year>;<volume>52</volume>(<issue>8</issue>):<fpage>104812</fpage>. doi:<pub-id pub-id-type="doi">10.1016/j.est.2022.104812</pub-id>.</mixed-citation></ref>
<ref id="ref-19"><label>[19]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Tushar</surname> <given-names>MHK</given-names></string-name>, <string-name><surname>Assi</surname> <given-names>C</given-names></string-name>, <string-name><surname>Maier</surname> <given-names>M</given-names></string-name>, <string-name><surname>Uddin</surname> <given-names>MF</given-names></string-name></person-group>. <article-title>Smart microgrids: optimal joint scheduling for electric vehicles and home appliances</article-title>. <source>IEEE Trans Smart Grid</source>. <year>2014</year>;<volume>5</volume>(<issue>1</issue>):<fpage>239</fpage>&#x2013;<lpage>50</lpage>. doi:<pub-id pub-id-type="doi">10.1109/TSG.2013.2290894</pub-id>.</mixed-citation></ref>
<ref id="ref-20"><label>[20]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Chen</surname> <given-names>J</given-names></string-name>, <string-name><surname>Chen</surname> <given-names>C</given-names></string-name>, <string-name><surname>Duan</surname> <given-names>S</given-names></string-name></person-group>. <article-title>Cooperative optimization of electric vehicles and renewable energy resources in a regional multi-microgrid system</article-title>. <source>Appl Sci</source>. <year>2019</year>;<volume>9</volume>(<issue>11</issue>):<fpage>2267</fpage>. doi:<pub-id pub-id-type="doi">10.3390/app9112267</pub-id>.</mixed-citation></ref>
<ref id="ref-21"><label>[21]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><surname>Shrivastava</surname> <given-names>A</given-names></string-name>, <string-name><surname>Ranga</surname> <given-names>J</given-names></string-name>, <string-name><surname>Narayana</surname> <given-names>VNSL</given-names></string-name>, <collab>Chiranjivi</collab>, <string-name><surname>Borole</surname> <given-names>YD</given-names></string-name></person-group>. <article-title>Green energy powered charging infrastructure for hybrid EVs</article-title>. In: <conf-name>2021 9th International Conference on Cyber and IT Service Management (CITSM)</conf-name>; <year>2021 Sep 22&#x2013;23</year>; <publisher-loc>Bengkulu, Indonesia</publisher-loc>. p. <fpage>1</fpage>&#x2013;<lpage>7</lpage>. doi:<pub-id pub-id-type="doi">10.1109/citsm52892.2021.9589027</pub-id>.</mixed-citation></ref>
<ref id="ref-22"><label>[22]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Ahmad</surname> <given-names>F</given-names></string-name>, <string-name><surname>Alam</surname> <given-names>MS</given-names></string-name>, <string-name><surname>Shariff</surname> <given-names>SM</given-names></string-name>, <string-name><surname>Krishnamurthy</surname> <given-names>M</given-names></string-name></person-group>. <article-title>A cost-efficient approach to EV charging station integrated community microgrid: a case study of Indian power market</article-title>. <source>IEEE Trans Transp Electrif</source>. <year>2019</year>;<volume>5</volume>(<issue>1</issue>):<fpage>200</fpage>&#x2013;<lpage>14</lpage>. doi:<pub-id pub-id-type="doi">10.1109/TTE.2019.2893766</pub-id>.</mixed-citation></ref>
<ref id="ref-23"><label>[23]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Ravichandran</surname> <given-names>A</given-names></string-name>, <string-name><surname>Sirouspour</surname> <given-names>S</given-names></string-name>, <string-name><surname>Malysz</surname> <given-names>P</given-names></string-name>, <string-name><surname>Emadi</surname> <given-names>A</given-names></string-name></person-group>. <article-title>A chance-constraints-based control strategy for microgrids with energy storage and integrated electric vehicles</article-title>. <source>IEEE Trans Smart Grid</source>. <year>2018</year>;<volume>9</volume>(<issue>1</issue>):<fpage>346</fpage>&#x2013;<lpage>59</lpage>. doi:<pub-id pub-id-type="doi">10.1109/TSG.2016.2552173</pub-id>.</mixed-citation></ref>
<ref id="ref-24"><label>[24]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Das</surname> <given-names>HS</given-names></string-name>, <string-name><surname>Rahman</surname> <given-names>MM</given-names></string-name>, <string-name><surname>Li</surname> <given-names>S</given-names></string-name>, <string-name><surname>Tan</surname> <given-names>CW</given-names></string-name></person-group>. <article-title>Electric vehicles standards, charging infrastructure, and impact on grid integration: a technological review</article-title>. <source>Renew Sustain Energy Rev</source>. <year>2020</year>;<volume>120</volume>(<issue>3</issue>):<fpage>109618</fpage>. doi:<pub-id pub-id-type="doi">10.1016/j.rser.2019.109618</pub-id>.</mixed-citation></ref>
<ref id="ref-25"><label>[25]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Rubino</surname> <given-names>L</given-names></string-name>, <string-name><surname>Capasso</surname> <given-names>C</given-names></string-name>, <string-name><surname>Veneri</surname> <given-names>O</given-names></string-name></person-group>. <article-title>Review on plug-in electric vehicle charging architectures integrated with distributed energy sources for sustainable mobility</article-title>. <source>Appl Energy</source>. <year>2017</year>;<volume>207</volume>(<issue>1</issue>):<fpage>438</fpage>&#x2013;<lpage>64</lpage>. doi:<pub-id pub-id-type="doi">10.1016/j.apenergy.2017.06.097</pub-id>.</mixed-citation></ref>
<ref id="ref-26"><label>[26]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Kavousi-Fard</surname> <given-names>A</given-names></string-name>, <string-name><surname>Khodaei</surname> <given-names>A</given-names></string-name></person-group>. <article-title>Efficient integration of plug-in electric vehicles via reconfigurable microgrids</article-title>. <source>Energy</source>. <year>2016</year>;<volume>111</volume>(<issue>3</issue>):<fpage>653</fpage>&#x2013;<lpage>63</lpage>. doi:<pub-id pub-id-type="doi">10.1016/j.energy.2016.06.018</pub-id>.</mixed-citation></ref>
<ref id="ref-27"><label>[27]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Lu</surname> <given-names>X</given-names></string-name>, <string-name><surname>Zhou</surname> <given-names>K</given-names></string-name>, <string-name><surname>Yang</surname> <given-names>S</given-names></string-name></person-group>. <article-title>Multi-objective optimal dispatch of microgrid containing electric vehicles</article-title>. <source>J Clean Prod</source>. <year>2017</year>;<volume>165</volume>(<issue>3</issue>):<fpage>1572</fpage>&#x2013;<lpage>81</lpage>. doi:<pub-id pub-id-type="doi">10.1016/j.jclepro.2017.07.221</pub-id>.</mixed-citation></ref>
<ref id="ref-28"><label>[28]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Kanakadhurga</surname> <given-names>D</given-names></string-name>, <string-name><surname>Prabaharan</surname> <given-names>N</given-names></string-name></person-group>. <article-title>Demand side management in microgrid: a critical review of key issues and recent trends</article-title>. <source>Renew Sustain Energy Rev</source>. <year>2022</year>;<volume>156</volume>(<issue>3</issue>):<fpage>111915</fpage>. doi:<pub-id pub-id-type="doi">10.1016/j.rser.2021.111915</pub-id>.</mixed-citation></ref>
<ref id="ref-29"><label>[29]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Aljohani</surname> <given-names>TM</given-names></string-name>, <string-name><surname>Ebrahim</surname> <given-names>AF</given-names></string-name>, <string-name><surname>Mohammed</surname> <given-names>O</given-names></string-name></person-group>. <article-title>Hybrid microgrid energy management and control based on metaheuristic-driven vector-decoupled algorithm considering intermittent renewable sources and electric vehicles charging lot</article-title>. <source>Energies</source>. <year>2020</year>;<volume>13</volume>(<issue>13</issue>):<fpage>3423</fpage>. doi:<pub-id pub-id-type="doi">10.3390/en13133423</pub-id>.</mixed-citation></ref>
<ref id="ref-30"><label>[30]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Rabie</surname> <given-names>A</given-names></string-name>, <string-name><surname>Ghanem</surname> <given-names>A</given-names></string-name>, <string-name><surname>Kaddah</surname> <given-names>SS</given-names></string-name>, <string-name><surname>El-Saadawi</surname> <given-names>MM</given-names></string-name></person-group>. <article-title>Electric vehicles based electric power grid support: a review</article-title>. <source>Int J Power Electron Drive Syst</source>. <year>2023</year>;<volume>14</volume>(<issue>1</issue>):<fpage>589</fpage>. doi:<pub-id pub-id-type="doi">10.11591/ijpeds.v14.i1.pp589-605</pub-id>.</mixed-citation></ref>
</ref-list>
</back></article>































