<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.1 20151215//EN" "http://jats.nlm.nih.gov/publishing/1.1/JATS-journalpublishing1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" xml:lang="en" article-type="research-article" dtd-version="1.1">
<front>
<journal-meta>
<journal-id journal-id-type="pmc">CMC</journal-id>
<journal-id journal-id-type="nlm-ta">CMC</journal-id>
<journal-id journal-id-type="publisher-id">CMC</journal-id>
<journal-title-group>
<journal-title>Computers, Materials &#x0026; Continua</journal-title>
</journal-title-group>
<issn pub-type="epub">1546-2226</issn>
<issn pub-type="ppub">1546-2218</issn>
<publisher>
<publisher-name>Tech Science Press</publisher-name>
<publisher-loc>USA</publisher-loc>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">77329</article-id>
<article-id pub-id-type="doi">10.32604/cmc.2026.077329</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Article</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Freeway Emergency Lane Opening Strategy under Accident Conditions Based on Improved Markov Model</article-title>
<alt-title alt-title-type="left-running-head">Freeway Emergency Lane Opening Strategy under Accident Conditions Based on Improved Markov Model</alt-title>
<alt-title alt-title-type="right-running-head">Freeway Emergency Lane Opening Strategy under Accident Conditions Based on Improved Markov Model</alt-title>
</title-group>
<contrib-group>
<contrib id="author-1" contrib-type="author">
<name name-style="western"><surname>Yao</surname><given-names>Jiao</given-names></name></contrib>
<contrib id="author-2" contrib-type="author">
<name name-style="western"><surname>Wang</surname><given-names>Pujie</given-names></name></contrib>
<contrib id="author-3" contrib-type="author">
<name name-style="western"><surname>Zhang</surname><given-names>Tianyi</given-names></name></contrib>
<contrib id="author-4" contrib-type="author">
<name name-style="western"><surname>Zhu</surname><given-names>Chenke</given-names></name></contrib>
<contrib id="author-5" contrib-type="author" corresp="yes">
<name name-style="western"><surname>Zhu</surname><given-names>Chenqiang</given-names></name><email>cqzhu@usst.edu.cn</email></contrib>
<aff id="aff-1"><institution>Business School, University of Shanghai for Science and Technology</institution>, <addr-line>Shanghai</addr-line>, <country>China</country></aff>
</contrib-group>
<author-notes>
<corresp id="cor1"><label>&#x002A;</label>Corresponding Author: Chenqiang Zhu. Email: <email>cqzhu@usst.edu.cn</email></corresp>
</author-notes>
<pub-date date-type="collection" publication-format="electronic">
<year>2026</year>
</pub-date>
<pub-date date-type="pub" publication-format="electronic">
<day>9</day><month>4</month><year>2026</year>
</pub-date>
<volume>87</volume>
<issue>3</issue>
<elocation-id>70</elocation-id>
<history>
<date date-type="received">
<day>07</day>
<month>12</month>
<year>2025</year>
</date>
<date date-type="accepted">
<day>20</day>
<month>02</month>
<year>2026</year>
</date>
</history>
<permissions>
<copyright-statement>&#x00A9; 2026 The Authors. Published by Tech Science Press.</copyright-statement>
<copyright-year>2026</copyright-year>
<copyright-holder>The Authors</copyright-holder>
<license xlink:href="https://creativecommons.org/licenses/by/4.0/">
<license-p>This work is licensed under a <ext-link ext-link-type="uri" xlink:type="simple" xlink:href="https://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution 4.0 International License</ext-link>, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
</license>
</permissions>
<self-uri content-type="pdf" xlink:href="TSP_CMC_77329.pdf"></self-uri>
<abstract>
<p>In accident scenarios on freeways, traffic congestion, sharp declines in capacity, and the limitations of closed systems where vehicles cannot turn around or exit freely often pose serious challenges. To address these issues, this study develops an improved Markov Decision Process (MDP) framework for dynamic emergency lane opening. Compared with traditional MDP-based traffic control models, the proposed method integrates three enhancements: Firstly, an explicit action decision space transition mechanism that couples variable speed limits with emergency lane opening decisions; Secondly, vehicle-type&#x2013;differentiated actions to support fine-grained and adaptive opening strategies; and a redesigned reward function incorporating congestion cost, action cost, rewards earned and penalty received to ensure decision rationality and operational feasibility. Based on this improved structure, the optimal strategy is derived using the value iteration algorithm. Finally, simulation results using SUMO demonstrate that under the innermost-lane accident scenario, the optimal strategy is to first implement &#x201C;variable speed limits&#x201D;, followed by &#x201C;opening the emergency lane to all vehicles&#x201D;. This approach increases average speed by 10.81% but enlarges the headway between vehicles at the detection cross-section, leading to an 8.79% decrease in vehicle throughput. Under the outermost-lane accident scenario, the optimal strategy is to first implement &#x201C;variable speed limits&#x201D;, followed by &#x201C;opening the emergency lane to HOVs&#x201D;, which increases average speed by 5.47% while reducing vehicle throughput by 3.13%. These results validate the effectiveness of the proposed model.</p>
</abstract>
<kwd-group kwd-group-type="author">
<kwd>Freeway</kwd>
<kwd>emergency lane opening strategy</kwd>
<kwd>Markov model</kwd>
<kwd>variable speed limits</kwd>
<kwd>high-occupancy vehicles (HOV)</kwd>
</kwd-group>
<funding-group>
<award-group id="awg1">
<funding-source>Shanghai Pujiang Programme grant number</funding-source>
<award-id>23PJC075</award-id>
</award-group>
<award-group id="awg2">
<funding-source>National Natural Science Foundation of China grant number</funding-source>
<award-id>72501184</award-id>
</award-group>
<award-group id="awg3">
<funding-source>Shanghai Philosophy and Social Science Planning Youth Project grant number</funding-source>
<award-id>2023EGL005</award-id>
</award-group>
<award-group id="awg4">
<funding-source>National Natural Science Foundation of China, and Shanghai Planning Office of Philosophyand Social Sciences</funding-source>
</award-group>
</funding-group>
</article-meta>
</front>
<body>
<sec id="s1">
<label>1</label>
<title>Introduction</title>
<p>Freeways are referred to as &#x201C;high-speed&#x201D; primarily due to their high-standard geometric conditions. More importantly, they operate within a closed system characterized by lateral separation, physical isolation of opposing traffic, and strict access control, as well as emergency lanes that help maintain pavement stability and offer temporary refuge for disabled vehicles. However, sudden accidents or short-term surges in passenger traffic during holidays can drastically reduce the capacity of bottleneck sections on these major arteries. The inherent drawbacks of the closed system&#x2014;such as the inability to turn around or exit freely&#x2014;become apparent, often turning the so-called &#x201C;freeway&#x201D; into a &#x201C;massive parking lot&#x201D;. Under such special circumstances, the rational utilization of emergency lanes has become one of the most effective measures to alleviate short-term congestion on freeways and prevent the formation of extensive &#x201C;traffic jams&#x201D;.</p>
<p>Research on emergency lane management, both domestically and internationally, has primarily focused on aspects such as variable speed limits, route optimization, dynamic control, and vehicle type-specific lane management. Variable speed limits for lanes are mainly optimized based on real-time traffic flow conditions and freeway lane characteristics. For instance, Yuan et al. [<xref ref-type="bibr" rid="ref-1">1</xref>] investigated rulebased variable speed limit (VSL) and lane-switching control strategies, focusing on the influence of upstream VSL zone distance on system performance. Regarding the traffic impact and safety implications caused by the accident. Malekzadeh et al. [<xref ref-type="bibr" rid="ref-2">2</xref>] examined VSL control in road traffic networks. Using modeling, simulation, and case studies, it shows that combining variable speed limits with lane management improves traffic efficiency, safety, and supports dynamic traffic management. Avelar et al. [<xref ref-type="bibr" rid="ref-3">3</xref>] evaluated safety benefits to develop collision correction factors. By combining logistic regression with generalized estimating equations for negative binomial distributions, they statistically analyzed and reduced accident frequencies across categories. Zhang et al. [<xref ref-type="bibr" rid="ref-4">4</xref>] showed that the strategy can effectively optimise the mixed-vehicle traffic state and maintain better control performance under any connected and autonomous vehicle (CAV) penetration rates. Wu et al. [<xref ref-type="bibr" rid="ref-5">5</xref>] studied a more effective deep reinforcement learning (DRL) model is developed for differential variable speed limit (DVSL) control, in which dynamic and distinct speed limits among lanes can be imposed. Grumert et al. [<xref ref-type="bibr" rid="ref-6">6</xref>] conducted comparative studies on control algorithm characteristics, focusing on the impacts of different algorithms on traffic efficiency, safety, and environmental factors. Yang et al. [<xref ref-type="bibr" rid="ref-7">7</xref>] analyzed the effects of variable speed limits on freeway macroscopic traffic flow, showing that VSL improves speed&#x2013;occupancy relationships, increases critical occupancy, and enables higher flow at the same occupancy, demonstrating its potential to enhance traffic control efficiency. Researchers such as Binjaku et al. [<xref ref-type="bibr" rid="ref-8">8</xref>] proposed a physically regularized Gaussian mixture model, aiming at the problem of traffic state estimation for multiple vehicle classes on freeways. For instance, Yuan et al. [<xref ref-type="bibr" rid="ref-9">9</xref>] examined the effectiveness and management strategies of HOV lanes under the influence of ridesharing services, addressing conflicts that arise when ride-sourcing and carpooling share HOV lanes. Naseri et al. [<xref ref-type="bibr" rid="ref-10">10</xref>] used the Tehran-Karaj Freeway in Iran as a case study and concluded that dual HOV lanes significantly improve HOV lane speeds through an evaluation of implementation outcomes.</p>
<p>Furthermore, research on emergency lane management, both domestically and internationally, primarily focuses on the spatial limitations of emergency lanes. This includes examining speed limits, usage restrictions, and especially emergency lane opening strategies. Existing studies explore dynamic decision-making models for emergency lane operation, opening measures, and the impacts of such openings on freeway traffic conditions. Dynamic lane opening has been shown to effectively enhance roadway capacity. For instance, Li et al. [<xref ref-type="bibr" rid="ref-11">11</xref>] investigated platoons of connected autonomous vehicles on multilane highways. They employed an extended cellular transport model to characterize capacity degradation and designed a hierarchical optimization strategy based on a model predictive control framework. Model calibration and validation were conducted using VISSIM microsimulation. Zhang et al. [<xref ref-type="bibr" rid="ref-12">12</xref>] adopted the YOLOv11 and ByteTrack algorithms to extract traffic flow parameters from videos, and designed a decision-making process for the activation and closure of emergency lanes based on the interval occupancy rate threshold. Tang et al. [<xref ref-type="bibr" rid="ref-13">13</xref>] carried out research on the optimization problem of emergency lane management and control, adopting methods to build a master-slave two-layer optimization model, which effectively improved traffic efficiency and safety. Jenior et al. [<xref ref-type="bibr" rid="ref-14">14</xref>] studied dynamic partial time shoulder usage. Through historical traffic data analysis, they constructed a decision parameter system with flow and speed as thresholds, and validated its effectiveness using tools such as VISSIM. Liu et al. [<xref ref-type="bibr" rid="ref-15">15</xref>] studied the impact of emergency lane opening on traffic flow. Through comparative analysis of measured data, the article found that the dynamic opening strategy should be combined with real-time traffic flow and accident early warning. Lu et al. [<xref ref-type="bibr" rid="ref-16">16</xref>] proposed a dynamic speed limit zone strategy to address the limited performance of variable speed limit control at fixed bottleneck sections. Besides, Choi et al. [<xref ref-type="bibr" rid="ref-17">17</xref>] proposed a modular architecture and quantitative evaluation metrics to support multiobjective optimization for emergency lane management. Their study demonstrated a 25% reduction in congestion duration and a 30% improvement in emergency response efficiency on the test section. Kononov et al. [<xref ref-type="bibr" rid="ref-18">18</xref>] investigated the safety impacts of emergency lane opening measures on South Korean freeways, identifying a correlation between the length of open emergency lanes and collision frequency. Wang et al. [<xref ref-type="bibr" rid="ref-19">19</xref>] used a multi-agent framework to construct under the connected vehicle environment, and a distributed reinforcement learning algorithm was adopted to design different reward functions for traffic efficiency and traffic safety, respectively. Li et al. [<xref ref-type="bibr" rid="ref-20">20</xref>] researched in a mixed traffic flow environment, a basic linear stability formula and capacity calculation expression. Papageorgiou et al. [<xref ref-type="bibr" rid="ref-21">21</xref>] analyzed methods for evaluating and enhancing urban transportation network resilience.</p>
<p>In summary, both domestic and international studies have made numerous valuable contributions to freeway lane management, emergency lane utilization, and opening strategies. However, several limitations remain:
<list list-type="simple">
<list-item><label>(1)</label><p>Existing methods employing variable speed limits to mitigate congestion under high traffic volumes have yet to integrate variable speed limits with emergency lane opening, which warrants further investigation;</p></list-item>
<list-item><label>(2)</label><p>Current research on emergency lane opening strategies generally fails to account for differences among vehicle types;</p></list-item>
<list-item><label>(3)</label><p>Optimization approaches for emergency lane opening strategies are often restricted to either time-based or space-based conditions, reflecting single-variable control mechanisms.</p></list-item>
</list></p>
<p>To address these issues, this study leverages the comprehensive modeling capabilities and flexibility of the Markov Decision Process (MDP). By defining an action space (opening or closing the emergency lane) within the state transition process and evaluating each action&#x2019;s effectiveness through a reward function, this study integrates variable speed limits and heterogeneous vehicle types to develop scientifically grounded emergency lane opening strategies. The proposed approach aims to effectively mitigate freeway congestion and enhance traffic operational safety.</p>
<p>The contributions of this paper are summarized as follows:
<list list-type="simple">
<list-item><label>(1)</label><p>An integrated decision-making mechanism is established under a unified MDP framework. Unlike most existing studies, it jointly models variable speed limits and emergency lane opening as coordinated controls.</p></list-item>
<list-item><label>(2)</label><p>The proposed framework explicitly captures state-dependent strategy differences linked to accident lane locations, enabling differentiated opening decisions for innermost and outermost lane accident scenarios.</p></list-item>
</list></p>
</sec>
<sec id="s2">
<label>2</label>
<title>Model Establishment</title>
<p>To address the dynamic decision-making problem of emergency lane opening on freeways, this study constructs a Markov Decision Process (MDP) model to determine the threshold of the traffic congestion index at which emergency lanes should be opened following an incident. It should be noted that the effectiveness of such a strategy may be influenced by specific vehicles do not adhere to the Vehicle Speed Control (VSC) protocol, but previous studies [<xref ref-type="bibr" rid="ref-22">22</xref>,<xref ref-type="bibr" rid="ref-23">23</xref>] have indicated that higher compliance with Variable Speed Limits (VSL) generally improved traffic safety and operational performance, whereas lower compliance weakens control effectiveness. Accordingly, the proposed MDP framework is developed under assumptions of typical VSL compliance.</p>
<sec id="s2_1">
<label>2.1</label>
<title>Construction of the Markov Decision Process</title>
<p>The Markovian property refers to a stochastic process in which the probability distribution of future states depends solely on the current state and is independent of all preceding states. In this study, examples of state variables include current traffic volume, accident duration, and emergency lane occupancy. Each state variable evolves over time, and the decision (whether to open or close the lane) influences the subsequent state.</p>
<p>A Markov Decision Process (MDP) primarily consists of five components: State Space, Action Space, State Transition Probabilities, Reward Function, and Discount Factor.</p>
<p>As illustrated in <xref ref-type="fig" rid="fig-1">Fig. 1</xref>, these components are defined as follows:</p>
<fig id="fig-1">
<label>Figure 1</label>
<caption>
<title>Markov decision process diagram.</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_77329-fig-1.tif"/>
</fig>
<p>State space: represents the traffic conditions of freeway sections, categorized into five states: free-flow, near free-flow, slow-moving, congested, and heavily congested.</p>
<p>State transition probabilities: indicate the likelihood of transitioning from the current state to another state within a given time interval.</p>
<p>Action space: includes variable speed limit control, emergency lane opening strategies, and vehicle-type differentiation during lane opening decisions.</p>
<p>Reward function: assigns a positive reward when congestion is alleviated after an action is executed, and a penalty otherwise. The cumulative reward is then computed, with the objective of maximizing overall benefit.</p>
<p>Discount factor: determines the relative weighting of immediate vs. future rewards in the optimization process.</p>
<p>The emergency lane opening problem on freeways focuses on making rapid, spaceconstrained decisions to relieve traffic congestion following an accident. The traffic congestion state evaluation criteria serve as the foundation for constructing the emergency lane opening decision model.</p>
<p>The Traffic Performance Index, TPI is a conceptual indicator that comprehensively reflects traffic flow conditions and congestion levels. In this study, the Traffic Congestion Index is adopted to quantify the degree of congestion. The index ranges from 1 to 5 and is divided into five levels: free-flow, near free-flow, slowmoving, congested, and heavily congested. Higher index values indicate more severe congestion, as summarized in <xref ref-type="table" rid="table-1">Table 1</xref>.
<disp-formula id="eqn-1"><label>(1)</label><mml:math id="mml-eqn-1" display="block"><mml:mtable columnalign="right left right left right left right left right left right left" rowspacing="3pt" columnspacing="0em 2em 0em 2em 0em 2em 0em 2em 0em 2em 0em" displaystyle="true"><mml:mtr><mml:mtd /><mml:mtd><mml:msubsup><mml:mover><mml:mi>V</mml:mi><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msubsup><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mi>n</mml:mi><mml:munderover><mml:mo movablelimits="false">&#x2211;</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mi>N</mml:mi></mml:mrow></mml:munderover><mml:msub><mml:mi>L</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mrow><mml:munderover><mml:mo movablelimits="false">&#x2211;</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mi>N</mml:mi></mml:mrow></mml:munderover><mml:msub><mml:mi>T</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:mfrac><mml:mo>,</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>where: <inline-formula id="ieqn-1"><mml:math id="mml-ieqn-1"><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> represents the free-flow speed of the road, measured in <inline-formula id="ieqn-2"><mml:math id="mml-ieqn-2"><mml:mrow><mml:mtext>km</mml:mtext></mml:mrow><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:mrow><mml:mtext>h</mml:mtext></mml:mrow></mml:math></inline-formula>; <inline-formula id="ieqn-3"><mml:math id="mml-ieqn-3"><mml:msubsup><mml:mover><mml:mi>V</mml:mi><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msubsup></mml:math></inline-formula> is the average travel speed of the road segment, measured in <inline-formula id="ieqn-4"><mml:math id="mml-ieqn-4"><mml:mrow><mml:mtext>km</mml:mtext></mml:mrow><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:mrow><mml:mtext>h</mml:mtext></mml:mrow></mml:math></inline-formula>; <inline-formula id="ieqn-5"><mml:math id="mml-ieqn-5"><mml:msub><mml:mi>L</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> is the vehicle travel distance, measured in <inline-formula id="ieqn-6"><mml:math id="mml-ieqn-6"><mml:mrow><mml:mtext>km</mml:mtext></mml:mrow></mml:math></inline-formula>; <inline-formula id="ieqn-7"><mml:math id="mml-ieqn-7"><mml:msub><mml:mi>T</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> is the travel time of a vehicle passing through the section, i.e., <inline-formula id="ieqn-8"><mml:math id="mml-ieqn-8"><mml:msub><mml:mi>L</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula>, measured in <inline-formula id="ieqn-9"><mml:math id="mml-ieqn-9"><mml:mrow><mml:mtext>h</mml:mtext></mml:mrow></mml:math></inline-formula>; <inline-formula id="ieqn-10"><mml:math id="mml-ieqn-10"><mml:mi>n</mml:mi></mml:math></inline-formula> is the number of vehicles.</p>
<table-wrap id="table-1">
<label>Table 1</label>
<caption>
<title>Traffic congestion index classification.</title>
</caption>
<table>
<colgroup>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
</colgroup>
<thead>
<tr>
<th>Congestion Index</th>
<th>Road Condition</th>
<th>Travel Speed</th>
<th>Congestion Status Description</th>
</tr>
</thead>
<tbody>
<tr>
<td>1</td>
<td>Smooth</td>
<td><inline-formula id="ieqn-11"><mml:math id="mml-ieqn-11"><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula></td>
<td>Minimal Congestion</td>
</tr>
<tr>
<td>2</td>
<td>Mostly Clear</td>
<td><inline-formula id="ieqn-12"><mml:math id="mml-ieqn-12"><mml:mrow><mml:mo>[</mml:mo><mml:mn>0.8</mml:mn><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula></td>
<td>Minor Congestion on Some Sections</td>
</tr>
<tr>
<td>3</td>
<td>Slow Traffic</td>
<td><inline-formula id="ieqn-13"><mml:math id="mml-ieqn-13"><mml:mrow><mml:mo>[</mml:mo><mml:mn>0.6</mml:mn><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:mn>0.8</mml:mn><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula></td>
<td>Congestion on Some Sections</td>
</tr>
<tr>
<td>4</td>
<td>Congestion</td>
<td><inline-formula id="ieqn-14"><mml:math id="mml-ieqn-14"><mml:mrow><mml:mo>[</mml:mo><mml:mn>0.4</mml:mn><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:mn>0.6</mml:mn><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula></td>
<td>Extensive Congestion on Many Sections</td>
</tr>
<tr>
<td>5</td>
<td>Severe Congestion</td>
<td><inline-formula id="ieqn-15"><mml:math id="mml-ieqn-15"><mml:mrow><mml:mo>[</mml:mo><mml:mn>0</mml:mn><mml:mo>,</mml:mo><mml:mn>0.4</mml:mn><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula></td>
<td>Most Sections Congested</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s2_2">
<label>2.2</label>
<title>Establishment of the Emergency Lane Opening Strategy Model</title>
<p>As shown in <xref ref-type="fig" rid="fig-2">Fig. 2</xref>, the freeway is divided into several segments. Road vehicle information is obtained through detectors installed along the freeway. Since detectors cannot cover the entire section, this study deploys corresponding detectors on the upstream main road and upstream ramp. The average travel speed for each segment in the road network is calculated using <xref ref-type="disp-formula" rid="eqn-1">Eq. (1)</xref>.</p>
<fig id="fig-2">
<label>Figure 2</label>
<caption>
<title>Division of freeway section.</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_77329-fig-2.tif"/>
</fig>
<p>(1) Decision Time
<disp-formula id="eqn-2"><label>(2)</label><mml:math id="mml-eqn-2" display="block"><mml:mtable columnalign="right left right left right left right left right left right left" rowspacing="3pt" columnspacing="0em 2em 0em 2em 0em 2em 0em 2em 0em 2em 0em" displaystyle="true"><mml:mtr><mml:mtd /><mml:mtd><mml:mi>T</mml:mi><mml:mo>=</mml:mo><mml:mrow><mml:mo>{</mml:mo><mml:mn>1</mml:mn><mml:mo>,</mml:mo><mml:mn>2</mml:mn><mml:mo>,</mml:mo><mml:mn>3</mml:mn><mml:mo>,</mml:mo><mml:mo>&#x2026;</mml:mo><mml:mo>,</mml:mo><mml:mi>N</mml:mi><mml:mo>}</mml:mo></mml:mrow><mml:mo>.</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula></p>
<p>In the equation, <inline-formula id="ieqn-16"><mml:math id="mml-ieqn-16"><mml:mi>T</mml:mi></mml:math></inline-formula> represents the time at which node is selected.</p>
<p>(2) State Space</p>
<p>The state space describes environmental information, denoted as <inline-formula id="ieqn-17"><mml:math id="mml-ieqn-17"><mml:mi>Z</mml:mi></mml:math></inline-formula>. In transportation, it can be used to study the traffic conditions of a road segment, encompassing information such as traffic congestion status, vehicle speed, and density. Therefore, the state space can be defined as the set of traffic conditions within that area. This study defines the state space as the road congestion status within the region <inline-formula id="ieqn-18"><mml:math id="mml-ieqn-18"><mml:msub><mml:mi>L</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula>, as shown in <xref ref-type="disp-formula" rid="eqn-3">Eq. (3)</xref>.
<disp-formula id="eqn-3"><label>(3)</label><mml:math id="mml-eqn-3" display="block"><mml:mtable columnalign="right left right left right left right left right left right left" rowspacing="3pt" columnspacing="0em 2em 0em 2em 0em 2em 0em 2em 0em 2em 0em" displaystyle="true"><mml:mtr><mml:mtd /><mml:mtd><mml:mi>Z</mml:mi><mml:mo>=</mml:mo><mml:mrow><mml:mo>{</mml:mo><mml:mtable columnalign="left left" rowspacing="4pt" columnspacing="1em"><mml:mtr><mml:mtd><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mn>1</mml:mn></mml:mrow></mml:msub></mml:mtd><mml:mtd><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub><mml:mo>&#x2264;</mml:mo><mml:msubsup><mml:mover><mml:mi>V</mml:mi><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msubsup></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msub></mml:mtd><mml:mtd><mml:mn>0.8</mml:mn><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub><mml:mo>&#x2264;</mml:mo><mml:msubsup><mml:mover><mml:mi>V</mml:mi><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msubsup><mml:mo>&#x003C;</mml:mo><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mn>3</mml:mn></mml:mrow></mml:msub></mml:mtd><mml:mtd><mml:mn>0.6</mml:mn><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub><mml:mo>&#x2264;</mml:mo><mml:msup><mml:mover><mml:msub><mml:mrow><mml:mi>V</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msup><mml:mo>&#x003C;</mml:mo><mml:mn>0.8</mml:mn><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mn>4</mml:mn></mml:mrow></mml:msub></mml:mtd><mml:mtd><mml:mn>0.4</mml:mn><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub><mml:mo>&#x2264;</mml:mo><mml:msup><mml:mover><mml:msub><mml:mrow><mml:mi>V</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msup><mml:mo>&#x003C;</mml:mo><mml:mn>0.6</mml:mn><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mn>5</mml:mn></mml:mrow></mml:msub></mml:mtd><mml:mtd><mml:mn>0</mml:mn><mml:mo>&#x2264;</mml:mo><mml:msup><mml:mover><mml:msub><mml:mrow><mml:mi>V</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msup><mml:mo>&#x003C;</mml:mo><mml:mn>0.4</mml:mn><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub></mml:mtd></mml:mtr></mml:mtable><mml:mo fence="true" stretchy="true" symmetric="true"></mml:mo></mml:mrow><mml:mo>,</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>where: <inline-formula id="ieqn-19"><mml:math id="mml-ieqn-19"><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> represents the free-flow speed of the road, measured in <inline-formula id="ieqn-20"><mml:math id="mml-ieqn-20"><mml:mrow><mml:mtext>km</mml:mtext></mml:mrow><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:mrow><mml:mtext>h</mml:mtext></mml:mrow></mml:math></inline-formula>; <inline-formula id="ieqn-21"><mml:math id="mml-ieqn-21"><mml:msubsup><mml:mover><mml:mi>V</mml:mi><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msubsup></mml:math></inline-formula> is the average travel speed of the road segment at time <inline-formula id="ieqn-22"><mml:math id="mml-ieqn-22"><mml:mi>t</mml:mi></mml:math></inline-formula>, measured in <inline-formula id="ieqn-23"><mml:math id="mml-ieqn-23"><mml:mrow><mml:mtext>km</mml:mtext></mml:mrow><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:mrow><mml:mtext>h</mml:mtext></mml:mrow></mml:math></inline-formula>; <inline-formula id="ieqn-24"><mml:math id="mml-ieqn-24"><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mn>1</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula> indicates the section is uncongested; <inline-formula id="ieqn-25"><mml:math id="mml-ieqn-25"><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula> indicates the section is mostly clear; <inline-formula id="ieqn-26"><mml:math id="mml-ieqn-26"><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mn>3</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula> indicates slow traffic; <inline-formula id="ieqn-27"><mml:math id="mml-ieqn-27"><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mn>4</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula> indicates congestion; <inline-formula id="ieqn-28"><mml:math id="mml-ieqn-28"><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mn>5</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula> indicates severe congestion.</p>
<p>(3) Action Decision Space</p>
<p>A decision made at a specific moment that alters the state of the environment is denoted as <inline-formula id="ieqn-29"><mml:math id="mml-ieqn-29"><mml:mi>M</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>z</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula>. This study investigates variable speed limit and emergency lane opening strategies, as well as distinguishing different vehicle types during lane opening. Therefore, the region <inline-formula id="ieqn-30"><mml:math id="mml-ieqn-30"><mml:msub><mml:mi>L</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> is defined. At the decision moment <inline-formula id="ieqn-31"><mml:math id="mml-ieqn-31"><mml:mi>t</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mn>1</mml:mn></mml:math></inline-formula>, the action set <inline-formula id="ieqn-32"><mml:math id="mml-ieqn-32"><mml:mi>M</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>z</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula> taken under state <inline-formula id="ieqn-33"><mml:math id="mml-ieqn-33"><mml:mi>z</mml:mi></mml:math></inline-formula> is defined as:
<disp-formula id="eqn-4"><label>(4)</label><mml:math id="mml-eqn-4" display="block"><mml:mi>M</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>z</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mrow><mml:mo>{</mml:mo><mml:mtable columnalign="left left" rowspacing="4pt" columnspacing="1em"><mml:mtr><mml:mtd><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mn>1</mml:mn></mml:mrow></mml:msub></mml:mtd><mml:mtd><mml:mi>z</mml:mi><mml:mo>=</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mn>1</mml:mn></mml:mrow></mml:msub></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msub></mml:mtd><mml:mtd><mml:mi>z</mml:mi><mml:mo>=</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msub></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mn>3</mml:mn></mml:mrow></mml:msub></mml:mtd><mml:mtd><mml:mi>z</mml:mi><mml:mo>=</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mn>3</mml:mn></mml:mrow></mml:msub></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mn>4</mml:mn></mml:mrow></mml:msub></mml:mtd><mml:mtd><mml:mi>z</mml:mi><mml:mo>=</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mn>4</mml:mn></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mn>5</mml:mn></mml:mrow></mml:msub></mml:mtd></mml:mtr></mml:mtable><mml:mo fence="true" stretchy="true" symmetric="true"></mml:mo></mml:mrow><mml:mo>.</mml:mo></mml:math></disp-formula></p>
<p>When the traffic congestion state is <inline-formula id="ieqn-34"><mml:math id="mml-ieqn-34"><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mn>1</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula> (free-flow state), perform action <inline-formula id="ieqn-35"><mml:math id="mml-ieqn-35"><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mn>1</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula>, implement variable speed limits on the upstream section of the accident affected segment, reducing the flow speed <inline-formula id="ieqn-36"><mml:math id="mml-ieqn-36"><mml:mn>20</mml:mn><mml:mtext>&#x00A0;</mml:mtext><mml:mrow><mml:mtext>km</mml:mtext></mml:mrow><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:mrow><mml:mtext>h</mml:mtext></mml:mrow></mml:math></inline-formula>.
<disp-formula id="eqn-5"><label>(5)</label><mml:math id="mml-eqn-5" display="block"><mml:mtable columnalign="right left right left right left right left right left right left" rowspacing="3pt" columnspacing="0em 2em 0em 2em 0em 2em 0em 2em 0em 2em 0em" displaystyle="true"><mml:mtr><mml:mtd /><mml:mtd><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mn>1</mml:mn></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:msubsup><mml:mover><mml:mi>V</mml:mi><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:msubsup><mml:mo>&#x2212;</mml:mo><mml:mn>20</mml:mn><mml:mo>,</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>where: <inline-formula id="ieqn-37"><mml:math id="mml-ieqn-37"><mml:msubsup><mml:mover><mml:mi>V</mml:mi><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> is the speed limit for the section <inline-formula id="ieqn-38"><mml:math id="mml-ieqn-38"><mml:msub><mml:mi>L</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> at time <inline-formula id="ieqn-39"><mml:math id="mml-ieqn-39"><mml:mi>t</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mn>1</mml:mn></mml:math></inline-formula>, measured in <inline-formula id="ieqn-40"><mml:math id="mml-ieqn-40"><mml:mrow><mml:mtext>km</mml:mtext></mml:mrow><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:mrow><mml:mtext>h</mml:mtext></mml:mrow></mml:math></inline-formula>.</p>
<p>As shown in <xref ref-type="fig" rid="fig-3">Fig. 3</xref>, when the traffic congestion state is <inline-formula id="ieqn-41"><mml:math id="mml-ieqn-41"><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula> (basically uncongested), perform action <inline-formula id="ieqn-42"><mml:math id="mml-ieqn-42"><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula> implement variable speed limits upstream of the congested segment to reduce vehicle flow speed <inline-formula id="ieqn-43"><mml:math id="mml-ieqn-43"><mml:mn>10</mml:mn><mml:mtext>&#x00A0;</mml:mtext><mml:mrow><mml:mtext>km</mml:mtext></mml:mrow><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:mrow><mml:mtext>h</mml:mtext></mml:mrow></mml:math></inline-formula>.
<disp-formula id="eqn-6"><label>(6)</label><mml:math id="mml-eqn-6" display="block"><mml:mtable columnalign="right left right left right left right left right left right left" rowspacing="3pt" columnspacing="0em 2em 0em 2em 0em 2em 0em 2em 0em 2em 0em" displaystyle="true"><mml:mtr><mml:mtd /><mml:mtd><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:msubsup><mml:mover><mml:mi>V</mml:mi><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:msubsup><mml:mo>&#x2212;</mml:mo><mml:mn>10</mml:mn><mml:mo>,</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>where: <inline-formula id="ieqn-44"><mml:math id="mml-ieqn-44"><mml:msubsup><mml:mover><mml:mi>V</mml:mi><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> is the speed limit for the section <inline-formula id="ieqn-45"><mml:math id="mml-ieqn-45"><mml:msub><mml:mi>L</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> at time <inline-formula id="ieqn-46"><mml:math id="mml-ieqn-46"><mml:mi>t</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mn>1</mml:mn></mml:math></inline-formula>, measured in <inline-formula id="ieqn-47"><mml:math id="mml-ieqn-47"><mml:mrow><mml:mtext>km</mml:mtext></mml:mrow><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:mrow><mml:mtext>h</mml:mtext></mml:mrow></mml:math></inline-formula>.</p>
<fig id="fig-3">
<label>Figure 3</label>
<caption>
<title>Action diagram <inline-formula id="ieqn-48"><mml:math id="mml-ieqn-48"><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mn>1</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula>.</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_77329-fig-3.tif"/>
</fig>
<p>As shown in <xref ref-type="fig" rid="fig-4">Fig. 4</xref>, when the traffic congestion state is in the slow-moving state <inline-formula id="ieqn-49"><mml:math id="mml-ieqn-49"><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mn>3</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula>, perform action <inline-formula id="ieqn-50"><mml:math id="mml-ieqn-50"><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mn>3</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula>. This study introduces a 0&#x2013;1 variable <inline-formula id="ieqn-51"><mml:math id="mml-ieqn-51"><mml:mi>E</mml:mi></mml:math></inline-formula> into action <inline-formula id="ieqn-52"><mml:math id="mml-ieqn-52"><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mn>3</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula>. When <inline-formula id="ieqn-53"><mml:math id="mml-ieqn-53"><mml:mi>E</mml:mi><mml:mo>=</mml:mo><mml:mn>0</mml:mn></mml:math></inline-formula>, it indicates the emergency lane is closed; when <inline-formula id="ieqn-54"><mml:math id="mml-ieqn-54"><mml:mi>E</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:math></inline-formula>, it indicates the emergency lane is open and only permits HOV vehicles to pass. The specific expression is as follows:
<disp-formula id="eqn-7"><label>(7)</label><mml:math id="mml-eqn-7" display="block"><mml:mtable columnalign="right left right left right left right left right left right left" rowspacing="3pt" columnspacing="0em 2em 0em 2em 0em 2em 0em 2em 0em 2em 0em" displaystyle="true"><mml:mtr><mml:mtd /><mml:mtd><mml:mtable columnalign="left" rowspacing="4pt" columnspacing="1em"><mml:mtr><mml:mtd><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mn>3</mml:mn></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>z</mml:mi><mml:mo>,</mml:mo><mml:mi>E</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mrow><mml:mo>(</mml:mo><mml:mn>1</mml:mn><mml:mo>&#x2212;</mml:mo><mml:mi>E</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo movablelimits="true" form="prefix">min</mml:mo><mml:mrow><mml:mo>{</mml:mo><mml:msubsup><mml:mover><mml:mi>V</mml:mi><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msubsup><mml:mo>,</mml:mo><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub><mml:mo>}</mml:mo></mml:mrow><mml:mo>+</mml:mo><mml:mi>E</mml:mi><mml:mo movablelimits="true" form="prefix">min</mml:mo><mml:mrow><mml:mo>{</mml:mo><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo>[</mml:mo><mml:mn>1</mml:mn><mml:mo>&#x2212;</mml:mo><mml:mi>&#x03B1;</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mstyle displaystyle="true" scriptlevel="0"><mml:mfrac><mml:mrow><mml:msub><mml:mi>k</mml:mi><mml:mrow><mml:mi>H</mml:mi><mml:mi>O</mml:mi><mml:mi>V</mml:mi></mml:mrow></mml:msub><mml:mo>&#x2212;</mml:mo><mml:mi>k</mml:mi></mml:mrow><mml:mrow><mml:msubsup><mml:mi>k</mml:mi><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mrow><mml:mi>H</mml:mi><mml:mi>O</mml:mi><mml:mi>V</mml:mi></mml:mrow></mml:msubsup><mml:mo>&#x2212;</mml:mo><mml:mi>k</mml:mi></mml:mrow></mml:mfrac></mml:mstyle><mml:mo>)</mml:mo></mml:mrow><mml:mo>,</mml:mo><mml:mi>&#x03B2;</mml:mi><mml:msubsup><mml:mover><mml:mi>V</mml:mi><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msubsup><mml:mo>]</mml:mo></mml:mrow><mml:mo>}</mml:mo></mml:mrow><mml:mo>,</mml:mo></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:msub><mml:mi>k</mml:mi><mml:mrow><mml:mi>H</mml:mi><mml:mi>O</mml:mi><mml:mi>V</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:msub><mml:mi>&#x03C1;</mml:mi><mml:mrow><mml:mi>H</mml:mi><mml:mi>O</mml:mi><mml:mi>V</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>k</mml:mi><mml:mstyle displaystyle="true" scriptlevel="0"><mml:mfrac><mml:mi>n</mml:mi><mml:mrow><mml:mi>n</mml:mi><mml:mo>+</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:mfrac></mml:mstyle><mml:mo>)</mml:mo></mml:mrow><mml:mo>.</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula></p>
<fig id="fig-4">
<label>Figure 4</label>
<caption>
<title>Action diagram <inline-formula id="ieqn-55"><mml:math id="mml-ieqn-55"><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula>.</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_77329-fig-4.tif"/>
</fig>
<p>In the formula, <inline-formula id="ieqn-56"><mml:math id="mml-ieqn-56"><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> represents the free-flow speed of the road, measured in <inline-formula id="ieqn-57"><mml:math id="mml-ieqn-57"><mml:mrow><mml:mtext>km</mml:mtext></mml:mrow><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:mrow><mml:mtext>h</mml:mtext></mml:mrow></mml:math></inline-formula>; <inline-formula id="ieqn-58"><mml:math id="mml-ieqn-58"><mml:msubsup><mml:mover><mml:mi>V</mml:mi><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msubsup></mml:math></inline-formula> represents the average travel speed of the road section at time <inline-formula id="ieqn-59"><mml:math id="mml-ieqn-59"><mml:mi>t</mml:mi></mml:math></inline-formula>, measured in <inline-formula id="ieqn-60"><mml:math id="mml-ieqn-60"><mml:mrow><mml:mtext>km</mml:mtext></mml:mrow><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:mrow><mml:mtext>h</mml:mtext></mml:mrow></mml:math></inline-formula>; <inline-formula id="ieqn-61"><mml:math id="mml-ieqn-61"><mml:mi>k</mml:mi></mml:math></inline-formula> is the traffic density; <inline-formula id="ieqn-62"><mml:math id="mml-ieqn-62"><mml:msub><mml:mi>&#x03C1;</mml:mi><mml:mrow><mml:mi>H</mml:mi><mml:mi>O</mml:mi><mml:mi>V</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> is the proportion of HOV vehicles; <inline-formula id="ieqn-63"><mml:math id="mml-ieqn-63"><mml:mi>&#x03B1;</mml:mi></mml:math></inline-formula> is the sensitivity coefficient; <inline-formula id="ieqn-64"><mml:math id="mml-ieqn-64"><mml:mi>&#x03B2;</mml:mi></mml:math></inline-formula> is the emergency lane safety factor; <inline-formula id="ieqn-65"><mml:math id="mml-ieqn-65"><mml:mi>n</mml:mi></mml:math></inline-formula> represents the number of lanes.</p>
<p>As shown in <xref ref-type="fig" rid="fig-5">Figs. 5</xref> and <xref ref-type="fig" rid="fig-6">6</xref>, when the traffic congestion state is in <inline-formula id="ieqn-66"><mml:math id="mml-ieqn-66"><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mn>4</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula> congestion state or the <inline-formula id="ieqn-67"><mml:math id="mml-ieqn-67"><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mn>5</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula> severe congestion state, perform action <inline-formula id="ieqn-68"><mml:math id="mml-ieqn-68"><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mn>4</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula>. Introduce a 0&#x2013;1 variable <inline-formula id="ieqn-69"><mml:math id="mml-ieqn-69"><mml:mi>E</mml:mi></mml:math></inline-formula>, it indicates the emergency lane is not open; when <inline-formula id="ieqn-70"><mml:math id="mml-ieqn-70"><mml:mi>E</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:math></inline-formula>, it indicates the emergency lane is open and allows all vehicles to pass, where expressed as follows:
<disp-formula id="eqn-8"><label>(8)</label><mml:math id="mml-eqn-8" display="block"><mml:mtable columnalign="right left right left right left right left right left right left" rowspacing="3pt" columnspacing="0em 2em 0em 2em 0em 2em 0em 2em 0em 2em 0em" displaystyle="true"><mml:mtr><mml:mtd /><mml:mtd><mml:mtable columnalign="left" rowspacing="4pt" columnspacing="1em"><mml:mtr><mml:mtd><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mn>4</mml:mn></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>z</mml:mi><mml:mo>,</mml:mo><mml:mi>E</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mrow><mml:mo>(</mml:mo><mml:mn>1</mml:mn><mml:mo>&#x2212;</mml:mo><mml:mi>E</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo movablelimits="true" form="prefix">min</mml:mo><mml:mrow><mml:mo>{</mml:mo><mml:msubsup><mml:mover><mml:mi>V</mml:mi><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msubsup><mml:mo>,</mml:mo><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub><mml:mo>}</mml:mo></mml:mrow><mml:mo>+</mml:mo><mml:mi>E</mml:mi><mml:mo movablelimits="true" form="prefix">min</mml:mo><mml:mrow><mml:mo>{</mml:mo><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo>[</mml:mo><mml:mn>1</mml:mn><mml:mo>&#x2212;</mml:mo><mml:mi>&#x03B1;</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mstyle displaystyle="true" scriptlevel="0"><mml:mfrac><mml:mrow><mml:msub><mml:mi>k</mml:mi><mml:mrow><mml:mi>a</mml:mi><mml:mi>l</mml:mi><mml:mi>l</mml:mi></mml:mrow></mml:msub><mml:mo>&#x2212;</mml:mo><mml:mi>k</mml:mi></mml:mrow><mml:mrow><mml:msubsup><mml:mi>k</mml:mi><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mrow><mml:mi mathvariant="normal">&#x2032;</mml:mi></mml:mrow></mml:msubsup><mml:mo>&#x2212;</mml:mo><mml:mi>k</mml:mi></mml:mrow></mml:mfrac></mml:mstyle><mml:mo>)</mml:mo></mml:mrow><mml:mo>,</mml:mo><mml:mi>&#x03B2;</mml:mi><mml:msubsup><mml:mover><mml:mi>V</mml:mi><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msubsup><mml:mo>]</mml:mo></mml:mrow><mml:mo>}</mml:mo></mml:mrow><mml:mo>,</mml:mo></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:msub><mml:mi>k</mml:mi><mml:mrow><mml:mi>a</mml:mi><mml:mi>l</mml:mi><mml:mi>l</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mi>k</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mstyle displaystyle="true" scriptlevel="0"><mml:mfrac><mml:mi>n</mml:mi><mml:mrow><mml:mi>n</mml:mi><mml:mo>+</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:mfrac></mml:mstyle><mml:mo>)</mml:mo></mml:mrow><mml:mo>.</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula></p>
<fig id="fig-5">
<label>Figure 5</label>
<caption>
<title>Action diagram <inline-formula id="ieqn-71"><mml:math id="mml-ieqn-71"><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mn>3</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula>.</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_77329-fig-5.tif"/>
</fig><fig id="fig-6">
<label>Figure 6</label>
<caption>
<title>Action diagram <inline-formula id="ieqn-72"><mml:math id="mml-ieqn-72"><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mn>4</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula>.</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_77329-fig-6.tif"/>
</fig>
<p>In the formula, <inline-formula id="ieqn-73"><mml:math id="mml-ieqn-73"><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> represents the road free-flow speed, measured in <inline-formula id="ieqn-74"><mml:math id="mml-ieqn-74"><mml:mrow><mml:mtext>km</mml:mtext></mml:mrow><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:mrow><mml:mtext>h</mml:mtext></mml:mrow></mml:math></inline-formula>; <inline-formula id="ieqn-75"><mml:math id="mml-ieqn-75"><mml:msubsup><mml:mover><mml:mi>V</mml:mi><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msubsup></mml:math></inline-formula> represents the average travel speed of the road section at time <inline-formula id="ieqn-76"><mml:math id="mml-ieqn-76"><mml:mi>t</mml:mi></mml:math></inline-formula>, measured in <inline-formula id="ieqn-77"><mml:math id="mml-ieqn-77"><mml:mrow><mml:mtext>km</mml:mtext></mml:mrow><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:mrow><mml:mtext>h</mml:mtext></mml:mrow></mml:math></inline-formula>; <inline-formula id="ieqn-78"><mml:math id="mml-ieqn-78"><mml:mi>k</mml:mi></mml:math></inline-formula> is the traffic density; <inline-formula id="ieqn-79"><mml:math id="mml-ieqn-79"><mml:mi>&#x03B1;</mml:mi></mml:math></inline-formula> is the sensitivity coefficient; <inline-formula id="ieqn-80"><mml:math id="mml-ieqn-80"><mml:mi>&#x03B2;</mml:mi></mml:math></inline-formula> is the emergency lane safety factor; <inline-formula id="ieqn-81"><mml:math id="mml-ieqn-81"><mml:mi>n</mml:mi></mml:math></inline-formula> represents the number of lanes.</p>
<p><xref ref-type="table" rid="table-2">Table 2</xref> summarizes the aforementioned action decision space defined for different traffic congestion states. For each congestion state, the corresponding control measures are specified, including the implementation of variable speed limits and differentiated emergency lane opening strategies.</p>
<table-wrap id="table-2">
<label>Table 2</label>
<caption>
<title>Action decision space.</title>
</caption>
<table>
<colgroup>
<col align="center"/>
<col align="center"/>
<col align="center"/>
</colgroup>
<thead>
<tr>
<th>State</th>
<th align="center" colspan="2">Action</th>
</tr>
</thead>
<tbody>
<tr>
<td><inline-formula id="ieqn-116"><mml:math id="mml-ieqn-116"><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mn>1</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula></td>
<td><inline-formula id="ieqn-117"><mml:math id="mml-ieqn-117"><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mn>1</mml:mn></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:msubsup><mml:mover><mml:mi>V</mml:mi><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:msubsup><mml:mo>&#x2212;</mml:mo><mml:mn>20</mml:mn></mml:math></inline-formula></td>
<td>Variable Speed Limit, Reduced Traffic Flow Speed 20 <inline-formula id="ieqn-118"><mml:math id="mml-ieqn-118"><mml:mrow><mml:mtext>km</mml:mtext></mml:mrow><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:mrow><mml:mtext>h</mml:mtext></mml:mrow></mml:math></inline-formula></td>
</tr>
<tr>
<td><inline-formula id="ieqn-119"><mml:math id="mml-ieqn-119"><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula></td>
<td><inline-formula id="ieqn-120"><mml:math id="mml-ieqn-120"><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:msubsup><mml:mover><mml:mi>V</mml:mi><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:msubsup><mml:mo>&#x2212;</mml:mo><mml:mn>10</mml:mn></mml:math></inline-formula></td>
<td>Variable Speed Limit, Reducing Traffic Flow Speed 10 <inline-formula id="ieqn-121"><mml:math id="mml-ieqn-121"><mml:mrow><mml:mtext>km</mml:mtext></mml:mrow><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:mrow><mml:mtext>h</mml:mtext></mml:mrow></mml:math></inline-formula></td>
</tr>
<tr>
<td><inline-formula id="ieqn-122"><mml:math id="mml-ieqn-122"><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mn>3</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula></td>
<td><inline-formula id="ieqn-123"><mml:math id="mml-ieqn-123"><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mn>3</mml:mn></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>z</mml:mi><mml:mo>,</mml:mo><mml:mi>E</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mrow><mml:mo>(</mml:mo><mml:mn>1</mml:mn><mml:mo>&#x2212;</mml:mo><mml:mi>E</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo movablelimits="true" form="prefix">min</mml:mo><mml:mrow><mml:mo>{</mml:mo><mml:msubsup><mml:mover><mml:mi>V</mml:mi><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msubsup><mml:mo>,</mml:mo><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub><mml:mo>}</mml:mo></mml:mrow><mml:mo>+</mml:mo><mml:mi>E</mml:mi><mml:mo movablelimits="true" form="prefix">min</mml:mo><mml:mrow><mml:mo>{</mml:mo><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo>[</mml:mo><mml:mn>1</mml:mn><mml:mo>&#x2212;</mml:mo><mml:mi>&#x03B1;</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mstyle displaystyle="true" scriptlevel="0"><mml:mfrac><mml:mrow><mml:msub><mml:mi>k</mml:mi><mml:mrow><mml:mi>H</mml:mi><mml:mi>O</mml:mi><mml:mi>V</mml:mi></mml:mrow></mml:msub><mml:mo>&#x2212;</mml:mo><mml:mi>k</mml:mi></mml:mrow><mml:mrow><mml:msubsup><mml:mi>k</mml:mi><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mrow><mml:mi>H</mml:mi><mml:mi>O</mml:mi><mml:mi>V</mml:mi></mml:mrow></mml:msubsup><mml:mo>&#x2212;</mml:mo><mml:mi>k</mml:mi></mml:mrow></mml:mfrac></mml:mstyle><mml:mo>)</mml:mo></mml:mrow><mml:mo>,</mml:mo><mml:mi>&#x03B2;</mml:mi><mml:msubsup><mml:mover><mml:mi>V</mml:mi><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msubsup><mml:mo>]</mml:mo></mml:mrow><mml:mo>}</mml:mo></mml:mrow></mml:math></inline-formula><inline-formula id="ieqn-124"><mml:math id="mml-ieqn-124"><mml:msub><mml:mi>k</mml:mi><mml:mrow><mml:mi>H</mml:mi><mml:mi>O</mml:mi><mml:mi>V</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:msub><mml:mi>&#x03C1;</mml:mi><mml:mrow><mml:mi>H</mml:mi><mml:mi>O</mml:mi><mml:mi>V</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>k</mml:mi><mml:mstyle displaystyle="true" scriptlevel="0"><mml:mfrac><mml:mi>n</mml:mi><mml:mrow><mml:mi>n</mml:mi><mml:mo>+</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:mfrac></mml:mstyle><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula></td>
<td>Emergency Lane open, Allowing only HOV Vehicles</td>
</tr>
<tr>
<td><inline-formula id="ieqn-125"><mml:math id="mml-ieqn-125"><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mn>4</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula>,<inline-formula id="ieqn-126"><mml:math id="mml-ieqn-126"><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mn>5</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula></td>
<td><inline-formula id="ieqn-127"><mml:math id="mml-ieqn-127"><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mn>4</mml:mn></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>z</mml:mi><mml:mo>,</mml:mo><mml:mi>E</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mrow><mml:mo>(</mml:mo><mml:mn>1</mml:mn><mml:mo>&#x2212;</mml:mo><mml:mi>E</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo movablelimits="true" form="prefix">min</mml:mo><mml:mrow><mml:mo>{</mml:mo><mml:msubsup><mml:mover><mml:mi>V</mml:mi><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msubsup><mml:mo>,</mml:mo><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub><mml:mo>}</mml:mo></mml:mrow><mml:mo>+</mml:mo><mml:mi>E</mml:mi><mml:mo movablelimits="true" form="prefix">min</mml:mo><mml:mrow><mml:mo>{</mml:mo><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo>[</mml:mo><mml:mn>1</mml:mn><mml:mo>&#x2212;</mml:mo><mml:mi>&#x03B1;</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mstyle displaystyle="true" scriptlevel="0"><mml:mfrac><mml:mrow><mml:msub><mml:mi>k</mml:mi><mml:mrow><mml:mi>a</mml:mi><mml:mi>l</mml:mi><mml:mi>l</mml:mi></mml:mrow></mml:msub><mml:mo>&#x2212;</mml:mo><mml:mi>k</mml:mi></mml:mrow><mml:mrow><mml:msubsup><mml:mi>k</mml:mi><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mrow><mml:mi mathvariant="normal">&#x2032;</mml:mi></mml:mrow></mml:msubsup><mml:mo>&#x2212;</mml:mo><mml:mi>k</mml:mi></mml:mrow></mml:mfrac></mml:mstyle><mml:mo>)</mml:mo></mml:mrow><mml:mo>,</mml:mo><mml:mi>&#x03B2;</mml:mi><mml:msubsup><mml:mover><mml:mi>V</mml:mi><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msubsup><mml:mo>]</mml:mo></mml:mrow><mml:mo>}</mml:mo></mml:mrow></mml:math></inline-formula><inline-formula id="ieqn-128"><mml:math id="mml-ieqn-128"><mml:msub><mml:mi>k</mml:mi><mml:mrow><mml:mi>a</mml:mi><mml:mi>l</mml:mi><mml:mi>l</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mi>k</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mstyle displaystyle="true" scriptlevel="0"><mml:mfrac><mml:mi>n</mml:mi><mml:mrow><mml:mi>n</mml:mi><mml:mo>+</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:mfrac></mml:mstyle><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula></td>
<td>Emergency Lane open, Permitting all Vehicles to Pass</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>(4) State Transition Probability</p>
<p>The transition probability matrix defining the likelihood of a system shifting from its current state to another state at a given moment is generally represented as <inline-formula id="ieqn-82"><mml:math id="mml-ieqn-82"><mml:mi>T</mml:mi><mml:mo>=</mml:mo><mml:mrow><mml:mo>{</mml:mo><mml:msub><mml:mi>T</mml:mi><mml:mrow><mml:mi>i</mml:mi><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mo>}</mml:mo></mml:mrow><mml:mo>,</mml:mo><mml:msub><mml:mi>T</mml:mi><mml:mrow><mml:mi>i</mml:mi><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mi>P</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:msub><mml:mi>z</mml:mi><mml:mrow><mml:mi>t</mml:mi><mml:mo>+</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mi>j</mml:mi><mml:mrow><mml:mo stretchy="false">|</mml:mo></mml:mrow><mml:msub><mml:mi>z</mml:mi><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mi>i</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula>. This study focuses on the emergency lane opening condition, incorporating the action space <inline-formula id="ieqn-83"><mml:math id="mml-ieqn-83"><mml:mi>M</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>z</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula>. Specifically, at time <inline-formula id="ieqn-84"><mml:math id="mml-ieqn-84"><mml:mi>t</mml:mi></mml:math></inline-formula>, after the agent executes action <inline-formula id="ieqn-85"><mml:math id="mml-ieqn-85"><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula>, the probability matrix <inline-formula id="ieqn-86"><mml:math id="mml-ieqn-86"><mml:mi>P</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:msub><mml:mi>z</mml:mi><mml:mrow><mml:mi>t</mml:mi><mml:mo>+</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:msub><mml:mrow><mml:mo stretchy="false">|</mml:mo></mml:mrow><mml:msub><mml:mi>z</mml:mi><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula> describing the transition of freeway traffic conditions from state <inline-formula id="ieqn-87"><mml:math id="mml-ieqn-87"><mml:msub><mml:mi>z</mml:mi><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> to the new state <inline-formula id="ieqn-88"><mml:math id="mml-ieqn-88"><mml:msub><mml:mi>z</mml:mi><mml:mrow><mml:mi>t</mml:mi><mml:mo>+</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:msub></mml:math></inline-formula> is defined as follows:
<disp-formula id="eqn-9"><label>(9)</label><mml:math id="mml-eqn-9" display="block"><mml:mtable columnalign="right left right left right left right left right left right left" rowspacing="3pt" columnspacing="0em 2em 0em 2em 0em 2em 0em 2em 0em 2em 0em" displaystyle="true"><mml:mtr><mml:mtd /><mml:mtd><mml:mi>P</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:msub><mml:mi>z</mml:mi><mml:mrow><mml:mi>t</mml:mi><mml:mo>+</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo stretchy="false">|</mml:mo></mml:mrow><mml:msub><mml:mi>z</mml:mi><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:msub><mml:mi>T</mml:mi><mml:mrow><mml:mi>i</mml:mi><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mi>&#x03D5;</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow></mml:mrow><mml:mrow><mml:munderover><mml:mo movablelimits="false">&#x2211;</mml:mo><mml:mrow><mml:mi>k</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mn>5</mml:mn></mml:mrow></mml:munderover><mml:msub><mml:mi>T</mml:mi><mml:mrow><mml:mi>i</mml:mi><mml:mi>k</mml:mi></mml:mrow></mml:msub><mml:mi>&#x03D5;</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>k</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow></mml:mrow></mml:mfrac><mml:mo>.</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula></p>
<p>In the equation, <inline-formula id="ieqn-89"><mml:math id="mml-ieqn-89"><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>&#x2208;</mml:mo><mml:mrow><mml:mo>{</mml:mo><mml:mn>1</mml:mn><mml:mo>,</mml:mo><mml:mn>2</mml:mn><mml:mo>,</mml:mo><mml:mn>3</mml:mn><mml:mo>,</mml:mo><mml:mn>4</mml:mn><mml:mo>,</mml:mo><mml:mn>5</mml:mn><mml:mo>}</mml:mo></mml:mrow></mml:math></inline-formula> represents the traffic congestion state before the action; <inline-formula id="ieqn-90"><mml:math id="mml-ieqn-90"><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mo>&#x2208;</mml:mo><mml:mrow><mml:mo>{</mml:mo><mml:mn>1</mml:mn><mml:mo>,</mml:mo><mml:mn>2</mml:mn><mml:mo>,</mml:mo><mml:mn>3</mml:mn><mml:mo>,</mml:mo><mml:mn>4</mml:mn><mml:mo>,</mml:mo><mml:mn>5</mml:mn><mml:mo>}</mml:mo></mml:mrow></mml:math></inline-formula> denotes the traffic congestion state after the action. By introducing the adjustment function <inline-formula id="ieqn-91"><mml:math id="mml-ieqn-91"><mml:mi>&#x03D5;</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula>, when <inline-formula id="ieqn-92"><mml:math id="mml-ieqn-92"><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>&#x2208;</mml:mo><mml:mrow><mml:mo>{</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mn>1</mml:mn></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msub><mml:mo>}</mml:mo></mml:mrow></mml:math></inline-formula> (emergency lane closed), set <inline-formula id="ieqn-93"><mml:math id="mml-ieqn-93"><mml:mi>&#x03D5;</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:math></inline-formula>; When <inline-formula id="ieqn-94"><mml:math id="mml-ieqn-94"><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>&#x2208;</mml:mo><mml:mrow><mml:mo>{</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mn>3</mml:mn></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mn>4</mml:mn></mml:mrow></mml:msub><mml:mo>}</mml:mo></mml:mrow></mml:math></inline-formula> (emergency lane open), set <inline-formula id="ieqn-95"><mml:math id="mml-ieqn-95"><mml:mi>&#x03D5;</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mrow><mml:mo>{</mml:mo><mml:mtable columnalign="left left" rowspacing="4pt" columnspacing="1em"><mml:mtr><mml:mtd><mml:mn>1</mml:mn><mml:mo>+</mml:mo><mml:mi>&#x03B4;</mml:mi></mml:mtd><mml:mtd><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mo>&#x2208;</mml:mo><mml:mrow><mml:mo>{</mml:mo><mml:mn>1</mml:mn><mml:mo>,</mml:mo><mml:mn>2</mml:mn><mml:mo>,</mml:mo><mml:mn>3</mml:mn><mml:mo>}</mml:mo></mml:mrow></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mn>1</mml:mn><mml:mo>&#x2212;</mml:mo><mml:mi>&#x03B4;</mml:mi></mml:mtd><mml:mtd><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mo>&#x2208;</mml:mo><mml:mrow><mml:mo>{</mml:mo><mml:mn>4</mml:mn><mml:mo>,</mml:mo><mml:mn>5</mml:mn><mml:mo>}</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable><mml:mo fence="true" stretchy="true" symmetric="true"></mml:mo></mml:mrow></mml:math></inline-formula>, where <inline-formula id="ieqn-96"><mml:math id="mml-ieqn-96"><mml:mi>&#x03B4;</mml:mi><mml:mo>&#x2208;</mml:mo><mml:mrow><mml:mo>(</mml:mo><mml:mn>0</mml:mn><mml:mo>,</mml:mo><mml:mn>1</mml:mn><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula> represents the intervention intensity.</p>
<p>(5) Reward Function</p>
<p>This study defines the reward function as the reward <inline-formula id="ieqn-97"><mml:math id="mml-ieqn-97"><mml:mi>r</mml:mi></mml:math></inline-formula> obtained when taking action <inline-formula id="ieqn-98"><mml:math id="mml-ieqn-98"><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> in state <inline-formula id="ieqn-99"><mml:math id="mml-ieqn-99"><mml:msub><mml:mi>z</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> and transitioning to the next state <inline-formula id="ieqn-100"><mml:math id="mml-ieqn-100"><mml:msub><mml:mi>z</mml:mi><mml:mrow><mml:mi>j</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula>. The traffic congestion cost function <inline-formula id="ieqn-101"><mml:math id="mml-ieqn-101"><mml:msub><mml:mi>G</mml:mi><mml:mrow><mml:mi>c</mml:mi><mml:mi>o</mml:mi><mml:mi>n</mml:mi><mml:mi>g</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>i</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula> is introduced as:
<disp-formula id="eqn-10"><label>(10)</label><mml:math id="mml-eqn-10" display="block"><mml:mtable columnalign="left" rowspacing="4pt" columnspacing="1em"><mml:mtr><mml:mtd><mml:mi>r</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mrow><mml:mo>{</mml:mo><mml:msup><mml:mi>r</mml:mi><mml:mrow><mml:mo>+</mml:mo></mml:mrow></mml:msup><mml:mrow><mml:mo>(</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow><mml:mo>,</mml:mo><mml:msup><mml:mi>r</mml:mi><mml:mrow><mml:mo>&#x2212;</mml:mo></mml:mrow></mml:msup><mml:mrow><mml:mo>(</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow><mml:mo>}</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:msub><mml:mi>G</mml:mi><mml:mrow><mml:mi>c</mml:mi><mml:mi>o</mml:mi><mml:mi>n</mml:mi><mml:mi>g</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>i</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>&#x2212;</mml:mo><mml:mi>G</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow><mml:mo>,</mml:mo></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:msub><mml:mi>G</mml:mi><mml:mrow><mml:mi>c</mml:mi><mml:mi>o</mml:mi><mml:mi>n</mml:mi><mml:mi>g</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>i</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mi>&#x03BB;</mml:mi><mml:mo>&#x22C5;</mml:mo><mml:mi mathvariant="normal">&#x0394;</mml:mi><mml:msub><mml:mi>t</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>&#x22C5;</mml:mo><mml:mrow><mml:mo>(</mml:mo><mml:mn>1</mml:mn><mml:mo>&#x2212;</mml:mo><mml:mstyle displaystyle="true" scriptlevel="0"><mml:mfrac><mml:mrow><mml:msubsup><mml:mover><mml:mi>V</mml:mi><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msubsup><mml:mo>&#x2212;</mml:mo><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mo movablelimits="true" form="prefix">min</mml:mo></mml:mrow></mml:msub></mml:mrow><mml:mrow><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub><mml:mo>&#x2212;</mml:mo><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mo movablelimits="true" form="prefix">min</mml:mo></mml:mrow></mml:msub></mml:mrow></mml:mfrac></mml:mstyle><mml:mo>)</mml:mo></mml:mrow><mml:mo>,</mml:mo></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mi mathvariant="normal">&#x0394;</mml:mi><mml:msub><mml:mi>t</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mfrac><mml:mi>L</mml:mi><mml:msubsup><mml:mover><mml:mi>V</mml:mi><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msubsup></mml:mfrac><mml:mo>&#x2212;</mml:mo><mml:mfrac><mml:mi>L</mml:mi><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub></mml:mfrac><mml:mo>,</mml:mo></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:msup><mml:mi>r</mml:mi><mml:mrow><mml:mo>+</mml:mo></mml:mrow></mml:msup><mml:mrow><mml:mo>(</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mo movablelimits="true" form="prefix">max</mml:mo><mml:mrow><mml:mo>(</mml:mo><mml:mi>r</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow><mml:mo>,</mml:mo><mml:mn>0</mml:mn><mml:mo>)</mml:mo></mml:mrow><mml:mo>,</mml:mo></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:msup><mml:mi>r</mml:mi><mml:mrow><mml:mo>&#x2212;</mml:mo></mml:mrow></mml:msup><mml:mrow><mml:mo>(</mml:mo><mml:mi>i</mml:mi><mml:mo>,</mml:mo><mml:mi>j</mml:mi><mml:mo>,</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mo movablelimits="true" form="prefix">min</mml:mo><mml:mrow><mml:mo>(</mml:mo><mml:mn>0</mml:mn><mml:mo>,</mml:mo><mml:mi>r</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>i</mml:mi><mml:mo>,</mml:mo><mml:mi>j</mml:mi><mml:mo>,</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow><mml:mo>)</mml:mo></mml:mrow><mml:mo>,</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>where <inline-formula id="ieqn-102"><mml:math id="mml-ieqn-102"><mml:msub><mml:mi>G</mml:mi><mml:mrow><mml:mi>c</mml:mi><mml:mi>o</mml:mi><mml:mi>n</mml:mi><mml:mi>g</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mi>i</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula> denotes the traffic congestion cost function, employing linear normalization such that costs decrease as congestion worsens; <inline-formula id="ieqn-103"><mml:math id="mml-ieqn-103"><mml:mi>G</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mi>c</mml:mi></mml:math></inline-formula> (is a constant), represents the action cost; <inline-formula id="ieqn-104"><mml:math id="mml-ieqn-104"><mml:mi>&#x03BB;</mml:mi></mml:math></inline-formula> represents the value of time per unit, converting traffic conditions into costs; <inline-formula id="ieqn-105"><mml:math id="mml-ieqn-105"><mml:mi mathvariant="normal">&#x0394;</mml:mi><mml:msub><mml:mi>t</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> represents the time difference between the average travel speed and the free-flow speed within the interval <inline-formula id="ieqn-106"><mml:math id="mml-ieqn-106"><mml:msub><mml:mi>L</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula>; <inline-formula id="ieqn-107"><mml:math id="mml-ieqn-107"><mml:msubsup><mml:mover><mml:mi>V</mml:mi><mml:mo accent="false">&#x00AF;</mml:mo></mml:mover><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msubsup></mml:math></inline-formula> is the average travel speed of the section at time <inline-formula id="ieqn-108"><mml:math id="mml-ieqn-108"><mml:mi>t</mml:mi></mml:math></inline-formula>, measured in <inline-formula id="ieqn-109"><mml:math id="mml-ieqn-109"><mml:mrow><mml:mtext>km</mml:mtext></mml:mrow><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:mrow><mml:mtext>h</mml:mtext></mml:mrow></mml:math></inline-formula>; <inline-formula id="ieqn-110"><mml:math id="mml-ieqn-110"><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mo movablelimits="true" form="prefix">min</mml:mo></mml:mrow></mml:msub></mml:math></inline-formula> is the minimum observable speed, measured in <inline-formula id="ieqn-111"><mml:math id="mml-ieqn-111"><mml:mrow><mml:mtext>km</mml:mtext></mml:mrow><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:mrow><mml:mtext>h</mml:mtext></mml:mrow></mml:math></inline-formula>; <inline-formula id="ieqn-112"><mml:math id="mml-ieqn-112"><mml:msub><mml:mi>V</mml:mi><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> is the free-flow speed, measured in <inline-formula id="ieqn-113"><mml:math id="mml-ieqn-113"><mml:mrow><mml:mtext>km</mml:mtext></mml:mrow><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:mrow><mml:mtext>h</mml:mtext></mml:mrow></mml:math></inline-formula>; <inline-formula id="ieqn-114"><mml:math id="mml-ieqn-114"><mml:msup><mml:mi>r</mml:mi><mml:mrow><mml:mo>+</mml:mo></mml:mrow></mml:msup><mml:mrow><mml:mo>(</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow><mml:mo>&#x2265;</mml:mo><mml:mn>0</mml:mn></mml:math></inline-formula> represents &#x201C;rewards earned&#x201D;; <inline-formula id="ieqn-115"><mml:math id="mml-ieqn-115"><mml:msup><mml:mi>r</mml:mi><mml:mrow><mml:mo>&#x2212;</mml:mo></mml:mrow></mml:msup><mml:mrow><mml:mo>(</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow><mml:mo>&#x2264;</mml:mo><mml:mn>0</mml:mn></mml:math></inline-formula> represents &#x201C;penalty received&#x201D;.</p>
</sec>
</sec>
<sec id="s3">
<label>3</label>
<title>Model Solution</title>
<p>When modeling using a Markov decision process, the value iteration algorithm enables rapid convergence [<xref ref-type="bibr" rid="ref-24">24</xref>]. The core of the solution lies in maximizing the expected total reward of the system, achieved through iterative updates of the expected total reward using the Bellman equation.</p>
<p>In this study, for <inline-formula id="ieqn-129"><mml:math id="mml-ieqn-129"><mml:mi>t</mml:mi><mml:mo>&#x2265;</mml:mo><mml:mn>0</mml:mn></mml:math></inline-formula>, after selecting a policy <inline-formula id="ieqn-130"><mml:math id="mml-ieqn-130"><mml:mi>s</mml:mi></mml:math></inline-formula>, the decision-maker obtains rewards according to the above steps&#x2014;that is, the expected total system payoff from the decision time <inline-formula id="ieqn-131"><mml:math id="mml-ieqn-131"><mml:mi>t</mml:mi></mml:math></inline-formula> until decision termination. The objective is to maximize the total payoff <inline-formula id="ieqn-132"><mml:math id="mml-ieqn-132"><mml:mi>V</mml:mi></mml:math></inline-formula>, expressed as:
<disp-formula id="eqn-11"><label>(11)</label><mml:math id="mml-eqn-11" display="block"><mml:mtable columnalign="right left right left right left right left right left right left" rowspacing="3pt" columnspacing="0em 2em 0em 2em 0em 2em 0em 2em 0em 2em 0em" displaystyle="true"><mml:mtr><mml:mtd /><mml:mtd><mml:mi>V</mml:mi><mml:mo>=</mml:mo><mml:mo>&#x2211;</mml:mo><mml:mi>r</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow><mml:mo>,</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>where <inline-formula id="ieqn-133"><mml:math id="mml-ieqn-133"><mml:mi>V</mml:mi></mml:math></inline-formula> is the expected total payoff; <inline-formula id="ieqn-134"><mml:math id="mml-ieqn-134"><mml:mi>r</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>i</mml:mi><mml:mo>,</mml:mo><mml:mi>j</mml:mi><mml:mo>,</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula> is the reward function.</p>
<p>(1) Bellman Equation</p>
<p>Based on the optimal policy, the Bellman equation is applied to the above model. Using the value iteration algorithm, the value function is iteratively updated. If the current policy is optimal, the system&#x2019;s expected total reward is denoted as <inline-formula id="ieqn-135"><mml:math id="mml-ieqn-135"><mml:msup><mml:mi>V</mml:mi><mml:mrow><mml:mo>&#x2217;</mml:mo></mml:mrow></mml:msup></mml:math></inline-formula>. If the current policy is not optimal, then upon a state transition, selecting the optimal action will increase the system&#x2019;s expected total reward, prompting a new iteration of the value function update. This process eventually converges to the optimal value function <inline-formula id="ieqn-136"><mml:math id="mml-ieqn-136"><mml:msup><mml:mi>V</mml:mi><mml:mrow><mml:mo>&#x2217;</mml:mo></mml:mrow></mml:msup></mml:math></inline-formula> for all states.
<disp-formula id="eqn-12"><label>(12)</label><mml:math id="mml-eqn-12" display="block"><mml:mtable columnalign="right left right left right left right left right left right left" rowspacing="3pt" columnspacing="0em 2em 0em 2em 0em 2em 0em 2em 0em 2em 0em" displaystyle="true"><mml:mtr><mml:mtd /><mml:mtd><mml:msup><mml:mi>V</mml:mi><mml:mrow><mml:mo>&#x2217;</mml:mo></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:munder><mml:mo movablelimits="true" form="prefix">max</mml:mo><mml:mrow><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>&#x2208;</mml:mo><mml:mi>M</mml:mi></mml:mrow></mml:munder><mml:munder><mml:mo>&#x2211;</mml:mo><mml:mrow><mml:msub><mml:mi>z</mml:mi><mml:mrow><mml:mi>t</mml:mi><mml:mo>+</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:msub><mml:mo>&#x2208;</mml:mo><mml:mi>Z</mml:mi></mml:mrow></mml:munder><mml:mi>P</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:msub><mml:mi>z</mml:mi><mml:mrow><mml:mi>t</mml:mi><mml:mo>+</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mi>j</mml:mi><mml:mrow><mml:mo stretchy="false">|</mml:mo></mml:mrow><mml:msub><mml:mi>z</mml:mi><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mi>i</mml:mi><mml:mo>,</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow><mml:mrow><mml:mo>[</mml:mo><mml:mi>r</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>i</mml:mi><mml:mo>,</mml:mo><mml:mi>j</mml:mi><mml:mo>,</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow><mml:mo>+</mml:mo><mml:mi>&#x03B3;</mml:mi><mml:mi>V</mml:mi><mml:mo>]</mml:mo></mml:mrow><mml:mo>.</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula></p>
<p>In this equation, the discount factor <inline-formula id="ieqn-137"><mml:math id="mml-ieqn-137"><mml:mi>&#x03B3;</mml:mi><mml:mo>&#x2208;</mml:mo><mml:mrow><mml:mo>(</mml:mo><mml:mn>0</mml:mn><mml:mo>,</mml:mo><mml:mn>1</mml:mn><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula> determines the weight assigned to immediate rewards vs. future rewards in the Markov decision process. If <inline-formula id="ieqn-138"><mml:math id="mml-ieqn-138"><mml:mi>&#x03B3;</mml:mi></mml:math></inline-formula> approaches 0, the model prioritizes immediate rewards over future ones; if <inline-formula id="ieqn-139"><mml:math id="mml-ieqn-139"><mml:mi>&#x03B3;</mml:mi></mml:math></inline-formula> approaches 1, the impact of future rewards is amplified. Additionally, the discount factor enhances overall convergence, mitigates the effects of uncertainty, and better balances short-term and long-term rewards.</p>
<p>Decision-makers obtain reward payments according to the above steps. In the solution process, the system&#x2019;s expected total profit <inline-formula id="ieqn-140"><mml:math id="mml-ieqn-140"><mml:msup><mml:mi>V</mml:mi><mml:mrow><mml:mo>&#x2217;</mml:mo></mml:mrow></mml:msup></mml:math></inline-formula> is defined as:
<disp-formula id="eqn-13"><label>(13)</label><mml:math id="mml-eqn-13" display="block"><mml:mtable columnalign="right left right left right left right left right left right left" rowspacing="3pt" columnspacing="0em 2em 0em 2em 0em 2em 0em 2em 0em 2em 0em" displaystyle="true"><mml:mtr><mml:mtd /><mml:mtd><mml:msup><mml:mi>V</mml:mi><mml:mrow><mml:mo>&#x2217;</mml:mo></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:mi>s</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>P</mml:mi><mml:mo>,</mml:mo><mml:mi>r</mml:mi><mml:mo>,</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow><mml:mo>.</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula></p>
<p>In the equation, <italic>V</italic><sup>&#x2217;</sup> represents total profit that calculate the expected total profit of the system and maximize it; <italic>P</italic> represents the state transition probability; <italic>r</italic> denotes the reward function; <italic>m</italic><sub><italic>i</italic></sub> indicates the action space.</p>
<p>(2) Solution Steps</p>
<p>As shown in <xref ref-type="fig" rid="fig-7">Fig. 7</xref>, it illustrates the model solution.</p>
<fig id="fig-7">
<label>Figure 7</label>
<caption>
<title>Solution procedure diagram.</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_77329-fig-7.tif"/>
</fig>
<p>Step 1: For <inline-formula id="ieqn-141"><mml:math id="mml-ieqn-141"><mml:mi>t</mml:mi><mml:mo>&#x2265;</mml:mo><mml:mn>0</mml:mn></mml:math></inline-formula>, <inline-formula id="ieqn-142"><mml:math id="mml-ieqn-142"><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>&#x2208;</mml:mo><mml:mi>M</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>z</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula>, and represents the total reward from the decision time to the decision termination;</p>
<p>Step 2: If <inline-formula id="ieqn-143"><mml:math id="mml-ieqn-143"><mml:mi>t</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:math></inline-formula>, then the optimal Markov strategy is <inline-formula id="ieqn-144"><mml:math id="mml-ieqn-144"><mml:msup><mml:mi>s</mml:mi><mml:mrow><mml:mo>&#x2217;</mml:mo></mml:mrow></mml:msup></mml:math></inline-formula> and <inline-formula id="ieqn-145"><mml:math id="mml-ieqn-145"><mml:msubsup><mml:mi>V</mml:mi><mml:mrow><mml:mi>N</mml:mi></mml:mrow><mml:mrow><mml:mo>&#x2217;</mml:mo></mml:mrow></mml:msubsup><mml:mrow><mml:mo>(</mml:mo><mml:mi>z</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:msubsup><mml:mi>V</mml:mi><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mo>&#x2217;</mml:mo></mml:mrow></mml:msubsup><mml:mrow><mml:mo>(</mml:mo><mml:mi>z</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula> is the optimal value function. The algorithm terminates. Otherwise, if <inline-formula id="ieqn-146"><mml:math id="mml-ieqn-146"><mml:mi>t</mml:mi><mml:mo>=</mml:mo><mml:mi>t</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mn>1</mml:mn></mml:math></inline-formula>, proceed to Step 3. The superscript &#x201C;&#x2217;&#x201D; denotes the optimal value of the corresponding function;</p>
<p>Step 3: For all <inline-formula id="ieqn-147"><mml:math id="mml-ieqn-147"><mml:mi>z</mml:mi><mml:mo>&#x2208;</mml:mo><mml:mi>Z</mml:mi></mml:math></inline-formula>, compute:
<disp-formula id="eqn-14"><label>(14)</label><mml:math id="mml-eqn-14" display="block"><mml:mtable columnalign="right left right left right left right left right left right left" rowspacing="3pt" columnspacing="0em 2em 0em 2em 0em 2em 0em 2em 0em 2em 0em" displaystyle="true"><mml:mtr><mml:mtd /><mml:mtd><mml:msup><mml:mi>V</mml:mi><mml:mrow><mml:mo>&#x2217;</mml:mo></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:munder><mml:mo movablelimits="true" form="prefix">max</mml:mo><mml:mrow><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>&#x2208;</mml:mo><mml:mi>M</mml:mi></mml:mrow></mml:munder><mml:mi>s</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>P</mml:mi><mml:mo>,</mml:mo><mml:mi>r</mml:mi><mml:mo>,</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow><mml:mo>.</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula></p>
<p>Calculate the expected total profit of the system and maximize it. In the equation, In the equation, <inline-formula id="ieqn-148"><mml:math id="mml-ieqn-148"><mml:msup><mml:mi>V</mml:mi><mml:mrow><mml:mo>&#x2217;</mml:mo></mml:mrow></mml:msup></mml:math></inline-formula> represents total profit that calculate the expected total profit of the system and maximize it. <inline-formula id="ieqn-149"><mml:math id="mml-ieqn-149"><mml:mi>P</mml:mi></mml:math></inline-formula> represents the state transition probability; <inline-formula id="ieqn-150"><mml:math id="mml-ieqn-150"><mml:mi>r</mml:mi></mml:math></inline-formula> denotes the reward function; <inline-formula id="ieqn-151"><mml:math id="mml-ieqn-151"><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> indicates the action space.</p>
<p>And record the action set that maximizes the total reward as:
<disp-formula id="eqn-15"><label>(15)</label><mml:math id="mml-eqn-15" display="block"><mml:mtable columnalign="right left right left right left right left right left right left" rowspacing="3pt" columnspacing="0em 2em 0em 2em 0em 2em 0em 2em 0em 2em 0em" displaystyle="true"><mml:mtr><mml:mtd /><mml:mtd><mml:msubsup><mml:mi>M</mml:mi><mml:mrow><mml:mi>t</mml:mi></mml:mrow><mml:mrow><mml:mo>&#x2217;</mml:mo></mml:mrow></mml:msubsup><mml:mrow><mml:mo>(</mml:mo><mml:mi>z</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mrow><mml:mi mathvariant="normal">a</mml:mi><mml:mi mathvariant="normal">r</mml:mi><mml:mi mathvariant="normal">g</mml:mi><mml:mspace width="thinmathspace" /><mml:mi mathvariant="normal">m</mml:mi><mml:mi mathvariant="normal">a</mml:mi><mml:mi mathvariant="normal">x</mml:mi><mml:mspace width="thinmathspace" /><mml:mi mathvariant="normal">s</mml:mi></mml:mrow><mml:mrow><mml:mo>(</mml:mo><mml:mi>P</mml:mi><mml:mo>,</mml:mo><mml:mi>r</mml:mi><mml:mo>,</mml:mo><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow><mml:mo>.</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula></p>
<p>Find the argument that maximizes the function and define <inline-formula id="ieqn-152"><mml:math id="mml-ieqn-152"><mml:msubsup><mml:mi>M</mml:mi><mml:mrow><mml:mi>t</mml:mi></mml:mrow><mml:mrow><mml:mo>&#x2217;</mml:mo></mml:mrow></mml:msubsup><mml:mrow><mml:mo>(</mml:mo><mml:mi>z</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula> as the set of actions that maximizes the total reward. <inline-formula id="ieqn-153"><mml:math id="mml-ieqn-153"><mml:mi>P</mml:mi></mml:math></inline-formula> represents the state transition probability; <inline-formula id="ieqn-154"><mml:math id="mml-ieqn-154"><mml:mi>r</mml:mi></mml:math></inline-formula> denotes the reward function; <inline-formula id="ieqn-155"><mml:math id="mml-ieqn-155"><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> indicates the action space.</p>
<p>For any fixed <inline-formula id="ieqn-156"><mml:math id="mml-ieqn-156"><mml:msubsup><mml:mi>s</mml:mi><mml:mrow><mml:mi>t</mml:mi></mml:mrow><mml:mrow><mml:mo>&#x2217;</mml:mo></mml:mrow></mml:msubsup><mml:mo>&#x2208;</mml:mo><mml:msubsup><mml:mi>M</mml:mi><mml:mrow><mml:mi>t</mml:mi></mml:mrow><mml:mrow><mml:mo>&#x2217;</mml:mo></mml:mrow></mml:msubsup><mml:mrow><mml:mo>(</mml:mo><mml:mi>z</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula>, the optimal action strategy <inline-formula id="ieqn-157"><mml:math id="mml-ieqn-157"><mml:msubsup><mml:mi>s</mml:mi><mml:mrow><mml:mi>t</mml:mi></mml:mrow><mml:mrow><mml:mo>&#x2217;</mml:mo></mml:mrow></mml:msubsup></mml:math></inline-formula> at decision time <inline-formula id="ieqn-158"><mml:math id="mml-ieqn-158"><mml:mi>t</mml:mi></mml:math></inline-formula> is defined.</p>
<p>Step 4: Return to Step 2.</p>
</sec>
<sec id="s4">
<label>4</label>
<title>Case Analysis</title>
<sec id="s4_1">
<label>4.1</label>
<title>Simulation Configuration</title>
<p>This study selected the section from Guoxiang to Changtai on Shanghai&#x2019;s Huchang Freeway. A single-vehicle accident simulation scenario was established for both the innermost and outermost lanes of the freeway [<xref ref-type="bibr" rid="ref-25">25</xref>&#x2013;<xref ref-type="bibr" rid="ref-27">27</xref>]. While, our study focused on the single-vehicle accidents, without weather conditions, driver behavior, or multiple concurrent incidents. Following the accident, the road congestion status was determined based on the aforementioned traffic congestion index to validate the opening action. The simulation is illustrated in shown in <xref ref-type="fig" rid="fig-8">Fig. 8</xref>.</p>
<fig id="fig-8">
<label>Figure 8</label>
<caption>
<title>Simulation diagram.</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_77329-fig-8.tif"/>
</fig>
<p>The simulation experiment utilizes SUMO, an open source and highly configurable micro-level, multi-modal traffic simulation platform. Originally developed for urban transportation analysis, SUMO is also well-suited for freeway and mixed-traffic scenarios. It supports large-scale network simulations, handles complex traffic conditions, and allows modeling of multiple transportation modes. SUMO can integrate real time traffic data to dynamically adjust and optimize simulations, provides extensive customization through scripts and plugins, and offers interfaces for Python and other programming environments to facilitate data analysis and processing. Specific parameters are listed as shown in <xref ref-type="table" rid="table-3">Table 3</xref>.</p>
<table-wrap id="table-3">
<label>Table 3</label>
<caption>
<title>Simulation parameter settings.</title>
</caption>
<table>
<colgroup>
<col align="center"/>
<col align="center"/>
</colgroup>
<thead>
<tr>
<th align="center" colspan="2">Simulation Parameter</th>
</tr>
</thead>
<tbody>
<tr>
<td>Simulation Time (<inline-formula id="ieqn-159"><mml:math id="mml-ieqn-159"><mml:mrow><mml:mtext>s</mml:mtext></mml:mrow></mml:math></inline-formula>)</td>
<td>3600</td>
</tr>
<tr>
<td>Road Length (<inline-formula id="ieqn-160"><mml:math id="mml-ieqn-160"><mml:mrow><mml:mtext>km</mml:mtext></mml:mrow></mml:math></inline-formula>)</td>
<td>4.5</td>
</tr>
<tr>
<td>Number of Unidirectional Lanes</td>
<td>3</td>
</tr>
<tr>
<td>Lane Width (<inline-formula id="ieqn-161"><mml:math id="mml-ieqn-161"><mml:mrow><mml:mtext>m</mml:mtext></mml:mrow></mml:math></inline-formula>)</td>
<td>3.75</td>
</tr>
<tr>
<td>Emergency Lane Width (<inline-formula id="ieqn-162"><mml:math id="mml-ieqn-162"><mml:mrow><mml:mtext>m</mml:mtext></mml:mrow></mml:math></inline-formula>)</td>
<td>3.5</td>
</tr>
<tr>
<td rowspan="3">Vehicle Type</td>
<td>Passenger Car</td>
</tr>
<tr>
<td>Emergency Vehicles</td>
</tr>
<tr>
<td>HOV Vehicles</td>
</tr>
<tr>
<td>Traffic Volume (<inline-formula id="ieqn-163"><mml:math id="mml-ieqn-163"><mml:mrow><mml:mtext>pcu</mml:mtext></mml:mrow><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:mrow><mml:mtext>h</mml:mtext></mml:mrow></mml:math></inline-formula>)</td>
<td>3200</td>
</tr>
<tr>
<td>Speed Limit (<inline-formula id="ieqn-164"><mml:math id="mml-ieqn-164"><mml:mrow><mml:mtext>km</mml:mtext></mml:mrow><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:mrow><mml:mtext>h</mml:mtext></mml:mrow></mml:math></inline-formula>)</td>
<td>120</td>
</tr>
<tr>
<td>Longitudinal Acceleration (<inline-formula id="ieqn-165"><mml:math id="mml-ieqn-165"><mml:mrow><mml:mtext>m</mml:mtext></mml:mrow><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:msup><mml:mrow><mml:mtext>s</mml:mtext></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup></mml:math></inline-formula>)</td>
<td>2.6, 1.2</td>
</tr>
<tr>
<td>Lateral Acceleration (<inline-formula id="ieqn-166"><mml:math id="mml-ieqn-166"><mml:mrow><mml:mtext>m</mml:mtext></mml:mrow><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:msup><mml:mrow><mml:mtext>s</mml:mtext></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup></mml:math></inline-formula>)</td>
<td>0.8</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Setup for single-vehicle accidents: The TraCI Python API is used to trigger accidents in real time during the simulation, accurately replicating the effects of emergency lane openings under single-lane accident conditions.</p>
<p>Simulation parameters: 60% passenger vehicles, 20% emergency vehicles, 20% HOV vehicles. Mainline freeway traffic volume: 3200 <inline-formula id="ieqn-167"><mml:math id="mml-ieqn-167"><mml:mrow><mml:mtext>pcu</mml:mtext></mml:mrow><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:mrow><mml:mtext>h</mml:mtext></mml:mrow></mml:math></inline-formula>.</p>
<p>This study primarily investigates the conditions for opening emergency lanes in single-vehicle accident scenarios occurring on the innermost lane, as shown in <xref ref-type="fig" rid="fig-9">Fig. 9</xref> and outermost lane, as shown in <xref ref-type="fig" rid="fig-10">Fig. 10</xref> of freeways under different levels of traffic congestion [<xref ref-type="bibr" rid="ref-28">28</xref>].</p>
<fig id="fig-9">
<label>Figure 9</label>
<caption>
<title>Single-Vehicle Accident in the Innermost Lane.</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_77329-fig-9.tif"/>
</fig><fig id="fig-10">
<label>Figure 10</label>
<caption>
<title>Single-Vehicle Accident in the Outermost Lane.</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_77329-fig-10.tif"/>
</fig>
<p><list list-type="simple">
<list-item><label>(1)</label><p>Innermost Lane Accident Scenario</p></list-item>
<list-item><label>(2)</label><p>Outermost Lane Accident Scenario</p></list-item>
</list></p>
</sec>
<sec id="s4_2">
<label>4.2</label>
<title>Results Analysis</title>
<p>Simulation analysis was conducted for two scenarios: single-vehicle accidents in the innermost and outermost lanes of freeways. Evaluation metrics included average vehicle speed, number of vehicles passing through, and traffic congestion levels.</p>
<p>(1) Innermost Lane Accident</p>
<p>Following the accident, traffic congestion remained largely unimpeded. A &#x201C;variable speed limit&#x201D; strategy was implemented. After 74 <inline-formula id="ieqn-168"><mml:math id="mml-ieqn-168"><mml:mrow><mml:mtext>s</mml:mtext></mml:mrow></mml:math></inline-formula>, congestion escalated to severe levels, prompting an immediate switch to the &#x201C;emergency lane open to all vehicles&#x201D; strategy.</p>
<p>The simulation results are shown in <xref ref-type="fig" rid="fig-11">Fig. 11</xref>. Since the accident occurred in the fast lane, traffic speed decreased significantly post-accident. Around 600 <inline-formula id="ieqn-169"><mml:math id="mml-ieqn-169"><mml:mrow><mml:mtext>s</mml:mtext></mml:mrow></mml:math></inline-formula>, the average speed gradually dropped from 106 to 39.2 <inline-formula id="ieqn-170"><mml:math id="mml-ieqn-170"><mml:mrow><mml:mtext>km</mml:mtext></mml:mrow><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:mrow><mml:mtext>h</mml:mtext></mml:mrow></mml:math></inline-formula>, a 63.2% decrease.</p>
<fig id="fig-11">
<label>Figure 11</label>
<caption>
<title>Average speed comparison before and after the decision.</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_77329-fig-11.tif"/>
</fig>
<p>Following the implementation of the strategy, the average speed remained lower than before the decision, leading to a temporary increase in the number of vehicles passing at 65 <inline-formula id="ieqn-171"><mml:math id="mml-ieqn-171"><mml:mrow><mml:mtext>s</mml:mtext></mml:mrow></mml:math></inline-formula>. Subsequently, at 634 <inline-formula id="ieqn-172"><mml:math id="mml-ieqn-172"><mml:mrow><mml:mtext>s</mml:mtext></mml:mrow></mml:math></inline-formula>, severe congestion occurred, prompting immediate implementation of the &#x201C;emergency lane open to all vehicles&#x201D; strategy. Opening the emergency lane functioned like &#x201C;precision flood discharge&#x201D;, increasing lane capacity and boosting average speed by 25.85%. However, this also lengthened the time interval between vehicles passing the detection cross-section, as shown in <xref ref-type="fig" rid="fig-12">Fig. 12</xref>, resulting in a 15.74% decrease in the number of vehicles passing through. At 1586 <inline-formula id="ieqn-173"><mml:math id="mml-ieqn-173"><mml:mrow><mml:mtext>s</mml:mtext></mml:mrow></mml:math></inline-formula>, average speed increased by 22.62%, while vehicle throughput decreased by 18.38%. <xref ref-type="fig" rid="fig-13">Fig. 13</xref> indicates that the average congestion level increased by one grade.</p>
<fig id="fig-12">
<label>Figure 12</label>
<caption>
<title>Comparison of vehicle count before and after the decision.</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_77329-fig-12.tif"/>
</fig><fig id="fig-13">
<label>Figure 13</label>
<caption>
<title>Comparison of traffic congestion before and after the decision.</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_77329-fig-13.tif"/>
</fig>
<p>Throughout the simulation, average speed increased by 10.81%, while the number of vehicles passing decreased by 8.79%. This outcome occurred because the overall traffic flow slowed following the accident, and the opening of the emergency lane effectively increased the number of available lanes, functioning as a &#x201C;flow relief mechanism&#x201D;. However, this also extended the time interval between vehicles passing through the detection cross-section, thereby reducing the total vehicle throughput.</p>
<p>(2) Outermost Lane Accident</p>
<p>After the accident occurred, traffic flow was initially stable due to the implementation of the &#x201C;variable speed limit&#x201D; strategy. However, by the 26 <inline-formula id="ieqn-174"><mml:math id="mml-ieqn-174"><mml:mrow><mml:mtext>s</mml:mtext></mml:mrow></mml:math></inline-formula>, congestion began to intensify, leading to the activation of the &#x201C;emergency lane open to HOV vehicles&#x201D; strategy.</p>
<p>Simulation results indicate that during this period, average speed (<xref ref-type="fig" rid="fig-14">Fig. 14</xref>), vehicle throughput (<xref ref-type="fig" rid="fig-15">Fig. 15</xref>), and congestion levels (<xref ref-type="fig" rid="fig-16">Fig. 16</xref>) fluctuated. This was because the accident in the outermost lane minimally impacted the innermost express lane and middle lanes. As shown, speeds only significantly decreased after 1200 <inline-formula id="ieqn-175"><mml:math id="mml-ieqn-175"><mml:mrow><mml:mtext>s</mml:mtext></mml:mrow></mml:math></inline-formula>, with average speed dropping from 78.02 to 33.18 <inline-formula id="ieqn-176"><mml:math id="mml-ieqn-176"><mml:mrow><mml:mtext>km</mml:mtext></mml:mrow><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:mrow><mml:mtext>h</mml:mtext></mml:mrow></mml:math></inline-formula>&#x2014;a 57.47% reduction. Therefore, adopting the &#x201C;emergency lane open to all vehicles&#x201D; strategy only yielded a significant speed increase after 2000 s. Switching to the &#x201C;emergency lane open to HOV vehicles&#x201D; strategy restored the average speed to 74.86 <inline-formula id="ieqn-177"><mml:math id="mml-ieqn-177"><mml:mrow><mml:mtext>km</mml:mtext></mml:mrow><mml:mrow><mml:mo>/</mml:mo></mml:mrow><mml:mrow><mml:mtext>h</mml:mtext></mml:mrow></mml:math></inline-formula>. This indicates that when accidents occur in the outermost lane, the emergency lane opening decision model requires considerable time to unlock the network&#x2019;s potential, and short-term evaluations may underestimate its value.</p>
<fig id="fig-14">
<label>Figure 14</label>
<caption>
<title>Average speed comparison before and after the decision.</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_77329-fig-14.tif"/>
</fig><fig id="fig-15">
<label>Figure 15</label>
<caption>
<title>Comparison of vehicle count before and after the decision.</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_77329-fig-15.tif"/>
</fig><fig id="fig-16">
<label>Figure 16</label>
<caption>
<title>Comparison of traffic congestion before and after the decision.</title>
</caption>
<graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_77329-fig-16.tif"/>
</fig>
<p>The emergency lane opening strategy is not a &#x201C;one-size-fits-all&#x201D; solution. During severe congestion, opening the lane to all vehicles can rapidly alleviate gridlock; however, during moderate congestion, opening it exclusively to HOV vehicles proves more effective for speed improvement. This reveals the &#x201C;state dependency&#x201D; of traffic management, where strategies must dynamically adapt to the current congestion level.</p>
<p>Overall, the case study demonstrates that the effectiveness of emergency lane opening strategies is highly dependent on both traffic congestion states and accident locations. Simulation results show that prioritizing variable speed limits in the early stage of accidents helps stabilize traffic flow, while differentiated emergency lane opening strategies become more effective as congestion intensifies.</p>
</sec>
</sec>
<sec id="s5">
<label>5</label>
<title>Conclusion</title>
<p>This study addresses freeway congestion under accident conditions by simulating incidents in both the innermost and outermost lanes. Considering traffic congestion levels, variable speed limits, dynamic emergency lane openings, and vehicle type differences, we developed an emergency lane opening strategy model based on an improved Markov Decision Process (MDP).
<list list-type="simple">
<list-item><label>(1)</label><p>The effectiveness of emergency lane opening varies by lane position. Throughout the innermost lane simulation, average speed increased by 10.81% and vehicle throughput decreased by 8.79%. Throughout the outermost lane simulation, average speed increased by 5.47% and vehicle throughput decreased by 3.13%.</p></list-item>
<list-item><label>(2)</label><p>Throughout the simulation cycle, the proposed emergency lane opening strategy model was applied. Dynamic strategy selection significantly enhances decision-making precision and timeliness. During the initial accident phase, &#x201C;variable speed limits&#x201D; were prioritized to control flow rates. Once traffic conditions stabilized, &#x201C;emergency lane openings&#x201D; were classified and implemented based on actual conditions to restore traffic capacity. This approach proved highly sensitive, particularly when the &#x201C;accident location&#x201D; occurred on the innermost road.</p></list-item>
<list-item><label>(3)</label><p>This study integrates variable speed limits, vehicle type differentiation, and emergency lane opening strategies into a MDP framework, overcoming the limitations of traditional single-control-variable approaches.</p></list-item>
</list></p>
<p>Besides, it proposes a unified Markov decision framework that integrates variable speed limits and emergency lane opening as coordinated actions, moving beyond traditional single-measure or sequential control approaches. Vehicle-type&#x2013;differentiated actions and a comprehensive reward function incorporating congestion, operational, and safety factors further enhance the realism and applicability of the model. As a result, the proposed framework offers a more adaptive decision-making paradigm for emergency lane management under accident conditions.</p>
<p>Furthermore, this study&#x2019;s novelty has two core aspects:</p>
<p>It develops an integrated decision-making mechanism within a unified Markov Decision Process (MDP) framework, jointly modeling variable speed limits and emergency lane opening as coordinated controls. Additionally, the framework captures state-dependent strategy differences tied to accident lane locations, enabling differentiated opening decisions for innermost and outermost lane accidents.</p>
<p>Additionally, our study focused on the single-vehicle accidents under controlled conditions, without driver behavior, or multiple concurrent incidents. These factors will be addressed in future research.</p>
</sec>
</body>
<back>
<ack>
<p>This research was funded by Shanghai Pujiang Programme [23PJC075], National Natural Science Foundation of China [72501184], Shanghai Planning Office of Philosophy and Social Sciences [2023EGL005]. The authors thank the these supports.</p>
</ack>
<sec>
<title>Funding Statement</title>
<p>This research was funded by Shanghai Pujiang Programme grant number [23PJC075], National Natural Science Foundation of China grant number [72501184], Shanghai Philosophy and Social Science Planning Youth Project grant number [2023EGL005]. The APC was funded by Shanghai Municipal Human Resources and Social Security Bureau, National Natural Science Foundation of China, and Shanghai Planning Office of Philosophyand Social Sciences.</p>
</sec>
<sec>
<title>Author Contributions</title>
<p>Conceptualization, Jiao Yao; methodology, Pujie Wang; software, Pujie Wang; validation, Pujie Wang and Tianyi Zhang; formal analysis, Pujie Wang; investigation, Pujie Wang and Chenke Zhu; resources, Pujie Wang; data curation, Pujie Wang; writing&#x2014;original draft preparation, Pujie Wang; writing&#x2014;review and editing, Jiao Yao; visualization, Tianyi Zhang; supervision, Jiao Yao; project administration, Chenqiang Zhu; funding acquisition, Chenqiang Zhu. All authors reviewed and approved the final version of the manuscript.</p>
</sec>
<sec sec-type="data-availability">
<title>Availability of Data and Materials</title>
<p>Not applicable.</p>
</sec>
<sec>
<title>Ethics Approval</title>
<p>Not applicable.</p>
</sec>
<sec sec-type="COI-statement">
<title>Conflicts of Interest</title>
<p>The authors declare no conflicts of interest.</p>
</sec>
<ref-list content-type="authoryear">
<title>References</title>
<ref id="ref-1"><label>[1]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Yuan</surname> <given-names>T</given-names></string-name>, <string-name><surname>Alasiri</surname> <given-names>F</given-names></string-name>, <string-name><surname>Ioannou</surname> <given-names>PA</given-names></string-name></person-group>. <article-title>Selection of the speed command distance for improved performance of a rule-based VSL and lane change control</article-title>. <source>IEEE Trans Intell Transp Syst</source>. <year>2022</year>;<volume>23</volume>(<issue>10</issue>):<fpage>19348</fpage>&#x2013;<lpage>57</lpage>. doi:<pub-id pub-id-type="doi">10.1109/TITS.2022.3157516</pub-id>.</mixed-citation></ref>
<ref id="ref-2"><label>[2]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Malekzadeh</surname> <given-names>M</given-names></string-name>, <string-name><surname>Naderi</surname> <given-names>M</given-names></string-name>, <string-name><surname>Jin</surname> <given-names>F</given-names></string-name>, <string-name><surname>Bogenberger</surname> <given-names>K</given-names></string-name>, <string-name><surname>Wang</surname> <given-names>Y</given-names></string-name>, <string-name><surname>Papageorgiou</surname> <given-names>M</given-names></string-name></person-group>. <article-title>A comprehensive review of tidal traffic flow control: from conventional lane reversal to emerging internal boundary control</article-title>. <source>Results Eng</source>. <year>2025</year>;<volume>27</volume>(<issue>12</issue>):<fpage>106198</fpage>. doi:<pub-id pub-id-type="doi">10.1016/j.rineng.2025.106198</pub-id>.</mixed-citation></ref>
<ref id="ref-3"><label>[3]</label><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Avelar</surname> <given-names>R</given-names></string-name>, <string-name><surname>Park</surname> <given-names>ES</given-names></string-name>, <string-name><surname>Ashraf</surname> <given-names>S</given-names></string-name>, <string-name><surname>Dixon</surname> <given-names>K</given-names></string-name>, <string-name><surname>Li</surname> <given-names>M</given-names></string-name>, <string-name><surname>Dadashova</surname> <given-names>B</given-names></string-name></person-group>. <source>Developing crash modification factors for variable speed limits</source>. <publisher-loc>Washington, DC, USA</publisher-loc>: <publisher-name>Federal Highway Administration, Office of Safety Research and Development</publisher-name>; <year>2021</year>. <comment>Report No.: HWA-HRT-21-053</comment>.</mixed-citation></ref>
<ref id="ref-4"><label>[4]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Zhang</surname> <given-names>L</given-names></string-name>, <string-name><surname>Ding</surname> <given-names>H</given-names></string-name>, <string-name><surname>Feng</surname> <given-names>Z</given-names></string-name>, <string-name><surname>Wang</surname> <given-names>L</given-names></string-name>, <string-name><surname>Di</surname> <given-names>Y</given-names></string-name>, <string-name><surname>Zheng</surname> <given-names>X</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Variable speed limit control strategy considering traffic flow lane assignment in mixed-vehicle driving environment</article-title>. <source>Phys A Stat Mech Appl</source>. <year>2024</year>;<volume>656</volume>(<issue>12</issue>):<fpage>130216</fpage>. doi:<pub-id pub-id-type="doi">10.1016/j.physa.2024.130216</pub-id>.</mixed-citation></ref>
<ref id="ref-5"><label>[5]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Wu</surname> <given-names>Y</given-names></string-name>, <string-name><surname>Tan</surname> <given-names>H</given-names></string-name>, <string-name><surname>Qin</surname> <given-names>L</given-names></string-name>, <string-name><surname>Ran</surname> <given-names>B</given-names></string-name></person-group>. <article-title>Differential variable speed limits control for freeway recurrent bottlenecks via deep actor-critic algorithm</article-title>. <source>Transp Res Part C Emerg Technol</source>. <year>2020</year>;<volume>117</volume>(<issue>4</issue>):<fpage>102649</fpage>. doi:<pub-id pub-id-type="doi">10.1016/j.trc.2020.102649</pub-id>.</mixed-citation></ref>
<ref id="ref-6"><label>[6]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Grumert</surname> <given-names>EF</given-names></string-name>, <string-name><surname>Tapani</surname> <given-names>A</given-names></string-name>, <string-name><surname>Ma</surname> <given-names>X</given-names></string-name></person-group>. <article-title>Characteristics of variable speed limit systems</article-title>. <source>Eur Transp Res Rev</source>. <year>2018</year>;<volume>10</volume>(<issue>2</issue>):<fpage>21</fpage>. doi:<pub-id pub-id-type="doi">10.1186/s12544-018-0294-8</pub-id>.</mixed-citation></ref>
<ref id="ref-7"><label>[7]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Yang</surname> <given-names>Y</given-names></string-name>, <string-name><surname>Liu</surname> <given-names>Q</given-names></string-name>, <string-name><surname>Shi</surname> <given-names>YJ</given-names></string-name></person-group>. <article-title>Study on decision model of dynamic hard shoulder running for highways with saturated traffic volume</article-title>. <source>Highw Eng</source>. <year>2022</year>;<volume>47</volume>(<issue>3</issue>):<fpage>172</fpage>&#x2013;<lpage>6</lpage>. (In Chinese). doi:<pub-id pub-id-type="doi">10.19782/j.cnki.1674-0610.2022.03.027</pub-id>.</mixed-citation></ref>
<ref id="ref-8"><label>[8]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Binjaku</surname> <given-names>K</given-names></string-name>, <string-name><surname>Pasquale</surname> <given-names>C</given-names></string-name>, <string-name><surname>Me&#x00E7;e</surname> <given-names>EK</given-names></string-name>, <string-name><surname>Sacone</surname> <given-names>S</given-names></string-name></person-group>. <article-title>Freeway traffic modeling by physics-regularized Gaussian processes</article-title>. <source>IEEE Open J Intell Transp Syst</source>. <year>2025</year>;<volume>6</volume>(<issue>6</issue>):<fpage>116</fpage>&#x2013;<lpage>30</lpage>. doi:<pub-id pub-id-type="doi">10.1109/OJITS.2025.3532796</pub-id>.</mixed-citation></ref>
<ref id="ref-9"><label>[9]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Yuan</surname> <given-names>F</given-names></string-name>, <string-name><surname>Wang</surname> <given-names>X</given-names></string-name>, <string-name><surname>Chen</surname> <given-names>Z</given-names></string-name></person-group>. <article-title>Assessing the impact of ride-sourcing vehicles on HOV-lane efficacy and management strategies</article-title>. <source>Transp Policy</source>. <year>2024</year>;<volume>150</volume>(<issue>2</issue>):<fpage>35</fpage>&#x2013;<lpage>52</lpage>. doi:<pub-id pub-id-type="doi">10.1016/j.tranpol.2024.02.017</pub-id>.</mixed-citation></ref>
<ref id="ref-10"><label>[10]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Naseri</surname> <given-names>A</given-names></string-name>, <string-name><surname>Estelaji</surname> <given-names>F</given-names></string-name>, <string-name><surname>Samani</surname> <given-names>A</given-names></string-name>, <string-name><surname>Omidifar</surname> <given-names>R</given-names></string-name>, <string-name><surname>Zahedi</surname> <given-names>R</given-names></string-name>, <string-name><surname>Yousefi</surname> <given-names>H</given-names></string-name></person-group>. <article-title>Simulating the performance of HOV lanes for optimal urban traffic management</article-title>. <source>Transp Res Interdiscip Perspect</source>. <year>2024</year>;<volume>23</volume>(<issue>1</issue>):<fpage>101010</fpage>. doi:<pub-id pub-id-type="doi">10.1016/j.trip.2023.101010</pub-id>.</mixed-citation></ref>
<ref id="ref-11"><label>[11]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><surname>Li</surname> <given-names>Z</given-names></string-name>, <string-name><surname>Zhu</surname> <given-names>X</given-names></string-name>, <string-name><surname>Liu</surname> <given-names>X</given-names></string-name>, <string-name><surname>Qu</surname> <given-names>X</given-names></string-name></person-group>. <article-title>Model-based predictive variable speed limit control on multi-lane freeways with a line of connected automated vehicles</article-title>. In: <conf-name>2019 IEEE Intelligent Transportation Systems Conference (ITSC); 2019 Oct 27&#x2013;30; Auckland, New Zealand</conf-name>. p. <fpage>1989</fpage>&#x2013;<lpage>94</lpage>. doi:<pub-id pub-id-type="doi">10.1109/ITSC.2019.8917471</pub-id>.</mixed-citation></ref>
<ref id="ref-12"><label>[12]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Zhang</surname> <given-names>CB</given-names></string-name>, <string-name><surname>Zhou</surname> <given-names>B</given-names></string-name>, <string-name><surname>Jiang</surname> <given-names>Z</given-names></string-name>, <string-name><surname>Xia</surname> <given-names>YX</given-names></string-name></person-group>. <article-title>Variable speed limits for freeway based on vehicle-class specific control</article-title>. <source>J Wuhan Univ Technol Transp Sci Eng</source>. <year>2015</year>;<volume>39</volume>(<issue>6</issue>):<fpage>1125</fpage>&#x2013;<lpage>9,34</lpage>. <comment>(In Chinese)</comment>.</mixed-citation></ref>
<ref id="ref-13"><label>[13]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Tang</surname> <given-names>JJ</given-names></string-name>, <string-name><surname>Hu</surname> <given-names>LP</given-names></string-name>, <string-name><surname>Li</surname> <given-names>MY</given-names></string-name>, <string-name><surname>Zhang</surname> <given-names>X</given-names></string-name></person-group>. <article-title>Optimization of highway emergency lane control based on Kriging genetic algorithm</article-title>. <source>J Syst Simul</source>. <year>2024</year>;<volume>36</volume>(<issue>5</issue>):<fpage>1165</fpage>&#x2013;<lpage>78</lpage>. (In Chinese). doi:<pub-id pub-id-type="doi">10.16182/j.issn1004731x.joss.23-0090</pub-id>.</mixed-citation></ref>
<ref id="ref-14"><label>[14]</label><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Jenior</surname> <given-names>P</given-names></string-name>, <string-name><surname>Schroeder</surname> <given-names>B</given-names></string-name>, <string-name><surname>Dowling</surname> <given-names>R</given-names></string-name>, <string-name><surname>Geistefeldt</surname> <given-names>J</given-names></string-name>, <string-name><surname>Hale</surname> <given-names>D</given-names></string-name></person-group>. <source>Decision support framework and parameters for dynamic part-time shoulder use: considerations for opening freeway shoulders for travel as a traffic management strategy</source>. <publisher-loc>Washington, DC, USA</publisher-loc>: <publisher-name>Federal Highway Administration</publisher-name>; <year>2019</year>. <comment>Report No.: FHWA-HOP-19-029</comment>.</mixed-citation></ref>
<ref id="ref-15"><label>[15]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Liu</surname> <given-names>Q</given-names></string-name>, <string-name><surname>Ding</surname> <given-names>F</given-names></string-name>, <string-name><surname>Zhang</surname> <given-names>Z</given-names></string-name>, <string-name><surname>Yang</surname> <given-names>Y</given-names></string-name></person-group>. <article-title>Analysis of traffic operation characteristics of highways under emergency lane opening conditions</article-title>. <source>J China Foreign Highw</source>. <year>2022</year>;<volume>42</volume>(<issue>4</issue>):<fpage>252</fpage>&#x2013;<lpage>7</lpage>.</mixed-citation></ref>
<ref id="ref-16"><label>[16]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Lu</surname> <given-names>R</given-names></string-name>, <string-name><surname>Ma</surname> <given-names>M</given-names></string-name>, <string-name><surname>Wang</surname> <given-names>Y</given-names></string-name>, <string-name><surname>Lu</surname> <given-names>J</given-names></string-name>, <string-name><surname>Liang</surname> <given-names>S</given-names></string-name></person-group>. <article-title>Dynamic areas strategy design for variable speed limiting at fixed freeway bottlenecks</article-title>. <source>Phys A Stat Mech Appl</source>. <year>2023</year>;<volume>615</volume>(<issue>4</issue>):<fpage>128572</fpage>. doi:<pub-id pub-id-type="doi">10.1016/j.physa.2023.128572</pub-id>.</mixed-citation></ref>
<ref id="ref-17"><label>[17]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Choi</surname> <given-names>J</given-names></string-name>, <string-name><surname>Tay</surname> <given-names>R</given-names></string-name>, <string-name><surname>Kim</surname> <given-names>S</given-names></string-name>, <string-name><surname>Jeong</surname> <given-names>S</given-names></string-name>, <string-name><surname>Kim</surname> <given-names>J</given-names></string-name>, <string-name><surname>Heo</surname> <given-names>TY</given-names></string-name></person-group>. <article-title>Safety effects of freeway hard shoulder running</article-title>. <source>Appl Sci</source>. <year>2019</year>;<volume>9</volume>(<issue>17</issue>):<fpage>3614</fpage>. doi:<pub-id pub-id-type="doi">10.3390/app9173614</pub-id>.</mixed-citation></ref>
<ref id="ref-18"><label>[18]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Kononov</surname> <given-names>J</given-names></string-name>, <string-name><surname>Hersey</surname> <given-names>S</given-names></string-name>, <string-name><surname>Reeves</surname> <given-names>D</given-names></string-name>, <string-name><surname>Allery</surname> <given-names>BK</given-names></string-name></person-group>. <article-title>Relationship between freeway flow parameters and safety and its implications for hard shoulder running</article-title>. <source>Transp Res Rec J Transp Res Board</source>. <year>2012</year>;<volume>2280</volume>(<issue>1</issue>):<fpage>10</fpage>&#x2013;<lpage>7</lpage>. doi:<pub-id pub-id-type="doi">10.3141/2280-02</pub-id>.</mixed-citation></ref>
<ref id="ref-19"><label>[19]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Wang</surname> <given-names>C</given-names></string-name>, <string-name><surname>Zhang</surname> <given-names>J</given-names></string-name>, <string-name><surname>Xu</surname> <given-names>L</given-names></string-name>, <string-name><surname>Li</surname> <given-names>L</given-names></string-name>, <string-name><surname>Ran</surname> <given-names>B</given-names></string-name></person-group>. <article-title>A new solution for freeway congestion: cooperative speed limit control using distributed reinforcement learning</article-title>. <source>IEEE Access</source>. <year>2019</year>;<volume>7</volume>:<fpage>41947</fpage>&#x2013;<lpage>57</lpage>. doi:<pub-id pub-id-type="doi">10.1109/ACCESS.2019.2904619</pub-id>.</mixed-citation></ref>
<ref id="ref-20"><label>[20]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Li</surname> <given-names>Y</given-names></string-name>, <string-name><surname>Zhang</surname> <given-names>S</given-names></string-name>, <string-name><surname>Pan</surname> <given-names>Y</given-names></string-name>, <string-name><surname>Zhou</surname> <given-names>B</given-names></string-name>, <string-name><surname>Peng</surname> <given-names>Y</given-names></string-name></person-group>. <article-title>Exploring the stability and capacity characteristics of mixed traffic flow with autonomous and human-driven vehicles considering aggressive driving</article-title>. <source>J Adv Transp</source>. <year>2023</year>;<volume>2023</volume>(<issue>1</issue>):<fpage>2578690</fpage>. doi:<pub-id pub-id-type="doi">10.1155/2023/2578690</pub-id>.</mixed-citation></ref>
<ref id="ref-21"><label>[21]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Papageorgiou</surname> <given-names>M</given-names></string-name>, <string-name><surname>Kosmatopoulos</surname> <given-names>E</given-names></string-name>, <string-name><surname>Papamichail</surname> <given-names>I</given-names></string-name></person-group>. <article-title>Effects of variable speed limits on motorway traffic flow</article-title>. <source>Transp Res Rec J Transp Res Board</source>. <year>2008</year>;<volume>2047</volume>(<issue>1</issue>):<fpage>37</fpage>&#x2013;<lpage>48</lpage>. doi:<pub-id pub-id-type="doi">10.3141/2047-05</pub-id>; <pub-id pub-id-type="pmid">12716185</pub-id></mixed-citation></ref>
<ref id="ref-22"><label>[22]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Hellinga</surname> <given-names>B</given-names></string-name>, <string-name><surname>Mandelzys</surname> <given-names>M</given-names></string-name></person-group>. <article-title>Impact of driver compliance on the safety and operational impacts of freeway variable speed limit systems</article-title>. <source>J Transp Eng</source>. <year>2011</year>;<volume>137</volume>(<issue>4</issue>):<fpage>260</fpage>&#x2013;<lpage>8</lpage>. doi:<pub-id pub-id-type="doi">10.1061/(asce)te.1943-5436.0000214</pub-id>; <pub-id pub-id-type="pmid">29515898</pub-id></mixed-citation></ref>
<ref id="ref-23"><label>[23]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><surname>Lan</surname> <given-names>R</given-names></string-name>, <string-name><surname>Yang</surname> <given-names>S</given-names></string-name>, <string-name><surname>Lou</surname> <given-names>E</given-names></string-name>, <string-name><surname>Li</surname> <given-names>H</given-names></string-name></person-group>. <article-title>Applicability analysis and application research of variable speed limit strategy on highways</article-title>. In: <conf-name>Proceedings of 2024 2nd International Conference on SmartRail, Traffic, and Transportation Engineering; 2024 Oct 25&#x2013;27; Chongqing, China</conf-name>. <publisher-loc>Singapore</publisher-loc>: <publisher-name>Springer</publisher-name>; <year>2025</year>. p. <fpage>46</fpage>&#x2013;<lpage>60</lpage>. doi:<pub-id pub-id-type="doi">10.1007/978-981-96-7441-1_5</pub-id>.</mixed-citation></ref>
<ref id="ref-24"><label>[24]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Terefe</surname> <given-names>MB</given-names></string-name>, <string-name><surname>Lee</surname> <given-names>H</given-names></string-name>, <string-name><surname>Heo</surname> <given-names>N</given-names></string-name>, <string-name><surname>Fox</surname> <given-names>GC</given-names></string-name>, <string-name><surname>Oh</surname> <given-names>S</given-names></string-name></person-group>. <article-title>Energy-efficient multisite offloading policy using Markov decision process for mobile cloud computing</article-title>. <source>Pervasive Mob Comput</source>. <year>2016</year>;<volume>27</volume>(<issue>11</issue>):<fpage>75</fpage>&#x2013;<lpage>89</lpage>. doi:<pub-id pub-id-type="doi">10.1016/j.pmcj.2015.10.008</pub-id>.</mixed-citation></ref>
<ref id="ref-25"><label>[25]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Yao</surname> <given-names>Z</given-names></string-name>, <string-name><surname>Ma</surname> <given-names>Z</given-names></string-name>, <string-name><surname>Wang</surname> <given-names>J</given-names></string-name>, <string-name><surname>Wu</surname> <given-names>Y</given-names></string-name>, <string-name><surname>Jiang</surname> <given-names>C</given-names></string-name></person-group>. <article-title>Connected vehicle-based simulation of variable speed limit effects on highway mixed traffic flow</article-title>. <source>Phys A Stat Mech Appl</source>. <year>2026</year>;<volume>685</volume>:<fpage>131272</fpage>. doi:<pub-id pub-id-type="doi">10.1016/j.physa.2026.131272</pub-id>.</mixed-citation></ref>
<ref id="ref-26"><label>[26]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Lu</surname> <given-names>QC</given-names></string-name>, <string-name><surname>Liu</surname> <given-names>L</given-names></string-name>, <string-name><surname>Gao</surname> <given-names>Y</given-names></string-name>, <string-name><surname>Meng</surname> <given-names>X</given-names></string-name>, <string-name><surname>Li</surname> <given-names>J</given-names></string-name>, <string-name><surname>Hu</surname> <given-names>Z</given-names></string-name></person-group>. <article-title>Variable speed limit control strategies in low CAV penetration scenarios</article-title>. <source>Transp A Transp Sci</source>. <year>2025</year>;<volume>27</volume>(<issue>6</issue>):<fpage>1</fpage>&#x2013;<lpage>36</lpage>. doi:<pub-id pub-id-type="doi">10.1080/23249935.2025.2582055</pub-id>.</mixed-citation></ref>
<ref id="ref-27"><label>[27]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Gu</surname> <given-names>Y</given-names></string-name>, <string-name><surname>Zhang</surname> <given-names>H</given-names></string-name>, <string-name><surname>Han</surname> <given-names>LD</given-names></string-name>, <string-name><surname>Jia</surname> <given-names>X</given-names></string-name>, <string-name><surname>Lee</surname> <given-names>DJ</given-names></string-name></person-group>. <article-title>Evaluating safety effects of variable speed limit systems via joint modeling</article-title>. <source>Accid Anal Prev</source>. <year>2025</year>;<volume>223</volume>(<issue>2</issue>):<fpage>108247</fpage>. doi:<pub-id pub-id-type="doi">10.1016/j.aap.2025.108247</pub-id>; <pub-id pub-id-type="pmid">40992114</pub-id></mixed-citation></ref>
<ref id="ref-28"><label>[28]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Yao</surname> <given-names>J</given-names></string-name>, <string-name><surname>Yang</surname> <given-names>CY</given-names></string-name>, <string-name><surname>Yang</surname> <given-names>YY</given-names></string-name>, <string-name><surname>Li</surname> <given-names>JJ</given-names></string-name>, <string-name><surname>Zhu</surname> <given-names>XX</given-names></string-name></person-group>. <article-title>Cooperative lane change guidance strategy in freeway traffic accident area based on safety potential field theory</article-title>. <source>China Saf Sci J</source>. <year>2024</year>;<volume>34</volume>(<issue>7</issue>):<fpage>71</fpage>&#x2013;<lpage>82</lpage>. (In Chinese). doi:<pub-id pub-id-type="doi">10.16265/j.cnki.issn1003-3033.2024.07.0069</pub-id>.</mixed-citation></ref>
</ref-list>
</back></article>