<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.1 20151215//EN" "http://jats.nlm.nih.gov/publishing/1.1/JATS-journalpublishing1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" xml:lang="en" article-type="research-article" dtd-version="1.1">
<front>
<journal-meta>
<journal-id journal-id-type="pmc">CMC</journal-id>
<journal-id journal-id-type="nlm-ta">CMC</journal-id>
<journal-id journal-id-type="publisher-id">CMC</journal-id>
<journal-title-group>
<journal-title>Computers, Materials &#x0026; Continua</journal-title>
</journal-title-group>
<issn pub-type="epub">1546-2226</issn>
<issn pub-type="ppub">1546-2218</issn>
<publisher>
<publisher-name>Tech Science Press</publisher-name>
<publisher-loc>USA</publisher-loc>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">36013</article-id>
<article-id pub-id-type="doi">10.32604/cmc.2023.036013</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Article</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Machine Learning Based Classifiers for QoE Prediction Framework in Video Streaming over 5G Wireless Networks</article-title>
<alt-title alt-title-type="left-running-head">Machine Learning Based Classifiers for QoE Prediction Framework in Video Streaming Over 5G Wireless Networks</alt-title>
<alt-title alt-title-type="right-running-head">Machine Learning Based Classifiers for QoE Prediction Framework in Video Streaming Over 5G Wireless Networks</alt-title>
</title-group>
<contrib-group>
<contrib id="author-1" contrib-type="author">
<name name-style="western"><surname>Ajeyprasaath</surname><given-names>K. B.</given-names></name></contrib>
<contrib id="author-2" contrib-type="author" corresp="yes">
<name name-style="western"><surname>Vetrivelan</surname><given-names>P.</given-names></name><email>vetrivelan.p@vit.ac.in</email></contrib>
<aff id="aff-1"><institution>School of Electronics Engineering, Vellore Institute of Technology</institution>, <addr-line>Chennai, 600127</addr-line>, <country>India</country></aff>
</contrib-group>
<author-notes>
<corresp id="cor1"><label>&#x002A;</label>Corresponding Author: P. Vetrivelan. Email: <email>vetrivelan.p@vit.ac.in</email></corresp>
</author-notes>
<pub-date date-type="collection" publication-format="electronic"><year>2023</year></pub-date>
<pub-date date-type="pub" publication-format="electronic"><day>24</day><month>1</month><year>2023</year></pub-date>
<volume>75</volume>
<issue>1</issue>
<fpage>1919</fpage>
<lpage>1939</lpage>
<history>
<date date-type="received"><day>13</day><month>9</month><year>2022</year></date>
<date date-type="accepted"><day>04</day><month>11</month><year>2022</year></date>
</history>
<permissions>
<copyright-statement>&#x00A9; 2023 Ajeyprasaath and Vetrivelan</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Ajeyprasaath and Vetrivelan</copyright-holder>
<license xlink:href="https://creativecommons.org/licenses/by/4.0/">
<license-p>This work is licensed under a <ext-link ext-link-type="uri" xlink:type="simple" xlink:href="https://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution 4.0 International License</ext-link>, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
</license>
</permissions>
<self-uri content-type="pdf" xlink:href="TSP_CMC_36013.pdf"></self-uri>
<abstract><p>Recently, the combination of video services and 5G networks have been gaining attention in the wireless communication realm. With the brisk advancement in 5G network usage and the massive popularity of three-dimensional video streaming, the quality of experience (QoE) of video in 5G systems has been receiving overwhelming significance from both customers and service provider ends. Therefore, effectively categorizing QoE-aware video streaming is imperative for achieving greater client satisfaction. This work makes the following contribution: First, a simulation platform based on NS-3 is introduced to analyze and improve the performance of video services. The simulation is formulated to offer real-time measurements, saving the expensive expenses associated with real-world equipment. Second, A valuable framework for QoE-aware video streaming categorization is introduced in 5G networks based on machine learning (ML) by incorporating the hyperparameter tuning (HPT) principle. It implements an enhanced hyperparameter tuning (EHPT) ensemble and decision tree (DT) classifier for video streaming categorization. The performance of the ML approach is assessed by considering precision, accuracy, recall, and computation time metrics for manifesting the superiority of these classifiers regarding video streaming categorization. This paper demonstrates that our ML classifiers achieve QoE prediction accuracy of 92.59&#x0025; for (EHPT) ensemble and 87.037&#x0025; for decision tree (DT) classifiers.</p>
</abstract>
<kwd-group kwd-group-type="author">
<kwd>QoE-aware</kwd>
<kwd>video streaming</kwd>
<kwd>5G networks</kwd>
<kwd>wireless networks</kwd>
<kwd>ensemble method</kwd>
</kwd-group>
</article-meta>
</front>
<body>
<sec id="s1"><label>1</label><title>Introduction</title>
<p>Recently, the augmented exploitation of video streaming facilities has abruptly enhanced bandwidth requisites via the internet. Generally, video streaming allows viewers to watch videos over the internet without the necessity of downloading them. Specifically, a chief portion of web/internet traffic, owing to live streaming, arrives from cardinal video sites like Netflix and YouTube [<xref ref-type="bibr" rid="ref-1">1</xref>]. In addition, video traffic involves video archives shared over the internet, video conferencing, internet video, and online games [<xref ref-type="bibr" rid="ref-2">2</xref>]. Slow web access is witnessed during peak periods like daytime when several customers are streaming videos simultaneously. This is likely to be extremely frustrating, particularly to those engaged in tasks that need an uninterrupted and rapid internet connection. Utilization of a major percentage of web traffic by video streaming services has raised heterogeneous concerns in the modern fast-pacing world. Several multimedia services like synergistic video gaming and HD video need high-speed connectivity, so the notion of fifth-generation (5G) ameliorates the end clients&#x2019; experience in handling these services. 5G technology is anticipated to provide innovative features compared to 4G by offering ultra-reliable, low-latency, and ubiquitous connectivity &#x2018;anytime&#x2019; and &#x2018;anywhere&#x2019; [<xref ref-type="bibr" rid="ref-3">3</xref>]. High-reliability and low-latency wireless communication methods are anticipated to become the chief attributes of these wireless networks [<xref ref-type="bibr" rid="ref-4">4</xref>]. With 5G networks, many services and applications can be accessible to remote clients/users. Consequently, clients expect improved network quality of service (QoS) with a greater quality standard [<xref ref-type="bibr" rid="ref-5">5</xref>]. <xref ref-type="table" rid="table-1">Table 1</xref> shows the different 5G ranges supported by 5G small cell types [<xref ref-type="bibr" rid="ref-6">6</xref>].</p>
<table-wrap id="table-1"><label>Table 1</label><caption><title>5G small cell types</title></caption>
<table frame="hsides">
<colgroup>
<col align="left"/>
<col align="left"/>
<col align="left"/>
<col align="left"/>
<col align="left"/>
</colgroup>
<thead>
<tr>
<th align="left">5G small cell types</th>
<th align="left">Deployment</th>
<th align="left">Number of concurrent users</th>
<th align="left">Power range</th>
<th align="left">Distance coverage</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">Femtocell</td>
<td align="left">It is primarily used in residences and enterprises</td>
<td align="left">4 to 8 users (residence) and 16 to 32 users (enterprise)</td>
<td align="left">10 to 100&#x2005;mW (Indoor) 0.2 to 1 Watt (Outdoor)</td>
<td align="left">10&#x2005;s of meters</td>
</tr>
<tr>
<td align="left">Pico cell</td>
<td align="left">Public areas such as indoors, outdoors, airports, malls, train stations</td>
<td align="left">64 to128 users</td>
<td align="left">100 to 250&#x2005;mW (Indoor) 1 to 5 Watt (Outdoor)</td>
<td align="left">10&#x2005;s of meters</td>
</tr>
<tr>
<td align="left">Microcell</td>
<td align="left">Urban areas to fill macro coverage gaps</td>
<td align="left">128 to 256 users</td>
<td align="left">5 to 10 Watt (Outdoor)</td>
<td align="left">Few 100&#x2005;s of meters</td>
</tr>
<tr>
<td align="left">Metro cell</td>
<td align="left">Urban areas to provide additional capacity</td>
<td align="left">&#x003E;250 users</td>
<td align="left">10 to 20 Watt (Outdoor)</td>
<td align="left">100&#x2005;s of meters</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>The difficulties with QoE management in networks are outlined in <xref ref-type="fig" rid="fig-1">Fig. 1</xref>. In the world of 5G networking, QoE has recently drawn a lot of attention. The crucial goal of QoE is to maintain end users for accurately estimating the perceived standard of service, as well as to consider and evaluate the network&#x2019;s QoS.</p>
<fig id="fig-1"><label>Figure 1</label><caption><title>QoE management challenges in networks</title></caption><graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_36013-fig-1.tif"/></fig>
<p>In fact, providing a great user experience while utilizing fewer network resources is the primary objective of network service providers. Furthermore, because the success of their business agreements heavily depends on the satisfaction of their customers, it is essential for these service providers to consider the impact of every network element on customer perception. In order to meet the tight QoE requirements of current video streaming systems, network operators typically implement a variety of network management strategies. But classifying video streaming that is QoE aware has become incredibly laborious. Therefore, creating better frameworks capable of achieving this objective has become essential. This article creates a QoE-aware framework for video streaming categorization in 5G systems in order to address this difficulty. This paper has integrated the HPT decision tree and the EHPT ensemble in the ML approach, with the EHPT ensemble having a higher accuracy due to its meticulous optimization of the gradient boosting methodology. The entire boosting procedure greatly enhances training time. This work trains a number of models on various subsets of the training dataset instead of building the best model feasible directly on the data and voting for the model that performs the best. EHPT ensemble XGBoost is frequently superior to conventional gradient boosting techniques. A large number of core parameters are accessible in the Python implementation, allowing for fine-tuning for increased precision and accuracy.</p>
<sec id="s1_1"><label>1.1</label><title>Paper Organization</title>
<p>The rest of this paper is arranged as follows: Section 2 reviews the related works. Section 3 provides the problem statement. Section 4 presents the methodology exploited for video streaming categorization. Section 5 provides a discussion of the achieved results. Finally, Section 6 concludes the paper.</p>
</sec>
<sec id="s1_2"><label>1.2</label><title>Contributions of Work</title>
<p>The cardinal contributions of this work include the following:
<list list-type="bullet">
<list-item><p>Development of a framework for QoE-aware video streaming categorization.</p></list-item>
<list-item><p>The exploitation of an enhanced ML approach for optimizing the classification performance.</p></list-item>
<list-item><p>Deployment of ML scheme for performing precise prediction of QoE-aware video streaming in 5G networks.</p></list-item>
</list></p>
</sec>
</sec>
<sec id="s2"><label>2</label><title>Related Work</title>
<p>In [<xref ref-type="bibr" rid="ref-7">7</xref>], personalized QoE management in 5G networks was described using a data-driven structure. The authors in this work used ML algorithms for establishing frameworks capable of predicting QoE using QoS network parameters like 5G-specific and wireless-specific parameters. Furthermore, a tool for assessing video QoE was adopted for gathering necessary QoE information for training prediction frameworks. This work utilized heterogeneous machine learning (ML) algorithms like neural networks (NNs), support vector machine (SVM), random forest (RF), and gradient-boosted (GB) trees for forecasting QoE. The impact of vital wireless-specific determinants was also explored in this work. Experimental outcomes clarified that among all employed ML schemes, the SVM approach performed better and achieved considerably low error. However, this work suggested that the use of wireless-specific determinants alone for QoE forecasting cannot offer the desired results. [<xref ref-type="bibr" rid="ref-8">8</xref>] described a QoE-aware video streaming using a deep reinforcement learning (DRL) scheme. The presented QoE framework used the data gathered during video playback. The DRL scheme was employed mainly for QoE optimization and viewport prediction. Furthermore, an LSTM framework was adopted for viewport and bandwidth prediction. It was identified from the experimental outputs that the presented framework exhibited improved performance than the previously introduced 3D video frameworks. Additionally, the presented system offered 10&#x0025;&#x2013;15&#x0025; performance amelioration and could be adapted to every situation under distinct QoE targets.</p>
<p>In [<xref ref-type="bibr" rid="ref-9">9</xref>], an ML method was utilized for classifying streaming video. The authors utilized a Markov decision process and NNs for identifying the class and source of video streams. This work precisely categorized similar sorts of streaming traffic into distinct services. The employed ML method considered packets gathered via a network interface and categorized the information stream into one of five video streaming services, including Amazon Prime, HBO, Netflix, YouTube tv, and YouTube. In [<xref ref-type="bibr" rid="ref-10">10</xref>], a video streaming assessment was conducted using the QoE framework in LTE systems. This work compared the QoE outputs from two distinct test benches, emulated and real and TCP-dependent video transport protocols. Additionally, it tested diverse propagation frameworks in the emulated setting to determine the one best matching the real conditions depending on QoE. The findings of this study revealed that the presented framework provided QoE quantification in a low-complexity and cost-effective manner. In [<xref ref-type="bibr" rid="ref-11">11</xref>], a supervised ML scheme was presented for forecasting video QoE in 5G systems. This work considered dynamic adaptive streaming over HTTP video application in a practical emulation environment acquired from practical 5G traces in mobility and static scenarios for assessing QoE performance. In [<xref ref-type="bibr" rid="ref-12">12</xref>,<xref ref-type="bibr" rid="ref-13">13</xref>], Dynamic adaptive streaming over HTTP(DASH) has been governing network traffic in the recent era. DASH supplies layouts to deliver the best quality video streaming service on the internet. Dash adheres to ABS standards. The adaptive bit rate streaming (ABS) algorithms aim to detect a favourable quality of video streaming. ABS algorithms decide the quality of the segments to be downloaded based on the network&#x2019;s available resources. The choice of the ABS algorithm plays a significant role in end-user satisfaction. It works on the principle of dividing a larger video file into a number of minuscule segments of equal intervals. Every segment is encrypted in varying bitrates and resolutions, and the illustration of individual segments is defined in the media presentation description (MPD) file. Based on the current network scenario, the user determines the video segments which can be played; the user chooses the segment with the most efficient bitrate feasible, which can be downloaded in that duration without causing any interruption. DASH users can swap between various video qualities to enhance the viewing experience based on the available network. Thus, it is necessary to know the network conditions for enhanced video distribution. Furthermore, an ML scheme was adopted for forecasting user satisfaction by considering network metrics like the sum of packets, throughput, and round-trip time. Simulations manifested that the ML scheme offered 87.63&#x0025; QoE forecasting accuracy and 79&#x0025; accuracy for mobility and static scenarios.</p>
<p>In [<xref ref-type="bibr" rid="ref-14">14</xref>], a framework for optimizing QoS-aware video streaming over wireless systems was presented. The presented structure fuses a media-conscious proxy for monitoring chief performance factors from multiple layers, distinct entities, and an ML-dependent decision engine for modelling sensed video quality. The presented architecture was completely integrated with LTE-reinforced packet core systems. This work also explored the ML-oriented schemes for providing a target QoE framework depending on the network, data link, and physical layer parameters. Statistical analysis and extensive experiments indicated that this framework could accurately model the effect of network stultifications on the 3D video user&#x2019;s perception quality. In [<xref ref-type="bibr" rid="ref-15">15</xref>], an artificial intelligence-dependent scheme was presented for video stream categorization. The authors exploited video attributes of distinct time scales for analysis. Initially, video frame sequences of distinct time scales were input to the 3D system for attribute extraction, and then the attributes of distinct time scales were weighted and combined. Furthermore, after combining several sequential frameworks, the combined 3D deep learning (DL) framework was constructed. Simulations revealed that this framework offered 90.6&#x0025; categorization accuracy and 2.9&#x0025; performance amelioration. In [<xref ref-type="bibr" rid="ref-16">16</xref>], an ML-oriented approach for categorizing YouTube QoE was presented. This approach aimed at classifying end-users QoE while watching videos depending on the statistical characteristics of network traffic. This work utilized the ML approach for categorizing QoE depending on the traffic attributes computed for every video session. For categorization, this work employed 1060 distinct videos streamed across distinct bandwidth scenarios. It was viewed from simulations that the adopted ML-oriented approach offered 84&#x0025; categorization accuracy regarding three ternary classifications (QoE classes involving high, medium, and low) and 91&#x0025; accuracy regarding binary classification (QoE classes involving high and low).</p>
<p>An ML-dependent analysis and computation of video QoE were presented in [<xref ref-type="bibr" rid="ref-17">17</xref>]. The authors adopted a random forest scheme for video QoE analysis. The employed random forest framework was trained on estimated video quality measures using the baseline/reference videos. Results ascertained that this scheme offered 94&#x0025; categorization accuracy. However, this work was not explored much in terms of video streaming categorization. In [<xref ref-type="bibr" rid="ref-18">18</xref>], a system for categorizing live video streaming was presented. The authors initially preprocessed the live video traffic packets purely depending on the statistical characteristics of network traffic packet flow. Here, traffic intensity was employed as a chief traffic form descriptor with certain additional transforms. This work investigated the categorization accuracy depending on diversified factors like traffic preprocessing type, traffic window length, and sampling time of traffic intensity. Findings declared that the traffic intensity samples offered 94&#x0025; accuracy without auxiliary transforms. In [<xref ref-type="bibr" rid="ref-19">19</xref>], the prominence of QoE in 5G networks was discussed. The chief challenges, like an augmented quantity of information generation by advanced applications, the necessity for better quality services, and a large number of devices for connecting distinct radio access methods, were identified as crucial 5G challenges regarding QoE. The authors also presented a neural network-oriented approach for QoE computation. This work clarified that owing to NN&#x2019;s capability to completely analyze the causal link between QoS network parameters and the resultant QoE; they are extremely suitable for achieving QoE self-optimization in 5G.</p>
<p>In [<xref ref-type="bibr" rid="ref-20">20</xref>], another methodology for video streaming categorization was presented. The authors in this work gathered a group of video traffic information from a realistic network. Furthermore, this information was preprocessed for choosing the desired attributes for classifying video traffic. The presented methodology offered 99.3&#x0025; overall accuracy in categorizing video traffic. In [<xref ref-type="bibr" rid="ref-21">21</xref>], an ML approach was described for QoE-aware networks. This work aimed at exploiting ML schemes for modelling the correlation of distinct network and QoS parameters of the application layer to QoE. An empirical investigation depending on the ML scheme was provided in [<xref ref-type="bibr" rid="ref-22">22</xref>] for assessing QoE/QoS correlation. This work explored how distinct determinants contributed to QoE in a video streaming context. It described that the cardinal parameters influencing the QoE involved network parameters, terminal characteristics, video characteristics, and various customer profiles. ML classifiers were further employed for categorizing a QoE database. This work adopted six distinct ML schemes: SVM, DT, Naive Bayes, neural network, four-nearest neighbour, and RF. An instance categorization test was performed to choose the appropriate framework. It was explicitly observed from the outputs that DT and RF displayed better performance compared to the remaining ML schemes. Simulations indicated DT offered 74.8&#x0025; precision, 74.5&#x0025; f-measure, and 74.3&#x0025; recall, while RF offered 75.2&#x0025; precision, 75.2&#x0025; f-measure, and 75.3&#x0025; recall. Furthermore, a statistical investigation of classification was also presented to explore the effectiveness of RF and DT schemes. Statistical analysis outputs clearly manifested that the RF classifier superseded the DT approach. This work thus illustrated the appropriateness of ML techniques for the QoE/QoS correlation task.</p>
<p>In [<xref ref-type="bibr" rid="ref-23">23</xref>], practical video QoE monitoring was discussed. The authors introduced an ML-oriented approach for monitoring QoE measures for encoded video traffic. The transport and network layer data were employed as attributes for training ML classifiers necessary for deducing video QoE measures like rebuffering events and startup delay. Experimental assessments declared that the exploited ML-oriented approach offered 90&#x0025; accuracy. In [<xref ref-type="bibr" rid="ref-24">24</xref>], the quality assessment of video streaming was discussed. The authors analyzed and compared distinct variations of target QoE assessment frameworks with and without ML schemes for video streaming. Performance analysis clarified that the hybrid frameworks performed better than QoS-initiated QoE approaches. Prior works on video QoE estimation have shown that network-level performances directly impact QoE. This motivates the use of machine learning to link the 5G network level measurements to QoE. Hence, in this article, video streaming is considered where prediction models are built by controlled experimentation that allows both the forecasting and monitoring of Video QoE using 5G network metrics. This study clarified that the ML-dependent framework slightly outperformed the framework without ML in the case of the same setting. Additionally, the findings of this work indicated that the available video QoE assessment frameworks still exhibit limited performance, thereby making it tedious to be applicable in realistic communication networks. <xref ref-type="table" rid="table-2">Table 2</xref> represents the comparison between ML-based QoE prediction models for video services with our proposed model.</p>
<table-wrap id="table-2"><label>Table 2</label><caption><title>Machine learning-based QoE prediction model for video services</title></caption>
<table frame="hsides">
<colgroup>
<col align="left"/>
<col align="left"/>
<col align="left"/>
<col align="left"/>
<col align="left"/>
<col align="left"/>
<col align="left"/>
</colgroup>
<thead>
<tr>
<th align="left">Reference</th>
<th align="left">ML technique</th>
<th align="left">Influencing factors</th>
<th align="left">Assessment metrics</th>
<th align="left"/>
<th align="left">Prediction accuracy (&#x0025;)</th>
<th align="left">Application</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">[<xref ref-type="bibr" rid="ref-25">25</xref>]</td>
<td align="left">DTR, multi-linear regression, RFR</td>
<td align="left">Round trip time (RTT), throughput, number of packets per video segment, rate-based, buffer-based, and hybrid ABS algorithms, number of stalls</td>
<td align="left">MOS, ACR</td>
<td align="left"/>
<td align="left">91</td>
<td align="left">DASH video streaming</td>
</tr>
<tr>
<td align="left">[<xref ref-type="bibr" rid="ref-26">26</xref>]</td>
<td align="left">LR, KNN, DT, Gaussian naive Bayes, SVM</td>
<td align="left">Bitrate, FPS, Resolution</td>
<td align="left">ACR</td>
<td align="left"/>
<td align="left">73.5&#x2013;86</td>
<td align="left">HAS video streaming</td>
</tr>
<tr>
<td align="left">[<xref ref-type="bibr" rid="ref-27">27</xref>]</td>
<td align="left">DL [CNN &#x0026; LSTM]</td>
<td align="left">Text, video, categorical information, continuous information, sequence data</td>
<td align="left">MOS</td>
<td align="left"/>
<td align="left">88.74</td>
<td align="left">HAS video streaming</td>
</tr>
<tr>
<td align="left">[<xref ref-type="bibr" rid="ref-28">28</xref>]</td>
<td align="left">SVM</td>
<td align="left">Brightness, colour information, FPS, initial buffering delay</td>
<td align="left">MOS</td>
<td align="left"/>
<td align="left">91.3</td>
<td align="left">HTTP video streaming</td>
</tr>
<tr>
<td align="left">[<xref ref-type="bibr" rid="ref-29">29</xref>]</td>
<td align="left">DT</td>
<td align="left">Average quantization parameters, average bits in interframes</td>
<td align="left">MOS, SSIM, VQM</td>
<td align="left"/>
<td align="left">88.9&#x2013;90.5</td>
<td align="left">H.264 AVC video streaming</td>
</tr>
<tr>
<td align="left">[<xref ref-type="bibr" rid="ref-30">30</xref>]</td>
<td align="left">Multiclass incremental SVM</td>
<td align="left">Delay, packet loss, FPS, video type, mean bitrate</td>
<td align="left">MOS</td>
<td align="left"/>
<td align="left">89</td>
<td align="left">Mobile video streaming</td>
</tr>
<tr>
<td align="left">[<xref ref-type="bibr" rid="ref-31">31</xref>]</td>
<td align="left">RF</td>
<td align="left">RSSI, RSRP, RSRQ, CQI, frame delay</td>
<td align="left">MOS, PSNR</td>
<td align="left"/>
<td align="left">75&#x2013;85</td>
<td align="left">Mobile video streaming</td>
</tr>
<tr>
<td align="left">[<xref ref-type="bibr" rid="ref-32">32</xref>]</td>
<td align="left">DT</td>
<td align="left">Immersion and presence, reality judgement</td>
<td align="left">MOS</td>
<td align="left"/>
<td align="left">91</td>
<td align="left">VR 360-degree video</td>
</tr>
<tr>
<td align="left">Proposed work</td>
<td align="left">HPT DT, EHPT ensemble</td>
<td align="left">The bitrate of video packets, traffic flow, simulation time</td>
<td align="left">MOS</td>
<td align="left"/>
<td align="left">87.037&#x2013;92.59</td>
<td align="left">Adaptive Bitrate streaming (ABS)</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>The comparison between the proposed EHPT ensemble method and the existing ML algorithms attained prediction accuracies (&#x0025;) is highlighted in <xref ref-type="fig" rid="fig-2">Fig. 2</xref>.</p>
<fig id="fig-2"><label>Figure 2</label><caption><title>Comparison of existing ML algorithms with the proposed EHPT ensemble method</title></caption><graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_36013-fig-2.tif"/></fig>
</sec>
<sec id="s3"><label>3</label><title>Problem Statement</title>
<p>The use of multimedia information is inescapable in daily life and is anticipated to grow rapidly in the next years. Greater throughput is made possible by 5G technology, which also greatly facilitates multimedia content streaming in a variety of applications like YouTube, Facebook, etc. The main goal of any video streaming technology is to provide the best possible quality of service (QoS) and quality of experience (QoE). Although it is predicted that the 5G system would provide better QoE, the challenge of balancing operator provisioning and meeting customer expectations remains a crucial concern. Numerous studies have recently been carried out to address this barrier and develop a QoE-aware network. ML frameworks have gained popularity recently for providing precise answers to complex problems and are widely used in a variety of fields. It has been demonstrated that ML approaches work well for a variety of classification problems. Therefore, the purpose of this work is to utilize an ML technique for classifying streaming video. Studies that have already been published employed ML techniques to predict video QoE in 5G systems. These studies assessed the quality of experience (QoE) of streaming approaches and used ML classifiers to predict the degree of user satisfaction. However, it was noted in these works that there was still a sizable area for improvement with reference to the accuracy measures. This work aims to optimize existing ML schemes by including the hyperparameter tuning concept and building enhanced ML classifiers for efficient QoE-aware video streaming categorization because employing the right tuning of ML schemes to achieve the necessary classification accuracy is laborious. <xref ref-type="fig" rid="fig-3">Fig. 3</xref> shows a comparison of the current worldwide data usage with mobile video use in various streams [<xref ref-type="bibr" rid="ref-33">33</xref>].</p>
<fig id="fig-3"><label>Figure 3</label><caption><title>Global mobile data traffic forecast</title></caption><graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_36013-fig-3.tif"/></fig>
</sec>
<sec id="s4"><label>4</label><title>Proposed Methodology</title>
<p>This methodology involves the network configuration and network construction, video packet streaming, ML-directed video streaming classification, and finally, performance evaluation of the developed ML approach. The block diagram of the proposed methodology is depicted in <xref ref-type="fig" rid="fig-4">Fig. 4</xref>.</p>
<fig id="fig-4"><label>Figure 4</label><caption><title>Schematic diagram of QoE improvisation in 5G Wireless Networks</title></caption><graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_36013-fig-4.tif"/></fig>
<sec id="s4_1"><label>4.1</label><title>Network Construction and Configuration</title>
<p>Initially, a 5G network is constructed and configured using 100 nodes for transmitting video streaming. Here, all nodes are placed, and every node is identified as n1, n2, n3&#x2026; n100. For network construction and configuration, the distinct network parameters considered in this work include transmission range, base station, number of nodes, traffic model, mobility model, bandwidth, carrier frequency, mmWave maximum physical rate, packet size and frame size. The values of these network parameters are enumerated in <xref ref-type="table" rid="table-3">Table 3</xref>.</p>
<table-wrap id="table-3"><label>Table 3</label><caption><title>Network configuration parameters</title></caption>
<table frame="hsides">
<colgroup>
<col align="left"/>
<col align="left"/>
<col align="left"/>
</colgroup>
<thead>
<tr>
<th align="left">Sl. No.</th>
<th align="left">Network parameter</th>
<th align="left">Value</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">1</td>
<td align="left">Transmission range</td>
<td align="left">1000 &#x002A; 1000</td>
</tr>
<tr>
<td align="left">2</td>
<td align="left">Number of nodes</td>
<td align="left">100</td>
</tr>
<tr>
<td align="left">3</td>
<td align="left">Base station</td>
<td align="left">gNodeB</td>
</tr>
<tr>
<td align="left">4</td>
<td align="left">Mobility model</td>
<td align="left">Static-Constant Position Mobility Model, Dynamic-Random Walk 2D Mobility Model</td>
</tr>
<tr>
<td align="left">5</td>
<td align="left">Traffic model</td>
<td align="left">ON/OFF Adaptive Bitrate Streaming (ABS)</td>
</tr>
<tr>
<td align="left">6</td>
<td align="left">mmWave max phy rate</td>
<td align="left">3.2 Gbit/s</td>
</tr>
<tr>
<td align="left">7</td>
<td align="left">Bandwidth</td>
<td align="left">1&#x2005;GHz</td>
</tr>
<tr>
<td align="left">8</td>
<td align="left">Carrier frequency</td>
<td align="left">28&#x2005;GHz</td>
</tr>
<tr>
<td align="left">9</td>
<td align="left">Packet size</td>
<td align="left">1400 bytes</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s4_2"><label>4.2</label><title>Video Packet Streaming</title>
<p>For video packet streaming, initially, a request for connection establishment between the nodes is sent by the 5G users. Once the connection is established, the video packet is transferred between the nodes through the bitstream segment. Thus, through this communication, the data pertinent to video packets are received, and further, this data is input to the ML classifier for categorizing the video streaming.</p>
<p>In this work, video packet streaming is performed using the adaptive bitrate streaming (ABS) method, illustrated in <xref ref-type="fig" rid="fig-5">Fig. 5</xref>. ABS adapt the video quality depending on network conditions for ameliorating video streaming across HTTP networks. It is basically a technology devised for delivering video in an extremely effective manner and in a usable quality for the device and every specific user. ABS begins mainly at the video encoding phase. For ABS to work, distinct video files which support distinct bit rates are created. In ABS, source content encoding is performed at diverse bit rates. Each of the distinct bit rate (BR) streams are partitioned into diminutive multi-second components. Initially, a manifest file is downloaded, which describes the existing stream segments and their corresponding bit rates. During stream initiation, the segments with the minimum BR stream are typically requested. If the network throughput is higher than the downloaded segment&#x2019;s bit rate, then a higher BR segment is requested. However, if the network throughput deteriorates, a lower BR segment is requested. The ABS technique thus aids in deciding which BR segments to be downloaded, depending on the network&#x2019;s current state.</p>
<fig id="fig-5"><label>Figure 5</label><caption><title>Adaptive bitrate streaming according to network conditions</title></caption><graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_36013-fig-5.tif"/></fig>
</sec>
<sec id="s4_3"><label>4.3</label><title>Machine Learning-Based Classification</title>
<p>The final stage involves the classification of video streaming. This process is executed after performing video packet streaming. In the current paper, video streaming categorization is achieved using the ML approach. Two distinct ML approaches, namely, enhanced hyperparameter tuning (EHPT) ensemble classifier and hyperparameter tuning (HPT) decision tree (DT) classifier, are used.</p>
<sec id="s4_3_1"><label>4.3.1</label><title>XG Boost Ensemble with HPT</title>
<p>Extreme gradient boosting (XGBoost) is an improved distributed gradient boosting library that implements ML techniques under the gradient boosting model. In gradient boosting, the loss function is minimized by incorporating weak learners via a gradient descent maximization method. XGBoost is typically an extension of gradient-boosted decision trees specifically devised for ameliorating performance and speed. XGBoost precisely forecasts a target parameter by fusing estimates of a group of weaker frameworks. XGBoost decreases a regularized objective function which integrates a loss function depending on the discrepancy between the target and predicted outputs. Here, the training proceeds repetitively, adding neoteric trees which forecast the errors or residuals of previous trees, which are further fused with the preceding trees to make the ultimate prediction. In this work, an XGBoost ensemble is exploited, as ensemble learning involves a set of predictors (frameworks) for offering better forecasting accuracy. For achieving improved performance, hyperparameter tuning is done in the ensemble classifier. HPT is chiefly done to achieve the best fit. It functions by executing several trials in a solitary training job. Every trial comprehensively executes a training process with values selected for hyperparameters. HPT optimizes a solitary target variable known as the hyperparameter metric.</p>
<p>In this case, the created ensemble framework is represented by <xref ref-type="disp-formula" rid="eqn-1">Eq. (1)</xref> as a weighted sum of weak learners.
<disp-formula id="eqn-1"><label>(1)</label><mml:math id="mml-eqn-1" display="block"><mml:msub><mml:mi>s</mml:mi><mml:mrow><mml:mi>q</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mo>&#x22C5;</mml:mo><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:msubsup><mml:mrow><mml:mo>&#x2211;</mml:mo></mml:mrow><mml:mrow><mml:mi>q</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mi>Q</mml:mi></mml:mrow></mml:msubsup><mml:msub><mml:mi>c</mml:mi><mml:mrow><mml:mi>q</mml:mi></mml:mrow></mml:msub><mml:mo>&#x00D7;</mml:mo><mml:msub><mml:mi>w</mml:mi><mml:mrow><mml:mi>q</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mo>&#x22C5;</mml:mo><mml:mo>)</mml:mo></mml:mrow></mml:math></disp-formula></p>
<p><inline-formula id="ieqn-1"><mml:math id="mml-ieqn-1"><mml:msub><mml:mi>s</mml:mi><mml:mrow><mml:mi>q</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula>(.) is the quality of the video, and Q stands for the number of decision trees, where <inline-formula id="ieqn-2"><mml:math id="mml-ieqn-2"><mml:msub><mml:mi>c</mml:mi><mml:mrow><mml:mi>q</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> Stands for learning rate. The learning rate value ranges between 0 to 1 and is selected based on the HPT. The major goal of this work is to determine the classifier&#x2019;s accuracy on the validation set; nevertheless, it appears that a learning rate of 0.01 delivers excellent performance on both the validation and training sets. <inline-formula id="ieqn-3"><mml:math id="mml-ieqn-3"><mml:msub><mml:mi>w</mml:mi><mml:mrow><mml:mi>q</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mo>&#x22C5;</mml:mo><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula> is the output given by the decision tree.</p>
<p>The issue is modelled as a gradient descent via gradient boosting. <xref ref-type="disp-formula" rid="eqn-2">Eq. (2)</xref> represents the gradient descent method over the ensemble framework.
<disp-formula id="eqn-2"><label>(2)</label><mml:math id="mml-eqn-2" display="block"><mml:msub><mml:mi>s</mml:mi><mml:mrow><mml:mi>q</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mo>&#x22C5;</mml:mo><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:msub><mml:mi>s</mml:mi><mml:mrow><mml:mi>q</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mo>&#x22C5;</mml:mo><mml:mo>)</mml:mo></mml:mrow><mml:mo>&#x2212;</mml:mo><mml:msub><mml:mi>c</mml:mi><mml:mrow><mml:mi>q</mml:mi></mml:mrow></mml:msub><mml:mo>&#x00D7;</mml:mo><mml:mi>g</mml:mi><mml:mi>r</mml:mi><mml:mi>a</mml:mi><mml:msub><mml:mi>d</mml:mi><mml:mrow><mml:mrow><mml:msub><mml:mi>s</mml:mi><mml:mrow><mml:mi>q</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:msub></mml:mrow></mml:mrow></mml:msub><mml:mi>E</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:msub><mml:mi>s</mml:mi><mml:mrow><mml:mi>q</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow><mml:mrow><mml:mo>(</mml:mo><mml:mo>&#x22C5;</mml:mo><mml:mo>)</mml:mo></mml:mrow></mml:math></disp-formula>where <inline-formula id="ieqn-4"><mml:math id="mml-ieqn-4"><mml:msub><mml:mi>c</mml:mi><mml:mrow><mml:mi>q</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> Represents the learning rate corresponding to step size, and E (<inline-formula id="ieqn-5"><mml:math id="mml-ieqn-5"><mml:mo>&#x22C5;</mml:mo></mml:math></inline-formula>) characterizes the framework&#x2019;s fitting error.</p>
<p>Initially, a weak framework is trained and aggregated to the ensemble framework. Furthermore, pseudo-residuals (targets of weak learners) are updated considering the ensemble framework&#x2019;s predictions.
</p>
<fig id="fig-13">
<graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_36013-fig-13.tif"/>
</fig>
</sec>
<sec id="s4_3_2"><label>4.3.2</label><title>DT with HPT</title>
<p>DT is an imperative ML scheme involving a tree-like structure, signifying the predictions resulting from a chain of feature-dependent splits. It begins with a root (base) node and terminates with an appropriate decision. For ameliorating the video streaming categorization performance, in this study, the HPT process is executed with DT.</p>
<p>In a DT approach, the entire training set is treated as a root. Here, categorical attribute values are preferred. If the attribute values are found to be continuous, then firstly, they are discretized before constructing the DT framework. Depending on the attribute values, here, the records are recursively distributed. For arranging attributes as the internal node or root, statistical metrics are employed. In the proposed HPT DT approach, attribute selection is achieved using two well-known attribute selection metrics, namely, entropy and the Gini index.</p>
<p>Entropy indicates the measure of a random variable&#x2019;s uncertainty. It mainly describes the impurity of a random set of examples. Information gain is the average of all entropy. If the information gain is higher, then that particular split of DT will be taken. In <xref ref-type="disp-formula" rid="eqn-3">Eq. (3)</xref>, if A represents an attribute, <italic>C</italic> is the set of examples, Value (<inline-formula id="ieqn-6"><mml:math id="mml-ieqn-6"><mml:mi>A</mml:mi></mml:math></inline-formula>) indicates a set of all plausible values of <italic>A</italic>, and <inline-formula id="ieqn-7"><mml:math id="mml-ieqn-7"><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>z</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> indicates the sample after a split, then
<disp-formula id="eqn-3"><label>(3)</label><mml:math id="mml-eqn-3" display="block"><mml:mi>G</mml:mi><mml:mi>a</mml:mi><mml:mi>i</mml:mi><mml:mi>n</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mi>C</mml:mi><mml:mo>,</mml:mo><mml:mi>A</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mrow><mml:mtext mathvariant="italic">Entropy</mml:mtext></mml:mrow><mml:mrow><mml:mo>(</mml:mo><mml:mi>C</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>&#x2212;</mml:mo><mml:msub><mml:mo movablelimits="false">&#x2211;</mml:mo><mml:mrow><mml:mrow><mml:mtext mathvariant="italic">Values</mml:mtext></mml:mrow><mml:mrow><mml:mo>(</mml:mo><mml:mi>A</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:mrow></mml:msub><mml:mfrac><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>z</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo>|</mml:mo><mml:mi>C</mml:mi><mml:mo>|</mml:mo></mml:mrow></mml:mfrac><mml:mo>&#x22C5;</mml:mo><mml:mrow><mml:mtext mathvariant="italic">Entropy</mml:mtext></mml:mrow><mml:mrow><mml:mo>(</mml:mo><mml:msub><mml:mi>C</mml:mi><mml:mrow><mml:mi>z</mml:mi></mml:mrow></mml:msub><mml:mo>)</mml:mo></mml:mrow></mml:math></disp-formula></p>
<p>The Gini index is basically a metric employed for estimating how frequently a randomly selected element would be identified incorrectly. In simpler terms, an attribute possessing a lower Gini value must be considered. In this metric, some arbitrary values are chosen for categorizing every attribute. By <xref ref-type="disp-formula" rid="eqn-4">Eq. (4)</xref> Gini index can be estimated as
<disp-formula id="eqn-4"><label>(4)</label><mml:math id="mml-eqn-4" display="block"><mml:mrow><mml:mtext mathvariant="italic">GiniIndex</mml:mtext></mml:mrow><mml:mo>=</mml:mo><mml:mn>1</mml:mn><mml:mo>&#x2212;</mml:mo><mml:msub><mml:mo movablelimits="false">&#x2211;</mml:mo><mml:mrow><mml:mi>z</mml:mi></mml:mrow></mml:msub><mml:msubsup><mml:mrow><mml:mi>p</mml:mi></mml:mrow><mml:mrow><mml:mi>z</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></disp-formula>where <inline-formula id="ieqn-8"><mml:math id="mml-ieqn-8"><mml:msub><mml:mi>p</mml:mi><mml:mrow><mml:mi>z</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> Indicates the percentage of positive value.</p>
<p>Thus, using entropy and Gini index metrics, attributes are selected. These attributes are then subjected to classification.
</p>
<fig id="fig-14">
<graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_36013-fig-14.tif"/>
</fig>
<p>After receiving the video packet data, as explained in the previous phase, the data is categorized using HPT ensemble and DT schemes. Furthermore, the video streaming categorization performances of these schemes are compared to determine the effectiveness of each classifier.</p>
</sec>
</sec>
<sec id="s4_4"><label>4.4</label><title>Performance Evaluation</title>
<p>The video streaming QoE dataset comprises simulation time, traffic flow, video packets, and packet transfer status. Here, the packet transfer status is treated as a label. The dataset class label in this work is categorized as good, denoted as &#x2018;1&#x2019; and fair, denoted as &#x2018;0&#x2019;. Here, the category &#x2018;good&#x2019; indicates successful video transfer without interference, and the category &#x2018;fair&#x2019; indicates failure in video transfer owing to certain interference.</p>
<p>The confusion matrix values achieved for the EHPT ensemble classifier and HPT DT method are presented below.</p>
<p>Confusion matrix of EHPT ensemble classifier &#x003D; <inline-formula id="ieqn-9"><mml:math id="mml-ieqn-9"><mml:mrow><mml:mo>[</mml:mo><mml:mtable columnalign="left left" rowspacing="4pt" columnspacing="1em"><mml:mtr><mml:mtd><mml:mn>1</mml:mn></mml:mtd><mml:mtd><mml:mn>3</mml:mn></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mn>1</mml:mn></mml:mtd><mml:mtd><mml:mn>49</mml:mn></mml:mtd></mml:mtr></mml:mtable><mml:mo>]</mml:mo></mml:mrow></mml:math></inline-formula></p>
<p>Confusion matrix of HPT DT classifier &#x003D; <inline-formula id="ieqn-10"><mml:math id="mml-ieqn-10"><mml:mrow><mml:mo>[</mml:mo><mml:mtable columnalign="left left" rowspacing="4pt" columnspacing="1em"><mml:mtr><mml:mtd><mml:mn>1</mml:mn></mml:mtd><mml:mtd><mml:mn>5</mml:mn></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mn>2</mml:mn></mml:mtd><mml:mtd><mml:mn>46</mml:mn></mml:mtd></mml:mtr></mml:mtable><mml:mo>]</mml:mo></mml:mrow></mml:math></inline-formula></p>
<p>The confusion matrix plots of the EHPT ensemble and HPT DT classifier are depicted in <xref ref-type="fig" rid="fig-6">Figs. 6</xref> and <xref ref-type="fig" rid="fig-7">7</xref>.</p>
<fig id="fig-6"><label>Figure 6</label><caption><title>EHPT ensemble classifier</title></caption><graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_36013-fig-6.tif"/></fig><fig id="fig-7"><label>Figure 7</label><caption><title>HPT DT classifier</title></caption><graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_36013-fig-7.tif"/></fig>
<p>The performance of the developed EHPT ensemble and HPT DT methods is evaluated using distinct metrics like precision, recall, accuracy, and computation time [<xref ref-type="bibr" rid="ref-34">34</xref>]. These metrics are calculated as follows:
<disp-formula id="eqn-5"><label>(5)</label><mml:math id="mml-eqn-5" display="block"><mml:mrow><mml:mtext mathvariant="italic">Precision</mml:mtext></mml:mrow><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mi>T</mml:mi><mml:mi>P</mml:mi></mml:mrow><mml:mrow><mml:mi>T</mml:mi><mml:mi>P</mml:mi><mml:mo>+</mml:mo><mml:mi>F</mml:mi><mml:mi>P</mml:mi></mml:mrow></mml:mfrac></mml:math></disp-formula>
<disp-formula id="eqn-6"><label>(6)</label><mml:math id="mml-eqn-6" display="block"><mml:mrow><mml:mtext mathvariant="italic">Recall</mml:mtext></mml:mrow><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mi>T</mml:mi><mml:mi>P</mml:mi></mml:mrow><mml:mrow><mml:mi>T</mml:mi><mml:mi>P</mml:mi><mml:mo>+</mml:mo><mml:mi>F</mml:mi><mml:mi>N</mml:mi></mml:mrow></mml:mfrac></mml:math></disp-formula>
<disp-formula id="eqn-7"><label>(7)</label><mml:math id="mml-eqn-7" display="block"><mml:mrow><mml:mtext mathvariant="italic">Accuracy</mml:mtext></mml:mrow><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mi>T</mml:mi><mml:mi>P</mml:mi><mml:mo>+</mml:mo><mml:mi>T</mml:mi><mml:mi>N</mml:mi></mml:mrow><mml:mrow><mml:mi>T</mml:mi><mml:mi>P</mml:mi><mml:mo>+</mml:mo><mml:mi>T</mml:mi><mml:mi>N</mml:mi><mml:mo>+</mml:mo><mml:mi>F</mml:mi><mml:mi>P</mml:mi><mml:mo>+</mml:mo><mml:mi>F</mml:mi><mml:mi>N</mml:mi></mml:mrow></mml:mfrac></mml:math></disp-formula>
<disp-formula id="eqn-8"><label>(8)</label><mml:math id="mml-eqn-8" display="block"><mml:mrow><mml:mtext mathvariant="italic">Computation</mml:mtext></mml:mrow><mml:mtext>&#x00A0;</mml:mtext><mml:mi>t</mml:mi><mml:mi>i</mml:mi><mml:mi>m</mml:mi><mml:mi>e</mml:mi><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mi>T</mml:mi><mml:mi>i</mml:mi><mml:mi>m</mml:mi><mml:mi>e</mml:mi><mml:mtext>&#x00A0;</mml:mtext><mml:mrow><mml:mtext mathvariant="italic">taken</mml:mtext></mml:mrow><mml:mtext>&#x00A0;</mml:mtext><mml:mi>f</mml:mi><mml:mi>o</mml:mi><mml:mi>r</mml:mi><mml:mtext>&#x00A0;</mml:mtext><mml:mrow><mml:mtext mathvariant="italic">computation</mml:mtext></mml:mrow></mml:mrow><mml:mrow><mml:mrow><mml:mtext mathvariant="italic">Total</mml:mtext></mml:mrow><mml:mtext>&#x00A0;</mml:mtext><mml:mi>t</mml:mi><mml:mi>i</mml:mi><mml:mi>m</mml:mi><mml:mi>e</mml:mi></mml:mrow></mml:mfrac></mml:math></disp-formula></p>
<p>TN, TP, FP, and FN represent true negative, true positive, false positive, and false negative, respectively. The TN and TP indicate the number of negative and positive samples which are correctly classified, while FN and FP indicate the number of misclassified negative and positive samples, respectively.</p>
</sec>
</sec>
<sec id="s5"><label>5</label><title>Results and Discussion</title>
<p>Simulations are conducted in this work using the software NS-3-mmwave and Python 2.7. The configuration of the 5G network is portrayed in <xref ref-type="fig" rid="fig-8">Fig. 8</xref>.</p>
<fig id="fig-8"><label>Figure 8</label><caption><title>5G Network configuration in NS-3</title></caption><graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_36013-fig-8.tif"/></fig>
<p>Furthermore, video stream communication data from NS-3 simulation is employed for analysis, and the performance of the enhanced tuning ensemble and DT classifiers is assessed by considering diverse performance measures like precision, accuracy, recall, and computation time. The achieved values and simulation results are presented below in <xref ref-type="table" rid="table-4">Table 4</xref>.</p>
<table-wrap id="table-4"><label>Table 4</label><caption><title>Performance results of tuning ensemble and DT classifier</title></caption>
<table frame="hsides">
<colgroup>
<col align="left"/>
<col align="left"/>
<col align="left"/>
<col align="left"/>
<col align="left"/>
</colgroup>
<thead>
<tr>
<th align="left">Technique</th>
<th align="left">Precision (&#x0025;)</th>
<th align="left">Accuracy (&#x0025;)</th>
<th align="left">Recall (&#x0025;)</th>
<th align="left">Computation time (ms)</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">EHPT ensemble classifier</td>
<td align="left">94.23</td>
<td align="left">92.59</td>
<td align="left">98</td>
<td align="left">0.0088</td>
</tr>
<tr>
<td align="left">HPT DT classifier</td>
<td align="left">85.18</td>
<td align="left">87.037</td>
<td align="left">95.83</td>
<td align="left">1.6388</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>The simulation time (ms) for a 5G video stream (Mbits/s) is depicted, and the UDP packets of video communication are analyzed and displayed in <xref ref-type="fig" rid="fig-9">Fig. 9</xref>. It could be viewed that for 10&#x2005;ms, the video stream exhibits 1000 Mbits/s and for 15&#x2005;ms also, the video stream exhibits 1000 Mbits/s. This is chiefly because the video transfer speed increases, reduce, and remains depending on the network traffic and the number of user access in the network.</p>
<fig id="fig-9"><label>Figure 9</label><caption><title>Simulation time <italic>vs.</italic> video stream</title></caption><graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_36013-fig-9.tif"/></fig>
<p><xref ref-type="fig" rid="fig-10">Fig. 10</xref> depicts the precision achieved by the developed EHPT ensemble and HPT DT classifier for a distinct number of packet flows. In <xref ref-type="fig" rid="fig-10">Fig. 10</xref>, it can be observed that the EHPT ensemble classifier offers a greater precision value of 94.23&#x0025; and the HPT DT classifier provides a precision value of 85.18&#x0025;. Simulation outputs reveal that for greater packet flows, the EHPT ensemble classifier offers a greater precision value than the HPT DT classifier. Thus, it could be viewed from the precision performance evaluation that the EHPT ensemble classifier outperforms the HPT DT classifier regarding precision.</p>
<fig id="fig-10"><label>Figure 10</label><caption><title>Performance of EHPT ensemble and HPT DT with regarding precision</title></caption><graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_36013-fig-10.tif"/></fig>
<p><xref ref-type="fig" rid="fig-11">Fig. 11</xref> depicts the recall value achieved by the developed EHPT ensemble and HPT DT classifier for a distinct number of packet flows. In <xref ref-type="fig" rid="fig-11">Fig. 11</xref>, it can be observed that the EHPT ensemble classifier provides the highest recall value of 98&#x0025; while the HPT DT classifier provides the highest recall value of 95.83&#x0025;. The attained results clarify that for greater packet flows, the EHPT ensemble classifier offers a greater recall value than the HPT DT classifier. Thus, the evaluation of the recall performance of the presented classifiers manifests that the EHPT ensemble classifier outperforms the HPT DT classifier in terms of recall.</p>
<fig id="fig-11"><label>Figure 11</label><caption><title>Performance of EHPT ensemble and HPT DT regarding the recall</title></caption><graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_36013-fig-11.tif"/></fig>
<p><xref ref-type="fig" rid="fig-12">Fig. 12</xref> depicts the accuracy value achieved by the developed EHPT ensemble and HPT DT classifier for a distinct number of packet flows. In <xref ref-type="fig" rid="fig-12">Fig. 12</xref>, it could be observed that the EHPT ensemble classifier provides the highest accuracy value of 92.59&#x0025; while the HPT DT classifier provides the highest accuracy value of 87&#x0025;. Simulation outputs reveal that for greater packet flows, the EHPT ensemble classifier offers a greater accuracy value than the HPT DT classifier. Five simulations ran for each transmission of 20 packets, and the average of various performance values are plotted. The EHPT ensemble classifier outperforms the HPT DT classifier, according to the accuracy performance of the provided classifiers. According to <xref ref-type="fig" rid="fig-10 fig-11 fig-12">Figs. 10&#x2013;12</xref>, the confusion matrix of the video transfer flow during 5G video streaming determines the increase and fall in precision, recall, and accuracy values. From this video transfer research work, the undertaken problem is a good fit for machine learning using ensemble classification. Here, Ensemble classification predicted high accuracy (92.59&#x0025;) compared to Decision Tree classification (87.037&#x0025;).</p>
<fig id="fig-12"><label>Figure 12</label><caption><title>Performance of EHPT ensemble and HPT DT regarding accuracy</title></caption><graphic mimetype="image" mime-subtype="tif" xlink:href="CMC_36013-fig-12.tif"/></fig>
</sec>
<sec id="s6"><label>6</label><title>Conclusions</title>
<p>This work presented an effective framework for QoE-aware video streaming categorization. It exploited video stream communication information from NS-3 simulation for analysis. A 5G network was configured and developed for transmitting video streaming, and then video packets were transferred. The video packet information was then fed to ML classifiers. In this work, enhanced ML classifiers like EHPT ensemble and HPT DT were developed for video streaming categorization. The classification performance of these classifiers was assessed and compared using distinct performance validation metrics. Simulation outputs explicitly confirmed that the implemented EHPT ensemble classifier displayed greater precision, accuracy, and recall scores than the HPT DT classifier. Moreover, the EHPT ensemble classifier exhibited faster computation time than the HPT DT classifier. Thus, the achieved results greatly manifested that the EHPT ensemble classifier greatly outperformed the HPT DT method in video streaming classification. Additionally, the findings of this work substantiated the enhanced ML classifier efficacy regarding QoE-aware video streaming categorization. Future work could involve building datasets based on each time slot&#x2019;s ground truth and the properties of the temporal network layer in order to provide a more reliable machine-learning strategy for addressing anomalies.</p>
</sec>
</body>
<back>
<ack>
<p>The authors would like to acknowledge Vellore Institute of Technology, Chennai, India, for their valuable support.</p>
</ack>
<sec><title>Funding Statement</title>
<p>The authors received no specific funding for this study.</p></sec>
<sec sec-type="COI-statement"><title>Conflicts of Interest</title>
<p>The authors declare that they have no conflicts of interest to report regarding the present study.</p></sec>
<ref-list content-type="authoryear"><title>References</title>
<ref id="ref-1"><label>[1]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>P.</given-names> <surname>Ameigeiras</surname></string-name>, <string-name><given-names>J. J.</given-names> <surname>Ramos-Munoz</surname></string-name>, <string-name><given-names>J</given-names><surname>. Navarro-Ortiz</surname></string-name> and <string-name><given-names>J. M</given-names><surname>. Lopez-Soler</surname></string-name></person-group>, &#x201C;<article-title>Analysis and modelling of YouTube traffic</article-title>,&#x201D; <source>Transactions on Emerging Telecommunications Technologies</source>, vol. <volume>23</volume>, no. <issue>4</issue>, pp. <fpage>360</fpage>&#x2013;<lpage>377</lpage>, <year>2012</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1002/ett.2546">https://doi.org/10.1002/ett.2546</ext-link>.</mixed-citation></ref>
<ref id="ref-2"><label>[2]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>F.</given-names> <surname>Loh</surname></string-name>, <string-name><given-names>F.</given-names> <surname>Poign&#x00E9;e</surname></string-name>, <string-name><given-names>F.</given-names> <surname>Wamser</surname></string-name>, <string-name><given-names>F.</given-names> <surname>Leidinger</surname></string-name> and <string-name><given-names>T.</given-names> <surname>Ho&#x00DF;feld</surname></string-name></person-group>, &#x201C;<article-title>Uplink vs. downlink: Machine learning-based quality prediction for http adaptive Video streaming</article-title>,&#x201D; <source>Sensors</source>, vol. <volume>21</volume>, no. <issue>12</issue>, pp. <fpage>4172</fpage>, <year>2021</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3390/s21124172">https://doi.org/10.3390/s21124172</ext-link>.</mixed-citation></ref>
<ref id="ref-3"><label>[3]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>M.</given-names> <surname>Agiwal</surname></string-name>, <string-name><given-names>A.</given-names> <surname>Roy</surname></string-name> and <string-name><given-names>N.</given-names> <surname>Saxena</surname></string-name></person-group>, &#x201C;<article-title>Next generation 5G wireless networks: A comprehensive survey</article-title>,&#x201D; <source>IEEE Communications Surveys &#x0026; Tutorials</source>, vol. <volume>18</volume>, no. <issue>3</issue>, pp. <fpage>1617</fpage>&#x2013;<lpage>1655</lpage>, <year>2016</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/COMST.2016.2532458">https://doi.org/10.1109/COMST.2016.2532458</ext-link>.</mixed-citation></ref>
<ref id="ref-4"><label>[4]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><given-names>J. A.</given-names> <surname>Adebusola</surname></string-name>, <string-name><given-names>A. A.</given-names> <surname>Ariyo</surname></string-name>, <string-name><given-names>O. A.</given-names> <surname>Elisha</surname></string-name>, <string-name><given-names>A. M.</given-names> <surname>Olubunmi</surname></string-name> and <string-name><given-names>O. O.</given-names> <surname>Julius</surname></string-name></person-group>, &#x201C;<article-title>An overview of 5G technology</article-title>,&#x201D; in <conf-name>2020 Int. Conf. in Mathematics, Computer Engineering and Computer Science (ICMCECS)</conf-name>, <conf-loc>Ayobo, Nigeria</conf-loc>, <publisher-name>IEEE</publisher-name>, pp. <fpage>1</fpage>&#x2013;<lpage>4</lpage>, <year>2020</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/ICMCECS47690.2020.240853">https://doi.org/10.1109/ICMCECS47690.2020.240853</ext-link>.</mixed-citation></ref>
<ref id="ref-5"><label>[5]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><given-names>M.</given-names> <surname>Jarschel</surname></string-name>, <string-name><given-names>D.</given-names> <surname>Schlosser</surname></string-name>, <string-name><given-names>S.</given-names> <surname>Scheuring</surname></string-name> and <string-name><given-names>T.</given-names> <surname>Ho&#x00DF;feld</surname></string-name></person-group>, &#x201C;<article-title>An evaluation of QoE in cloud gaming based on subjective tests</article-title>,&#x201D; in <conf-name>2011 Fifth Int. Conf. on Innovative Mobile and Internet Services in Ubiquitous Computing</conf-name>, <conf-loc>Seoul, Korea (South)</conf-loc>, <publisher-name>IEEE</publisher-name>, pp. <fpage>330</fpage>&#x2013;<lpage>335</lpage>, <year>2011</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/IMIS.2011.92">https://doi.org/10.1109/IMIS.2011.92</ext-link>.</mixed-citation></ref>
<ref id="ref-6"><label>[6]</label><mixed-citation publication-type="web"><person-group person-group-type="author"><collab>5G speed vs 5G range-What is the value of 5G speed, 5G range</collab></person-group>, <year>2019</year> [Online]. Available: <ext-link ext-link-type="uri" xlink:href="https://www.rfwireless-world.com/Terminology/5G-Speed-Vs-5G-Range.html">https://www.rfwireless-world.com/Terminology/5G-Speed-Vs-5G-Range.html</ext-link>.</mixed-citation></ref>
<ref id="ref-7"><label>[7]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><given-names>Z.</given-names> <surname>qasim EL-ezzi</surname></string-name>, <string-name><given-names>A. M.</given-names> <surname>Al-Dulaimi</surname></string-name> and <string-name><given-names>A. A.</given-names> <surname>Ibrahim</surname></string-name></person-group>, &#x201C;<article-title>Personalized quality of experience (QOE) management using data driven architecture in 5G wireless networks</article-title>,&#x201D; in <conf-name>2020 4th Int. Symp. on Multidisciplinary Studies and Innovative Technologies (ISMSIT)</conf-name>, Istanbul, Turkey, IEEE, pp. <fpage>1</fpage>&#x2013;<lpage>10</lpage>, <year>2020</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/ISMSIT50672.2020.9254863">https://doi.org/10.1109/ISMSIT50672.2020.9254863</ext-link>.</mixed-citation></ref>
<ref id="ref-8"><label>[8]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>P.</given-names> <surname>Zhou</surname></string-name>, <string-name><given-names>Y.</given-names> <surname>Xie</surname></string-name>, <string-name><given-names>B.</given-names> <surname>Niu</surname></string-name>, <string-name><given-names>L.</given-names> <surname>Pu</surname></string-name>,  <string-name><given-names>Z.</given-names> <surname>Xu</surname></string-name> <etal>et al.,</etal></person-group> &#x201C;<article-title>QoE-Aware 3D video streaming via deep reinforcement learning in software defined networking enabled mobile edge computing</article-title>,&#x201D; <source>IEEE Transactions on Network Science and Engineering</source>, vol. <volume>8</volume>, no. <issue>1</issue>, pp. <fpage>419</fpage>&#x2013;<lpage>433</lpage>, <year>2020</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/TNSE.2020.3038998">https://doi.org/10.1109/TNSE.2020.3038998</ext-link>.</mixed-citation></ref>
<ref id="ref-9"><label>[9]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>A.</given-names> <surname>Shaout</surname></string-name> and <string-name><given-names>B.</given-names> <surname>Crispin</surname></string-name></person-group>, &#x201C;<article-title>Streaming video classification using machine learning</article-title>,&#x201D; <source>International Journal of Arab Information and Technology</source>, vol. <volume>17</volume>, no. <issue>4A</issue>, pp. <fpage>677</fpage>&#x2013;<lpage>682</lpage>, <year>2020</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.34028/iajit/17/4A/13">https://doi.org/10.34028/iajit/17/4A/13</ext-link>.</mixed-citation></ref>
<ref id="ref-10"><label>[10]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>H. F.</given-names> <surname>Bermudez</surname></string-name>, <string-name><given-names>J. M.</given-names> <surname>Martinez-Caro</surname></string-name>, <string-name><given-names>R.</given-names> <surname>Sanchez-Iborra</surname></string-name>, <string-name><given-names>J. L.</given-names> <surname>Arciniegas</surname></string-name> and <string-name><given-names>M. D.</given-names> <surname>Cano</surname></string-name></person-group>, &#x201C;<article-title>Live video-streaming evaluation using the ITU-T P. 1203 QoE model in LTE networks</article-title>,&#x201D; <source>Computer Networks</source>, vol. <volume>165</volume>, pp. <fpage>106967</fpage>, <year>2019</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.comnet.2019.106967">https://doi.org/10.1016/j.comnet.2019.106967</ext-link>.</mixed-citation></ref>
<ref id="ref-11"><label>[11]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><given-names>R.</given-names> <surname>Ul Mustafa</surname></string-name>, <string-name><given-names>S.</given-names> <surname>Ferlin</surname></string-name>, <string-name><given-names>C.</given-names> <surname>Esteve Rothenberg</surname></string-name>, <string-name><given-names>D.</given-names> <surname>Raca</surname></string-name> and <string-name><given-names>J.</given-names> <surname>Quinlan</surname></string-name></person-group>, &#x201C;<article-title>A supervised machine learning approach for dash video QoE prediction in 5&#x2005;G networks</article-title>,&#x201D; in <conf-name>Proc. of the 16th ACM Symp. on QoS and Security for Wireless and Mobile Networks</conf-name>, Alicante, Spain, pp. <fpage>57</fpage>&#x2013;<lpage>64</lpage>, <year>2020</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1145/3416013.3426458">https://doi.org/10.1145/3416013.3426458</ext-link>.</mixed-citation></ref>
<ref id="ref-12"><label>[12]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>W.</given-names> <surname>Zhou</surname></string-name>, <string-name><given-names>X.</given-names> <surname>Min</surname></string-name>, <string-name><given-names>H.</given-names> <surname>Li</surname></string-name> and <string-name><given-names>Q.</given-names> <surname>Jiang</surname></string-name></person-group>, &#x201C;<article-title>A brief survey on adaptive video streaming quality assessment</article-title>,&#x201D; <source>Journal of Visual Communication and Image Representation</source>, vol. 86, pp. <fpage>103526</fpage>, <year>2022</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.jvcir.2022.103526">https://doi.org/10.1016/j.jvcir.2022.103526</ext-link>.</mixed-citation></ref>
<ref id="ref-13"><label>[13]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>N.</given-names> <surname>Barman</surname></string-name> and <string-name><given-names>M. G.</given-names> <surname>Martini</surname></string-name></person-group>, &#x201C;<article-title>QoE modeling for HTTP adaptive video streaming&#x2013;A survey and open challenges</article-title>,&#x201D; <source>IEEE Access</source>, vol. <volume>7</volume>, pp. <fpage>30831</fpage>&#x2013;<lpage>30859</lpage>, <year>2019</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/ACCESS.2019.2901778">https://doi.org/10.1109/ACCESS.2019.2901778</ext-link>.</mixed-citation></ref>
<ref id="ref-14"><label>[14]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>I.</given-names> <surname>Politis</surname></string-name>, <string-name><given-names>A.</given-names> <surname>Lykourgiotis</surname></string-name> and <string-name><given-names>T.</given-names> <surname>Dagiuklas</surname></string-name></person-group>, &#x201C;<article-title>A framework for QoE-aware 3D video streaming optimization over wireless networks</article-title>,&#x201D; <source>Mobile Information Systems</source>, vol. <volume>2016</volume>, pp. <fpage>1</fpage>&#x2013;<lpage>18</lpage>, <year>2016</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1155/2016/4913216">https://doi.org/10.1155/2016/4913216</ext-link>.</mixed-citation></ref>
<ref id="ref-15"><label>[15]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><given-names>X.</given-names> <surname>Luo</surname></string-name>, <string-name><given-names>O.</given-names> <surname>Ye</surname></string-name> and <string-name><given-names>B.</given-names> <surname>Zhou</surname></string-name></person-group>, &#x201C;<article-title>An modified video stream classification method which fuses three-dimensional convolutional neural network</article-title>,&#x201D; in <conf-name>2019 Int. Conf. on Machine Learning, Big Data and Business Intelligence (MLBDBI)</conf-name>, <conf-loc>Taiyuan, China</conf-loc>, <publisher-name>IEEE</publisher-name>, pp. <fpage>105</fpage>&#x2013;<lpage>108</lpage>, <year>2019</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/MLBDBI48998.2019.00026">https://doi.org/10.1109/MLBDBI48998.2019.00026</ext-link>.</mixed-citation></ref>
<ref id="ref-16"><label>[16]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>I.</given-names> <surname>Orsolic</surname></string-name>, <string-name><given-names>D.</given-names> <surname>Pevec</surname></string-name>, <string-name><given-names>M.</given-names> <surname>Suznjevic</surname></string-name> and <string-name><given-names>L.</given-names> <surname>Skorin-Kapov</surname></string-name></person-group>, &#x201C;<article-title>A machine learning approach to classifying YouTube QoE based on encrypted network traffic</article-title>,&#x201D; <source>Multimedia Tools and Applications</source>, vol. <volume>76</volume>, no. <issue>21</issue>, pp. <fpage>22267</fpage>&#x2013;<lpage>22301</lpage>, <year>2017</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s11042-017-4728-4">https://doi.org/10.1007/s11042-017-4728-4</ext-link>.</mixed-citation></ref>
<ref id="ref-17"><label>[17]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><given-names>M.</given-names> <surname>Shahid Anwar</surname></string-name>, <string-name><given-names>J.</given-names> <surname> Wang</surname></string-name>, <string-name><given-names>S.</given-names> <surname>Ahmad</surname></string-name>, <string-name><given-names>A.</given-names> <surname>Ullah</surname></string-name>, <string-name><given-names>W.</given-names> <surname> Khan</surname></string-name> <etal>et al.,</etal></person-group> &#x201C;<article-title>Evaluating the factors affecting QoE of 360-Degree videos and cybersickness levels predictions in virtual reality</article-title>,&#x201D; <conf-name>Electronics</conf-name>, vol. 9, pp. <fpage>1530</fpage>, <year>2020</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3390/electronics9091530">https://doi.org/10.3390/electronics9091530</ext-link>.</mixed-citation></ref>
<ref id="ref-18"><label>[18]</label><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><given-names>E.</given-names> <surname>Grabs</surname></string-name>, <string-name><given-names>T.</given-names> <surname>Chen</surname></string-name>, <string-name><given-names>E.</given-names> <surname>Petersons</surname></string-name>, <string-name><given-names>D.</given-names> <surname>Efrosinin</surname></string-name>, <string-name><given-names>A.</given-names> <surname>Ipatovs</surname></string-name> <etal>et al.,</etal></person-group> &#x201C;<chapter-title>Features extraction for live Streaming video classification with deep and convolutional neural networks</chapter-title>,&#x201D; in <source>2021 IEEE Microwave Theory and Techniques in Wireless Communications (MTTW)</source>, <publisher-loc>Riga, Latvia</publisher-loc>: <publisher-name>IEEE</publisher-name>, pp. <fpage>58</fpage>&#x2013;<lpage>63</lpage>, <year>2021</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/MTTW53539.2021.9607153">https://doi.org/10.1109/MTTW53539.2021.9607153</ext-link>.</mixed-citation></ref>
<ref id="ref-19"><label>[19]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>L.</given-names> <surname>Pierucci</surname></string-name></person-group>, &#x201C;<article-title>The quality of experience perspective toward 5G technology</article-title>,<italic>&#x201D;</italic> <source>IEEE Wireless Communications</source>, vol. <volume>22</volume>, no. <issue>4</issue>, pp. <fpage>10</fpage>&#x2013;<lpage>16</lpage>, <year>2015</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/MWC.2015.7224722">https://doi.org/10.1109/MWC.2015.7224722</ext-link>.</mixed-citation></ref>
<ref id="ref-20"><label>[20]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><given-names>M.</given-names> <surname>Al Jameel</surname></string-name>, <string-name><given-names>S.</given-names> <surname>Turner</surname></string-name>, <string-name><given-names>T.</given-names> <surname>Kanakis</surname></string-name>, <string-name><given-names>A.</given-names> <surname>Al-Sherbaz</surname></string-name> and <string-name><given-names>W. S.</given-names> <surname>Bhaya</surname></string-name></person-group>, &#x201C;<article-title>Deep learning approach for real-time video streaming traffic classification</article-title>,&#x201D; in <conf-name>2022 Int. Conf. on Computer Science and Software Engineering (CSASE)</conf-name>, Duhok, Iraq, IEEE, pp. <fpage>168</fpage>&#x2013;<lpage>174</lpage>, <year>2022</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/CSASE51777.2022.9759644">https://doi.org/10.1109/CSASE51777.2022.9759644</ext-link>.</mixed-citation></ref>
<ref id="ref-21"><label>[21]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><given-names>V.</given-names> <surname>Menkovski</surname></string-name>, <string-name><given-names>G.</given-names> <surname>Exarchakos</surname></string-name> and <string-name><given-names>A.</given-names> <surname>Liotta</surname></string-name></person-group>, &#x201C;<article-title>Machine learning approach for quality of experience aware networks</article-title>,&#x201D; in <conf-name>2010 Int. Conf. on Intelligent Networking and Collaborative Systems</conf-name>, <conf-loc>Thessaloniki, Greece</conf-loc>, <publisher-name>IEEE</publisher-name>, pp. <fpage>461</fpage>&#x2013;<lpage>466</lpage>, <year>2010</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/INCOS.2010.86">https://doi.org/10.1109/INCOS.2010.86</ext-link>.</mixed-citation></ref>
<ref id="ref-22"><label>[22]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><given-names>M. S.</given-names> <surname>Mushtaq</surname></string-name>, <string-name><given-names>B.</given-names> <surname>Augustin</surname></string-name> and <string-name><given-names>A.</given-names> <surname>Mellouk</surname></string-name></person-group>, &#x201C;<chapter-title>Empirical study based on machine learning approach to assess the QoS/QoE correlation</chapter-title>,&#x201D; in <conf-name>2012 17th European Conf. on Networks and Optical Communications</conf-name>, <conf-loc>Vilanova i la Geltru, Spain</conf-loc>, <publisher-name>IEEE</publisher-name>, pp. <fpage>1</fpage>&#x2013;<lpage>7</lpage>, <year>2012</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/NOC.2012.6249939">https://doi.org/10.1109/NOC.2012.6249939</ext-link>.</mixed-citation></ref>
<ref id="ref-23"><label>[23]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><given-names>M. H.</given-names> <surname>Mazhar</surname></string-name> and <string-name><given-names>Z.</given-names> <surname>Shafiq</surname></string-name></person-group>, &#x201C;<article-title>Real-time video quality of experience monitoring for https and Quic</article-title>,&#x201D; in <conf-name>IEEE INFOCOM 2018-IEEE Conf. on Computer Communications</conf-name>, Honolulu, HI, USA, IEEE, pp. <fpage>1331</fpage>&#x2013;<lpage>1339</lpage>, <year>2018</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/INFOCOM.2018.8486321">https://doi.org/10.1109/INFOCOM.2018.8486321</ext-link>.</mixed-citation></ref>
<ref id="ref-24"><label>[24]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><given-names>R. U.</given-names> <surname>Mustafa</surname></string-name>, <string-name><given-names>D.</given-names> <surname>Moura</surname></string-name> and <string-name><given-names>C. E.</given-names> <surname>Rothenberg</surname></string-name></person-group>, &#x201C;<article-title>Machine learning approach to estimate video QoE of encrypted dash traffic in 5&#x2005;G networks</article-title>,&#x201D; in <conf-name>2021 IEEE Statistical Signal Processing Workshop (SSP)</conf-name>, Rio de Janeiro, Brazil, IEEE, pp. <fpage>586</fpage>&#x2013;<lpage>589</lpage>, <year>2021</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/SSP49050.2021.9513804">https://doi.org/10.1109/SSP49050.2021.9513804</ext-link>.</mixed-citation></ref>
<ref id="ref-25"><label>[25]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><given-names>R. U.</given-names> <surname>Mustafa</surname></string-name>, <string-name><given-names>M. T.</given-names> <surname>Islam</surname></string-name>, <string-name><given-names>C.</given-names> <surname>Rothenberg</surname></string-name>, <string-name><given-names>S.</given-names> <surname>Ferlin</surname></string-name>, <string-name><given-names>D.</given-names> <surname>Raca</surname></string-name> <etal>et al.,</etal></person-group> &#x201C;<article-title>A supervised machine learning approach for dash video QoE prediction in 5&#x2005;G networks</article-title>,&#x201D; in <conf-name>Proc. of the 16th ACM Symp. on QoS and Security for Wireless and Mobile Networks</conf-name>, <conf-loc>New York, NY, United States</conf-loc>, pp. <fpage>57</fpage>&#x2013;<lpage>64</lpage>, <year>2020</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1145/3416013.3426458">https://doi.org/10.1145/3416013.3426458</ext-link>.</mixed-citation></ref>
<ref id="ref-26"><label>[26]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><given-names>R.</given-names> <surname>Shalala</surname></string-name>, <string-name><given-names>R.</given-names> <surname>Dubin</surname></string-name>, <string-name><given-names>O.</given-names> <surname>Hadar</surname></string-name> and <string-name><given-names>A.</given-names> <surname>Dvir</surname></string-name></person-group>, &#x201C;<article-title>Video QoE prediction based on user profile</article-title>,&#x201D; in <conf-name>2018 Int. Conf. on Computing, Networking and Communications (ICNC)</conf-name>, <conf-loc>Maui, HI, USA</conf-loc>, <publisher-name>IEEE</publisher-name>, pp. <fpage>588</fpage>&#x2013;<lpage>592</lpage>, <year>2018</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/ICCNC.2018.8390347">https://doi.org/10.1109/ICCNC.2018.8390347</ext-link>.</mixed-citation></ref>
<ref id="ref-27"><label>[27]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>L.</given-names> <surname>Liu</surname></string-name>, <string-name><given-names>H.</given-names> <surname>Hu</surname></string-name>, <string-name><given-names>Y.</given-names> <surname>Luo</surname></string-name> and <string-name><given-names>Y.</given-names> <surname>Wen</surname></string-name></person-group>, &#x201C;<article-title>When wireless video streaming meets AI: A deep learning approach</article-title>,&#x201D; <source>IEEE Wireless Communications</source>, vol. <volume>27</volume>, no. <issue>2</issue>, pp. <fpage>127</fpage>&#x2013;<lpage>133</lpage>, <year>2019</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/MWC.001.1900220">https://doi.org/10.1109/MWC.001.1900220</ext-link>.</mixed-citation></ref>
<ref id="ref-28"><label>[28]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><given-names>L.</given-names> <surname>Qian</surname></string-name>, <string-name><given-names>H.</given-names> <surname>Chen</surname></string-name> and <string-name><given-names>L.</given-names> <surname>Xie</surname></string-name></person-group>, &#x201C;<article-title>SVM-Based QoE estimation model for video streaming service over wireless networks</article-title>,&#x201D; in <conf-name>2015 Int. Conf. on Wireless Communications &#x0026; Signal Processing (WCSP)</conf-name>, <conf-loc>Nanjing, China</conf-loc>, <publisher-name>IEEE</publisher-name>, pp. <fpage>1</fpage>&#x2013;<lpage>6</lpage>, <year>2015</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/WCSP.2015.7341066">https://doi.org/10.1109/WCSP.2015.7341066</ext-link>.</mixed-citation></ref>
<ref id="ref-29"><label>[29]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>A.</given-names> <surname>Hameed</surname></string-name>, <string-name><given-names>R.</given-names> <surname>Dai</surname></string-name> and <string-name><given-names>B.</given-names> <surname>Balas</surname></string-name></person-group>, &#x201C;<article-title>A decision-tree-based perceptual video quality prediction model and its application in FEC for wireless multimedia communications</article-title>,&#x201D; <source>IEEE Transactions on Multimedia</source>, vol. <volume>18</volume>, no. <issue>4</issue>, pp. <fpage>764</fpage>&#x2013;<lpage>774</lpage>, <year>2016</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/TMM.2016.2525862">https://doi.org/10.1109/TMM.2016.2525862</ext-link>.</mixed-citation></ref>
<ref id="ref-30"><label>[30]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><given-names>Y. B.</given-names> <surname>Youssef</surname></string-name>, <string-name><given-names>M.</given-names> <surname>Afif</surname></string-name>, <string-name><given-names>R.</given-names> <surname>Ksantini</surname></string-name> and <string-name><given-names>S.</given-names> <surname>Tabbane</surname></string-name></person-group>, &#x201C;<article-title>A novel online QoE prediction model based on multiclass incremental support vector machine</article-title>,&#x201D; in <conf-name>2018 IEEE 32nd Int. Conf. on Advanced Information Networking and Applications (AINA)</conf-name>, Krakow, Poland, IEEE, pp. <fpage>334</fpage>&#x2013;<lpage>341</lpage>, <year>2018</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/AINA.2018.00058">https://doi.org/10.1109/AINA.2018.00058</ext-link>.</mixed-citation></ref>
<ref id="ref-31"><label>[31]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><given-names>D.</given-names> <surname>Minovski</surname></string-name>, <string-name><given-names>C.</given-names> <surname>&#x00C5;hlund</surname></string-name>, <string-name><given-names>K.</given-names> <surname>Mitra</surname></string-name> and <string-name><given-names>P.</given-names> <surname>Johansson</surname></string-name></person-group>, &#x201C;<article-title>Analysis and estimation of video QoE in wireless cellular networks using machine learning</article-title>,&#x201D; in <conf-name>2019 Eleventh Int. Conf. on Quality of Multimedia Experience (QoMEX)</conf-name>, <conf-loc>Berlin, Germany</conf-loc>, <publisher-name>IEEE</publisher-name>, pp. <fpage>1</fpage>&#x2013;<lpage>6</lpage>, <year>2019</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/QoMEX.2019.8743281">https://doi.org/10.1109/QoMEX.2019.8743281</ext-link>.</mixed-citation></ref>
<ref id="ref-32"><label>[32]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>M. S.</given-names> <surname>Anwar</surname></string-name>, <string-name><given-names>J.</given-names> <surname>Wang</surname></string-name>, <string-name><given-names>S.</given-names> <surname>Ahmad</surname></string-name>, <string-name><given-names>W.</given-names> <surname>Khan</surname></string-name>, <string-name><given-names>A.</given-names> <surname>Ullah</surname></string-name> <etal>et al.,</etal></person-group> &#x201C;<article-title>Impact of the impairment in 360-degree videos on users VR involvement and machine learning-based QoE predictions</article-title>,&#x201D; <source>IEEE Access</source>, pp. <fpage>204585</fpage>&#x2013;<lpage>204596</lpage>, <year>2020</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/ACCESS.2020.3037253">https://doi.org/10.1109/ACCESS.2020.3037253</ext-link>.</mixed-citation></ref>
<ref id="ref-33"><label>[33]</label><mixed-citation publication-type="web"><person-group person-group-type="author"><collab>CISCO Visual Networking Index, Global Mobile Data Traffic Forecast Update, 20172022 White Paper. Tech. rep.. CISCO</collab></person-group>, <year>2019</year>. [Online]. Available: <ext-link ext-link-type="uri" xlink:href="http://media.mediapost.com/uploads/CiscoForecast.pdf">http://media.mediapost.com/uploads/CiscoForecast.pdf</ext-link>.</mixed-citation></ref>
<ref id="ref-34"><label>[34]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><given-names>S. K.</given-names> <surname>Ray</surname></string-name> and <string-name><given-names>S.</given-names> <surname>Susan</surname></string-name></person-group>, &#x201C;<article-title>Performance evaluation using online machine learning packages for streaming data</article-title>,&#x201D; in <conf-name>2022 Int. Conf. on Computer Communication and Informatics (ICCCI)</conf-name>, <conf-loc>Coimbatore, India</conf-loc>, pp. <fpage>1</fpage>&#x2013;<lpage>6</lpage>, <year>2022</year>. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/ICCCI54379.2022.9741068">https://doi.org/10.1109/ICCCI54379.2022.9741068</ext-link>.</mixed-citation></ref>
</ref-list>
</back>
</article>