key: cord-0844715-aoygufhf authors: Teixeira, Márcio J.; Timóteo, Varese S. title: A Predictive Resource Allocation for Wireless Communications Systems date: 2021-09-27 journal: SN Comput Sci DOI: 10.1007/s42979-021-00854-8 sha: 0c924a2ada3b34613f17c4dd328f400d2c0cfc89 doc_id: 844715 cord_uid: aoygufhf Using event-driven computer simulations, we test a predictive resource allocation scheme for broadband wireless communications systems based on the Kalman Filter. We implemented the filter in six different scheduling algorithms and selected the best performing of them (EXP Rule and FLS) for a detailed analysis. We considered several simulation scenarios with velocities ranging from 0 to 350 km/h representing pedestrian, vehicular and high-speed train scenarios. We also considered different traffic profiles by changing the number of mobile devices between 10 and 250. Our simulations showed improvement in throughput, spectral efficiency, and a decrease in packet loss rates for two schedulers: the EXP Rule and the Frame Level Scheduler. Our predictor can be applied to any wireless system that performs centralized resource allocation based on data rate or any other quantity that needs to be estimated for resource distribution in a network. Mobile communication systems changed dramatically the traffic paradigm since their appearance in the late 1970s both in volume and profile. With 2G systems traffic was circuitswitched and network planning based on the availability of voice channels. For this reason, design was focused on the blocking probability of the voice channels because data demand was very incipient. The change to 3G systems introduced dedicated traffic channels for data sessions and the dimensioning process required to take the data traffic profile into account. The arrival of 3.5G made for the first time possible to users have mobile applications with an acceptable Quality of Service (QoS) and this feature increased the usage of video, Voice over IP (VoIP), and other multimedia services through cellular network together with the massive adoption of social media in the decade of 2010. Available bandwidth in mobile networks, which was already a problem for data transmissions, became critical with most of the subscribers requesting more radio resources for their video and data applications. Ericsson mobility report forecasts that the 4G long-term evolution (LTE) networks will remain the most used access technology until 2026 after reaching a peak of 4.5 billion subscribers in 2021 while 5G is expected to approach 3.5 billion users mostly in early adopters such as North America and Western Europe. This will increase mobile traffic from the current 51 EB/month to 226 EB/month. Around 97 % of this volume will come from smartphones carrying an average of 34 GB/ month (nowadays this traffic is close to 9.5 GB/month) [1] . The Covid-19 pandemics shifted the traffic locations from offices and public places to homes and this change was driven mostly by virtual working environments, usage of applications for food and goods delivery, and entertainment (e.g. streaming and gaming). Optimization of network resources is critical to ensure QoS and, regardless of the access technology, spectrum will always be a limited and disputed resource. Therefore, efficient schedulers performing In cellular networks, media access control (MAC) layer is responsible for RA and scheduling is performed at Evolved NodeB (eNodeB) in LTE and at Next Generation Node B (gNB) in 5G networks. Depending on objective and network constraints schedulers may engage at every transmission time interval (TTI) or multiples of these intervals. Frequent triggering of the scheduling algorithm has a two-fold effect: on one side it allows a better distribution of network resources at the cost of extra signaling between the radio access nodes [4] . One of the goals of an efficient scheduler is to maximize aggregated network throughput and spectrum efficiency. To maintain quality in video calls and transmissions packet loss ratio (PLR) should also be kept low. For delay-sensitive applications, it is expected that it can handle User Equipment (UE) requests and remain within the maximum delay allowed by applications. Fairness is also an important feature and, in general, these goals are not achieved simultaneously and one must make a few compromises when designing a new scheduler. There are various solutions in literature with different approaches and results. Below we list a few of them. In [5] authors explained that increased throughput does not necessarily mean quality as it also increases the average PLR. They proposed a cross-layer design for the scheduler combining information on throughput, application QoS and fairness that dynamically allocate resources and optimize system parameters such as modulation and coding scheme (MCS) adapting channel quality at each resource block. Following this cross-layer paradigm, the work of [6] blended objective measurements with a mean opinion score experience of users providing a scheduler whose performance is also tied to quality of experience (QoE). Separating real-time from non-real-time traffic aiming to balance data delivery is also a common strategy for RA as exemplified in [7] where authors proposed a change in the maximumlargest weighted delay first (M-LWDF) scheduler. Solving a minimization or a maximization problem (e.g. get the maximum rate per user) is another common approach to design schedulers. However, some of them are NP-hard problems and can only be solved by heuristic methods [8, 9] . All the works exemplified above use the non-predictive approach meaning that there is no dynamic scheme to change predefined parameters in schedulers. Conversely, predictive schedulers forecast values of a given measured quantity or a performance indicator to maximize the allocation of resources. The work of [10] used neural networks consisting of long-short term memory (LSTM) using Keras and TensorFlow as back-end and predicted traffic patterns for one week with good accuracy. An interesting possibility, in this case applied to machineto-machine (M2M) communications, appeared in [11] where they used the concept of directed information (DI) to calculate the correlation between four devices to predict traffic based on entropy and mutual information. The work of [12] proposed a guided search algorithm as an alternative lowcomplexity solution. The solution of this guided search is highly dependent on the variance of signal measurements over time: a super estimated variance can allocate excessive airtime to users while underestimated variance would sub allocate resources. These authors used the Kalman Filter (KF) to predict these variances and adaptively configure the guided search algorithm to optimal values. Their results were verified with an open-source simulator and a commercial optimization solver and they reported that the proposed solution runs in less than one millisecond but this study is restricted for a maximum of 12 users moving at 60 km/h. The contribution of our work is to use a simple, real-time predictor based in the Kalman Filter that improves throughput and spectrum efficiency and reduces packet loss. This approach does not rely on historical data or training of neural networks; it predicts the rate R every TTI instead of using a blind equal throughput formula, Eq. (12) . When we increase the number of users disputing network resources the filter effect is more noticeable as we will show in following sections. The drawback is that the predictor compromise fairness of resource distribution among users. This work is organized as follows: In Sect. 2 we briefly describe the Kalman filter (2.1), the RA process in mobile systems (2.2), six selected schedulers and their metrics (2.3) and finally how we use the filter to improve these metrics (2.4) . Section 3 compares the values of throughput, packet loss rates and delay with and without the predictor when we increase the number of users and velocity of mobiles. Then we selected the best performing schedulers in this test (the FLS and EXP Rule) and proceeded to extended simulations (Sect. 4) where the number of users (and consequently the network traffic) was extended to 250 mobiles. We studied the effect of the predictor in throughput (4.1), packet loss (4.2) and added to our study spectral efficiency (4.3) and fairness index (4.4). Finally, Sect. 5 discusses results and outlines future extensions of this work. As it is well-known the KF [13] has two steps: prediction and correction. For given initial estimates of x k−1 and P k−1 , the prediction steps calculate the values of x − k and P − k the projected error covariance (see for example [14] ) : with A as a matrix that relates the state at the previous time step k − 1 to the state at the current step. The superscript minus sign mean that it is a a priori value of given state x and the circumflex that it is an estimated quantity. So is x − k the a priori estimate of state x. The correction step is given by the following equations: where represents the identity matrix. During the cycle of prediction and correction, we calculate the Kalman gain K k using the new estimates for x k and P k . At the end of the loop k is incremented by 1, the values of x − k and P − k are updated and the cycle restarts. Similarly to A, the matrix H will relate the state of the system X to the measurement z by the relation z k = Hx k + R . The quantities Q and R are the process and measurement noise covariance respectively that may or may not change at every step of the simulation [14] . The resource scheduler is the logical entity in the eNodeB or gNB that assigns for a given user enough bandwidth in downlink and uplink to match QoS requirements of their applications. With distinct requirements on jitter, throughput, delay and packet loss, the role of the scheduler is to maintain the guaranteed QoS of applications regardless of the uncertainties of radio environment [15] . LTE uses the orthogonal frequency division multiple access (OFDMA) as modulation technique meaning that a UE has resources assigned both in the time domain (symbols) as well as in frequency domain (sub-carriers). One LTE frame is composed of ten subframes of 1 ms each that are subdivided into time slots of 0.5 ms. Together these subframes in the time domain and 12 subcarriers of 15 kHz (180 kHz) in the frequency domain build a Resource Block (RB), the smallest resource unit assigned to a user within an LTE frame. Resource scheduler will allocate the RBs based on UEs requests and the number of available blocks will depend on the bandwidth assigned to LTE. For 1.5 MHz only six RB are assignable, for 5 MHz there will be 25 RBs going up to 100 RBs when operator has 20 MHz of available spectrum [16] . Every application session started in the network is called a flow and the goal of the scheduler is to give the right amount of RBs to users to maintain the QoS of their flows. The output of the scheduler algorithm is a number m i,j called metric. So, given a flow i with a given RB j, the metric is the priority that a scheduler will allocate the RB j for a flow i, that is, the bigger the metrics the stronger the priority of allocation to a RB [2] . To have an efficient scheduler handling real time traffic a few basic requirements must be fulfilled. The first is computational simplicity specially if they work within the time window of one TTI, i.e.,1 ms. As the usage of networks increase scalability is important because calculations will raise by a factor of N × M per TTI [2] with N representing the number of users and M the available RBs. Finally, it is desirable to distribute RBs equally among users, that is, fairness. Achieving these goals simultaneously may not be an easy task. There is no requirement in 3GPP standards for a specific type of scheduler so we can, in principle, pick anyone. We ruled out the popular Round Robin scheduler because its performance gets worse in mobile environments compared to the Proportional Fair (PF) as shown in [17] . Therefore, we selected six schedulers that make use of channel aware strategies aiming to maximize throughput by measurements of the quality perceived by users. Except for the simplest of them, the Proportional Fair, all make use of QoS aware strategies that are based on maximum delay and allowed packet loss. Some schedulers require a predefined maximum allowed packet loss per user. When this is the case, we set i = 1%. This scheduler favors the users with smaller data rates in past periods. The proportional fair scheduler metric i,j is proportional to the inverse of past data rates and is defined by: where R i (t − 1) is the estimate of the i-th flow in previous TTI and d i j (t) is the data rate of i-th flow at the j-th RB. This scheduler uses a bounded delay, i.e., it will differentiate the real-time versus non-real-time traffic. Treating the former with the PF metric, Eq. (6), and the later by: It considers the Head of Line packet (HOL) delay D HOL,i multiplied by a factor i = − log i ∕ i , being i the acceptable PLR for user i and i the delay threshold for that user. As its name says it combines two parts: an exponential function End-to-End (E2E) delay and the PF metric for non-real-time flows. The metrics is given by: where is defined as: and 1∕N rt is the active number of downlink real-time flows. The LOG rule scheduler is very similar to the EXP Rule. It is given by: with a = 5∕ i , b = 1 and c = 1.1 according to Ref. [2] . EXP Rule has a similar metric of the one shown in Eq. (8) and it is given by the generic expression: In our simulations we use a i = 6∕ i , b = c = 1 as in Ref. [18] . The term under the square root is the average delay of the HOL. This scheduler was designed to handle real-time multimedia services in LTE networks and has an upper level that analyses the needs of transmission flows at the beginning of each LTE frame. The design of the upper layer was based on control theory and at the lower layer a PF algorithm is chosen to handle the non-real-time flows. Despite its implementation complexity, the scheduler handles well video and multimedia traffic. There is no closed-form for a metric m i,j in this scheduler, and details of its design are explained in [19] . As seen in Sec. 2.3 all schedulers, except the FLS, will make explicit use of the proportional fair metric, Eq. (6), to handle real-time flows. The denominator of i,j is estimated every TTI for each user [2] so that: with k being the time-stamp and = 0.8 as used in ref. [18] . Our contribution is to improve the estimate of R k using a Kalman filter to predict its value instead of the expression in Eq. (12) . With A = H = 1 , we rewrite the Kalman filter equations shown in Sect. 2.1 as shown in Algorithm 1. Being N TTI the number of transmission time intervals and N UE the number of mobile devices in the network, for each user at a given TTI we calculate the factor R i,k using as input the data rate experienced by users at a given time d i,k . Lines 6 and 7 of the algorithm show the implementation of the prediction part of the KF, Eqs. (1) and (2). The correction part, Eqs. (3)-(5) is implemented in lines 8-10. The predicted rate using the KF (line 13) is then used as input to calculate the metrics as defined in Sect. 2.3. As we previously mentioned the scheduler performs N × M operations per TTI and the use of the KF will add the matrix operations listed on Eqs. (1)-(5) that depend only on the rank of matrices used by the filter. In this section, we perform a systematic analysis of the use of Kalman filter to predict R k in the schedulers and compare it with the usual expression for given by Eq. (12) . For this study, we used LTE-Sim [18] a flexible open-source simulator coded in C++ that allows various configurations such as radio propagation models (urban, suburban, and rural), movement pattern (random or fixed direction), number of UEs, number of cells, available bandwidth, effective cell radius among others. When a simulation ends, the output is a list of events with a timestamp, type of traffic, bearer (i.e. application per user), packet size in bytes and delays that are post-processed to get the performance indicators. Simulated scenarios consisted of variations in the number of UEs, mobile velocity, and maximum delay for both selected schedulers. To ensure accuracy, each scenario is simulated 10 times, and the values of performance indicators are averaged. The parameters used for this simulation are shown in Table 1 . Our previous work [20] implemented the KF in the resource allocation routine of LTE-Sim and studied some performance indicators for 6 schedulers (PF, M-LWDF, EXP, FLS, EXP Rule and LOG Rule) and two mobility scenarios: pedestrian with v = 3 km/h and vehicular with v = 120 km/h and 10, 20, 30 and 40 UEs. Data in Fig. 1 use an intermediate value of v = 90 km/h to assess performance of the schedulers with respect to increasing number of UEs. We obtained, as expected, a similar result as our previous study [20] . The throughput increases for FLS and EXP Rule is observed when we introduce the filter, and the effect gets more noticeable as the number of UEs increment in the network. This can be observed by comparing the left (without prediction) and right (with prediction) top panels of Fig. 1 . We also observe a significant decrease in the packet loss rate when we compare the two bottom panels of Fig. 1 , which display the results with (right) and without (left) the KF based predictor. From Fig. 2 we see that both throughput and PLR have a relatively small variation with the change in velocity, which validates our choice of Sect. 3.1 to use v = 90 km/h . We see similarities with Fig. 1 when we apply the KF, i.e., performance of FLS and EXP Rule improve significantly compared to other schedulers. Best results happen for the EXP Rule that shows an improvement of about two times in throughput (see green lines in the top panels of Fig. 2 ) and a reduction from ∼ 12 to ∼ 4% in the packet loss rate (see green lines in the bottom panels of Fig. 2 ). This shows that the performance of the EXP Rule scheduler with the predictor approaches the performance of the FLS scheduler which is particularly designed for handling real-time multimedia traffic [19] . The improvement of more than 35 % in throughput for M-LWDF although significant in relative numbers is no match for the absolute values achieved by FLS or the EXP Rule schedulers. The same applies to other schedulers that do not benefit from KF sometimes even having its performance degraded, for example the PF. Some schedulers such as the EXP and LOG rule take the maximum allowed application delay in their metrics as we mentioned in Sect. 2.3. This is important because some applications have strict requirements on maximum permitted delay. In this paper, we used two different values for the target delay: 0.04 s and 0.1 s. The simulated measurements of delay when we introduce the KF schedulers are compiled in Fig. 3 . First thing to notice is that PF scheduler fails to remain within required delay. (note that we scaled down the values by a factor of 10 for better visualization). This is expected because the simplicity of the PF metric is not suited for handling real or near real-time flows. For remaining schedulers, addition of filter does not help to reduce delay. As all of them remain in the region well below the target delay we can say that these schedulers are "delay neutral" with respect to the use of the predictor. Before proceeding, we summarize our findings on the use of the Kalman filter to predict R k : Like in the previous section, we simulate various network configurations to verify the impact of a prediction model in the performance of the resource allocation schedulers. Simulated scenarios consisted of variations in the number of UEs, mobile velocity, and maximum delay for both selected schedulers as we explained in Sect. 3. To test the accuracy of the results we repeated the same scenario 10 times resulting in 7680 output files for each case, that is, with or without the KF predictor. Simulations took from a few minutes (up to 40 UEs) to 30 h (for the maximum 250 UEs simulated) showing that the number of users is the major computational bottleneck. To optimize simulation time, we distributed the executions among 24 processors in Table 2 summarizes the parameters used in our simulations and the values for each studied scenario. As the number of schedulers is now limited to two, we increased the simulation time to six thousand TTI to collect more samples and keep simulation within a reasonable running time. The choice of bandwidth (and consequently resource blocks) is to reach cell throughput saturation with increased number of users. Other parameters are selected to emulate real world scenarios and replicate mobility and traffic patterns as accurate as possible. As an extreme example consider a cell with 50 m radius. That would not simulate vehicular traffic because the cars would enter and leave cell many times and there would be more signaling than traffic itself. In other hand a cell with coverage of thousands of meters the UEs situated close to the cell boundaries would show a low Channel Quality Information (CQI) and therefore have the RBs allocation requests queued by eNodeB. Simulation results are displayed using contour plots so that we can observe the variation with both velocity and number of users simultaneously. The x-axis represents the velocities and the y-axis the number of UEs. Performance indicators are then scaled by colors in a rainbow scale, i.e., the lower values are shown in purple/blue while the upper values are displayed in orange/red. These plots provide a macro view of the filter effect in the FLS and EXP Rule schedulers. To help visualization and discussion of results for each contour plot we also show horizontal and vertical crosssections for a fixed number of UEs ( N UE = 60 ) velocity ( v = 90 km/h ) respectively. Figure 4 shows the effect of KF on cell throughput. When we compare the left panels with the right panels it is evident the benefits of including the filter notably for the FLS. The EXP Rule scheduler, although not achieving data rates as high as the FLS, also shows significant improvement. The left panel of Fig. 5 shows clearly the improvement in the EXP Rule schedule. For the region until 60 UEs the FLS Figure 6 shows simulated measurements of PLR and the effect of the filter. We can readily see the overall improvement as the orange-reddish colors representing high PLR in left panels (no predictor) are flushed away in right panels (with predictor). Once more both schedulers benefit from the introduction of KF predictor. In particular, the FLS benefits from filter when the number of UEs is greater than 30 suggesting that the scheduler is pre-optimized for a maximum of users/traffic (see left pane of Fig. 7) . When the number of users increase the FLS shows effects of filter diminishing the packet loss rate (red solid line). In its original version, the EXP Rule scheduler drops more packets than FLS during all simulation without predictor (dashed blue line) but when the filter is applied these rates get closer to those from FLS (blue solid line). Right panel of Fig. 7 shows this relative improvement for the EXP rule scheduler and how their performance is similar with the KF. So, choosing a general propose and relatively simple scheduler such as EXP Rule consistently reduces overall packet losses in the system with the aid of the KF predictor running TTI level without the need of complex algorithms. The quantity spectral efficiency (SE) is a measure of how much data a system can transmit with given bandwidth and its unit is bps∕Hz . In our simulations, we calculated the cell spectral efficiency dividing the total throughput by the simulation time and the available bandwidth which is in our case 5 MHz. In Fig. 8 comparing left with right panels we see again that predictor improve SE for both schedulers. Before the predictor spectral efficiency was around 0.38 bps∕Hz and after prediction, we see values close to 0.6 bps∕Hz . Left pane of Fig. 9 shows that both schedulers have similar SE values as we increased the number of users in simulation with and without the KF predictor as seen comparing dashed with solid lines. The right pane of same figure Jain's Fairness Index [21] is a quantity representing how equally the resources are allocated among all users in the network and it is given by: where x i represents the resource consumed by user i. If the network resources have been equally shared, FI = 1 . However, if the resources are concentrated in a few users, then FI → 1∕N . In Fig. 10 we show the calculated fairness index before and after the introduction of the KF. The first thing to note is that the horizontal patterns seen in previous measurements disappear. The right panel of Fig. 11 shows the sensitivity of Fairness Index (FI) velocity differently from what we observed in previous quantities. Recalling that we are simulating a single cell with interference, a possible explanation for the dependence on velocities could be that at higher speeds the UEs use cell resources for less time and the schedulers have more spectrum availability. We can also see that the addition of KF degrades by a factor of two the FI meaning that resources are more concentrated among a few users. As the number of users increase, we see that FI quickly decreases (Fig. 11, left pane) showing that all improvements were achieved at the expense of concentrating resources. Before reviewing our results, it is important to discuss why the Kalman filter improved the schedulers performance. It is known that the Kalman filter works better when the system exhibits memory which, in principle, is not the case of scheduling in radio access networks. However, in practice, few allocation types occur for multimedia calls (VoIP, Audio, Video) and in the end, the system behaves as it had some memory. In this paper, we propose the use of KF to predict the average data rates used by the schedulers algorithm to improve their performance. According to our simulations, the inclusion of the Kalman predictor increases both the throughput and spectral efficiency and reduces the packet loss rate at the cost of fairness in resource allocation. We also concluded that the best schedulers, when competition for resources increase, are the EXP Rule and the FLS (as explained at the end of Sect. 4). It is important to reinforce that the predictive model implemented here in LTE schedulers can be applied to any other system with a centralized resource allocation scheme and therefore can be extended to vehicular, Internet of Things (IoT), 5G networks, and other wideband wireless systems. A possible reason for the good performance of the EXP Rule is given as follows: examining the M-LWDF and the EXP/PF schedulers we deduce that the i term is overriding the effect of the predictor. This term is the logarithm of the acceptable packet loss − i divided by the delay threshold i for user i. So, the users having less tolerance to delays and requiring low packet loss rates will receive more resources. Comparing with the LOG rule scheduler, the EXP performs better because its metric increases faster than LOG Rule for a given HOL. Also, the denominator of EXP rule normalizes the delay of user i with the delays of all users in the network making it a more robust solution compared with LOG Rule [2] . The FLS scheduler also presents good results and this is mostly because it runs on two levels: the low level meaning it acts on TTI and frame level, i.e., working on ten TTIs. This scheduler was designed for real-time video applications and uses as main inputs the queue size and maximum delay for application [2, 19] . Here, we show that the FLS performs well under most cases studied and predictor also improves its performance. Nevertheless, when we use the KF predictor both schedulers have similar performances. In other words, applying our predictor to a scheduler that uses a simple metric (EXP Rule) matches the performance of a specialized and comparably complex scheduler (FLS). The use of our predictor is delay neutral meaning that the schedulers comply with maximum delay required for application, except for the PF. Fairness in other hand is degraded so some users will show consistently higher throughput that others. A recent work used a fuzzy-logic based packet scheduler which goal is to achieve maximum fairness for a given pool of resources [22] . It would be interesting to check if this approach can equate resources among users without compromising the other performance indicators. Applying the KF predictor in controlled, test-bed environment can demonstrate the validity of our approach and the real impact on the network processing capacity because the computer will no longer calculate mobility, fading, and other physical aspects of the mobile environment. We also consider the introduction of other predictive or machine learning methods if it shows benefits to the system and is sufficiently simple to run on a TTI base. Finally, we plan to use the Kalman-Takens filter as predictor [23] . With this approach the KF does not require any state model a priori. Using this filter we expect to break the limitations of a fixed state model used for dynamic radio signals therefore expecting to have a more flexible, accurate, and efficient predictor. The authors declare no conflicting/competing interests. Code availability Code used is available at: https:// github. com/ mteix/ LTESim/ tree/ Kalma nFilt er. Ericsson mobility report Downlink packet scheduling in LTE cellular networks: key design issues and a survey Uplink scheduling in LTE and LTE-advanced: tutorial, survey and evaluation framework A survey on inter-cell interference coordination techniques in OFDMA-based cellular networks Quality-driven cross-layer optimized video delivery over LTE QoE oriented cross-layer design of a resource allocation algorithm in beyond 3G systems 24th International symposium on personal, indoor and mobile radio communications (PIMRC) Distributed and autonomous resource and power allocation for wireless networks A low-complexity resource allocation algorithm for multicast service delivery in OFDMA networks 29th IEEE annual international symposium on personal, indoor and mobile radio communications (PIMRC) A directed information learning framework for event-driven M2M traffic prediction Joint chance-constrained predictive resource allocation for energyefficient video streaming A new approach to linear filtering and prediction problems An introduction to the Kalman filter Heterogeneous networks in LTEadvanced Wireless networks: design and integration for LTE. EVDO: HSPA, and WiMAX Performance evaluation of Round Robin and Proportional Fair scheduling algorithms for constant bit rate traffic in LTE Simulating LTE cellular systems: an open-source framework Two-level downlink scheduling for real-time multimedia services in LTE networks 15th International wireless communications and mobile computing conference (IWCMC) Eastern research laboratory. Hudson: Digital Equipment Corporation Telecommunication systems Ensemble Kalman filtering without a model Publisher's Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations