Location-Aware Sleep Strategy for Energy-Delay Tradeoffs in 5G with Reinforcement Learning

Ali El Amine 1, 2 Hussein Al Haj Hassan 3 Mauricio Iturralde 4 Loutfi Nuaymi 1, 2
1 IMT Atlantique - SRCD - Département Systèmes Réseaux, Cybersécurité et Droit du numérique
2 ADOPNET - Advanced technologies for operated networks
UR1 - Université de Rennes 1, IMT Atlantique - IMT Atlantique Bretagne-Pays de la Loire, IRISA-D2 - RÉSEAUX, TÉLÉCOMMUNICATION ET SERVICES
3 AUST (American University of Sciences and Technology)
4 IMT Atlantique - IMT Atlantique Bretagne-Pays de la Loire
Abstract : In this paper, we propose a sleep strategy for energy-efficient 5G Base Stations (BSs) with multiple Sleep Mode (SM) levels to bring down energy consumption. Such management of energy savings is coupled with managing the Quality of Service (QoS) resulting from waking up sleeping BSs. As a result, a tradeoff exists between energy savings and delay. Unlike prior work that studies this problem for binary state BS (ON and OFF), this work focuses on multi-level SM environment, where the BS can switch to several SM levels. We propose a Q-Learning algorithm that controls the state of the BS depending on the geographical location and moving velocity of neighboring users in order to learn the best policy that maximizes the tradeoff between energy savings and delay. We evaluate the performance of our proposed algorithm with an online suboptimal algorithm that we introduce as well. Results show that the Q-Learning algorithm performs better with energy savings up to 92% as well as better delay performance than the heuristic scheme.
Keywords : Energy consumption service delay 5G sleep modes LTE positioning Q-learning
Document type :
Conference papers
Complete list of metadatas

Cited literature [23 references]  Display  Hide  Download
https://hal-imt-atlantique.archives-ouvertes.fr/hal-02168390
Contributor : Ali El Amine <>
Submitted on : Friday, June 28, 2019 - 4:05:08 PM
Last modification on : Friday, September 13, 2019 - 9:50:55 AM

File

Location-Aware Sleep Strategy ...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02168390, version 1

Collections

IMT-ATLANTIQUE | UNIV-RENNES1 | CNRS | CENTRALESUPELEC | IRISA | INRIA | UNIV-RENNES | UR1-UFR-ISTIC

Citation

Ali El Amine, Hussein Al Haj Hassan, Mauricio Iturralde, Loutfi Nuaymi. Location-Aware Sleep Strategy for Energy-Delay Tradeoffs in 5G with Reinforcement Learning. 2019 IEEE 30th Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC), Sep 2019, Istanboul, Turkey. ⟨hal-02168390⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

65

Files downloads

80

Contact

CCSD