Logo: to the web site of Uppsala University

uu.sePublications from Uppsala University
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Online Learning for Intelligent Thermal Management of Interference-Coupled and Passively Cooled Base Stations
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Computing Science. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Division of Computing Science.ORCID iD: 0000-0001-7306-8354
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Division of Computing Science. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Computing Science.ORCID iD: 0000-0002-6025-3515
Department of Electronic and Electrical Engineering, University of Sheffield, Sheffield, U.K..ORCID iD: 0000-0003-1863-6149
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Computing Science. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Division of Computing Science.ORCID iD: 0000-0001-8119-5206
2025 (English)In: IEEE Transactions on Machine Learning in Communications and Networking, E-ISSN 2831-316X, Vol. 3, p. 64-79Article in journal (Refereed) Published
Abstract [en]

Passively cooled base stations (PCBSs) have emerged to deliver better cost and energy efficiency. However, passive cooling necessitates intelligent thermal control via traffic management, i.e., the instantaneous data traffic or throughput of a PCBS directly impacts its thermal performance. This is particularly challenging for outdoor deployment of PCBSs because the heat dissipation efficiency is uncertain and fluctuates over time. What is more, the PCBSs are interference-coupled in multi-cell scenarios. Thus, a higher-throughput PCBS leads to higher interference to the other PCBSs, which, in turn, would require more resource consumption to meet their respective throughput targets. In this paper, we address online decision-making for maximizing the total downlink throughput for a multi-PCBS system subject to constraints related on operating temperature. We demonstrate that a reinforcement learning (RL) approach, specifically soft actor-critic (SAC), can successfully perform throughput maximization while keeping the PCBSs cool, by adapting the throughput to time-varying heat dissipation conditions. Furthermore, we design a denial and reward mechanism that effectively mitigates the risk of overheating during the exploration phase of RL. Simulation results show that our approach achieves up to 88.6% of the global optimum. This is very promising, as our approach operates without prior knowledge of future heat dissipation efficiency, which is required by the global optimum.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2025. Vol. 3, p. 64-79
Keywords [en]
Reinforcement learning, interference, passive cooling, throughput maximization, thermal management
National Category
Telecommunications
Identifiers
URN: urn:nbn:se:uu:diva-555954DOI: 10.1109/tmlcn.2024.3517619ISI: 001487807300001OAI: oai:DiVA.org:uu-555954DiVA, id: diva2:1956758
Part of project
Operations Research in a Millisecond: Real-Time Resource Optimization for Mobile Networks, Swedish Research Council
Funder
Swedish Research Council, 2022-04123EU, European Research Council, 101086219Available from: 2025-05-07 Created: 2025-05-07 Last updated: 2025-05-23Bibliographically approved
In thesis
1. Selected Topics on Optimal Allocation and Configuration in Mobile Computing for 5G and Beyond
Open this publication in new window or tab >>Selected Topics on Optimal Allocation and Configuration in Mobile Computing for 5G and Beyond
2025 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

This dissertation explores optimal allocation and configuration in mobile computing for 5G and beyond. As wireless technologies rapidly evolve, emerging technologies such as integrated terrestrial, aerial, and satellite networks (ITASNs), integrated sensing and communication (ISAC), reconfigurable intelligent surfaces (RIS), edge computing, AI-driven networking, cell-free multiple-input multiple-output (MIMO), movable antenna systems, and passively cooled base stations (PCBS) are reshaping network design. These innovations promise significant improvements in capacity, energy efficiency, and sustainability, but also introduce challenges in resource allocation and configuration.

The bulk of this dissertation comprises five research papers that address key resource allocation and configuration problems for some of the evolving technologies. Paper I presents a novel framework for jointly optimizing RIS configuration and resource allocation in multi-cell networks. Paper II investigates content caching in edge computing, proposing a column generation-based approach for balancing cost and data freshness. Paper III examines renewable energy management in edge computing networks to minimize the carbon footprint while maintaining performance. Papers IV and V focus on thermal management in PCBS, with Paper IV developing an online reinforcement learning method for dynamic load allocation in a single base station and Paper V extending this approach to multi-cell scenarios with inter-cell interference and resource coupling.

Place, publisher, year, edition, pages
Uppsala: Acta Universitatis Upsaliensis, 2025. p. 69
Series
Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Science and Technology, ISSN 1651-6214 ; 2550
Keywords
Mathematical Optimization, Resource Allocation and Configuration, Mobile Networks.
National Category
Computer Sciences
Identifiers
urn:nbn:se:uu:diva-555957 (URN)978-91-513-2505-7 (ISBN)
Public defence
2025-08-22, 101121, Sonja Lyttkens, Ångström, Regementsvägen 10, Uppsala, 13:15 (English)
Opponent
Supervisors
Available from: 2025-06-02 Created: 2025-05-07 Last updated: 2025-06-03

Open Access in DiVA

fulltext(5137 kB)30 downloads
File information
File name FULLTEXT01.pdfFile size 5137 kBChecksum SHA-512
ceea579141fdf6752541fde6bbcc3019b03dff33e82354a7b424f41804906e5843d29c2c44548c69c0384d9acf0a28591a17e23289778573cedf81dc2314102f
Type fulltextMimetype application/pdf

Other links

Publisher's full text

Authority records

Yu, ZhanweiZhao, YiYuan, Di

Search in DiVA

By author/editor
Yu, ZhanweiZhao, YiChu, XiaoliYuan, Di
By organisation
Computing ScienceDivision of Computing Science
Telecommunications

Search outside of DiVA

GoogleGoogle Scholar
Total: 34 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 96 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf