uu.seUppsala University Publications
Change search
ReferencesLink to record
Permanent link

Direct link
Markov Decision Problems in ATM Traffic Control
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Computer Systems.
1998 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

This thesis discusses how to make cost-effective use of the communication resources in the Broadband Integrated Services Digital Network (B-ISDN), which is based on the Asynchronous Transfer Mode (ATM) switching and multiplexing technique.

The thesis deals with two important functions in ATM traffic control, namely Call Admission Control (CAC) and routing, which affects both the network operator's revenue over time and the users' Quality of Service (QOS) and Grade of Service (GOS). The routing function finds a route, expressed in terms of successive links, with sufficient QOS (e.g. cell loss probability) according to the CACQOS function. The CACGOS function accepts or rejects the call request based on fairness (e.g. call blocking probability) and revenue considerations.

The CACGOS and routing tasks are modelled a Semi-Markov Decision Problem (SMDP). The SMDP solution gives high resource utilization and ability to control GOS distribution between the call classes. In SMDP routing, the task is to control the state transitions between reward generating states such that the average reward rate is maximized. In order to obtain a solution with feasible computational complexity, the network SMDP is decomposed into a set of link SMDPs. Each link SMDP is solved by either dynamic programming (DP) or reinforcement learning (RL). DP is based on a model of the decision task in terms of the state transition probabilities and expected reward in each state. RL is not based on a model of the decision task. Instead, the optimal policy is found from simulated state transitions, where long-term reward predictions are corrected by temporal difference learning.

We study aspects such as delayed set up of wide-band calls, link-level integration of guaranteed QOS services and best effort services, and Poisson versus self-similar call arrival processes.

Place, publisher, year, edition, pages
Department of Computer Systems, Uppsala University , 1998. , 39 p.
DoCS, ISSN 0283-0574 ; 100
National Category
Computer Engineering
Research subject
Computer Systems
URN: urn:nbn:se:uu:diva-1159ISBN: 99-2795294-5OAI: oai:DiVA.org:uu-1159DiVA: diva2:160709
Public defence
1998-12-11, Room 6159, Polacksbacken, Uppsala University, Uppsala, 10:00 (English)
Available from: 1998-11-20 Created: 1998-11-20 Last updated: 2015-01-29Bibliographically approved

Open Access in DiVA

No full text

By organisation
Department of Computer Systems
Computer Engineering

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 508 hits
ReferencesLink to record
Permanent link

Direct link