Share Email Print
cover

Proceedings Paper

Q-learning-based cross-layer Learning Engine design for cognitive radio network
Author(s): Congbin Liu; Hong Jiang; Yanchao Yang; Jinghui Ma
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

In cognitive radio (CR) networks, Learning Engine has considerable significance on dynamic spectrum access (DSA) and implementation of cognitive function. In this paper, a cross-layer learning engine design scheme is proposed by jointly considering physical-layer dynamic channel selection, modulation and coding scheme, data-link layer frame length in CR networks, with the purpose to maximize system throughput and simultaneously meet heterogeneous Quality of Service (QoS) requirements. The wireless fading channel is modeled as a continuous state space Markov decision process (MDP) and the licensed network activity is abstracted as a finite-state one. We introduce Q-learning algorithm to realize the function of learning from state space and adapt wireless environment. And meanwhile a large scale Qfunction approximator based on support vector machine (SVM) is employed to effectively reduce storage requirement and decrease the operation complexity. A cross-layer learning engine communication platform is realized by using Matlab simulator. the simulation results demonstrate that while lacking system prior knowledge, the learning engine can effectively achieve configuration function by system cross-layer learning approach, and furthermore, it can converge to the best—i.e., realize reconfiguration function in CR networks while meeting users’ QoS.

Paper Details

Date Published: 13 March 2013
PDF: 9 pages
Proc. SPIE 8784, Fifth International Conference on Machine Vision (ICMV 2012): Algorithms, Pattern Recognition, and Basic Technologies, 878419 (13 March 2013); doi: 10.1117/12.2014021
Show Author Affiliations
Congbin Liu, Southwest Univ. of Science and Technology (China)
Hong Jiang, Southwest Univ. of Science and Technology (China)
Yanchao Yang, Southwest Univ. of Science and Technology (China)
Jinghui Ma, Southwest Univ. of Science and Technology (China)


Published in SPIE Proceedings Vol. 8784:
Fifth International Conference on Machine Vision (ICMV 2012): Algorithms, Pattern Recognition, and Basic Technologies
Yulin Wang; Liansheng Tan; Jianhong Zhou, Editor(s)

© SPIE. Terms of Use
Back to Top