侯国涛1, 2, 韩慧1, 胡俊2. 基于部分可观察马氏决策过程的频谱接入方法[J]. 电波科学学报, 2013, 28(3): 563-568.
      引用本文: 侯国涛1, 2, 韩慧1, 胡俊2. 基于部分可观察马氏决策过程的频谱接入方法[J]. 电波科学学报, 2013, 28(3): 563-568.
      HOU Guotao1, 2, HAN Hui1, HU Jun2. Spectrum access method based on POMDP[J]. CHINESE JOURNAL OF RADIO SCIENCE, 2013, 28(3): 563-568.
      Citation: HOU Guotao1, 2, HAN Hui1, HU Jun2. Spectrum access method based on POMDP[J]. CHINESE JOURNAL OF RADIO SCIENCE, 2013, 28(3): 563-568.

      基于部分可观察马氏决策过程的频谱接入方法

      Spectrum access method based on POMDP

      • 摘要: 在次用户无法准确掌握信道被占用情况下,为了减少对主用户的干扰,提出了一种基于部分可观察马尔科夫决策过程(Partially Observable Markov Decision Processes,POMDP)的机会式频谱接入方法.该方法把次用户在每个决策时刻从多个信道中选择其中一个信道进行接入这一过程模型化为一个无限阶部分可观察马尔科夫决策过程. 仿真结果表明,通过不断从外界环境中学习,次用户总可以按照目标函数最大准则选择满意的频谱空穴.该模型为动态频谱接入提供了思路.

         

        Abstract: A scheme of opportunistic spectrum access based on POMDP is proposed, to avoid the interference to the primary user for the secondary user does not have the exact knowledge of which channel is occupied. The process of secondary user selecting a satisfied channel is formulated as a partial observable Markov decision process which is infinite horizon. The simulation results show that through learning from the extern world, secondary users can search for and exploit spectrum holes according to the rule of maximizing the expected rewards. The simulation results validate this model. It provides a new idea to dynamic spectrum access method.

         

      /

      返回文章
      返回