Defense decision-making method based on incomplete information stochastic game and Q-learning
Most of the existing stochastic games are based on the assumption of complete information,which are not consistent with the fact of network attack and defense.Aiming at this problem,the uncertainty of the attacker’s revenue was transformed to the uncertainty of the attacker type,and then a stochasti...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Editorial Department of Journal on Communications
2018-08-01
|
| Series: | Tongxin xuebao |
| Subjects: | |
| Online Access: | http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2018145/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841539446161276928 |
|---|---|
| author | Hongqi ZHANG Junnan YANG Chuanfu ZHANG |
| author_facet | Hongqi ZHANG Junnan YANG Chuanfu ZHANG |
| author_sort | Hongqi ZHANG |
| collection | DOAJ |
| description | Most of the existing stochastic games are based on the assumption of complete information,which are not consistent with the fact of network attack and defense.Aiming at this problem,the uncertainty of the attacker’s revenue was transformed to the uncertainty of the attacker type,and then a stochastic game model with incomplete information was constructed.The probability of network state transition is difficult to determine,which makes it impossible to determine the parameter needed to solve the equilibrium.Aiming at this problem,the Q-learning was introduced into stochastic game,which allowed defender to get the relevant parameter by learning in network attack and defense and to solve Bayesian Nash equilibrium.Based on the above,a defense decision algorithm that could learn online was designed.The simulation experiment proves the effectiveness of the proposed method. |
| format | Article |
| id | doaj-art-9be5ce1ad0bc4105a8a2574404ba5919 |
| institution | Kabale University |
| issn | 1000-436X |
| language | zho |
| publishDate | 2018-08-01 |
| publisher | Editorial Department of Journal on Communications |
| record_format | Article |
| series | Tongxin xuebao |
| spelling | doaj-art-9be5ce1ad0bc4105a8a2574404ba59192025-01-14T07:15:15ZzhoEditorial Department of Journal on CommunicationsTongxin xuebao1000-436X2018-08-0139566859719925Defense decision-making method based on incomplete information stochastic game and Q-learningHongqi ZHANGJunnan YANGChuanfu ZHANGMost of the existing stochastic games are based on the assumption of complete information,which are not consistent with the fact of network attack and defense.Aiming at this problem,the uncertainty of the attacker’s revenue was transformed to the uncertainty of the attacker type,and then a stochastic game model with incomplete information was constructed.The probability of network state transition is difficult to determine,which makes it impossible to determine the parameter needed to solve the equilibrium.Aiming at this problem,the Q-learning was introduced into stochastic game,which allowed defender to get the relevant parameter by learning in network attack and defense and to solve Bayesian Nash equilibrium.Based on the above,a defense decision algorithm that could learn online was designed.The simulation experiment proves the effectiveness of the proposed method.http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2018145/network attack and defensestochastic gameQ-learningBayesian Nash equilibriumdefense strategy |
| spellingShingle | Hongqi ZHANG Junnan YANG Chuanfu ZHANG Defense decision-making method based on incomplete information stochastic game and Q-learning Tongxin xuebao network attack and defense stochastic game Q-learning Bayesian Nash equilibrium defense strategy |
| title | Defense decision-making method based on incomplete information stochastic game and Q-learning |
| title_full | Defense decision-making method based on incomplete information stochastic game and Q-learning |
| title_fullStr | Defense decision-making method based on incomplete information stochastic game and Q-learning |
| title_full_unstemmed | Defense decision-making method based on incomplete information stochastic game and Q-learning |
| title_short | Defense decision-making method based on incomplete information stochastic game and Q-learning |
| title_sort | defense decision making method based on incomplete information stochastic game and q learning |
| topic | network attack and defense stochastic game Q-learning Bayesian Nash equilibrium defense strategy |
| url | http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2018145/ |
| work_keys_str_mv | AT hongqizhang defensedecisionmakingmethodbasedonincompleteinformationstochasticgameandqlearning AT junnanyang defensedecisionmakingmethodbasedonincompleteinformationstochasticgameandqlearning AT chuanfuzhang defensedecisionmakingmethodbasedonincompleteinformationstochasticgameandqlearning |