Gradient-Based Algorithms With Intermediate Observations in Static and Differential Games
In two-player static and differential games, strategic players often use available or delayed information about the other player’s decisions and solve an optimization or optimal control problem to determine their strategic choices. Without this information, the player’s ability...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10816421/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841557019918598144 |
|---|---|
| author | Mohammad Safayet Hossain Marwan A. Simaan Zhihua Qu |
| author_facet | Mohammad Safayet Hossain Marwan A. Simaan Zhihua Qu |
| author_sort | Mohammad Safayet Hossain |
| collection | DOAJ |
| description | In two-player static and differential games, strategic players often use available or delayed information about the other player’s decisions and solve an optimization or optimal control problem to determine their strategic choices. Without this information, the player’s ability to determine its optimal decisions becomes problematic. In this paper, we propose an approach in which each player implements an iterative discrete-time gradient-based algorithm that relies only on intermediate either current or prior observations about the other player’s actions. We explore the implementation of such gradient play algorithms in the case of non-zero-sum static games and in the more complex case of differential games. We discuss the properties of these algorithms with heterogeneous stepsizes and derive explicit necessary and sufficient conditions on the game parameters in the objective functions and stepsizes that guarantee convergence to the Nash equilibrium in static games with quadratic objective functions. Examples in both static and differential games are presented to illustrate the results. |
| format | Article |
| id | doaj-art-6c8cde1c1b7a436391b411375848ab50 |
| institution | Kabale University |
| issn | 2169-3536 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-6c8cde1c1b7a436391b411375848ab502025-01-07T00:02:14ZengIEEEIEEE Access2169-35362025-01-01132694270410.1109/ACCESS.2024.352325810816421Gradient-Based Algorithms With Intermediate Observations in Static and Differential GamesMohammad Safayet Hossain0https://orcid.org/0000-0002-6745-4168Marwan A. Simaan1https://orcid.org/0000-0002-5393-2018Zhihua Qu2https://orcid.org/0000-0001-6710-7134Department of Electrical and Computer Engineering, University of Central Florida, Orlando, FL, USADepartment of Electrical and Computer Engineering, University of Central Florida, Orlando, FL, USADepartment of Electrical and Computer Engineering, University of Central Florida, Orlando, FL, USAIn two-player static and differential games, strategic players often use available or delayed information about the other player’s decisions and solve an optimization or optimal control problem to determine their strategic choices. Without this information, the player’s ability to determine its optimal decisions becomes problematic. In this paper, we propose an approach in which each player implements an iterative discrete-time gradient-based algorithm that relies only on intermediate either current or prior observations about the other player’s actions. We explore the implementation of such gradient play algorithms in the case of non-zero-sum static games and in the more complex case of differential games. We discuss the properties of these algorithms with heterogeneous stepsizes and derive explicit necessary and sufficient conditions on the game parameters in the objective functions and stepsizes that guarantee convergence to the Nash equilibrium in static games with quadratic objective functions. Examples in both static and differential games are presented to illustrate the results.https://ieeexplore.ieee.org/document/10816421/Static gamesdifferential gamesNash equilibriumgradient-based minimization algorithms |
| spellingShingle | Mohammad Safayet Hossain Marwan A. Simaan Zhihua Qu Gradient-Based Algorithms With Intermediate Observations in Static and Differential Games IEEE Access Static games differential games Nash equilibrium gradient-based minimization algorithms |
| title | Gradient-Based Algorithms With Intermediate Observations in Static and Differential Games |
| title_full | Gradient-Based Algorithms With Intermediate Observations in Static and Differential Games |
| title_fullStr | Gradient-Based Algorithms With Intermediate Observations in Static and Differential Games |
| title_full_unstemmed | Gradient-Based Algorithms With Intermediate Observations in Static and Differential Games |
| title_short | Gradient-Based Algorithms With Intermediate Observations in Static and Differential Games |
| title_sort | gradient based algorithms with intermediate observations in static and differential games |
| topic | Static games differential games Nash equilibrium gradient-based minimization algorithms |
| url | https://ieeexplore.ieee.org/document/10816421/ |
| work_keys_str_mv | AT mohammadsafayethossain gradientbasedalgorithmswithintermediateobservationsinstaticanddifferentialgames AT marwanasimaan gradientbasedalgorithmswithintermediateobservationsinstaticanddifferentialgames AT zhihuaqu gradientbasedalgorithmswithintermediateobservationsinstaticanddifferentialgames |