Abstract
A prominent feature of biological organization in many species of social animals is the ability to achieve cooperation. However, despite its predominance in natural evolution, cooperative behaviors come at a cost, typically in the form of do ut des mechanisms (e.g., reciprocal altruism in vampire bats) with given thresholds for sharing resources or communication efforts. In this paper, we investigate the conditions of cooperation through the evolutionary dynamics of the prisoner's dilemma (PD) game as well as the learning dynamics resulting from the corresponding multi-agent reinforcement learning (MARL) model. In both cases, the interactions in the population are captured by a regular network and the impact of the players' actions is reflected through the evolution of an environmental resource, which also acts as a feedback on the dynamics. The following is a list of contributions: i) we provide a full characterization of the stability properties of the networked feedback-evolving PD game; ii) we determine a set of threshold values below which cooperation is promoted; iii) we develop the corresponding cross-learning model, which is a stateless MARL model, and we show that this model is equivalent to the networked PD game with environmental feedback.
Original language | English |
---|---|
Title of host publication | 2023 62nd IEEE Conference on Decision and Control, CDC 2023 |
Publisher | Institute of Electrical and Electronics Engineers (IEEE) |
Pages | 2196-2201 |
Number of pages | 6 |
ISBN (Electronic) | 9798350301243, 9798350301236 |
ISBN (Print) | 9798350301250 |
DOIs | |
Publication status | Published - 19 Jan 2024 |
Event | 62nd IEEE Conference on Decision and Control, CDC 2023 - Singapore, Singapore Duration: 13 Dec 2023 → 15 Dec 2023 |
Publication series
Name | Proceedings of the IEEE Conference on Decision and Control |
---|---|
ISSN (Print) | 0743-1546 |
ISSN (Electronic) | 2576-2370 |
Conference
Conference | 62nd IEEE Conference on Decision and Control, CDC 2023 |
---|---|
Country/Territory | Singapore |
City | Singapore |
Period | 13/12/23 → 15/12/23 |
Bibliographical note
Publisher Copyright:© 2023 IEEE.
ASJC Scopus subject areas
- Control and Systems Engineering
- Modelling and Simulation
- Control and Optimization