- We are sorry, but NCBI web applications do not support your browser and may not function properly. More information

- Journal List
- NIHPA Author Manuscripts
- PMC2430087

# A simple rule for the evolution of cooperation on graphs

^{1}Department of Biology, Kyushu University, Fukuoka 812-8581, Japan

^{2}Program for Evolutionary Dynamics, Department of Organismic and Evolutionary Biology, Department of Mathematics, Harvard University, Cambridge MA 02138, USA

^{3}Department of Applied Mathematics, Harvard University, Cambridge MA 02138, USA

## Abstract

A fundamental aspect of all biological systems is cooperation. Cooperative interactions are required for many levels of biological organization ranging from single cells to groups of animals^{1}^{–}^{4}. Human society is based to a large extent on mechanisms that promote cooperation^{5}^{–}^{7}. It is well known that in unstructured populations, natural selection favors defectors over cooperators. There is much current interest, however, for studying evolutionary games in structured populations and on graphs^{8}^{–}^{17}. These efforts recognize the fact that who-meets-whom is not random, but determined by spatial relationships or social networks^{18}^{–}^{24}. Here we describe a surprisingly simple rule, which is a good approximation for all graphs that we have analyzed, including cycles, spatial lattices, random regular graphs, random graphs and scale-free networks^{25}^{,}^{26}: natural selection favors cooperation, if the benefit of the altruistic act, *b*, divided by the cost, *c*, exceeds the average number of neighbors, *k*. Therefore, cooperation can evolve as a consequence of ‘social viscosity’ even in the absence of reputation effects or strategic complexity.

A cooperator is someone who pays a cost, *c*, for another individual to receive a benefit, *b*. A defector pays no cost and does not distribute any benefits. In evolutionary biology, cost and benefit are measured in terms of fitness. Reproduction can be genetic or cultural. In the latter case, the strategy of someone who does well is imitated by others. In an unstructured population, where all individuals interact equally likely with each other, defectors have a higher average payoff than unconditional cooperators. Therefore, natural selection increases the relative abundance of defectors and drives cooperators to extinction. These evolutionary dynamics hold for the deterministic setting of the replicator equation^{27}^{,}^{28} and for stochastic game dynamics of finite populations^{29}.

In our model, the players of an evolutionary game occupy the vertices of a graph. The edges denote links between individuals in terms of game dynamical interaction and biological reproduction. We assume that the graph is fixed for the duration of the evolutionary dynamics. Consider a population of *N* individuals consisting of cooperators and defectors. A cooperator helps all individuals to whom it is connected. If a cooperator is connected to *k* other individuals and *i* of those are cooperators, then its payoff is *bi* – *ck*. A defector does not provide any help, and therefore has no costs, but it can receive the benefit from neighboring cooperators. If a defector is connected to *j* cooperators, then its payoff is *bj*.

The fitness of an individual is given by a constant term, denoting the baseline fitness, plus the payoff that arises from the game. Strong selection means that the payoff is large compared to the baseline fitness; weak selection means the payoff is small compared to the baseline fitness. The idea behind weak selection is that many different factors contribute to the overall fitness of an individual, and the game under consideration is just one of those factors.

At first, we will study the following update rule for evolutionary dynamics (Fig 1): in each time step, a random individual is chosen to die, and the neighbors compete for the empty site proportional to their fitness. We call this mechanism ‘death-birth’ updating, because first there is a death event followed by a birth. Later we will investigate other update mechanisms.

*P*, from interactions with adjacent individuals. A cooperator (blue) pays a cost,

*c*, for each neighbor to receive a benefit,

*b*. A defector (red) pays no cost and

**...**

Let us explore if natural selection can favor cooperation on certain graphs. In order to do this, we need to calculate the probability that a single cooperator starting in a random position turns the whole population from defection to cooperation. If selection neither favors nor opposes cooperation, then this probability is 1*/N*, which is the fixation probability of a neutral mutant. If the fixation probability of a single cooperator is greater than 1*/N*, then selection favors the emergence of cooperation. We also calculate the fixation probability of a single defector in a population of cooperators, and compare the two fixation probabilities.

The traditional well-mixed population of evolutionary game theory is represented by the complete graph, where all vertices are connected. In this special situation, cooperators are always opposed by selection. This is the fundamental intuition of classical evolutionary game theory. But what happens on other graphs?

Let us first consider a cycle. Each individual is linked to two neighbors. A single cooperator could be wiped out immediately or take over one of its two neighbors. A cluster of two cooperators could expand to three cooperators or revert to a single cooperator. In any case, the lineage starting from one cooperator always forms a single cluster of cooperators, which cannot fragment into pieces. This fact allows a straightforward calculation. We find that selection favors cooperation if *b/c >* 2. This result holds for weak selection and large population size.

Next, we study regular graphs, where each individual has exactly *k* neighbors. Such graphs include cycles, spatial lattices and random regular graphs. For all those graphs, a direct calculation of the fixation probability is impossible, because a single invader can lead to very complicated patterns: the emerging cluster usually break into many pieces allowing a large number of conceivable geometric configurations. In general, the inherent complexity of games on graphs makes analytical investigations almost always impossible.

Nevertheless, we can calculate the fixation probability of a randomly placed mutant for any two-person, two-strategy game on a regular graph by using pair approximation and diffusion approximation (see online Supplementary Information). In particular, we find that cooperators have a fixation probability greater than 1*/N* and defectors have a fixation probability less than 1*/N*, if

The ratio of benefit to cost of the altruistic act has to exceed the degree, *k*, which is given by the number of neighbors per individual. This condition is derived for weak selection and under the assumption that the population size, *N*, is much larger than the degree, *k*.

There is excellent agreement with numerical simulations (Fig 2). For a given population size, *b/c > k* is a necessary condition for selection to favor cooperators. As the population size increases, the discrepancy between *b/c > k* and the numerical simulations becomes smaller. Moreover, we find that the rule also holds for random graphs^{25} and scale-free networks^{26}^{,}^{27}, where individuals differ in the number of their neighbors. Here *k* denotes the average degree of the graph. Scale free networks fit slightly less well than random graphs, presumably because they have a larger variance of the degree distribution.

*b/c*>

*k*, is in good agreement with numerical simulations. The parameter

*k*denotes the degree of the graph, which is given by the (average) number of neighbors per individual. The first row illustrates the type of graph for (a)

**...**

The intuitive justification for the *b/c > k* rule is illustrated in Fig 3. Consider one cooperator and one defector competing for an empty site. The payoff for the cooperator is *P _{C}* =

*bq*

_{C}_{|}

*(*

_{C}*k*− 1)−

*ck*. The payoff for the defector is

*P*=

_{D}*bq*

_{C}_{|}

*(*

_{D}*k*− 1). The conditional probability to find a cooperator next to a cooperator is

*q*

_{C}_{|}

*and to find a cooperator next to a defector is*

_{C}*q*

_{C}_{|}

*The cooperator pays cost*

_{D.}*c*for all of its

*k*neighbors and receives benefit

*b*from each cooperator among its

*k*− 1 neighbors excluding the contested site. The defector pays no cost, but receives benefit

*b*from each cooperator among its

*k*− 1 neighbors also excluding the contested site. The payoff that comes from the contested site is excluded, because it contributes equally to the cooperator and the defector and therefore cancels out. If

*P*>

_{C}*P*, then selection favors the cooperator. Pair-approximation shows that (

_{D}*k*− 1)(

*q*−

_{C|C}*q*) = 1 for weak selection. Thus, the cooperator has on average one more cooperator neighbor than the defector. Therefore, we obtain

_{C|D}*P*−

_{C}*P*=

_{D}*b*−

*ck*, which leads to the

*b/c*>

*k*rule.

**...**

We have also explored other update mechanisms. Suppose at each time step a random individual is chosen to update its strategy; it will stay with its own strategy or imitate one of the neighbors proportional to fitness. For this ‘imitation updating’, we find that cooperators are favored if *b/c* > *k*+2. This result can be obtained with an exact calculation for the cycle and with pair approximation for regular graphs. Again there is good agreement with numerical simulations (Fig 4 online). Mathematically, imitation updating can be obtained from our earlier death-birth updating by adding loops to every vertex. Therefore, each individual is also its own neighbor. Let us define the connectivity, *k*, of a vertex as the total number of links connected to that vertex, noting that a loop is connected twice. Then the simple rule *b/c* > *k* holds both for the imitation and death-birth updating.

There are also update rules, where selection can never favor cooperators. For example, let us consider ‘birth-death’ updating: at each time step an individual is selected for reproduction proportional to fitness, and the offspring replaces a randomly chosen neighbor. In this case, selection always favors defectors, because only the payoff of individuals right at the boundary between cooperators and defectors matters, and there cooperators are always at a disadvantage (Fig 3b). In the two other models, the payoffs of individuals that are one place removed from the boundary also play a role, which gives cooperation a chance to live.

Using a different model, van Baalen & Rand^{11} have derived a condition for the initial invasion of cooperators. In their model, the vertices of a spatial lattice (or a graph) are either empty or occupied by cooperators or defectors. There are birth, death and migration events. Implicitly, they have shown that without migration a few cooperators can successfully invade a population of defectors if *b/c* > *k ^{2}/*(

*k*−1). The difference between this result and ours is not surprising. The invasion condition of van Baalen & Rand examines whether rare cooperators are able to increase in abundance, while our fixation probability includes the whole evolutionary trajectory including the initial invasion and propagation of cooperators as well as the final extinction of defectors. For a comparison of invasion and fixation criteria see Wild & Taylor

^{30}. Interestingly, the update mechanism of van Baalen & Rand does not allow selection to favor the fixation of cooperators.

In summary, we have shown that evolutionary dynamics on graphs can favor cooperation over defection if the benefit to cost ratio, *b/c*, of the altruistic act exceeds the average connectivity, *k*. The fewer connections the easier it is for natural selection to promote cooperation. In our present analysis, all connections are equally strong. A next step will be to explore graphs with weighted edges. In social networks, people might have a substantial number of connections, but only very few of them are strong. Hence, the ‘effective’ average degree, *k*, of many relevant networks could be small, thereby making selection of cooperation on graphs a powerful option.

Our study is theoretically motivated, but has implications for empirical research. For example, one can envisage an experiment where people are asked to play a non-repeated Prisoner’s Dilemma within a given network. Certain network structures should promote cooperative behavior more than others. In particular, more cooperation should emerge if connectivity is low. Moreover, in certain animal species there exist complicated social networks. Observational studies could reveal how network structure affects the level of cooperation; higher connectivity should reduce cooperation. In this paper, as a logical first step, we have studied the simplest possible interaction between unconditional cooperators and defectors, but in an extended approach, both in terms of theory and experiment, it will be interesting to see which strategies of direct or indirect reciprocity evolve on particular networks.

Finally, we note the beautiful similarity of our finding with Hamilton’s rule^{1}, which states that kin selection can favor cooperation provided *b/c* > 1*/r*, where *r* is the coefficient of genetic relatedness between individuals. The similarity makes sense. In our framework, the average degree of a graph is an inverse measure of social relatedness (or social viscosity). The fewer friends I have the stronger my fate is bound to theirs.

## Acknowledgments

Support from JSPS, NDSEG and Harvard-MIT HST is gratefully acknowledged. The Program for Evolutionary Dynamics at Harvard University is sponsored by Jeffrey Epstein.

## Footnotes

**Author Information** The authors declare no competing financial interests.

## References

## Formats:

- Article |
- PubReader |
- ePub (beta) |
- PDF (860K)

- Cooperation prevails when individuals adjust their social ties.[PLoS Comput Biol. 2006]
*Santos FC, Pacheco JM, Lenaerts T.**PLoS Comput Biol. 2006 Oct 20; 2(10):e140.* - Evolutionary graph theory: breaking the symmetry between interaction and replacement.[J Theor Biol. 2007]
*Ohtsuki H, Pacheco JM, Nowak MA.**J Theor Biol. 2007 Jun 21; 246(4):681-94. Epub 2007 Feb 8.* - Oscillatory dynamics in the coevolution of cooperation and mobility.[J Theor Biol. 2011]
*Suzuki S, Kimura H.**J Theor Biol. 2011 Oct 21; 287:42-7. Epub 2011 Jul 30.* - Five rules for the evolution of cooperation.[Science. 2006]
*Nowak MA.**Science. 2006 Dec 8; 314(5805):1560-3.* - The evolution of cooperation and altruism--a general framework and a classification of models.[J Evol Biol. 2006]
*Lehmann L, Keller L.**J Evol Biol. 2006 Sep; 19(5):1365-76.*

- An Application of Evolutionary Game Theory to Social Dilemmas: The Traveler's Dilemma and the Minimum Effort Coordination Game[PLoS ONE. ]
*Iyer S, Reyes J, Killingback T.**PLoS ONE. 9(4)e93988* - Evolutionary Origin of Asymptotically Stable Consensus[Scientific Reports. ]
*Tang CB, Wu B, Wang JB, Li X.**Scientific Reports. 44590* - Random allocation of pies promotes the evolution of fairness in the Ultimatum Game[Scientific Reports. ]
*Wang X, Chen X, Wang L.**Scientific Reports. 44534* - Biased imitation in coupled evolutionary games in interdependent networks[Scientific Reports. ]
*Santos MD, Dorogovtsev SN, Mendes JF.**Scientific Reports. 44436* - Direct Sum Matrix Game with Prisoner's Dilemma and Snowdrift Game[PLoS ONE. ]
*Ma C, Cao W, Liu W, Gui R, Jia Y.**PLoS ONE. 8(12)e81855*

- PubMedPubMedPubMed citations for these articles

- A simple rule for the evolution of cooperation on graphsA simple rule for the evolution of cooperation on graphsNIHPA Author Manuscripts. May 25, 2006; 441(7092)502PMC

Your browsing activity is empty.

Activity recording is turned off.

See more...