Abstract:Abstract One of the triumphs of evolutionary biology is the discovery of robust mechanisms that promote the evolution of cooperative behaviors even when those behaviors reduce the fertility or survival of cooperators. Though these mechanisms, kin selection, reciprocity, and nonlinear payoffs to cooperation, have been extensively studied separately, investigating their joint effect on the evolution of cooperation has been more difficult. Moreover, how these mechanisms shape variation in cooperation is not well known. Such variation is crucial for understanding the evolution of behavioral syndromes and animal personality. Here, I use the tools of kin selection theory and evolutionary game theory to build a framework that integrates these mechanisms for pairwise social interactions. Using relatedness as a measure of the strength of kin selection, responsiveness as a measure of reciprocity, and synergy as a measure of payoff nonlinearity, I show how different combinations of these three parameters produce directional selection for or against cooperation or variation in levels of cooperation via balancing or diversifying selection. Moreover, each of these outcomes maps uniquely to one of four classic games from evolutionary game theory, which means that modulating relatedness, responsiveness, and synergy effectively transforms the payoff matrix from one the evolutionary game to another. Assuming that cooperation exacts a fertility cost on cooperators and provides a fertility benefit to social partners, a prisoner’s dilemma game and directional selection against cooperation occur when relatedness and responsiveness are low and synergy is not too positive. Enough positive synergy in these conditions generates a stag-hunt game and diversifying selection. High levels of relatedness or responsiveness turn cooperation from a fitness cost into a fitness benefit, which produces a mutualism game and directional selection for cooperation when synergy is not too negative. Sufficiently negative synergy in this case creates a hawk-dove game and balancing selection for cooperation. I extend the results with relatedness and synergy to larger social groups and show that how group size changes the effect of relatedness and synergy on selection for cooperation depends on how the per capita benefit of cooperation changes with group size. Together, these results provide a general framework with which to generate comparative predictions that can be tested using quantitative genetic techniques and experimental techniques that manipulate investment in cooperation. These predictions will help us understand both interspecific variation in cooperation as well as within-population and within-group variation in cooperation related to behavioral syndromes.

Evolution of sex differences in cooperation: the role of trade-offs with dispersal

Evolution of sex differences in cooperation can be explained by trade-offs with dispersal

Cooperation and Coordination in Socially Monogamous Birds: Moving Away From a Focus on Sexual Conflict

Implications of adult sex ratios for natal dispersal in a cooperative breeder

Sex-biased dispersal: a review of the theory

The price of associating with breeders in the cooperatively breeding chestnut-crowned babbler: foraging constraints, survival and sociality

Interspecific Density Influences the Adaptive Significance of Provisioning Coordination Between Breeding Partners

A path analysis disentangling determinants of natal dispersal in a cooperatively breeding bird

Parent-preferred Dispersal Promotes Cooperation in Structured Populations

Stags, Hawks, and Doves: Social Evolution Theory and Individual Variation in Cooperation

Neurogenomic landscape associated with status‐dependent cooperative behaviour

The evolution of cooperation: an evolutionary advantage of individuals impedes the evolution of the population

Diminishing returns drive altruists to help extended family

Population Sex Ratio Shift from Fledging to Recruitment: Consequences for Demography in A Philopatric Seabird

Dispersal in Kin Coalition Throughout the Non‐Breeding Season to Facilitate Fine‐Scale Genetic Structure in the Breeding Season: Evidence from a Small Passerine

Intra-sexual selection in cooperative mammals and birds: why are females not bigger and better armed?

Going with the flow: evidence for phenotypic variation in cooperative plasticity during predator inspection in Trinidadian guppies ( )

Coordination of care reduces conflict and predation risk in a cooperatively breeding bird

Family living and cooperative breeding in birds are associated with the number of avian predators

Prospecting and dispersal: their eco-evolutionary dynamics and implications for population patterns

Disentangling genetic, plastic and social learning drivers of sex-specific foraging behaviour in Trinidadian guppies (Poecilia reticulata)