endstream endobj 1 0 obj <> endobj 2 0 obj [/PDF/Text] endobj 3 0 obj <> endobj 8 0 obj <> endobj 9 0 obj <>stream This essay first appeared in the Acheson Prize 2018 Issue of the Yale Review of International Studies. Jean-Jacques Rousseau described a situation in which two individuals go out on a hunt. a 0000000696 00000 n However, anyone who hunts rabbit can do sosuccessfullyby themselves, but with a smaller meal. How can the security dilemma be mitigated and transcended? f(x)={332(4xx2)if0x40otherwisef(x)= \begin{cases}\frac{3}{32}\left(4 x-x^2\right) & \text { if } 0 \leq x \leq 4 \\ 0 & \text { otherwise }\end{cases} The hunters hide and wait along a path. and other examples to illustrate how game theory might be applied to understand the Taiwan Strait issue. In their paper, the authors suggest Both the game that underlies an arms race and the conditions under which it is conducted can dramatically affect the success of any strategy designed to end it[58]. We see this in the media as prominent news sources with greater frequency highlight new developments and social impacts of AI with some experts heralding it as the new electricity.[10] In the business realm, investments in AI companies are soaring. This may not amount to a recipe for good governance, but it has meant the preservation of a credible bulwark against state collapse. Use integration to find the indicated probabilities. The second technology revolution caused World War II. We are all familiar with the basic Prisoners Dilemma. Perhaps most alarming, however, is the global catastrophic risk that the unchecked development of AI presents. I thank my advisor, Professor Allan Dafoe, for his time, support, and introduction to this papers subject matter in his Global Politics of AI seminar. 2020 Yale International Relations Association | New Haven, CT, https://www.technologyreview.com/s/610026/algorithms-are-making-american-inequality-worse/, https://www.belfercenter.org/sites/default/files/files/publication/AI%20NatSec%20-%20final.pdf, Preparing for the Future of Artificial Intelligence, Artificial Intelligence, Automation, and the Economy, https://www.nytimes.com/2017/07/20/business/china-artificial-intelligence.html, Interview with YPG volunteer soldier Brace Belden, Shaping Saddam: How the Media Mythologized A Monster Honorable Mention, Probability Actor A believes it will develop a beneficial AI, Probability Actor B believes Actor A will develop a beneficial AI, Probability Actor A believes Actor B will develop a beneficial AI, Probability Actor B believes it will develop a beneficial AI, Probability Actor A believes AI Coordination Regime will develop a beneficial AI, Probability Actor B believes AI Coordination Regime will develop a beneficial AI, Percent of benefits Actor A can expect to receive from an AI Coordination Regime, Percent of benefits Actor B can expect to receive from an AI Coordination Regime, Actor As perceived utility from developing beneficial AI, Actor Bs perceived utility from developing beneficial AI, Probability Actor A believes it will develop a harmful AI, Probability Actor B believes Actor A will develop a harmful AI, Probability Actor A believes Actor B will develop a harmful AI, Probability Actor B believes it will develop a harmful AI, Probability Actor A believes AI Coordination Regime will develop a harmful AI, Probability Actor B believes AI Coordination Regime will develop a harmful AI, Actor As perceived harm from developing a harmful AI, Actor Bs perceived harm from developing a harmful AI. endstream endobj 12 0 obj <>stream The Stag Hunt represents an example of compensation structure in theory. The story is briefly told by Rousseau, in A Discourse on Inequality : If it was a matter of hunting a deer, everyone well realized that he must remain faithful to his post; but if a hare happened to pass within reach of one of them, we cannot doubt that he would h ave gone off in pursuit . 0 A person's choice to bind himself to a social contract depends entirely on his beliefs whether or not the other person's or people's choice. [25] For more on the existential risks of Superintelligence, see Bostrom (2014) at Chapters 6 and 8. PDF The Stag Hunt - University of California, Irvine Dipali Mukhopadhyay is an associate professor of international and public affairs at Columbia University and the author of Warlords, Strongman Governors, and the State in Afghanistan (Cambridge University Press, 2014). While each actors greatest preference is to defect while their opponent cooperates, the prospect of both actors defecting is less desirable then both actors cooperating. [52] In the context of developing an AI Coordination Regime, recognizing that two competing actors are in a state of Deadlock might drive peace-maximizing individuals to pursue de-escalation strategies that differ from other game models. THE STAG HUNT THE STAG HUNT T HE Stag Hunt is a story that became a game. For instance, if the expected punishment is 2, then the imposition of this punishment turns the above prisoner's dilemma into the stag hunt given at the introduction. Here, both actors demonstrate a high degree of optimism in both their and their opponents ability to develop a beneficial AI, while this likelihood would only be slightly greater under a cooperation regime. HW?n9*K$kBOQiBo1d\QlQ%AAW\gQV#j^KRmEB^]L6Rw4muu.G]a>[U/h;@ip|=PS[nyfGI0YD+FK:or+:=y&4i'kvC In this article, we employ a class of symmetric, ordinal 2 2 games including the frequently studied Prisoner's Dilemma, Chicken, and Stag Hunt to model the stability of the social contract in the face of catastrophic changes in social relations. [9] That is, the extent to which competitors prioritize speed of development over safety (Bostrom 2014: 767). An example of norm enforcement provided by Axelrod (1986: 1100) is of a man hit in the face with a bottle for failing to support a lynching in the Jim Crow South. The payoff matrix is displayed as Table 12. How do strategies of non-violent resistance view power differently from conventional 'monolithic' understandings of power? (lljhrpc). For example, if the two international actors cooperate with one another, we can expect some reduction in individual payoffs if both sides agree to distribute benefits amongst each other. As a result, it is conceivable that international actors might agree to certain limitations or cooperative regimes to reduce insecurity and stabilize the balance of power. hRj0pq%[a00a IIR~>jzNTDLC=Qm=,e-[Vi?kCE"X~5eyE]/2z))!6fqfx6sHD8&: s>)Mg 5>6v9\s7U One is the coordination of slime molds. In this book, you will make an introduction to realism, liberalism and economic structuralism as major traditions in the field, their historical evolution and some theories they have given birth . When looking at these components in detail, however, we see that the anticipated benefits and harms are linked to whether the actors cooperate or defect from an AI Coordination Regime. Like the hunters in the woods, Afghanistans political elites have a great deal, at least theoretically, to gain from sticking together. [47] look at different policy responses to arms race de-escalation and find that the model or game that underlies an arms race can affect the success of policies or strategies to mitigate or end the race. This equilibrium depends on the payoffs, but the risk dominance condition places a bound on the mixed strategy Nash equilibrium. First-move advantage will be decisive in determining the winner of the race due to the expected exponential growth in capabilities of an AI system and resulting difficulty of other parties to catch up. In the Prisoner's dilemma, defect is a dominant strategy and only the bad outcome is possible. Because of the instantaneous nature of this particular game, we can anticipate its occurrence to be rare in the context of technology development, where opportunities to coordinate are continuous. The corresponding payoff matrix is displayed as Table 10. For example, Stag Hunts are likely to occur when the perceived harm of developing a harmful AI is significantly greater than the perceived benefit that comes from a beneficial AI. [25] In a particularly telling quote, Stephen Hawking, Stuart Russell, Max Tegmark, and Frank Wilczek foreshadow this stark risk: One can imagine such technology outsmarting financial markets, out-inventing human researchers, out-manipulating human leaders, and developing weapons we cannot even understand. The ultimate resolution of the war in Afghanistan will involve a complex set of interlocking bargains, and the presence of U.S. forces represents a key political instrument in those negotiations. [7] E.g. For example, in a scenario where the United States and Russia are competing to be the one to land on the moon first, the stag hunt would allow the two countries to work together to achieve this goal when they would have gone their separate ways and done the lunar landing on their own. But cooperation is not easy. Structural Conflict Prevention refers to a compromosde of long term intervention that aim to transform key socioeconomic, political and institional factors that could lead to conflict. 7into the two-person Stag Hunt: This is an exact version of the8 informal arguments of Hume and Hobbes. It comes with colossal opportunities, but also threats that are difficult to predict. [8] Elsa Kania, Beyond CFIUS: The Strategic Challenge of Chinas Rise in Artificial Intelligence, Lawfare, June 20, 2017, https://www.lawfareblog.com/beyond-cfius-strategic-challenge-chinas-rise-artificial-intelligence (highlighting legislation considered that would limit Chinese investments in U.S. artificial intelligence companies and other emerging technologies considered crucial to U.S. national security interests). Can you think of any situations of scenarios in international Moreover, they also argue that pursuing all strategies at once would also be suboptimal (or even impossible due to mutual exclusivity), making it even more important to know what sort of game youre playing before pursuing a strategy[59]. Together, this is expressed as: One last consideration to take into account is the relationship between the probabilities of developing a harmful AI for each of these scenarios. Although most authors focus on the prisoner's dilemma as the game that best represents the problem of social cooperation, some authors believe that the stag hunt represents an equally (or more) interesting context in which to study cooperation and its problems (for an overview see Skyrms 2004). But the moral is not quite so bleak. Therefore, if it is likely that both actors perceive to be in a state of Prisoners Dilemma when deciding whether to agree on AI, strategic resources should be especially allocated to addressing this vulnerability. Finally, a Stag Hunt occurs when the returns for both actors are higher if they cooperate than if either or both defect. Such a Coordination Regime could also exist in either a unilateral scenario where one team consisting of representatives from multiple states develops AI together or a multilateral scenario where multiple teams simultaneously develop AI on their own while agreeing to set standards and regulations (and potentially distributive arrangements) in advance. The best response correspondences are pictured here. The complex machinations required to create a lasting peace may well be under way, but any viable agreementand the eventual withdrawal of U.S. forces that would entailrequires an Afghan government capable of holding its ground on behalf of its citizens and in the ongoing struggle against violent extremism. Example of stag hunt in international relations - United States guide In short, the theory suggests the variables that affect the payoff structure of cooperating or defecting from an AI Coordination Regime that determine which model of coordination we see arise between the two actors (modeled after normal-form game setups). Stag Hunt: Anti-Corruption Disclosures Concerning Natural Resources [21] Jackie Snow, Algorithms are making American inequality worse, MIT Technology Review, January 26, 2018, https://www.technologyreview.com/s/610026/algorithms-are-making-american-inequality-worse/; The Boston Consulting Group & Sutton Trust, The State of Social mobility in the UK, July 2017, https://www.suttontrust.com/wp-content/uploads/2017/07/BCGSocial-Mobility-report-full-version_WEB_FINAL-1.pdf. The Stag Hunt UCI School of Social Sciences, Example of stag hunt in international relations, on Example of stag hunt in international relations, https://en.wikipedia.org/wiki/Stag_Hunt_Mosaic, example of application letter for sales representative, Example of selection criteria planning and organising, Example sentences with the word detrimental, Manual de access 2010 avanzado pdf en espanol gratis. For Rousseau, in his famous parable of the stag hunt, war is inevitable because of the security dilemma and the lack of trust between states. Using game theory as a way of modelingstrategicallymotivated decisions has direct implications for understanding basic international relations issues. If the regime allows for multilateral development, for example, the actors might agree that whoever reaches AI first receives 60% of the benefit, while the other actor receives 40% of the benefit. A sudden drop in current troop levels will likely trigger a series of responses that undermine the very peace and stability the United States hopes to achieve. hunting stag is successful only if both hunters hunt stag, while each hunter can catch a less valuable hare on his own. One significant limitation of this theory is that it assumes that the AI Coordination Problem will involve two key actors. The Stag Hunt - YouTube I also examine the main agenda of this paper: to better understand and begin outlining strategies to maximize coordination in AI development, despite relevant actors varying and uncertain preferences for coordination. 'War appears to be as old as mankind, but peace is a modern invention'. Most prominently addressed in Nick Bostroms Superintelligence, the creation of an artificial superintelligence (ASI)[24] requires exceptional care and safety measures to avoid developing an ASI whose misaligned values and capacity can result in existential risks for mankind. The hedge is shared so both parties are responsible for maintaining it. [11] In our everyday lives, we store AI technology as voice assistants in our pockets[12] and as vehicle controllers in our garages. Using their intuition, the remainder of this paper looks at strategy and policy considerations relevant to some game models in the context of the AI Coordination Problem. War is anarchic, and intervening actors can sometimes help to mitigate the chaos. The first technology revolution caused World War I. Uneven distribution of AIs benefits couldexacerbate inequality, resulting in higher concentrations of wealth within and among nations. Here, this is expressed as P_(h|A or B) (A)h_(A or B). [5] They can, for example, work together to improve good corporate governance. In this scenario, however, both actors can also anticipate to the receive additional anticipated harm from the defector pursuing their own AI development outside of the regime. You note that the temptation to cheat creates tension between the two trading nations, but you could phrase this much more strongly: theoretically, both players SHOULD cheat. Individuals, factions and coalitions previously on the same pro-government side have begun to trade accusations with one another. Stag hunt - Wikipedia In addition to leadership, the formation of a small but successful group is also likely to influence group dynamics. Stag Hunt - Game Theory .net Although the development of AI at present has not yet led to a clear and convincing military arms race (although this has been suggested to be the case[43]), the elements of the arms race literature described above suggest that AIs broad and wide-encompassing capacity can lead actors to see AI development as a threatening technological shock worth responding to with reinforcements or augmentations in ones own security perhaps through bolstering ones own AI development program. Here, values are measured in utility. To begin exploring this, I now look to the literature on arms control and coordination. [23] United Nations Office for Disarmament Affairs, Pathways to Banning Fully Autonomous Weapons, United Nations, October 23, 2017, https://www.un.org/disarmament/update/pathways-to-banning-fully-autonomous-weapons/. An individual can get a hare by himself, but a hare is worth less than a stag. Payoff matrix for simulated Prisoners Dilemma. Intuition and Deliberation in the Stag Hunt Game - Nature This can be facilitated, for example, by a state leader publicly and dramatically expressing understanding of danger and willingness to negotiate with other states to achieve this. It truly takes a village, to whom this paper is dedicated. Course blog for INFO 2040/CS 2850/Econ 2040/SOC 2090, Link: http://www.socsci.uci.edu/~bskyrms/bio/papers/StagHunt.pdf. In times of stress, individual unicellular protists will aggregate to form one large body. A major terrorist attack launched from Afghanistan would represent a kind of equal opportunity disaster and should make a commitment to establishing and preserving a capable state of ultimate value to all involved. 0 Battle of the sexes (game theory) - Wikipedia Outline a basic understanding of what the discipline of International Relations is about, and Jean Jacques Rousseau (1712-1778): Parable of the Stag Hunt. On the other hand, Glaser[46] argues that rational actors under certain conditions might opt for cooperative policies. This additional benefit is expressed here as P_(b|A) (A)b_A. In the stag hunt, what matters is trust Can actors trust that the other will follow through Depends on what they believe about each other, What actors pursue hinges on how likely the other actor is to follow through What is Game Theory theory of looking strategic interaction Under this principle, parties to an armed conflict must always distinguish between civilians and civilian objects on the one hand, and combatants and military targets on the other. As a result, this could reduce a rival actors perceived relative benefits gained from developing AI. Furthermore, in June 2017, China unveiled a policy strategy document unveiling grand ambitions to become the world leader in AI by 2030. SCJ Int'l L. & Bus. So it seems that the moral of the story is that we are selfish human beings with little patience or trust in others, even if that cooperation meant mutual benefit. Table 9. Finally, there are a plethora of other assuredly relevant factors that this theory does not account for or fully consider such as multiple iterations of game playing, degrees of perfect information, or how other diplomacy-affecting spheres (economic policy, ideology, political institutional setup, etc.) In addition to boasting the worlds largest economies, China and the U.S. also lead the world in A.I. However, the interest of the state has continued to overshadow the interest of the people. As the infighting continues, the impulse to forego the elusive stag in favor of the rabbits on offer will grow stronger by the day. On a separate piece of paper, write the best possible answer for each one. For example, Stag Hunts are likely to occur when the perceived harm of developing a harmful AI is significantly greater than the perceived benefit that comes from a beneficial AI . As we discussed in class, the catch is that the players involved must all work together in order to successfully hunt the stag and reap the rewards once one person leaves the hunt for a hare, the stag hunt fails and those involved in it wind up with nothing. Language links are at the top of the page across from the title. If all the hunters work together, they can kill the stag and all eat. In order for human security to challenge global inequalities, there has to be cooperation between a country's foreign policy and its approach to global health. }}F:,EdSr Both actors see the potential harms from developing AI to be significant greater than the potential benefits, but expect that cooperating to develop AI could still result in a positive benefit for both parties. <>stream The corresponding payoff matrix is displayed as Table 14. Moreover, the usefulness of this model requires accurately gauging or forecasting variables that are hard to work with. [11] This Article conceptualizes a stag hunt in which the participants are countries that host extractive companies on their stock exchanges, including the U.S., Canada, the United Kingdom, the Member States . Each can individually choose to hunt a stag or hunt a hare. endobj [51] An analogous scenario in the context of the AI Coordination Problem could be if both international actors have developed, but not yet unleashed an ASI, where knowledge of whether the technology will be beneficial or harmful is still uncertain. Any individual move to capture a rabbit will guarantee a small meal for the defector but ensure the loss of the bigger, shared bounty. In 2016, the Obama Administration developed two reports on the future of AI. Hume's second example involves two neighbors wishing to drain a meadow. NUMBER OF PAGES 65 14. The 18th century political philosopher Jean-Jacques Rousseau famously described a dilemma that arises when a group of hunters sets out in search of a stag: To catch the prized male deer, they must cooperate, waiting quietly in the woods for its arrival. If, by contrast, the prospect of a return to anarchy looms, trust erodes and short-sighted self-interest wins the day. From that moment on, the tenuous bonds keeping together the larger band of weary, untrusting hunters will break and the stag will be lost. [29] There is a scenario where a private actor might develop AI in secret from the government, but this is unlikely to be the case as government surveillance capabilities improve. PDF A game theory view of the relationship between the U.S., China and Taiwan Of Stag Hunts and secret societies: Cooperation, male coalitions and Meanwhile, the escalation of an arms race where neither side halts or slows progress is less desirable to each actors safety than both fully entering the agreement. N-person stag hunt dilemmas Jorge M. Pachecol'*, Francisco C. Santos2, Max O. Souza3 and Brian Skyrms4 . Stag hunt - Wikipedia Within the arms race literature, scholars have distinguished between types of arms races depending on the nature of arming. Uncategorized, Mail (will not be published) One example payoff structure that results in a Deadlock is outlined in Table 9. [11] McKinsey Global Institute, Artificial Intelligence: The Next Digital Frontier, June 2017, https://www.mckinsey.com/~/media/McKinsey/Industries/Advanced%20Electronics/Our%20Insights/How%20artificial%20intelligence%20can%20deliver%20real%20value%20to%20companies/MGI-Artificial-Intelligence-Discussion-paper.ashx: 5 (estimating major tech companies in 2016 spent $20-30 billion on AI development and acquisitions). A common example of the Prisoners Dilemma in IR is trade agreements. Several animal behaviors have been described as stag hunts. Table 2. 0000003638 00000 n To what extent are today's so-called 'new wars' (Mary Kaldor) post Clausewitzean in nature? [49] For example, see Glenn H. Snyder Prisoners Dilemma and Chicken Models in International Politics, International Studies Quarterly 15, 1(1971): 66103 and Downs et al., Arms Races and Cooperation., [50] Snyder, Prisoners Dilemma and Chicken Models in International Politics., [51] Snyder, Prisoners Dilemma and Chicken Models in International Politics.. d Table 8. Prisoner's Dilemma - Stanford Encyclopedia of Philosophy Two players, simultaneous decisions. Additionally, this model accounts for an AI Coordination Regime that might result in variable distribution of benefits for each actor. Last Resort, Legitimate authority, Just cause, high probablity of succession, right intention, proportionality, casualities. This is the third technology revolution., Artificial intelligence is the future, not only for Russia, but for all humankind. SECURITY CLASSIFICATION OF REPORT Unclassified 18. First, I survey the relevant background of AI development and coordination by summarizing the literature on the expected benefits and harms from developing AI and what actors are relevant in an international safety context. Explain how the 'Responsibility to Protect' norm tries to provide a compromise between the UN Charter's principle of non-interference (state sovereignty) and the UN genocide convention. [32] Paul Mozur, Beijing Wants A.I. (1) the responsibility of the state to protect its own population from genocide, war crimes, ethnic cleansing and crimes against humanity, and from their incitement; What is the difference between structural and operational conflict prevention? Table 13. Similar strategic analyses can be done on variables and variable relationships outlined in this model. This article is about the game theory problem about stag hunting. If an individual hunts a stag, he must have the cooperation of his partner in order to succeed. @scR^}C$I3v95p6S'34Y1rar{SQ!#fzHBM6 K4m|OOpa7rB'~Y(A|'vh=ziN/quu~6,{Q Instead, each hunter should separately choose the more ambitious and far more rewarding goal of getting the stag, thereby giving up some autonomy in exchange for the other hunter's cooperation and added might. Type of game model and prospect of coordination.
Mussolini Speech 1936,
Breeze Airways Flight Attendant,
Oxford High School Baseball Coach,
El Salvador Native Female Names,
Articles S