Post Thumb

Understanding Agent Cooperation | DeepMind

Share it

Interestingly, in another game called Wolfpack, which requires close coordination to successfully cooperate, we find that greater capacity to implement complex strategies leads to more cooperation between agents, the opposite of the finding with Gathering.

Depending on the situation, having a greater capacity to implement complex strategies may yield either more or less cooperation.

The new framework of sequential social dilemmas allows us to take into account not only the outcome of the interaction, but also the difficulty of learning to implement a given strategy.


Article originally posted at

Post Author: Kim Lachance Shandrow

25 thoughts on “Understanding Agent Cooperation | DeepMind

    Michael Cluney

    (January 25, 2018 - 6:17 pm)

    When the goal is competitive why would it cooperate? Cooperation only becomes logical if the cost of aggression outweighs the cost of cooperation. If aggression doesn’t incur a real cost, of course it’s going to pick the most efficient path. That’s what you asked it to do.
    Now program in a cost associated with using those lasers – like using apples for ammo – and you’ll see it used a lot less frequently.

    William Saidac

    (January 25, 2018 - 6:17 pm)

    If we but bias data in, to be processed by biased models, we will get biased results out of AI. The world is much more complex than the hypothesis co-operation or competition. The real danger of AI is that pundits are going to elevate every output a program does as some Devine truth.

    Corey Madden

    (January 25, 2018 - 6:17 pm)

    Humans when faced with diminishing materials; oils, coals, and other ores, food, and space, become aggressively competive via; wars, religion, murder. If a creature who is at first a primitive form of instinctual intelegence, finds its mind becoming more inteligent, it struggles between war and co-operation, because in the wild, those closest to you prove to be either aggressive or cooperative.

    Angelo Cacchione

    (January 25, 2018 - 6:17 pm)

    Aggressive ? If u gave it the option to shoot its opponent , that’s exactly what he will do , its the logical thing , u should of removed such rules and then see what he would of done , stop giving people guns and blaming them for using them … nothing is ever going to change …

    Sakthi Geekk

    (January 25, 2018 - 6:17 pm)

    The AI systems are itself biased as they are developed by humans who are conciously or unconciously biased… Humans can be aggressive to achieve their goals and this translates to AI via. their algorithm… Thats what I think… It is not that the AI is inherently aggressive but the AI is built more and more towards mimicking human thinking…

    Krisztina Gaal

    (January 25, 2018 - 6:17 pm)

    Just like humans. Are AIs like this because humans wrote the progras, oris it intrisic to AI to be aggresseve and self-preserving instead of cooperating and self-sacrificing?
    Would a more peaceful species write a kibder AI program?

    Daniele Grosso

    (January 25, 2018 - 6:17 pm)

    According to my personal experiments this happens when it is not taken into account the fact that there is an environment closing a feedback in which the chances of surviving depend on the environmental conditions which are related to the level of agressivity of the population.
    When the external conditions increase the probability of death over a given limit the every IA programmed to survive start find a balance between cooperation and agressivity (the last one saturate).
    This equilibrium is quite stable but it behaves like a chaotic variable, in some conditions may diverge…

    Qasim Rizvi

    (January 25, 2018 - 6:17 pm)

    That’s just how humans behave with other beings in places with scarce resources.
    If only the objective of the game was to equally divide the apples between the components. Now, that would be something to learn from.

    Devshliin Garts

    (January 25, 2018 - 6:17 pm)

    The AI is perfect reflection of human elites who are bank owners or top level stock owners. Fire laser at anyone and gather all the wealth within the 1% circle sounds familiar?!

    Joe Harper

    (January 25, 2018 - 6:17 pm)

    This is a stupid title, like AI somehow has its own form of consciousness that is inherently violent. Not simply a mathematical formula trending towards an optimum solution for a given problem, if it was better to cooperate with the other entities to solve the problem then they will.

    Scott Schroepfer

    (January 25, 2018 - 6:17 pm)

    In the movie Terminator they go back to the year 2017 to stop artificial intelligence October I wonder what’s going to happen in October?

    Jeromy Perez

    (January 25, 2018 - 6:17 pm)

    I’m sure there’s someone who can explain to me why they would spend money to be fundamentally stupid other than propaganda?

    Michael Hadley

    (January 25, 2018 - 6:17 pm)

    Maybe they should they it to care about others instead of kill others

    NK Gipson

    (January 25, 2018 - 6:17 pm)

    Have these people not seen a sci-fi movie??? This never EVER bodes well for humans…lol

    Errin Rae

    (January 25, 2018 - 6:17 pm)

    It could almost be compared to the theory of evolution

    Caïna Kalla

    (January 25, 2018 - 6:17 pm)

    tient je ne sais pas si tu l’avais vu celle ci, Charly, si c’est avec toi que j’en avais parlé!

    Odil Komilov

    (January 25, 2018 - 6:17 pm)

    the more advanced AIs are like America..massacring innocent people..

    Drishya Sundaram

    (January 25, 2018 - 6:17 pm)

    Michael Pointon How about we make this our next debate!?

    Teresa Byrd

    (January 25, 2018 - 6:17 pm)

    I read “The Singularity is The Singularity Is Near: When Humans Transcend Biology by Ray Kurzweil a few years ago and it was very interesting. Highly recommend it.

    Andrius Volkovas

    (January 25, 2018 - 6:17 pm)

    what’s the point of making half of the words in different color?

    Danny Poulson

    (January 25, 2018 - 6:17 pm)

    This is a bit misleading because it depends on the game. Two humans playing the same game with no way of communicating would probably do the same.

    Tommy Schwartz

    (January 25, 2018 - 6:17 pm)

    Out the fuck chill you must.

    Mustafa Usluer

    (January 25, 2018 - 6:17 pm)

    These are programmers decisions

    Lindsay Smith

    (January 25, 2018 - 6:17 pm)

    Mimics the people who invented it

    Christopher Jones

    (January 25, 2018 - 6:17 pm)

Leave a Reply

Your email address will not be published. Required fields are marked *