Post Thumb

Understanding Agent Cooperation | DeepMind

Share it

Interestingly, in another game called Wolfpack, which requires close coordination to successfully cooperate, we find that greater capacity to implement complex strategies leads to more cooperation between agents, the opposite of the finding with Gathering.

Depending on the situation, having a greater capacity to implement complex strategies may yield either more or less cooperation.

The new framework of sequential social dilemmas allows us to take into account not only the outcome of the interaction, but also the difficulty of learning to implement a given strategy.


Article originally posted at

Post Author: Carla Parsons

25 thoughts on “Understanding Agent Cooperation | DeepMind

    Michael Cluney

    (October 29, 2017 - 8:05 am)

    When the goal is competitive why would it cooperate? Cooperation only becomes logical if the cost of aggression outweighs the cost of cooperation. If aggression doesn’t incur a real cost, of course it’s going to pick the most efficient path. That’s what you asked it to do.
    Now program in a cost associated with using those lasers – like using apples for ammo – and you’ll see it used a lot less frequently.

    William Saidac

    (October 29, 2017 - 8:05 am)

    If we but bias data in, to be processed by biased models, we will get biased results out of AI. The world is much more complex than the hypothesis co-operation or competition. The real danger of AI is that pundits are going to elevate every output a program does as some Devine truth.

    Corey Madden

    (October 29, 2017 - 8:05 am)

    Humans when faced with diminishing materials; oils, coals, and other ores, food, and space, become aggressively competive via; wars, religion, murder. If a creature who is at first a primitive form of instinctual intelegence, finds its mind becoming more inteligent, it struggles between war and co-operation, because in the wild, those closest to you prove to be either aggressive or cooperative.

    Angelo Cacchione

    (October 29, 2017 - 8:05 am)

    Aggressive ? If u gave it the option to shoot its opponent , that’s exactly what he will do , its the logical thing , u should of removed such rules and then see what he would of done , stop giving people guns and blaming them for using them … nothing is ever going to change …

    Sakthi Geekk

    (October 29, 2017 - 8:05 am)

    The AI systems are itself biased as they are developed by humans who are conciously or unconciously biased… Humans can be aggressive to achieve their goals and this translates to AI via. their algorithm… Thats what I think… It is not that the AI is inherently aggressive but the AI is built more and more towards mimicking human thinking…

    Krisztina Gaal

    (October 29, 2017 - 8:05 am)

    Just like humans. Are AIs like this because humans wrote the progras, oris it intrisic to AI to be aggresseve and self-preserving instead of cooperating and self-sacrificing?
    Would a more peaceful species write a kibder AI program?

    Daniele Grosso

    (October 29, 2017 - 8:05 am)

    According to my personal experiments this happens when it is not taken into account the fact that there is an environment closing a feedback in which the chances of surviving depend on the environmental conditions which are related to the level of agressivity of the population.
    When the external conditions increase the probability of death over a given limit the every IA programmed to survive start find a balance between cooperation and agressivity (the last one saturate).
    This equilibrium is quite stable but it behaves like a chaotic variable, in some conditions may diverge…

    Qasim Rizvi

    (October 29, 2017 - 8:05 am)

    That’s just how humans behave with other beings in places with scarce resources.
    If only the objective of the game was to equally divide the apples between the components. Now, that would be something to learn from.

    Devshliin Garts

    (October 29, 2017 - 8:05 am)

    The AI is perfect reflection of human elites who are bank owners or top level stock owners. Fire laser at anyone and gather all the wealth within the 1% circle sounds familiar?!

    Joe Harper

    (October 29, 2017 - 8:05 am)

    This is a stupid title, like AI somehow has its own form of consciousness that is inherently violent. Not simply a mathematical formula trending towards an optimum solution for a given problem, if it was better to cooperate with the other entities to solve the problem then they will.

    Scott Schroepfer

    (October 29, 2017 - 8:05 am)

    In the movie Terminator they go back to the year 2017 to stop artificial intelligence October I wonder what’s going to happen in October?

    Jeromy Perez

    (October 29, 2017 - 8:05 am)

    I’m sure there’s someone who can explain to me why they would spend money to be fundamentally stupid other than propaganda?

    Michael Hadley

    (October 29, 2017 - 8:05 am)

    Maybe they should they it to care about others instead of kill others

    NK Gipson

    (October 29, 2017 - 8:05 am)

    Have these people not seen a sci-fi movie??? This never EVER bodes well for humans…lol

    Errin Rae

    (October 29, 2017 - 8:05 am)

    It could almost be compared to the theory of evolution

    Caïna Kalla

    (October 29, 2017 - 8:05 am)

    tient je ne sais pas si tu l’avais vu celle ci, Charly, si c’est avec toi que j’en avais parlé!

    Odil Komilov

    (October 29, 2017 - 8:05 am)

    the more advanced AIs are like America..massacring innocent people..

    Drishya Sundaram

    (October 29, 2017 - 8:05 am)

    Michael Pointon How about we make this our next debate!?

    Teresa Byrd

    (October 29, 2017 - 8:05 am)

    I read “The Singularity is The Singularity Is Near: When Humans Transcend Biology by Ray Kurzweil a few years ago and it was very interesting. Highly recommend it.

    Andrius Volkovas

    (October 29, 2017 - 8:05 am)

    what’s the point of making half of the words in different color?

    Danny Poulson

    (October 29, 2017 - 8:05 am)

    This is a bit misleading because it depends on the game. Two humans playing the same game with no way of communicating would probably do the same.

    Tommy Schwartz

    (October 29, 2017 - 8:05 am)

    Out the fuck chill you must.

    Mustafa Usluer

    (October 29, 2017 - 8:05 am)

    These are programmers decisions

    Lindsay Smith

    (October 29, 2017 - 8:05 am)

    Mimics the people who invented it

    Christopher Jones

    (October 29, 2017 - 8:05 am)

Leave a Reply

Your email address will not be published. Required fields are marked *