GDC: Riot Experimentally Investigates Online Toxicity

tribunal2Riot Games has gotten a fair amount of press in recent months regarding their empirically-based research on the nature of “toxic” player behavior in League of Legends.  As a result, I wasn’t surprised to find standing room only for Jeffrey Lin’s (Lead Designer of Social Systems for LoL) talk on research-informed measures for managing toxic behavior in online games.

Lin opened with the common notion that online gameplay has an inherently toxic element that must simply be accepted.  However, as this assumption is costly (players leave due to toxicity), Lin and his team – including several Ph.D.’s in fields ranging from cognitive neuroscience to human factors, who themselves are gamers – have sought to challenge it.  Working with designers, marketing, UI, and other production staff, the team of research specialists have conducted a series of empirical studies in-game investigating the nature of toxicity and features for potentially mitigating it.

Riot first constructed “behavior profiles” for individual players, examining the severity of toxic offenses across game sessions.  They found that severe toxicity in a given player is rare; rather, many games seem toxic because a single player is having a single, uncharacteristically “bad day”.  This lead the team to infer that toxicity may perpetuate through a ripple effect, as negativity fleetingly spreads from one player to others.

To investigate this idea the researchers conducted an experiment in which cross-team chat, as one of the main venues for negative interactions, was made optional for individual players.  And indeed, they observed a significant decrease in all measures of toxicity (offensive language, obscenity, and displays of negative attitudes).  Moreover, the total percentage of games using chat remained the same (only 46-47% included no chat, both before and after).  Lin and team therefore concluded that shielding players from toxic behavior can in fact prevent it from spreading.

Following this the team wondered if toxicity and attitudes about it could be changed by engaging players regarding their negative behavior.  This lead to the introduction of LoL’s Tribunal – a system by which the player community votes on whether a given player’s behavior should be sanctioned and the severity of any punishments (usually in terms of how many days a ban should last).  Lin noted that as of two weeks ago, the Tribunal has registered 105 million votes and, perhaps more impressive, has lead to 280,000 reformed players (those that have been punished previously but are currently in positive standing).  With regards to the “accuracy” of social sanctions, Lin also noted approximately 80% agreement between the community and Riot’s in-house team (with the team actually being the more severe of the two parties).


Sample League of Legends forums comments shared by Dr. Jeffrey Lin of Riot Games. No copyright of slide contents claimed by Motivate Play.

Lin then explained that, up to that point, players being punished with toxicity-related account bans in LoL were typically provided with vague notifications, messages that detailed the length of the ban but lacking real details on why the sanction was coming down on them.  To this end, the team conducted a third experiment in the series, to investigate if explicit feedback on previous behavior would increase reform rate.  All banned players were sent Tribunal reform cards, providing greater details on the player’s offense.  Not only did reports of toxic behavior decrease afterward, but forum posts showed that when offenders went to the forums and complained about how a particular behavior lead to a ban, the community generally agreed with the punishment.  What’s more, according to Lin, is that penalized players have written in to the moderators, apologizing for their behavior and asking for guidance on how to reform or prevent future transgressions.

Finally, Lin closed with a quick summary and partial report on one of the team’s most recent efforts, a study dubbed the “Optimus Experiment”. Reflecting on the psychological literature on priming effects, Lin and colleagues wondered if it might be possible to prime players so as to reduce toxic behavior.  To explain the concept to the non-academic audience, he noted that brief exposure to the color read can cause people to do relatively worse on an exam and that exposure to words related to the elderly can result in people walking more slowly (likely referring to this work on color association and Bargh’s renown experiments on stereotype priming).

The experiment was a 5 (information category) x 3 (color) x 4 (information location) factorial design, in which players received different types of game-related information in different game screens.  Category types included positive player behavior stats, negative player behavior stats, self-reflection notes, fun facts and a control (general gameplay tips).  The font colors for these messages included red, blue (thought to be associated with creativity) and white (control).  Message display location conditions included the loading screen, in-game, both, and none.

Lin briefly shared, for the first time, just a few of the results from the Optimus study.  One interesting finding was that showing a red message about negative behavior during the loading screen lead to a much larger decrease in toxic behaviors (in terms of attitude displays, abuse, and offensive language) than did the exact same message in a white font.  Additionally, showing a blue message about positive, cooperative behavior during the loading screen also lead to a decrease in a negative behavior, while no effect was observed for the same message in white.  And, interestingly, when the question “Who will be the most sportsmanlike?” (a positive behavior message) was presented in red, the toxic behavior metrics actually all increased.

Lin was quick to note that these studies are just the beginning, with a number a potential questions about the nature of toxic player behavior that could be examined. For instance, he briefly mentioned that the observed changes in behavior may be due to the spotlight effect, an assumption that we assume further research could later test more precisely.

Together, these results have lead Lin and colleagues to conclude that players are not innately toxic and that context is key for shaping behavior in online gameplay. To this end, he suggested to the other developers in the audience that it is their responsibility to help their players, to provide the information and mechanics necessary for removing oneself from negative behavior or bad choices rather than to simply remove offensive players from the game.  Altogether, I was quite  impressed with his team’s inclination to conduct these studies as well as the conclusions they took from the collective results.  It would seem that Riot, in turning to their scientists for answers, seeks to route toxicity by understanding and refining the player experience (bottom-up) as opposed to simply extracting offenders in full (top-down).  That is, user-centric, psychology-based design and policy rather than a blind “War on Toxicity” lacking nuance.  Indeed, in not only giving scientists a seat at the table but also relying on their insights for important development decisions, Riot is poising itself as one of the most well-informed designers of player experience, with likely long-term implications for both player retention and revenue.

GDC: Riot Experimentally Investigates Online Toxicity by Jim Cummings, unless otherwise expressly stated, is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License.

17 Responses to “GDC: Riot Experimentally Investigates Online Toxicity”

  1. Lauren says:

    Very cool findings, thank you for reporting them. It's heartening to see the inclusion of scientists in game development and the cross-disciplinary presentation of results.

    Do they have any slides or papers or anything available for view?

    • Jim says:

      Hey there Lauren,

      Agreed - discussing the talk with others, we all found it encouraging (both as academic researchers and as players) that Riot has made an explicit move to draw upon scientifically-derived insights. I think it's all very promising.

      Regarding results, I don't believe any mention was made of any publicly-available reports of their work. However, I'm hoping to follow-up with their team in the near future...

  2. Steve L. says:

    I'd be very curious as to how Lin et. al. are defining toxicity in terms of their metrics (which there is no mention of in the above article). Any ideas?

    In this regard, I'd be interested in looking at how much of the variation in attrition rates are actually explained by these toxicity metrics. This would really give us a good idea of how severe toxicity actually is in effecting changes in churn/retention.

    Am currently working on a platform that will allow us to test such things in the Minecraft environment... Should be interesting. Will follow up when I know more. Anyone interested, please get in touch with me. Am open for collaboration on these issues.

  3. Small items like these actually set League apart from it really is rivals.
    The problem with the Korean inflation is that unlike Brood War, most of the audience for Star - Craft
    2 came from countries other than South Korea. If you feel like spending some money you do have the option of
    acquiring neat new looks (skins) for your characters, but no player will acquire an unfair advantage from shelling out much more
    money than someone else.

  4. Hey I found a awesome hack site for clash of kings game.
    Here you can generate unlimited resources to your account .
    Join and have fun !

  5. Terese says:

    Empathy is different than sympathy, as sympathy is
    feeling sorry for the person's circumstances, while empathy is the ability to step into
    customer's shoes. As a result, the concept of online marketing took center stage and had eventually taken its stride in the last couple of years.
    They can update the customer with their new product by sending them an email.

  6. Plus, your contact lenses don't always contain the same prescription as your eyeglasses do.
    We're all for websites that offer promotions that help
    save money, which is why Eye - Buy - Direct. Laser cryptolysis or resurfacing
    is also often advised.

  7. Roxie says:

    At the same time as the Sega Master System was released, so was the Atari 1000.
    Residents of a dieselpunk setting view technology differently.
    If looking at the past i'd identify that before only a few folks played
    browsergames if we review the range that the overall participant
    add up is at now.

  8. Just wish to say your article is as astounding. The clearness in your post is
    just excellent and i can assume you're an expert on this subject.

    Well with your permission allow me to grab your
    RSS feed to keep updated with forthcoming post. Thanks a million and please keep up the rewarding work.

  9. I got what you intend, regards for putting up.Woh I am glad to find this website through google.

  10. lina says:

    whoah this blog is wonderful i really like reading your articles. Keep up the great paintings! You realize, a lot of people are hunting round for this info, you could help them greatly.

  11. lina says:

    I have read so many posts about the blogger lovers however this post is really a good piece of writing, keep it up

  12. rama says:

    I have read so many posts about the blogger lovers howeverthis post is really a good piece of writing, keep it up.

  13. I have been examinating out many of your stories and i must say pretty clever stuff. I will make sure to bookmark your website.

  14. After checking out a few of the articles on your site, I honestly appreciate your way of writing a blog. I book marked it to my bookmark site list and will be checking back in the near future. Please check out my web site too and let me know how you feel.

  15. One thing I would really like to say is the fact car insurance termination is a feared experience so if you're doing the right things being a driver you will not get one. A number of people do obtain the notice that they have been officially dumped by their own insurance company and many have to fight to get supplemental insurance from a cancellation. Cheap auto insurance rates tend to be hard to get after a cancellation. Understanding the main reasons regarding auto insurance cancellations can help car owners prevent burning off one of the most vital privileges available. Thanks for the tips shared by your blog.

  16. Kym Doire says:

    Hello there! Do you know if they make any plugins to help with SEO? I'm trying to get my blog to rank for some targeted keywords but I'm not seeing very good success. If you know of any please share. Appreciate it!


  1. League of Legends – Van Frustratie Tot Rechtzaak | Gamebooz - [...] te halen is inspirerend en noemenswaardig. Voor meer informatie over Riot’s onderzoek is hier te vinden in het oorspronkelijke [...]
  2. How League of Legends user research brings real results » Gaming News Alerts - [...] part of our coverage of this year’s Game Developers Conference, I offered a summary of Jeffrey Lin’s (Lead Designer …
  3. Kill Screen: Facebook's Social Experiments Are Only The Beginning - PSFK - […] systems designer Jeff Lin, for example, has been conducting “priming” experiments in an attempt to reduce negative behavior. Simply changing …
  4. The Ethics of UX Research | UX Booth - […] was performed by Dr. Jeffrey Lin, a research scientist with Riot Games trying to better understand reports of “toxic …
  5. The Ethics of UX Research | - […] was performed by Dr. Jeffrey Lin, a research scientist with Riot Games trying to better understand reports of “toxic …
  6. The Ethics of UX Research | UX World - […] was performed by Dr. Jeffrey Lin, a research scientist with Riot Games trying to better understand reports of “toxic …
  7. Today's Author | How to Talk to People Online - […] disinhibition effect‘ for an better understanding of online chats. Or this one from Jeffrey Lin on the toxicity of …
  8. How to Talk to People Online | WordDreams... - […] disinhibition effect‘ for an better understanding of online chats. Or this one from Jeffrey Lin on the toxicity of …
  9. How to Talk to People Online « Jacqui Murray - […] disinhibition effect‘ for an better understanding of online chats. Or this one from Jeffrey Lin on the toxicity of …
  10. Interface: 17. Sorry, I’m Going to Be The Liability | - […] discusses how they tested eliminating toxicity -Another Jeff Lin talk -Yet another Jeff Lin talk -More on Jeff’s experiments …

Leave a Reply to Hairstyles VIP Cancel reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>