How to Reduce Antisocial Behavior

Recently Bungie (Halo 4)  and NCsoft (Guild wars 2) have both taken a very aggressive stance on antisocial behavior in chat channels. Both companies have begun to ban players who use hate speech. Now, as far as I can tell banning such behavior can be difficult and I haven’t heard reports of how well it is going. Trolls and griefers can be crafty and may find other ways outside chat to reduce the enjoyment of the community. As these companies have taken some excellent steps toward getting rid of bad behavior, I wanted to help. In order to do so, I’ve compiled some suggestions for how to make more prosocial online communities based on my own research and that of others in the field of social policy.

1: The overall goal should be to build community norms.

My dissertation focuses specifically on how game developers can use norms reduce antisocial behavior in the online communities in games.  Norms are powerful in that they emerge from community behavior. When a norm exists the community can reduce the cost of surveillance. If norms exist then a developer can rely on community members to report or even sanction (punish) players who are behaving badly. This can reduce costs for developers and even empower community members possibly increasing the feeling of self-determination.

2: There are two types of norms. Both are important.

That’s right, there are two types of norms. The first are known as descriptive norms – these communicate what other players are doing. In other words, descriptive norms can be observed in the behavior of others (in chat channels they are broadcast). This information is extremely important for developers because humans have a propensity to copy others, and to use relatively small amounts of social information to inform decisions and form scripts about their environments. What this means is that it is possible for antisocial behavior to spread through a community - especially if it is intrinsically motivating - and that a small amount of bad behavior can set off a chain reaction of bad behavior. Think flame wars, white-knighting, etc. When people get mad at trolls and griefers revenge or good intentions can actually lead to more antisocial behavior.

The second type of norm is called a social or injunctive norm. These are important because they put social pressure on individuals. They communicate what others expect. Yet, games often lack clear communication of these norms, which draw their power from shame and social expectation. In addition, it seems like players in online environments are less responsive to shame – as they probably recognize there are no lasting reputational implications. In the real world social norms are generally also accompanied by sanctions for transgression.

I want to make an important note about these two types of norms. They should be treated as separate motivational forces. In addition, research indicates that descriptive norms out-rank social norms. What I mean is that if descriptive norms communicate that antisocial behavior is common then social norms will not hold up. If enough people are behaving antisocially no one will believe that other people expect them to be prosocial. Interestingly existing social norms can unexpectedly collapse if the public perception of descriptive norms changes  – Scott Page talks about how this can happen.

3: Sanctions

Given that the worst trolls and griefers actually like when others respond to their behavior (see flame wars) social norms (the expectations of others) are not enough to stop individuals and may sometimes encourage them. To stop the worst trolls and griefers you must punish them by taking away what they enjoy. One option for punishment is for developers to pay police officers to sanction deviants. This can work, but when there are a lot of players or games policing can be expensive - telemetry and machine learning can certainly help.

Another option if for the players to do the sanctioning. After all, policing griefers and trolls isn’t dangerous and if norms of prosocial behavior are in place players should feel expectations to sanction others bad behavior. Sanctioning systems can actually be complex and difficult to implement. Why? Well if they are too powerful and easy to use then they become a tool for griefing (ironic). However, if they are too weak or costly then they won’t be effective or be employed by community members. I won’t go into all of the details about how to make a great sanctioning system – in fact there are still many questions for community designers and researchers to address. However, I will give an example – like any game design this probably needs some iterative testing:

Points for antisocial behavior

  1. Players can earn points for bad behavior.
  2. Other players can assign points.
  3. Points expire after an amount of time.
  4. Points are multiplied when multiple players in one session report a transgression.
  5. Players who cross certain point threshold are hit with a graduated sanction (sanctions increase with the multiplier). First take away voice communication, then take away the game.
  6. Players can file an appeal within x days.
  7. Other players are given tools to research an appeal (telemetry data) and are paid in virtual currency for answering appeals (three random players must review the appeal and come to a consensus. If they do not it is passed to an actual customer service agent. Players earn trust ratings for arbitration.
  8. Players that lose arbitration hearings earn addition points.
  9. Players that sanction a player who wins an arbitration earn points that reduce their ability to sanction – for a long period of time.

4. Should sanctions be graduated?

One thing that is still uncertain in community management and research is if players should be banned or if sanctions should be graduated. There are arguments for both.

Ban Hammer

First, it seems that descriptive norms for antisocial behavior already exist in the chat channels of many online games. "That's just gamers being gamers." Or "Antisocial behavior is normal in these games." Creating norms for players to sanction bad behavior maybe difficult. And why would players sanction unless there are expectations that they should? There is something called the 2nd order free-rider problem where group members don't sanction because there is a cost. To get rid of the perception that antisocial behavior is normative or OK, the ban hammer maybe required. In addition,  sexism, racism, foul language deserves severe punishment.

Graduated Sanctions

However, what if people can be rehabilitated? What if individuals simply are following the status quo for FPS? In competitive environments it can be difficult to control ones emotions and sometimes people get frustrated. Could this be a teaching moment? Do people deserve a warning? Could this actually help people be more prosocial in real life? One of the findings of research in social policy is that very severe sanctions can actually be detrimental to a community. It doesn’t allow for second chances and can frustrate or create enemies. This is especially the case when descriptive and social norms of a certain behavior don’t exist or are not clearly communicated. In other words when players feel like they didn’t get a warning or understand what was expected of them, but still get the ban hammer. After all antisocial behavior has been normative in these environments for some time.


In conclusion, a significant amount of research exists that could help community managers build and sustain communities where prosocial behavior is normative. What I’ve talked about is really only the tip of the iceberg and there are still a lot of questions about behavior in online communities that need to be answered. It is up to game developers and researchers to keep trying to figure out how to construct societies that promote prosocial behavior.

If anyone things this is interesting and would like to apply it to their communities I’d be happy to talk about it in more detail – just leave a comment, tweet me or shoot an email.



How to Reduce Antisocial Behavior by Travis Ross, unless otherwise expressly stated, is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License.

21 Responses to “How to Reduce Antisocial Behavior”

  1. Proxy Store says:

    My wife and i were really satisfied that Peter managed to do his survey through your precious recommendations he received while using the blog. It's not at all simplistic to just possibly be giving out techniques which others might have been making money from. And we also fully understand we need the blog owner to be grateful to for this. The most important explanations you made, the straightforward website navigation, the friendships your site aid to engender - it's everything astounding, and it's really facilitating our son and the family do think this idea is thrilling, which is certainly very vital. Thank you for all!

  2. I and also my guys were looking at the great tips and tricks on the website while instantly came up with a terrible suspicion I never expressed respect to the blog owner for them. All of the women were passionate to learn all of them and now have certainly been using those things. We appreciate you truly being simply considerate and also for pick out certain useful resources most people are really wanting to be aware of. My personal sincere apologies for not expressing gratitude to you sooner.

  3. air jordan says:

    Thank you so much for giving everyone a very terrific possiblity to discover important secrets from here. It is often very nice and also jam-packed with fun for me and my office acquaintances to search the blog at minimum 3 times a week to read through the latest items you have. And definitely, I am always fulfilled for the magnificent guidelines you give. Certain 1 facts in this posting are in fact the most suitable I've had.

  4. Needed to compose you one tiny remark to finally thank you very much yet again on your spectacular methods you've featured on this website. It was extremely generous with you in giving unhampered what exactly a few individuals would have supplied as an electronic book to generate some dough for their own end, certainly since you might well have tried it in case you decided. Those good ideas in addition acted as the easy way to be sure that other people online have the same dreams like my own to understand a whole lot more when it comes to this condition. I'm certain there are some more fun opportunities up front for folks who looked over your blog post.

  5. curry shoes says:

    I happen to be writing to make you be aware of of the great encounter my cousin's child experienced using yuor web blog. She noticed too many things, which included what it's like to possess a marvelous teaching style to let other people very easily know just exactly certain tricky things. You actually did more than our desires. I appreciate you for rendering such powerful, dependable, edifying and as well as easy guidance on that topic to Sandra.

  6. Needed to send you the very small observation so as to give many thanks as before for all the splendid things you have discussed in this article. It is simply unbelievably open-handed of people like you to convey unhampered all that numerous people could have offered as an e book to end up making some bucks for their own end, primarily considering that you could have done it in case you desired. These principles likewise acted to become a good way to be aware that someone else have the same interest like my very own to realize a good deal more regarding this condition. Certainly there are several more fun opportunities in the future for many who read your blog post.

  7. I have to voice my affection for your kind-heartedness supporting those who must have help on in this idea. Your real dedication to getting the message all-around turned out to be particularly functional and has always helped many people just like me to realize their ambitions. Your personal warm and friendly help and advice entails a great deal to me and even further to my office workers. Many thanks; from everyone of us.

  8. I'm also commenting to make you know of the terrific encounter my wife's child encountered checking your web site. She picked up many details, most notably what it's like to have a very effective coaching mindset to get men and women easily completely grasp selected tortuous subject matter. You undoubtedly did more than visitors' expected results. Thank you for offering those practical, safe, edifying as well as easy guidance on that topic to Sandra.

  9. My wife and i felt so joyful Peter could finish up his studies from the precious recommendations he discovered through the web page. It's not at all simplistic to just find yourself freely giving guidelines that many other people have been trying to sell. We grasp we have the writer to appreciate because of that. All of the explanations you have made, the simple blog navigation, the relationships you give support to promote - it is everything amazing, and it is making our son and us feel that that theme is excellent, and that's truly important. Thanks for the whole thing!

  10. My husband and i ended up being very excited that Michael managed to deal with his investigation because of the ideas he got out of the site. It's not at all simplistic just to happen to be giving away techniques that some other people may have been making money from. Therefore we know we have the writer to appreciate for that. The entire illustrations you've made, the simple site navigation, the relationships you aid to engender - it is many fabulous, and it's really assisting our son in addition to us reason why that issue is enjoyable, which is certainly exceptionally mandatory. Thanks for the whole lot!

  11. supreme says:

    My husband and i have been absolutely contented Michael managed to conclude his researching through your precious recommendations he received out of your blog. It's not at all simplistic to just find yourself giving freely solutions which often some other people might have been selling. So we do know we have the blog owner to thank for that. The entire illustrations you made, the simple blog menu, the relationships you can make it possible to instill - it is all powerful, and it's helping our son in addition to the family believe that that theme is thrilling, which is seriously mandatory. Thank you for all the pieces!

  12. air jordan says:

    I simply desired to thank you very much yet again. I do not know what I could possibly have achieved in the absence of these pointers shown by you concerning this theme. It was the intimidating difficulty for me personally, however , encountering the very specialized form you resolved it took me to cry with joy. I'm thankful for this help and then wish you really know what an amazing job you are putting in training the mediocre ones by way of a blog. More than likely you haven't come across any of us.

  13. jordan 6 says:

    Thanks for all of the work on this website. Kim delights in setting aside time for investigation and it's really easy to see why. A number of us learn all of the powerful method you offer very important tactics via the website and as well attract contribution from other individuals on that point while our favorite child is undoubtedly learning a great deal. Enjoy the rest of the new year. Your performing a very good job.

  14. kd 14 says:

    I not to mention my pals were actually reading through the best secrets from the blog and at once developed a terrible feeling I had not expressed respect to the website owner for them. My boys are actually very interested to read through them and have very much been tapping into them. Appreciate your genuinely quite considerate and also for figuring out variety of fine subjects millions of individuals are really needing to learn about. Our own honest apologies for not expressing appreciation to earlier.

  15. A lot of thanks for your entire work on this web page. Gloria delights in managing investigation and it's really obvious why. My spouse and i notice all concerning the powerful method you convey valuable solutions via the web site and in addition cause response from other ones on the content so our own daughter is certainly being taught a lot of things. Take pleasure in the rest of the year. You have been conducting a superb job.

  16. Thanks so much for giving everyone an extraordinarily wonderful chance to read articles and blog posts from here. It is usually very beneficial plus jam-packed with a great time for me and my office colleagues to visit your blog at minimum 3 times in a week to study the latest guidance you will have. And lastly, I'm also usually astounded concerning the unique inspiring ideas you serve. Some 2 points on this page are truly the best we have all had.

  17. yeezys says:

    I am also writing to make you know what a fabulous encounter our daughter went through studying your site. She mastered lots of issues, with the inclusion of how it is like to possess a marvelous giving character to let other individuals smoothly know specified advanced topics. You actually exceeded readers' expected results. Thank you for delivering these priceless, safe, edifying and also unique guidance on this topic to Gloria.

  18. I precisely had to appreciate you yet again. I do not know what I could possibly have sorted out without the points discussed by you relating to that topic. It absolutely was a difficult condition in my circumstances, nevertheless viewing your skilled way you handled it made me to cry over gladness. I am grateful for this service as well as hope that you are aware of a powerful job you are carrying out instructing most people with the aid of your webpage. More than likely you haven't come across any of us.

  19. My spouse and i ended up being so joyful Emmanuel could do his inquiry from the ideas he obtained in your site. It is now and again perplexing to just always be giving out helpful hints that many some other people could have been selling. So we see we've got you to be grateful to for this. The type of explanations you have made, the simple web site menu, the friendships your site assist to promote - it's everything sensational, and it's helping our son and the family understand the matter is enjoyable, and that is seriously fundamental. Thanks for everything!

  20. I actually wanted to type a brief comment in order to express gratitude to you for some of the fantastic information you are posting here. My time intensive internet research has finally been compensated with beneficial points to exchange with my classmates and friends. I would declare that many of us readers actually are very much blessed to dwell in a great website with many lovely people with insightful things. I feel truly grateful to have come across your entire site and look forward to some more pleasurable minutes reading here. Thanks once again for a lot of things.

  21. kd 15 says:

    I simply needed to say thanks once again. I'm not certain the things that I could possibly have made to happen without the entire concepts revealed by you directly on such a theme. It has been the frightening problem for me personally, nevertheless coming across this professional mode you resolved it took me to weep for delight. Now i am happy for the advice and thus hope you find out what an amazing job that you're undertaking teaching other individuals all through your blog. More than likely you have never met any of us.

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>