Jump to content

Content moderation

From Wikipedia, the free encyclopedia

This is an old revision of this page, as edited by Ronapax431 (talk | contribs) at 07:14, 12 January 2024. The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

Comment moderation on a GitHub discussion, where a user called Mallory has deleted several comments before closing the discussion and locking it

On Internet websites that invite users to post comments, content moderation is the process of detecting contributions that are irrelevant, obscene, illegal, harmful, or insulting, in contrast to useful or informative contributions, frequently for censorship or suppression of opposing viewpoints. The purpose of content moderation is to remove or apply a warning label to problematic content or allow users to block and filter content themselves.[1]

Various types of Internet sites permit user-generated content such as comments, including Internet forums, blogs, and news sites powered by scripts such as phpBB, a Wiki, or PHP-Nuke. and etc. Depending on the site's content and intended audience, the site's administrators will decide what kinds of user comments are appropriate, then delegate the responsibility of sifting through comments to lesser moderators. Most often, they will attempt to eliminate trolling, spamming, or flaming, although this varies widely from site to site.

Major platforms use a combination of algorithmic tools, user reporting and human review.[1] Social media sites may also employ content moderators to manually inspect or remove content flagged for hate speech or other objectionable content. Other content issues include revenge porn, graphic content, child abuse material and propaganda.[1] Some websites must also make their content hospitable to advertisements.[1]

Supervisor moderation

Also known as unilateral moderation, this kind of moderation system is often seen on Internet forums. A group of people are chosen by the site's administrators (usually on a long-term basis) to act as delegates, enforcing the community rules on their behalf. These moderators are given special privileges to delete or edit others' contributions and/or exclude people based on their e-mail address or IP address, and generally attempt to remove negative contributions throughout the community. They act as an invisible backbone, underpinning the social web in a crucial but undervalued role.[2]

Facebook

As of 2017, Facebook had increased the number of content moderators from 4,500 to 7,500 in 2017 due to legal and other controversies. In Germany, Facebook was responsible for removing hate speech within 24 hours of when it was posted.[3] As of 2021, according to Frances Haugen, the number of Facebook employees responsible for content moderation was much smaller.[4]

If you have a new Page on Facebook, you can manage the following moderation settings:

  • Comment ranking: See the most relevant comments on your public posts first.
  • Profanity filter: You can choose whether to block profanity from your Page, and to what degree. Facebook determines what to block by using the most commonly reported words and phrases marked as offensive by the community.
  • Country restrictions: You can choose to show your Page to people in certain countries or hide it from people in others. If no countries are listed, your Page will be visible to everyone.
  • Age restrictions: When you select an age restriction for your Page, people younger than the age won't be able to see your Page or its content.
  • Keyword blocklist: Hide comments containing certain words from your timeline.
  • Tag review: Review tags people add to your posts before the tags appear on Facebook.
  • Blocking: Once you block someone, that person can no longer see things that you post on your timeline, tag your Page, invite your Page to events or groups or start a conversation with your Page.
  • Inbox comment moderation: Manage comment moderation for Inbox from Meta Business Suite[5]

Twitter

Social media site Twitter has a suspension policy. Between August 2015 and December 2017 it suspended over 1.2 million accounts for terrorist content in an effort to reduce the number of followers and amount of content associated with the Islamic State.[6] Following the acquisition of Twitter by Elon Musk in October 2022, content rules have been weakened across the platform in an attempt to prioritize free speech.[7] However, the effects of this campaign have been called into question. [8]

Commercial content moderation (CCM)

Commercial Content Moderation is a term coined by Sarah T. Roberts to describe the practice of "monitoring and vetting user-generated content (UGC) for social media platforms of all types, in order to ensure that the content complies with legal and regulatory exigencies, site/community guidelines, user agreements, and that it falls within norms of taste and acceptability for that site and its cultural context."[9]

While at one time this work may have been done by volunteers within the online community, for commercial websites this is largely achieved through outsourcing the task to specialized companies, often in low-wage areas such as India and the Philippines. Outsourcing of content moderation jobs grew as a result of the social media boom. With the overwhelming growth of users and UGC, companies needed many more employees to moderate the content. In the late 1980s and early 1990s, tech companies began to outsource jobs to foreign countries that had an educated workforce but were willing to work for cheap.[10]

As of 2010, employees work by viewing, assessing and deleting disturbing content.[11] Wired reported in 2014, they may suffer psychological damage[12][13][14][2][15] In 2017, the Guardian reported Secondary trauma may arise, with symptoms similar to PTSD.[16] Some large companies such as Facebook offer psychological support[16] and increasingly rely on the use of Artificial Intelligence (AI) to sort out the most graphic and inappropriate content, but critics claim that it is insufficient.[17] In 2019, NPR called it a job hazard.[18]

Facebook

Main article: Facebook content oversight board

Facebook has decided to create an oversight board that will decide what content remains and what content is removed. This idea was proposed in late 2018. The "Supreme Court" at Facebook is to replace making decisions in an ad hoc manner.[18][19]

Distributed moderation

Distributed moderation comes in two types: user moderation and spontaneous moderation.

User moderation

User moderation allows any user to moderate any other user's contributions. Billions of people are currently making decisions on what to share, forward or give visibility to on a daily basis.[20] On a large site with a sufficiently large active population, this usually works well, since relatively small numbers of troublemakers are screened out by the votes of the rest of the community. Strictly speaking, wikis such as Wikipedia are the ultimate in user moderation, but in the context of Internet forums, the definitive example of a user moderation system is Slashdot.[citation needed]

For example, each moderator is given a limited number of "mod points," each of which can be used to moderate an individual comment up or down by one point. Comments thus accumulate a score, which is additionally bounded to the range of -1 to 5 points. When viewing the site, a threshold can be chosen from the same scale, and only posts meeting or exceeding that threshold will be displayed. This system is further refined by the concept of karma—the ratings assigned to a user's' previous contributions can bias the initial rating of contributions he or she makes.

On sufficiently specialized websites, user moderation will often lead to groupthink, in which any opinion that is in disagreement with the website's established principles (no matter how sound or well-phrased) will very likely be "modded down" and censored, leading to the perpetuation of the groupthink mentality. This is often confused with trolling.[citation needed]

User moderation can also be characterized by reactive moderation. This type of moderation depends on users of a platform or site to report content that is inappropriate and breaches community standards. In this process, when users are faced with an image or video they deem unfit, they can click the report button. The complaint is filed and queued for moderators to look at.[21]

See also: Spam reporting

Spontaneous moderation

Spontaneous moderation is what occurs when no official moderation scheme exists. Without any ability to moderate comments, users will spontaneously moderate their peers through posting their own comments about others' comments. Because spontaneous moderation exists, no system that allows users to submit their own content can ever go completely without any kind of moderation.[citation needed]

See also

References

  1. ^ a b c d Grygiel, Jennifer; Brown, Nina (June 2019). "Are social media companies motivated to be good corporate citizens? Examination of the connection between corporate social responsibility and social media safety". Telecommunications Policy. 43 (5): 2, 3. doi:10.1016/j.telpol.2018.12.003. S2CID 158295433. Retrieved 25 May 2022.
  2. ^ a b "Invisible Data Janitors Mop Up Top Websites - Al Jazeera America". aljazeera.com.
  3. ^ "Artificial intelligence will create new kinds of work". The Economist. Retrieved 2017-09-02.
  4. ^ Jan Böhmermann, ZDF Magazin Royale. Facebook Whistleblowerin Frances Haugen im Talk über die Facebook Papers.
  5. ^ "About moderation for new Pages on Facebook". Meta Business Help Centre. Retrieved 2023-08-21.
  6. ^ Gartenstein-Ross, Daveed; Koduvayur, Varsha (26 May 2022). "Texas's New Social Media Law Will Create a Haven for Global Extremists". foreignpolicy.com. Foreign Policy. Retrieved 27 May 2022.
  7. ^ "Elon Musk on X: "@essagar Suspending the Twitter account of a major news organization for publishing a truthful story was obviously incredibly inappropriate"". Twitter. Retrieved 2023-08-21.
  8. ^ Burel, Grégoire; Alani, Harith; Farrell, Tracie (2022-05-12). "Elon Musk could roll back social media moderation – just as we're learning how it can stop misinformation". The Conversation. Retrieved 2023-08-21.
  9. ^ "Behind the Screen: Commercial Content Moderation (CCM)". Sarah T. Roberts | The Illusion of Volition. 2012-06-20. Retrieved 2017-02-03.
  10. ^ Elliott, Vittoria; Parmar, Tekendra (22 July 2020). ""The darkness and despair of people will get to you"". rest of world.
  11. ^ Stone, Brad (July 18, 2010). "Concern for Those Who Screen the Web for Barbarity". The New York Times – via NYTimes.com.
  12. ^ Adrian Chen (23 October 2014). "The Laborers Who Keep Dick Pics and Beheadings Out of Your Facebook Feed". WIRED. Archived from the original on 2015-09-13.
  13. ^ "The Internet's Invisible Sin-Eaters". The Awl. Archived from the original on 2015-09-08.
  14. ^ University, Department of Communications and Public Affairs, Western (March 19, 2014). "Western News - Professor uncovers the Internet's hidden labour force". Western News.{{cite web}}: CS1 maint: multiple names: authors list (link)
  15. ^ "Should Facebook Block Offensive Videos Before They Post?". WIRED. 26 August 2015.
  16. ^ a b Olivia Solon (2017-05-04). "Facebook is hiring moderators. But is the job too gruesome to handle?". The Guardian. Retrieved 2018-09-13.
  17. ^ Olivia Solon (2017-05-25). "Underpaid and overburdened: the life of a Facebook moderator". The Guardian. Retrieved 2018-09-13.
  18. ^ a b Gross, Terry. "For Facebook Content Moderators, Traumatizing Material Is A Job Hazard". NPR.org.
  19. ^ "Social Media Content". 2023-10-23. Retrieved 2024-01-12.
  20. ^ Hartmann, Ivar A. (April 2020). "A new framework for online content moderation". Computer Law & Security Review. 36: 3. doi:10.1016/j.clsr.2019.105376. S2CID 209063940. Retrieved 25 May 2022.
  21. ^ Grimes-Viort, Blaise (December 7, 2010). "6 types of content moderation you need to know about". Social Media Today.

Further reading

  • Sarah T. Roberts (2019). Behind the Screen: Content Moderation in the Shadows of Social Media. Yale University Press. ISBN 978-0300235883.
Wikimedia Commons has media related to Content moderation.
Retrieved from "https://en.wikipedia.org/w/index.php?title=Content_moderation&oldid=1195085457"