hate site
   HOME

TheInfoList



OR:

Online hate speech is a type of speech that takes place online with the purpose of attacking a person or a group based on their
race Race, RACE or "The Race" may refer to: * Race (biology), an informal taxonomic classification within a species, generally within a sub-species * Race (human categorization), classification of humans into groups based on physical traits, and/or s ...
,
religion Religion is usually defined as a social- cultural system of designated behaviors and practices, morals, beliefs, worldviews, texts, sanctified places, prophecies, ethics, or organizations, that generally relates humanity to supernatur ...
,
ethnic origin An ethnic group or an ethnicity is a grouping of people who identify with each other on the basis of shared attributes that distinguish them from other groups. Those attributes can include common sets of traditions, ancestry, language, history, ...
,
sexual orientation Sexual orientation is an enduring pattern of romantic or sexual attraction (or a combination of these) to persons of the opposite sex or gender, the same sex or gender, or to both sexes or more than one gender. These attractions are generall ...
,
disability Disability is the experience of any condition that makes it more difficult for a person to do certain activities or have equitable access within a given society. Disabilities may be cognitive, developmental, intellectual, mental, physical, ...
, and/or
gender Gender is the range of characteristics pertaining to femininity and masculinity and differentiating between them. Depending on the context, this may include sex-based social structures (i.e. gender roles) and gender identity. Most culture ...
. Online hate speech is not easily defined, but can be recognized by the degrading or dehumanizing function it serves.
Multilateral treaties A multilateral treaty is a treaty to which two or more sovereign states are parties. Each party owes the same obligations to all other parties, except to the extent that they have stated reservations. Examples of multilateral treaties include the ...
such as the
International Covenant on Civil and Political Rights The International Covenant on Civil and Political Rights (ICCPR) is a multilateral treaty that commits nations to respect the civil and political rights of individuals, including the right to life, freedom of religion, freedom of speech, fre ...
(ICCPR) have sought to define its contours. Multi-stakeholders processes (e.g. the
Rabat Rabat (, also , ; ar, الرِّبَاط, er-Ribât; ber, ⵕⵕⴱⴰⵟ, ṛṛbaṭ) is the capital city of Morocco and the country's seventh largest city with an urban population of approximately 580,000 (2014) and a metropolitan populatio ...
Plan of Action) have tried to bring greater clarity and suggested mechanisms to identify hateful messages. Yet, hate speech is still a generic term in everyday discourse, mixing concrete threats to individuals and/or groups with cases in which people may be simply venting their anger against authority. Internet
intermediaries An intermediary (or go-between) is a third party that offers intermediation services between two parties, which involves conveying messages between principals in a dispute, preventing direct contact and potential escalation of the issue. In law ...
—organizations and
social networks A social network is a social structure made up of a set of social actors (such as individuals or organizations), sets of dyadic ties, and other social interactions between actors. The social network perspective provides a set of methods for a ...
that mediate online communication such as
Facebook Facebook is an online social media and social networking service owned by American company Meta Platforms. Founded in 2004 by Mark Zuckerberg with fellow Harvard College students and roommates Eduardo Saverin, Andrew McCollum, Dust ...
,
Twitter Twitter is an online social media and social networking service owned and operated by American company Twitter, Inc., on which users post and interact with 280-character-long messages known as "tweets". Registered users can post, like, and ...
, and
Google Google LLC () is an American Multinational corporation, multinational technology company focusing on Search Engine, search engine technology, online advertising, cloud computing, software, computer software, quantum computing, e-commerce, ar ...
—have advanced their own definitions of hate speech that bind users to a set of rules and allow companies to limit certain forms of expression. National and regional bodies have sought to promote understandings of the term that are more rooted in local
tradition A tradition is a belief or behavior (folk custom) passed down within a group or society with symbolic meaning or special significance with origins in the past. A component of cultural expressions and folklore, common examples include holidays or ...
s. The
Internet The Internet (or internet) is the global system of interconnected computer networks that uses the Internet protocol suite (TCP/IP) to communicate between networks and devices. It is a '' network of networks'' that consists of private, p ...
's speed and reach makes it difficult for governments to enforce national legislation in the
virtual world A virtual world (also called a virtual space) is a computer-simulated environment which may be populated by many users who can create a personal avatar, and simultaneously and independently explore the virtual world, participate in its activities ...
. Social media is a private space for public expression, which makes it difficult for regulators. Some of the companies owning these spaces have become more responsive towards tackling the problem of online hate speech. Politicians, activists, and academics discuss the character of online hate speech and its relation to offline speech and action, but the debates tend to be removed from systematic empirical evidence. The character of perceived hate speech and its possible consequences has led to placing much emphasis on the solutions to the problem and on how they should be grounded in
international human rights law International human rights law (IHRL) is the body of international law designed to promote human rights on social, regional, and domestic levels. As a form of international law, international human rights law are primarily made up of treaties, a ...
. Yet this very focus has also limited deeper attempts to understand the causes underlying the phenomenon and the dynamics through which certain types of content emerge, diffuse and lead—or not—to actual
discrimination Discrimination is the act of making unjustified distinctions between people based on the groups, classes, or other categories to which they belong or are perceived to belong. People may be discriminated on the basis of Racial discrimination, r ...
, hostility, or
violence Violence is the use of physical force so as to injure, abuse, damage, or destroy. Other definitions are also used, such as the World Health Organization's definition of violence as "the intentional use of physical force or power, threatened ...
.


Definitions


Hate speech

The concept of hate speech touches on the clash of
freedom of expression Freedom of speech is a principle that supports the freedom of an individual or a community to articulate their opinions and ideas without fear of retaliation, censorship, or legal sanction. The right to freedom of expression has been recog ...
and individual, collective, and
minority rights Minority rights are the normal individual rights as applied to members of racial, ethnic, class, religious, linguistic or gender and sexual minorities, and also the collective rights accorded to any minority group. Civil-rights movements ...
, as well as concepts of
dignity Dignity is the right of a person to be valued and respected for their own sake, and to be treated ethically. It is of significance in morality, ethics, law and politics as an extension of the Enlightenment-era concepts of inherent, inaliena ...
,
liberty Liberty is the ability to do as one pleases, or a right or immunity enjoyed by prescription or by grant (i.e. privilege). It is a synonym for the word freedom. In modern politics, liberty is understood as the state of being free within society fr ...
, and
equality Equality may refer to: Society * Political equality, in which all members of a society are of equal standing ** Consociationalism, in which an ethnically, religiously, or linguistically divided state functions by cooperation of each group's elit ...
. It is not easily defined but can be recognized by its function. In national and international legislation, hate speech refers to expressions that advocate incitement to harm, including acts of
discrimination Discrimination is the act of making unjustified distinctions between people based on the groups, classes, or other categories to which they belong or are perceived to belong. People may be discriminated on the basis of Racial discrimination, r ...
, hostility, radicalization, verbal and/or physical violence, based upon the targets' social and/or demographic identity. Hate speech may include, but is not limited to, speech that advocates, threatens, or encourages violent acts. The concept may extend also to expressions that foster a climate of prejudice and intolerance on the assumption that this may fuel targeted discrimination, hostility, and violent attacks. At critical times, such as during political elections, the concept of hate speech may be prone to manipulation; accusations of instigating hate speech may be traded among political opponents or used by those in power to curb
dissent Dissent is an opinion, philosophy or sentiment of non-agreement or opposition to a prevailing idea or policy enforced under the authority of a government, political party or other entity or individual. A dissenting person may be referred to as ...
and
criticism Criticism is the construction of a judgement about the negative qualities of someone or something. Criticism can range from impromptu comments to a written detailed response. , ''"the act of giving your opinion or judgment about the good or bad q ...
. Hate speech (be it conveyed through text, images, and/or sound) can be identified by approximation through the degrading or dehumanizing functions that it serves. Legal scholar and political theorist
Jeremy Waldron Jeremy Waldron (; born 13 October 1953) is a New Zealand professor of law and philosophy. He holds a University Professorship at the New York University School of Law, is affiliated with the New York University Department of Philosophy, and was ...
argues that hate speech always contains two messages: first, to let members of the out-group feel unwelcome or afraid; and second, to let members of the in-group feel that their hateful beliefs are legitimate.


Characteristics of online hate speech

The proliferation of hate speech online, observed by the
UN Human Rights Council The United Nations Human Rights Council (UNHRC), CDH is a United Nations body whose mission is to promote and protect human rights around the world. The Council has 47 members elected for staggered three-year terms on a regional group basis ...
Special Rapporteur on Minority Issues poses a new set of challenges. Both social networking platforms and organizations created to combat hate speech have recognized that hateful messages disseminated online are increasingly common and have elicited unprecedented attention to develop adequate responses. According to HateBase, a web-based application that collects instances of hate speech online worldwide, the majority of cases of hate speech target individuals based on
ethnicity An ethnic group or an ethnicity is a grouping of people who identify with each other on the basis of shared attributes that distinguish them from other groups. Those attributes can include common sets of traditions, ancestry, language, history, ...
and
nationality Nationality is a legal identification of a person in international law, establishing the person as a subject, a ''national'', of a sovereign state. It affords the state jurisdiction over the person and affords the person the protection of t ...
, but incitements to hatred focusing on
religion Religion is usually defined as a social- cultural system of designated behaviors and practices, morals, beliefs, worldviews, texts, sanctified places, prophecies, ethics, or organizations, that generally relates humanity to supernatur ...
and
social class A social class is a grouping of people into a set of hierarchical social categories, the most common being the upper, middle and lower classes. Membership in a social class can for example be dependent on education, wealth, occupation, inc ...
have also been on the rise. While hate speech online is not intrinsically different from similar expressions found offline, there are peculiar challenges unique to online content and its regulation. Those challenges related to its permanence, itinerancy,
anonymity Anonymity describes situations where the acting person's identity is unknown. Some writers have argued that namelessness, though technically correct, does not capture what is more centrally at stake in contexts of anonymity. The important idea he ...
and complex cross-jurisdictional character.


Permanence

Hate speech can stay online for a long time in different formats across multiple platforms, which can be linked repeatedly. As Andre Oboler, the CEO of the Online Hate Prevention Institute, has noted, "The longer the content stays available, the more damage it can inflict on the victims and empower the perpetrators. If you remove the content at an early stage you can limit the exposure. This is just like cleaning litter, it doesn't stop people from littering but if you do not take care of the problem it just piles up and further exacerbates."
Twitter Twitter is an online social media and social networking service owned and operated by American company Twitter, Inc., on which users post and interact with 280-character-long messages known as "tweets". Registered users can post, like, and ...
's conversations organized around trending topics may facilitate the quick and wide spreading of hateful messages, but they also offer the opportunity for influential speakers to shun messages and possibly end popular threads inciting violence.
Facebook Facebook is an online social media and social networking service owned by American company Meta Platforms. Founded in 2004 by Mark Zuckerberg with fellow Harvard College students and roommates Eduardo Saverin, Andrew McCollum, Dust ...
, on the contrary, may allow multiple threads to continue in parallel and go unnoticed; creating longer lasting spaces that offend, discriminate, and ridicule certain individuals and groups.


Itinerance

Hate speech online can be itinerant. Even when content is removed, it may find expression elsewhere, possibly on the same platform under a different name or on different online spaces. If a
website A website (also written as a web site) is a collection of web pages and related content that is identified by a common domain name and published on at least one web server. Examples of notable websites are Google, Facebook, Amazon, and W ...
is shut down, it can quickly reopen using a web-hosting service with less stringent
regulation Regulation is the management of complex systems according to a set of rules and trends. In systems theory, these types of rules exist in various fields of biology and society, but the term has slightly different meanings according to context. ...
s or via the reallocation to a country with laws imposing higher threshold for hate speech. The itinerant nature of hate speech also means that poorly formulated thoughts, or under-the-influence behavior, that would have not found public expression and support in the past may now land on spaces where they can be visible to large audiences.


Anonymity

Anonymity Anonymity describes situations where the acting person's identity is unknown. Some writers have argued that namelessness, though technically correct, does not capture what is more centrally at stake in contexts of anonymity. The important idea he ...
can also present a challenge to dealing with online hate speech. Internet discussions may be anonymous or
pseudonymous A pseudonym (; ) or alias () is a fictitious name that a person or group assumes for a particular purpose, which differs from their original or true name ( orthonym). This also differs from a new name that entirely or legally replaces an individu ...
, which can make people feel more safe expressing their opinions but can just as easily accelerate destructive behavior. As Drew Boyd, Director of Operations at The Sentinel Project, has stated, "the Internet grants individuals the ability to say horrific things because they think they will not be discovered. This is what makes online hate speech so unique, because people feel much more comfortable speaking hate as opposed to real life when they have to deal with the consequences of what they say."
China China, officially the People's Republic of China (PRC), is a country in East Asia. It is the world's List of countries and dependencies by population, most populous country, with a Population of China, population exceeding 1.4 billion, slig ...
and
South Korea South Korea, officially the Republic of Korea (ROK), is a country in East Asia, constituting the southern part of the Korea, Korean Peninsula and sharing a Korean Demilitarized Zone, land border with North Korea. Its western border is formed ...
enforce real-name policies for
social media Social media are interactive media technologies that facilitate the creation and sharing of information, ideas, interests, and other forms of expression through virtual communities and networks. While challenges to the definition of ''social me ...
.
Facebook Facebook is an online social media and social networking service owned by American company Meta Platforms. Founded in 2004 by Mark Zuckerberg with fellow Harvard College students and roommates Eduardo Saverin, Andrew McCollum, Dust ...
,
LinkedIn LinkedIn () is an American business and employment-oriented online service that operates via websites and mobile apps. Launched on May 5, 2003, the platform is primarily used for professional networking and career development, and allows job se ...
, and
Quora Quora () is a social question-and-answer website based in Mountain View, California. It was founded on June 25, 2009, and made available to the public on June 21, 2010. Users can collaborate by editing questions and commenting on answers that ...
have sought to activate a
real-name system A real-name system is a system in which users can register an account on a blog, website or bulletin board system using their legal name. Users are required to provide identification credentials and their legal name. A public pseudonym can also ...
to have more control on online hate speech. Such measures have been deeply contested as they are seen to violate the
right to privacy The right to privacy is an element of various legal traditions that intends to restrain governmental and private actions that threaten the privacy of individuals. Over 150 national constitutions mention the right to privacy. On 10 December 194 ...
and its intersection with free expression. Many instances of online hate speech are posted by Internet "trolls", which are typically pseudonymous users who post shocking, vulgar, and overall untrue content that is explicitly intended to trigger a negative reaction, though may also be indended to influence or recruit the reader to their beliefs, if they share the same opinion. Social media has also provided a platform for
radical Radical may refer to: Politics and ideology Politics * Radical politics, the political intent of fundamental societal change *Radicalism (historical), the Radical Movement that began in late 18th century Britain and spread to continental Europe an ...
and
extremist Extremism is "the quality or state of being extreme" or "the advocacy of extreme measures or views". The term is primarily used in a political or religious sense to refer to an ideology that is considered (by the speaker or by some implied share ...
political or religious groups to form, network, and collaborate to spread their messages of anti-establishment and anti-political correctness, and promote beliefs and ideologies that are
racist Racism is the belief that groups of humans possess different behavioral traits corresponding to inherited attributes and can be divided based on the superiority of one race over another. It may also mean prejudice, discrimination, or antagonism ...
, anti-feminist,
homophobic Homophobia encompasses a range of negative attitudes and feelings toward homosexuality or people who are identified or perceived as being lesbian, gay or bisexual. It has been defined as contempt, prejudice, aversion, hatred or antipathy, m ...
, transphobic, etc. Fully-anonymous online communication is rare, as it requires the user to employ highly technical measures to ensure that they cannot be easily identified.


Cross-jurisdictional spread

A further complication is the transnational reach of the
Internet The Internet (or internet) is the global system of interconnected computer networks that uses the Internet protocol suite (TCP/IP) to communicate between networks and devices. It is a '' network of networks'' that consists of private, p ...
, raising issues of cross jurisdictional co-operation in regard to legal mechanisms for combating hate speech. While there are Mutual Legal Assistance treaties in place across
Europe Europe is a large peninsula conventionally considered a continent in its own right because of its great physical size and the weight of its history and traditions. Europe is also considered a Continent#Subcontinents, subcontinent of Eurasia ...
,
Asia Asia (, ) is one of the world's most notable geographical regions, which is either considered a continent in its own right or a subcontinent of Eurasia, which shares the continental landmass of Afro-Eurasia with Africa. Asia covers an are ...
, and
North America North America is a continent in the Northern Hemisphere and almost entirely within the Western Hemisphere. It is bordered to the north by the Arctic Ocean, to the east by the Atlantic Ocean, to the southeast by South America and th ...
, these are characteristically slow to work. The transnational reach of many
private-sector The private sector is the part of the economy, sometimes referred to as the citizen sector, which is owned by private groups, usually as a means of establishment for profit or non profit, rather than being owned by the government. Employment Th ...
Internet intermediaries may provide a more effective channel for resolving issues in some cases, although these bodies are also often impacted upon by cross-jurisdictional appeals for data (such as revealing the identity of the author(s) of a particular content). Different jurisdictions also have unique definitions for hate speech, making it difficult to prosecute perpetrators who may seek haven in less stringent jurisdictions. Unlike the dissemination of hate speech through conventional channels, victims of online hate speech may face difficulties knowing to whom they should turn to help, as the platform, their local law enforcement, and the local law enforcement of the person or people using hate speech, may all feel as though the issue does not fall into their jurisdiction, even when hate speech policies and laws are in place.
Nongovernmental organizations A non-governmental organization (NGO) or non-governmental organisation (see spelling differences) is an organization that generally is formed independent from government. They are typically nonprofit entities, and many of them are active in ...
and
lobby groups Advocacy groups, also known as interest groups, special interest groups, lobbying groups or pressure groups use various forms of advocacy in order to influence public opinion and ultimately policy. They play an important role in the developm ...
have been raising awareness and encourage different stakeholders to take action.


Artificial intelligence

Some tech companies, such as
Facebook Facebook is an online social media and social networking service owned by American company Meta Platforms. Founded in 2004 by Mark Zuckerberg with fellow Harvard College students and roommates Eduardo Saverin, Andrew McCollum, Dust ...
, use
Artificial Intelligence (AI) Artificial intelligence (AI) is intelligence—perceiving, synthesizing, and inferring information—demonstrated by machines, as opposed to intelligence displayed by animals and humans. Example tasks in which this is done include speech rec ...
systems to monitor hate speech. However, AI may not always be an effective way of monitoring hate speech, since the systems lack the judgment skills that humans have. For example, a user might post or comment something that classifies as hate speech, or violates community guidelines, but if the target word is misspelled, or some letters are replaced with symbols, the AI systems will not recognize it. This weakness has led to the proliferation of attempts to circumvent censorship algorithms using deliberate misspellings, such as the use of "vachscenes" instead of "vaccines" by anti-vaxxers during
COVID-19 Coronavirus disease 2019 (COVID-19) is a contagious disease caused by a virus, the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). The first known case was identified in Wuhan, China, in December 2019. The disease quick ...
. Therefore, humans still have to monitor the AI systems that monitor hate speech; a common problem in AI technology which is referred to as "Automation's Last Mile.", meaning the last 10% or 1% of the job is the hardest to complete.


Frameworks


''Stormfront'' Precedent

In the aftermath of
2014 File:2014 Events Collage.png, From top left, clockwise: Stocking up supplies and personal protective equipment (PPE) for the Western African Ebola virus epidemic; Citizens examining the ruins after the Chibok schoolgirls kidnapping; Bundles of wa ...
's dramatic incidents, calls for more restrictive or intrusive measures to contain the Internet's potential to spread hate and violence are common, as if the links between online and offline violence were well known. On the contrary, as the following example indicates, appearances may often be deceiving. Stormfront is considered the first "hate website." Launched in March 1995 by a former Ku Klux Klan leader, it quickly became a popular space for discussing ideas related to
Neo-Nazism Neo-Nazism comprises the post–World War II militant, social, and political movements that seek to revive and reinstate Nazi ideology. Neo-Nazis employ their ideology to promote hatred and racial supremacy (often white supremacy), attack ...
,
White nationalism White nationalism is a type of racial nationalism or pan-nationalism which espouses the belief that white people are a raceHeidi Beirich and Kevin Hicks. "Chapter 7: White nationalism in America". In Perry, Barbara. ''Hate Crimes''. Greenwood ...
and
White separatism White supremacy or white supremacism is the belief that white people are superior to those of other races and thus should dominate them. The belief favors the maintenance and defense of any power and privilege held by white people. White su ...
, first in the
United States of America The United States of America (U.S.A. or USA), commonly known as the United States (U.S. or US) or America, is a country primarily located in North America. It consists of 50 states, a federal district, five major unincorporated territo ...
and then globally. The forum hosts calls for a racial holy war and incitement to use violence to resist
immigration Immigration is the international movement of people to a destination country of which they are not natives or where they do not possess citizenship in order to settle as permanent residents or naturalized citizens. Commuters, tourists, ...
. and is considered a space for recruiting
activists Activism (or Advocacy) consists of efforts to promote, impede, direct or intervene in social, political, economic or environmental reform with the desire to make changes in society toward a perceived greater good. Forms of activism range fro ...
and possibly coordinating violent acts. The few studies that have explored the identities of Stormfront actually depict a more complex picture. Rather than seeing it as a space for coordinating actions. Well-known extreme right activists have accused the forum to be just a gathering for " keyboard warriors." One of them for example, as reported by De Koster and Houtman, stated, "I have read quite a few pieces around the forum, and it strikes me that a great fuss is made, whereas little happens. The section activism/politics itself is plainly ridiculous. ..Not to mention the assemblies where just four people turn up." Even more revealing are some of the responses to these accusations provided by regular members of the website. As one of them argued, "Surely, I am entitled to have an opinion without actively carrying it out. ..I do not attend demonstrations and I neither join a political party. If this makes me a keyboard warrior, that is all right. I feel good this way. ..I am not ashamed of it." De Koster and Houtman surveyed only one national chapter of Stormfront and a non-representative sample of users, but answers like those above should at least invite to caution towards hypotheses connecting expressions and actions, even in spaces whose main function is to host extremist views. The Southern Poverty Law Center published a study in 2014 that found users of the site "were allegedly responsible for the murders of nearly 100 people in the preceding five years."


International Principles

Hate speech is not explicitly mentioned in many
international human rights International human rights law (IHRL) is the body of international law designed to promote human rights on social, regional, and domestic levels. As a form of international law, international human rights law are primarily made up of treaties, ag ...
documents and
treaties A treaty is a formal, legally binding written agreement between actors in international law. It is usually made by and between sovereign states, but can include international organizations, individuals, business entities, and other legal pers ...
, but it is indirectly called upon by some of the principles related to human dignity and
freedom of expression Freedom of speech is a principle that supports the freedom of an individual or a community to articulate their opinions and ideas without fear of retaliation, censorship, or legal sanction. The right to freedom of expression has been recog ...
. For example, the 1948
Universal Declaration of Human Rights The Universal Declaration of Human Rights (UDHR) is an international document adopted by the United Nations General Assembly that enshrines the rights and freedoms of all human beings. Drafted by a UN committee chaired by Eleanor Roosevelt ...
(UDHR), which was drafted as a response to the atrocities of the
World War II World War II or the Second World War, often abbreviated as WWII or WW2, was a world war that lasted from 1939 to 1945. It involved the World War II by country, vast majority of the world's countries—including all of the great power ...
, contains the right to equal protection under the law in Article 7, which proclaims that: "All are entitled to equal protection against any discrimination in violation of this Declaration and against any incitement to such discrimination." The UDHR also states that everyone has the right to freedom of expression, which includes "freedom to hold opinions without interference and to seek, receive and impart information and ideas through any media and regardless of frontiers." The UDHR was decisive in setting a framework and agenda for human rights protection, but the Declaration is
non-binding A non-binding resolution is a written motion adopted by a deliberative body that can or cannot progress into a law. The substance of the resolution can be anything that can normally be proposed as a motion. This type of resolution is often used ...
. A series of binding documents have been subsequently created to offer a more robust protection for freedom of expression and protection against discrimination. The
International Covenant on Civil and Political Rights The International Covenant on Civil and Political Rights (ICCPR) is a multilateral treaty that commits nations to respect the civil and political rights of individuals, including the right to life, freedom of religion, freedom of speech, fre ...
(ICCPR) addresses hate speech and contains the right to freedom of expression in Article 19 and the prohibition of advocacy to hatred that constitutes incitement to discrimination, hostility or violence in Article 20. Other more tailored international legal instruments contain provisions that have repercussions for the definition of hate speech and identification of responses to it, such as: the
Convention on the Prevention and Punishment of the Crime of Genocide The Convention on the Prevention and Punishment of the Crime of Genocide (CPPCG), or the Genocide Convention, is an international treaty that criminalizes genocide and obligates state parties to pursue the enforcement of its prohibition. It was ...
(1951), the
International Convention on the Elimination of All Forms of Racial Discrimination The International Convention on the Elimination of All Forms of Racial Discrimination (ICERD) is a United Nations convention. A third -generation human rights instrument, the Convention commits its members to the elimination of racial discri ...
, ICERD (1969), and, to a lesser extent, the Convention on the Elimination of All Forms of Discrimination against Women, CEDAW (1981).


Hate speech and the ICCPR

The
ICCPR The International Covenant on Civil and Political Rights (ICCPR) is a multilateral treaty that commits nations to respect the civil and political rights of individuals, including the right to life, freedom of religion, freedom of speech, freedom ...
is the legal instrument most commonly referred to in debates on hate speech and its regulation, although it does not explicitly use the term "hate speech." Article 19, which is often referred to as part of the "core of the Covenant", provides for the right to freedom of expression. This sets out the right, and it also includes general strictures to which any limitation of the right must conform in order to be legitimate. Article 19 is followed by Article 20 that expressly limits freedom of expression in cases of "advocacy of national,
racial A race is a categorization of humans based on shared physical or social qualities into groups generally viewed as distinct within a given society. The term came into common usage during the 1500s, when it was used to refer to groups of variou ...
or religious hatred that constitutes incitement to discrimination, hostility or violence." The decision to include this provision, which can be characterized as embodying a particular conceptualization of hate speech, has been deeply contested. The
Human Rights Committee The United Nations Human Rights Committee is a treaty body composed of 18 experts, established by a 1966 human rights treaty, the International Covenant on Civil and Political Rights (ICCPR). The Committee meets for three four-week sessions per ...
, the
United Nations The United Nations (UN) is an intergovernmental organization whose stated purposes are to maintain international peace and security, develop friendly relations among nations, achieve international cooperation, and be a centre for harmoni ...
body created by the
ICCPR The International Covenant on Civil and Political Rights (ICCPR) is a multilateral treaty that commits nations to respect the civil and political rights of individuals, including the right to life, freedom of religion, freedom of speech, freedom ...
to oversee its implementation, cognizant of the tension, has sought to stress that Article 20 is fully compatible with the right to freedom of expression. In the ICCPR, the right to freedom of expression is not an absolute right. It can legitimately be limited by states under restricted circumstances: "3. The exercise of the rights provided for in paragraph 2 of this article carries with it special duties and responsibilities. It may therefore be subject to certain restrictions, but these shall only be such as are provided by law and are necessary: (a) For respect of the rights or reputations of others; (b) For the protection of national security or of public order (
ordre public A suite, in Western classical music and jazz, is an ordered set of instrumental or orchestral/concert band pieces. It originated in the late 14th century as a pairing of dance tunes and grew in scope to comprise up to five dances, sometimes wi ...
), or of
public health Public health is "the science and art of preventing disease, prolonging life and promoting health through the organized efforts and informed choices of society, organizations, public and private, communities and individuals". Analyzing the det ...
or
morals Morality () is the differentiation of intentions, decisions and actions between those that are distinguished as proper (right) and those that are improper (wrong). Morality can be a body of standards or principles derived from a code of cond ...
." Between Article 19 (3) and Article 20, there is a distinction between optional and obligatory limitations to the right to freedom of expression. Article 19 (3) states that limitations on
freedom of expression Freedom of speech is a principle that supports the freedom of an individual or a community to articulate their opinions and ideas without fear of retaliation, censorship, or legal sanction. The right to freedom of expression has been recog ...
"may therefore be subject to certain restrictions", as long as they are provided by law and necessary to certain legitimate purposes. Article 20 states that any advocacy of (certain kinds of) hatred that constitutes incitement to
discrimination Discrimination is the act of making unjustified distinctions between people based on the groups, classes, or other categories to which they belong or are perceived to belong. People may be discriminated on the basis of Racial discrimination, r ...
, hostility or violence "shall be prohibited by law." Despite indications on the gravity of speech offenses that should be prohibited by law under Article 20, there remains complexity. In particular there is a grey area in conceptualizing clear distinctions between (i) expressions of hatred, (ii) expression that advocate hatred, and (iii) hateful speech that specifically constitutes incitement to the practical harms of discrimination, hostility or violence. While states have an obligation to prohibit speech conceived as "advocacy to hatred that constitutes incitement to discrimination, hostility or violence", as consistent with Article 20 (2), how to interpret such is not clearly defined.


Other international legal instruments


ICERD

The
International Convention on the Elimination of All Forms of Racial Discrimination The International Convention on the Elimination of All Forms of Racial Discrimination (ICERD) is a United Nations convention. A third -generation human rights instrument, the Convention commits its members to the elimination of racial discri ...
(ICERD), which came into force in 1969, has also implications for conceptualizing forms of hate speech. The ICERD differs from the ICCPR in three respects. Its conceptualization of hate speech is specifically limited to speech that refers to race and
ethnicity An ethnic group or an ethnicity is a grouping of people who identify with each other on the basis of shared attributes that distinguish them from other groups. Those attributes can include common sets of traditions, ancestry, language, history, ...
. It asserts in Article 4, paragraph (a), that state parties: "Shall declare as an offense punishable by law all dissemination of ideas based on racial superiority or hatred, incitement to racial discrimination, as well as all acts of violence or incitement to such acts against any race or group of persons of another color or ethnic origin, and also the provision of any assistance to racist activities, including the financing thereof; This obligation imposed by the ICERD on state parties is also stricter than the case of Article 20 of the ICCPR covering the criminalization of racist ideas that are not necessarily inciting discrimination, hostility or violence." An important difference is in the issue of
intent Intentions are mental states in which the agent commits themselves to a course of action. Having the plan to visit the zoo tomorrow is an example of an intention. The action plan is the ''content'' of the intention while the commitment is the ''a ...
. The concept of "advocacy of hatred" introduced in the ICCPR is more specific than discriminatory speech described in the ICERD, since it is taken to require consideration of the intent of author and not the expression in isolation—this is because "advocacy" is interpreted in the ICCPR as requiring the intent to sow hatred. The Committee on the Elimination of Racial Discrimination has actively addressed hate speech in its General Recommendation 29, in which the Committee recommends state parties to: "(r) Take measures against any dissemination of ideas of caste superiority and inferiority or which attempt to justify violence, hatred or discrimination against descent-based communities; (s) Take strict measures against any incitement to discrimination or violence against the communities, including through the Internet; (t) Take measures to raise awareness among media professionals of the nature and incidence of descent-based discrimination;" These points, which reflect the ICERD's reference to the dissemination of expression, have significance for the
Internet The Internet (or internet) is the global system of interconnected computer networks that uses the Internet protocol suite (TCP/IP) to communicate between networks and devices. It is a '' network of networks'' that consists of private, p ...
. The expression of ideas in some online contexts may immediately amount to spreading them. This is especially relevant for private spaces that have begun to play a public role, as in the case of many social networking platforms.


Genocide Convention

Similarly to the ICERD, the
Genocide Convention The Convention on the Prevention and Punishment of the Crime of Genocide (CPPCG), or the Genocide Convention, is an international treaty that criminalizes genocide and obligates state parties to pursue the enforcement of its prohibition. It wa ...
aims to protect groups defined by race, nationality or ethnicity, although it also extends its provisions to religious groups. When it comes to hate speech the Genocide Convention is limited only to acts that publicly incite to
genocide Genocide is the intentional destruction of a people—usually defined as an ethnic, national, racial, or religious group—in whole or in part. Raphael Lemkin coined the term in 1944, combining the Greek word (, "race, people") with the ...
, recognized as "acts committed with intent to destroy, in whole or in part, a national, ethnical, racial or religious group", regardless of whether such acts are undertaken in peacetime or in wartime. Specifically gender-based hate speech (as distinct from discriminatory actions) is not covered in depth in
international law International law (also known as public international law and the law of nations) is the set of rules, norms, and standards generally recognized as binding between states. It establishes normative guidelines and a common conceptual framework for ...
.


CEDAW

The Convention on the Elimination of All Forms of Discrimination against Women (CEDAW), which entered into force in 1981, imposes obligations on states to condemn discrimination against women and "prevent, investigate, prosecute and punish" acts of gender-based violence.


Regional responses

Most regional instruments do not have specific articles prescribing
prohibition Prohibition is the act or practice of forbidding something by law; more particularly the term refers to the banning of the manufacture, storage (whether in barrels or in bottles), transportation, sale, possession, and consumption of alcoholi ...
of hate speech, but they more generally allow states to limit freedom of expression—which provisions can be applied to specific cases.


American Convention on Human Rights

The
American Convention on Human Rights The American Convention on Human Rights, also known as the Pact of San José, is an international human rights instrument. It was adopted by many countries in the Western Hemisphere in San José, Costa Rica, on 22 November 1969. It came into for ...
describes limitations on freedom of expression in a manner similar to the ICCPR in Article 19 (3). The
Organization of American States The Organization of American States (OAS; es, Organización de los Estados Americanos, pt, Organização dos Estados Americanos, french: Organisation des États américains; ''OEA'') is an international organization that was founded on 30 Apri ...
has also adopted another declaration on the principles of freedom of expression, which includes a specific clause stating that "prior conditioning of expressions, such as truthfulness, timeliness or
impartiality Impartiality (also called evenhandedness or fair-mindedness) is a principle of justice holding that decisions should be based on objective criteria, rather than on the basis of bias, prejudice, or preferring the benefit to one person over another ...
is incompatible with the right to freedom of expression recognized in international instruments." The Inter-American Court has advised that "(a)buse of freedom of information thus cannot be controlled by preventive measures but only through the subsequent imposition of sanctions on those who are guilty of the abuses." The Court also imposes a test for States willing to enact restrictions on freedom of expression, as they need to observe the following requirements: "a) the existence of previously established grounds for liability; b) the express and precise definition of these grounds by law; c) the legitimacy of the ends sought to be achieved; d) a showing that these grounds of liability are ‘necessary to ensure' the aforementioned ends."Inter-American Commission on Human Rights, Advisory Opinion OC-5/85, 13 November 1985, para 39. The Inter-American System has a Special Rapporteur on Freedom of Expression who conducted a comprehensive study on hate speech. He concluded that the Inter-American Human Rights System differs from the United Nations and the European approach on a key point: The Inter-American system covers and restricts hate speech that actually leads to violence, and solely such speech can be restricted.


African Charter on Human Rights and Peoples' Rights

The African Charter on Human Rights and Peoples' Rights takes a different approach in Article 9 (2), allowing for restrictions on rights as long as they are "within the law." This concept has been criticized and there is a vast amount of legal scholarship on the so-called "claw-back" clauses and their interpretation. The criticism is mainly aimed at the fact that countries can manipulate their own legislation and weaken the essence of the right to freedom of expression. The Declaration of Principles on Freedom of Expression in Africa elaborates a higher standard for limitations on freedom of expression. It declares that the right "should not be restricted on public order or national security grounds unless there is a real risk of harm to a legitimate interest and there is a close causal link between the risk of harm and the expression."


Cairo Declaration on Human Rights in Islam

In 1990, the
Organization of the Islamic Conference An organization or organisation (Commonwealth English; see spelling differences), is an entity—such as a company, an institution, or an association—comprising one or more people and having a particular purpose. The word is derived from ...
(which was later renamed Organization of Islamic Cooperation, OIC) adopted the
Cairo Declaration on Human Rights in Islam The Cairo Declaration on Human Rights in Islam (CDHRI) is a declaration of the member states of the Organisation of Islamic Cooperation (OIC) first adopted in Cairo, Egypt, on 5 August 1990, (Conference of Foreign Ministers, 9–14 Muharram ...
(CDHRI), which calls for criminalization of speech that extends beyond cases of imminent violence to encompass "acts or speech that denote manifest intolerance and hate."


Arab Charter on Human Rights

The Arab Charter on Human Rights, which was adopted by the
Council A council is a group of people who come together to consult, deliberate, or make decisions. A council may function as a legislature, especially at a town, city or county/ shire level, but most legislative bodies at the state/provincial or nati ...
of the
League of Arab States League or The League may refer to: Arts and entertainment * ''Leagues'' (band), an American rock band * '' The League'', an American sitcom broadcast on FX and FXX about fantasy football Sports * Sports league * Rugby league, full contact foo ...
in 2004, includes in Article 32 provisions that are relevant also for online communication as it guarantees the right to "freedom of opinion and expression, and the right to seek, receive and impart information and ideas through any medium, regardless of geographical boundaries." It allows a limitation on a broad basis in paragraph 2 "Such rights and freedoms shall be exercised in conformity with the fundamental values of society."


ASEAN Human Rights Declaration

The
ASEAN Human Rights Declaration In 2009, the Association of Southeast Asian Nations (ASEAN) established the ASEAN Intergovernmental Commission on Human Rights to promote human rights in the ten ASEAN countries. By mid-2012, the Commission had drafted the ASEAN Human Rights Declar ...
includes the right to freedom of expression in Article 23. Article 7 of the Declaration provides for general limitations, affirming, "the realization of human rights must be considered in the regional and national context bearing in mind different political, economic, legal, social, cultural, historical and religious backgrounds."


Charter of Fundamental Rights of the European Union

The
Charter of Fundamental Rights of the European Union The Charter of Fundamental Rights of the European Union (CFR) enshrines certain political, social, and economic rights for European Union (EU) citizens and residents into EU law. It was drafted by the European Convention and solemnly proclai ...
which declares the right to freedom of expression in Article 11, has a clause which prohibits abuse of rights. It asserts that the Charter must not be interpreted as implying any "limitation to a greater extent than is provided for therein." An example of a limitation which implies a strict test of necessity and proportionality is the provision on freedom of expression in the
European Convention on Human Rights The European Convention on Human Rights (ECHR; formally the Convention for the Protection of Human Rights and Fundamental Freedoms) is an international convention to protect human rights and political freedoms in Europe. Drafted in 1950 by ...
, which underlines that the exercise of freedom of expression carries duties and responsibilities. It "may be subject to such formalities, conditions, restrictions or penalties as are prescribed by law and are
necessary in a democratic society __NOTOC__ "Necessary in a democratic society" is a test found in Articles 8–11 of the European Convention on Human Rights, which provides that the state may impose restrictions of these rights only if such restrictions are "necessary in a democra ...
, in the interests of
national security National security, or national defence, is the security and defence of a sovereign state, including its citizens, economy, and institutions, which is regarded as a duty of government. Originally conceived as protection against military att ...
,
territorial integrity Territorial integrity is the principle under international law that gives the right to sovereign states to defend their borders and all territory in them of another state. It is enshrined in Article 2(4) of the UN Charter and has been recognized ...
or
public safety Public security or public safety is the prevention of and protection from events that could endanger the safety and security of the public from significant danger, injury, or property damage. It is often conducted by a state government to ensur ...
, for the prevention of disorder or crime, for the protection of health or morals, for the protection of the reputation or rights of others, for preventing the disclosure of information received in confidence, or for maintaining the authority and impartiality of the judiciary." The
European Court of Human Rights The European Court of Human Rights (ECHR or ECtHR), also known as the Strasbourg Court, is an international court of the Council of Europe which interprets the European Convention on Human Rights. The court hears applications alleging that ...
is careful to distinguish between hate speech and the right of individuals to express their views freely, even if others take offense. There are regional instances relevant specifically to online hate speech. The
Council of Europe The Council of Europe (CoE; french: Conseil de l'Europe, ) is an international organisation founded in the wake of World War II to uphold human rights, democracy and the rule of law in Europe. Founded in 1949, it has 46 member states, with a p ...
(CoE) in 2000 issued a General Policy Recommendation on Combating the Dissemination of Racist,
Xenophobic Xenophobia () is the fear or dislike of anything which is perceived as being foreign or strange. It is an expression of perceived conflict between an in-group and out-group and may manifest in suspicion by the one of the other's activities, a ...
and
Anti-Semitic Antisemitism (also spelled anti-semitism or anti-Semitism) is hostility to, prejudice towards, or discrimination against Jews. A person who holds such positions is called an antisemite. Antisemitism is considered to be a form of racism. Antis ...
Material via the Internet. The creation of the CoE Convention on Cybercrime in 2001, which regulates mutual assistance regarding investigative powers, provides signatory countries with a mechanism to deal with computer data, which would include transnational hate speech online. In 2003 the CoE launched an additional protocol to the Convention on Cybercrime which addresses online expression of racism and xenophobia. The convention and its protocol were opened for signature and ratification of countries outside
Europe Europe is a large peninsula conventionally considered a continent in its own right because of its great physical size and the weight of its history and traditions. Europe is also considered a Continent#Subcontinents, subcontinent of Eurasia ...
, and other countries, such as
Canada Canada is a country in North America. Its ten provinces and three territories extend from the Atlantic Ocean to the Pacific Ocean and northward into the Arctic Ocean, covering over , making it the world's second-largest country by to ...
and
South Africa South Africa, officially the Republic of South Africa (RSA), is the southernmost country in Africa. It is bounded to the south by of coastline that stretch along the South Atlantic and Indian Oceans; to the north by the neighbouring coun ...
, are already part of this convention. The Protocol imposes an obligation on Member States to criminalize racist and xenophobic insults online of "(i) persons for the reason that they belong to a group distinguished by race, color, descent or national or ethnic origin, as well as religion, if used as a pretext for any of these factors; or (ii) a group of persons which is distinguished by any of these characteristics."


Private spaces

Internet The Internet (or internet) is the global system of interconnected computer networks that uses the Internet protocol suite (TCP/IP) to communicate between networks and devices. It is a '' network of networks'' that consists of private, p ...
intermediaries such as social networking platforms,
Internet Service Providers An Internet service provider (ISP) is an organization that provides services for accessing, using, or participating in the Internet. ISPs can be organized in various forms, such as commercial, community-owned, non-profit, or otherwise privat ...
or
Search Engines A search engine is a software system designed to carry out web searches. They search the World Wide Web in a systematic way for particular information specified in a textual web search query. The search results are generally presented in ...
, stipulate in their terms of service how they may intervene in allowing, restricting, or channelling the creation and access to specific content. A vast amount of online interactions occur on social networking platforms that transcend national jurisdictions and which platforms have also developed their own definitions of hate speech and measures to respond to it. For a user who violates the terms of service, the content he or she has posted may be removed from the platform, or its access may be restricted to be viewed only by a certain category of users (e.g. users living outside a specific country). The principles that inspire terms of service agreements and the mechanisms that each company develops to ensure their
implementation Implementation is the realization of an application, or execution of a plan, idea, model, design, specification, standard, algorithm, or policy. Industry-specific definitions Computer science In computer science, an implementation is a real ...
have significant repercussions on the ability that people have to express themselves online as well as to be protected from hate speech. Most intermediaries have to enter in negotiations with national governments to an extent that varies according to the type of intermediary, areas where the company is registered, and the legal regime that applies. As Tsesis explains, "(i)f transmissions on the Internet are sent and received in particular locations, then specific fora retain jurisdiction to prosecute illegal activities transacted on the Internet." Internet Service Providers are the most directly affected by national legislation because they have to be located in a specific country to operate. Search Engines, while they can modify search results for self-regulatory or commercial reasons, have increasingly tended to adapt to the intermediary liability regime of both their registered home jurisdictions and other jurisdictions in which they provide their services, either removing links to content proactively or upon request by authorities. All Internet intermediaries operated by private companies are also expected to respect
human rights Human rights are moral principles or normsJames Nickel, with assistance from Thomas Pogge, M.B.E. Smith, and Leif Wenar, 13 December 2013, Stanford Encyclopedia of PhilosophyHuman Rights Retrieved 14 August 2014 for certain standards of hu ...
. This is set out in the Guiding Principles on Business and Human Rights elaborated by the
United Nations Office of the High Commissioner for Human Rights The Office of the United Nations High Commissioner for Human Rights, commonly known as the Office of the High Commissioner for Human Rights (OHCHR) or the United Nations Human Rights Office, is a department of the Secretariat of the United Nati ...
. The document emphasizes
corporate responsibility Corporate responsibility is a term which has come to characterize a family of professional disciplines intended to help a corporation stay competitive by maintaining accountability to its four main stakeholder groups: customers, employees, share ...
in upholding human rights. In principle 11, it declares that: "Business enterprises should respect human rights. This means that they should avoid infringing on the human rights of others and should address adverse human rights impacts with which they are involved." The United Nations Guiding Principles also indicate that in cases in which human rights are violated, companies should "provide for or cooperate in their remediation through legitimate processes." In the case of Internet intermediaries and conceptions of hate speech, this means that they should ensure that measures are in place to provide a commensurate response.


Social responses


Case studies


The American Trends Panel

The
Pew Research Center The Pew Research Center is a nonpartisan American think tank (referring to itself as a "fact tank") based in Washington, D.C. It provides information on social issues, public opinion, and demographic trends shaping the United States and th ...
surveyed over 10,000 adults in July 2020 to study social media's effect on politics and
social justice Social justice is justice in terms of the distribution of wealth, opportunities, and privileges within a society. In Western and Asian cultures, the concept of social justice has often referred to the process of ensuring that individuals ...
activism. 23% of respondents, who are adult social media users, reported that social media content has caused them to change their opinion, positively or negatively, on a political or social justice issue. 35% of those respondents cited the
Black Lives Matter Black Lives Matter (abbreviated BLM) is a decentralized political and social movement that seeks to highlight racism, discrimination, and racial inequality experienced by black people. Its primary concerns are incidents of police bruta ...
movement, police reform, and/or
race relations Race relations is a sociological concept that emerged in Chicago in connection with the work of sociologist Robert E. Park and the Chicago race riot of 1919. Race relations designates a paradigm or field in sociology and a legal concept in th ...
. 18% of respondents reported a change of opinion on political parties,
ideologies An ideology is a set of beliefs or philosophies attributed to a person or group of persons, especially those held for reasons that are not purely epistemic, in which "practical elements are as prominent as theoretical ones." Formerly applied prim ...
, politicians, and/or President Donald Trump. 9% of respondents cited social justice issues, such as
LGBTQIA+ ' is an initialism that stands for lesbian, gay, bisexual, and transgender. In use since the 1990s, the initialism, as well as some of its common variants, functions as an umbrella term for sexuality and gender identity. The LGBT term is an ...
rights,
feminism Feminism is a range of socio-political movements and ideologies that aim to define and establish the political, economic, personal, and social equality of the sexes. Feminism incorporates the position that society prioritizes the male po ...
,
immigration Immigration is the international movement of people to a destination country of which they are not natives or where they do not possess citizenship in order to settle as permanent residents or naturalized citizens. Commuters, tourists, ...
, etc. 8% of respondents changed their opinion on the
COVID-19 pandemic The COVID-19 pandemic, also known as the coronavirus pandemic, is an ongoing global pandemic of coronavirus disease 2019 (COVID-19) caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). The novel virus was first identi ...
, and 10% cited other opinions. Based on these results, social media plays an important role in influencing public opinion.


Media Manipulation and Disinformation Online

A study conducted by researchers
Alice Marwick Alice E. Marwick is a communication scholar, academic, and author, who currently works as an Associate Professor in the Communication department and Principal Researcher at the Center for Information, Technology and Public Life at the University ...
and Rebecca Lewis observed media manipulation and explored how the alt-right marketed, networked, and collaborated to influence their controversial beliefs that could have potentially helped influence
President Trump Donald John Trump (born June 14, 1946) is an American politician, media personality, and businessman who served as the 45th president of the United States from 2017 to 2021. Trump graduated from the Wharton School of the University of Pe ...
's victory in the 2016 election. Unlike
mainstream media In journalism, mainstream media (MSM) is a term and abbreviation used to refer collectively to the various large mass news media that influence many people and both reflect and shape prevailing currents of thought. Chomsky, Noam, ''"What makes ma ...
, the
alt-right The alt-right, an abbreviation of alternative right, is a far-right, white nationalist movement. A largely online phenomenon, the alt-right originated in the United States during the late 2000s before increasing in popularity during the mid-2 ...
does not need to comply to any rules when it comes to influence and do not need to worry about network ratings, audience reviews, or
sensationalism In journalism and mass media, sensationalism is a type of editorial tactic. Events and topics in news stories are selected and worded to excite the greatest number of readers and viewers. This style of news reporting encourages biased or emotio ...
. Alt-right groups can share and persuade others of their controversial beliefs as bluntly and brashly as they desire, on any platform, which may have played a role in the 2016 election. Although the study could not conclude what exactly the effect was on the election, but did provide extensive research on the characteristics of
media manipulation Media manipulation is a series of related techniques in which partisans create an image or argument that favors their particular interests. Such tactics may include the use of logical fallacies, manipulation, outright deception (disinformation ...
and
trolling In slang, a troll is a person who posts or makes inflammatory, insincere, digressive, extraneous, or off-topic messages online (such as in social media, a newsgroup, a forum, a chat room, a online video game), or in real life, with the i ...
.


Hate Speech and Linguistic Profiling in Online Gaming

Professor and gamer
Kishonna Gray Kishonna L. Gray is an American communication and gender studies researcher based at the University of Kentucky College of Arts and Sciences. Gray is best known for her research on technology, gaming, race, and gender. As an expert in Women's a ...
studied intersectional oppressions in the online gaming community and called on
Microsoft Microsoft Corporation is an American multinational technology corporation producing computer software, consumer electronics, personal computers, and related services headquartered at the Microsoft Redmond campus located in Redmond, Washi ...
and game developers to "critically assess the experiences of non-traditional gamers in online communities...recognize
diversity Diversity, diversify, or diverse may refer to: Business *Diversity (business), the inclusion of people of different identities (ethnicity, gender, age) in the workforce *Diversity marketing, marketing communication targeting diverse customers * ...
... nd thatthe default gaming population are deploying hegemonic whiteness and
masculinity Masculinity (also called manhood or manliness) is a set of attributes, behaviors, and roles associated with men and boys. Masculinity can be theoretically understood as socially constructed, and there is also evidence that some behaviors ...
to the detriment of non-white and/or non-male users within the space." Gray examined
sexism Sexism is prejudice or discrimination based on one's sex or gender. Sexism can affect anyone, but it primarily affects women and girls.There is a clear and broad consensus among academic scholars in multiple fields that sexism refers pri ...
and
racism Racism is the belief that groups of humans possess different behavioral traits corresponding to inherited attributes and can be divided based on the superiority of one race over another. It may also mean prejudice, discrimination, or antagoni ...
in the online gaming community. Gamers attempt to identify the gender, sexuality, and ethnic background of their teammates and opponents through
linguistic profiling Linguistic profiling is the practice of identifying the social characteristics of an individual based on auditory cues, in particular dialect and accent. The theory was first developed by Professor John Baugh to explain discriminatory practices ...
, when the other players cannot be seen. Due to the intense atmosphere of the virtual gaming sphere, and the inability to not be seen, located, or physically confronted, gamers tend to say things on the virtual game that they likely would not have said in a public setting. Many gamers of marginalized communities have branched off from the global gaming network and joined "
clans A clan is a group of people united by actual or perceived kinship and descent. Even if lineage details are unknown, clans may claim descent from founding member or apical ancestor. Clans, in indigenous societies, tend to be endogamous, mea ...
," that consist of only gamers of the same gender, sexuality, and/or ethnic identity, to avoid
discrimination Discrimination is the act of making unjustified distinctions between people based on the groups, classes, or other categories to which they belong or are perceived to belong. People may be discriminated on the basis of Racial discrimination, r ...
while gaming. A study found that 78 percent of all online gamers play in "guilds" which are smaller groups of players, similar to "
clans A clan is a group of people united by actual or perceived kinship and descent. Even if lineage details are unknown, clans may claim descent from founding member or apical ancestor. Clans, in indigenous societies, tend to be endogamous, mea ...
." One of the most notable "
clans A clan is a group of people united by actual or perceived kinship and descent. Even if lineage details are unknown, clans may claim descent from founding member or apical ancestor. Clans, in indigenous societies, tend to be endogamous, mea ...
," Puerto Reekan Killaz, have created an online gaming space where Black and Latina women of the LGBTQIA+ community can play without risk of
racism Racism is the belief that groups of humans possess different behavioral traits corresponding to inherited attributes and can be divided based on the superiority of one race over another. It may also mean prejudice, discrimination, or antagoni ...
, nativism,
homophobia Homophobia encompasses a range of negative attitudes and feelings toward homosexuality or people who are identified or perceived as being lesbian, gay or bisexual. It has been defined as contempt, prejudice, aversion, hatred or antipathy, ...
,
sexism Sexism is prejudice or discrimination based on one's sex or gender. Sexism can affect anyone, but it primarily affects women and girls.There is a clear and broad consensus among academic scholars in multiple fields that sexism refers pri ...
, and
sexual harassment Sexual harassment is a type of harassment involving the use of explicit or implicit sexual overtones, including the unwelcome and inappropriate promises of rewards in exchange for sexual favors. Sexual harassment includes a range of actions fr ...
. In addition to hate speech, Professor and gamer Lisa Nakamura found that many gamers have experienced
identity tourism Identity tourism may refer to the act of assuming a racial, ethnic, socioeconomic, sexual or gender identity for recreational purposes, or the construction of cultural identities and re-examination of one’s ethnic and cultural heritage from what t ...
- which is when a person or group appropriate and pretend to members of another group- as Nakamura observed white male gamers play as Japanese "
geisha {{Culture of Japan, Traditions, Geisha {{nihongo, Geisha, 芸者 ({{IPAc-en, ˈ, ɡ, eɪ, ʃ, ə; {{IPA-ja, ɡeːɕa, lang), also known as {{nihongo, , 芸子, geiko (in Kyoto and Kanazawa) or {{nihongo, , 芸妓, geigi, are a class of female J ...
" women.
Identity Tourism Identity tourism may refer to the act of assuming a racial, ethnic, socioeconomic, sexual or gender identity for recreational purposes, or the construction of cultural identities and re-examination of one’s ethnic and cultural heritage from what t ...
often leads to
stereotyping In social psychology, a stereotype is a generalized belief about a particular category of people. It is an expectation that people might have about every person of a particular group. The type of expectation can vary; it can be, for example ...
,
discrimination Discrimination is the act of making unjustified distinctions between people based on the groups, classes, or other categories to which they belong or are perceived to belong. People may be discriminated on the basis of Racial discrimination, r ...
, and
cultural appropriation Cultural appropriation is the inappropriate or unacknowledged adoption of an element or elements of one culture or identity by members of another culture or identity. This can be controversial when members of a dominant culture appropriate from ...
. Nakamura called on the online gaming community to recognize Cybertyping- "the way the Internet propagates, disseminates, and commodifies images of race and racism."


Anti-Chinese Rhetoric Employed by Perpetrators of Anti-Asian Hate

As of August 2020, over 2,500
Asian-Americans Asian Americans are Americans of Asian ancestry (including naturalized Americans who are immigrants from specific regions in Asia and descendants of such immigrants). Although this term had historically been used for all the indigenous peopl ...
have reported experiencing racism fueled by
COVID-19 Coronavirus disease 2019 (COVID-19) is a contagious disease caused by a virus, the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). The first known case was identified in Wuhan, China, in December 2019. The disease quick ...
, with 30.5% of those cases containing anti-Chinese rhetoric, according to Stop AAPI (Asian-American/Pacific Islander) Hate. The language used in these incidents are divided into five categories: virulent animosity,
scapegoating Scapegoating is the practice of singling out a person or group for unmerited blame and consequent negative treatment. Scapegoating may be conducted by individuals against individuals (e.g. "he did it, not me!"), individuals against groups (e.g., ...
of China, anti-immigrant nativism, racist characterizations of Chinese, and racial slurs. 60.4% of these reported incidents fit into the virulent animosity category, which includes phrases such as "get your Chinese a** away from me!"


Pakistan

Online hate speech and
cyberbullying Cyberbullying or cyberharassment is a form of bullying or harassment using electronic means. Cyberbullying and cyberharassment are also known as online bullying. It has become increasingly common, especially among teenagers, as the digital ...
against religious and ethnic minorities,
women A woman is an adult female human. Prior to adulthood, a female human is referred to as a girl (a female child or Adolescence, adolescent). The plural ''women'' is sometimes used in certain phrases such as "women's rights" to denote female hum ...
, and other socially marginalized groups have long been an issue that is downplayed and/or ignored in the
Islamic Republic of Pakistan Pakistan ( ur, ), officially the Islamic Republic of Pakistan ( ur, , label=none), is a country in South Asia. It is the world's List of countries and dependencies by population, fifth-most populous country, with a population of almost 24 ...
. Hate Speech against
Ahmadis Ahmadiyya (, ), officially the Ahmadiyya Muslim Community or the Ahmadiyya Muslim Jama'at (AMJ, ar, الجماعة الإسلامية الأحمدية, al-Jamāʿah al-Islāmīyah al-Aḥmadīyah; ur, , translit=Jamā'at Aḥmadiyyah Musl ...
both online and in real life have led to their large-scale
persecution Persecution is the systematic mistreatment of an individual or group by another individual or group. The most common forms are religious persecution, racism, and political persecution, though there is naturally some overlap between these ter ...
. BytesForAll, a
South Asia South Asia is the southern subregion of Asia, which is defined in both geographical and ethno-cultural terms. The region consists of the countries of Afghanistan, Bangladesh, Bhutan, India, Maldives, Nepal, Pakistan, and Sri Lanka.;;;;; ...
n initiative and an APC member project released a study on hate speech online in Pakistan on June 07, 2014. The research included two independent phases: According to the report:


Myanmar

The Internet has grown at unprecedented rates.
Myanmar Myanmar, ; UK pronunciations: US pronunciations incl. . Note: Wikipedia's IPA conventions require indicating /r/ even in British English although only some British English speakers pronounce r at the end of syllables. As John Wells explai ...
is transitioning towards greater openness and access, which leads to social media negatives, such as using hate speech and calls to violence. In 2014, the
UN Human Rights Council The United Nations Human Rights Council (UNHRC), CDH is a United Nations body whose mission is to promote and protect human rights around the world. The Council has 47 members elected for staggered three-year terms on a regional group basis ...
Special Rapporteur on Minority Issues expressed her concern over the spread of
misinformation Misinformation is incorrect or misleading information. It differs from disinformation, which is ''deliberately'' deceptive. Rumors are information not attributed to any particular source, and so are unreliable and often unverified, but can turn ...
, hate speech and
incitement to violence In criminal law, incitement is the encouragement of another person to commit a crime. Depending on the jurisdiction, some or all types of incitement may be illegal. Where illegal, it is known as an inchoate offense, where harm is intended but ...
, discrimination and hostility in the media and Internet, particularly targeted against a minority community. The growing tension online has gone parallel with cases of actual violence leaving hundreds dead and thousands displaced."Why Is There Communal Violence in Myanmar?", BBC, 3 July 2014. https://www.bbc.co.uk/news/worldasia-18395788 One challenge in this process has concerned ethnic and religious minorities. In 2013, 43 people were killed due to clashes that erupted after a dispute in the
Rakhine state Rakhine State (; , , ; formerly known as Arakan State) is a state in Myanmar (Burma). Situated on the western coast, it is bordered by Chin State to the north, Magway Region, Bago Region and Ayeyarwady Region to the east, the Bay of Ben ...
in the Western Part of the country. A year earlier, more than 200 people were killed and thousands displaced 37 because of ethnic violence, which erupted after an alleged rape case. Against this backdrop, the rapid emergence of new online spaces, albeit for a fraction of the population, has reflected some of these deeply rooted tensions in a new form. Dealing with intolerance and hate speech online is an emerging issue. Facebook has rapidly become the platform of choice for those citizens making their first steps online. In this environment there have been individual and groups, which have championed a more aggressive use of the medium, especially when feeling protected by a sense of righteousness and by claims to be acting in defense of the
national interest The national interest is a sovereign state's goals and ambitions (economic, military, cultural, or otherwise), taken to be the aim of government. Etymology The Italian phrase ''ragione degli stati'' was first used by Giovanni della Casa around ...
. Political figures have also used online media for particular causes. In social media, there has been the use of derogatory terms in reference to minorities. In this complex situation, a variety of actors has begun to mobilize, seeking to offer responses that can avoid further violence. Facebook has sought to take a more active role in monitoring the uses of the social network platform in Myanmar, developing
partnership A partnership is an arrangement where parties, known as business partners, agree to cooperate to advance their mutual interests. The partners in a partnership may be individuals, businesses, interest-based organizations, schools, governments ...
s with local organizations and making guidelines on reporting problems accessible in Burmese. The local civil society has constituted a strong voice in openly condemning the spread of online hate speech, but at the same time calling for alternatives to
censorship Censorship is the suppression of speech, public communication, or other information. This may be done on the basis that such material is considered objectionable, harmful, sensitive, or "inconvenient". Censorship can be conducted by governments ...
. Among the most innovative responses has been Panzagar, which in Burmese means "flower speech", a campaign launched by blogger and activist
Nay Phone Latt Nay Phone Latt ( my, နေဘုန်းလတ်; born Nay Myo Kyaw on 28 June 1980) is a Burmese blogger and activist, currently serving as a Yangon Region Hluttaw MP for Thingangyun Township. He was a recipient of PEN/Barbara Goldsmith Fre ...
to openly oppose hate speech. The goal of the initiative was offering a joyful example of how people can interact, both online and offline. Local activists have been focussed upon local solutions, rather than trying to mobilize
global civil society Civil society can be understood as the "third sector" of society, distinct from government and business, and including the family and the private sphere. for the civil war in Sudan, or the organization Invisible Children with the Kony2012 campaign that denounced the atrocities committed by the Lord Resistance Army, are popular examples. As commentaries on these campaigns have pointed out, such global responses may have negative repercussions on the ability for local solutions to be found.


Ethiopia

;2019–2020 The long-lived ethnic rivalry in
Ethiopia Ethiopia, , om, Itiyoophiyaa, so, Itoobiya, ti, ኢትዮጵያ, Ítiyop'iya, aa, Itiyoppiya officially the Federal Democratic Republic of Ethiopia, is a landlocked country in the Horn of Africa. It shares borders with Eritrea to the ...
between the Oromo people and the Amhara people found battleground on
Facebook Facebook is an online social media and social networking service owned by American company Meta Platforms. Founded in 2004 by Mark Zuckerberg with fellow Harvard College students and roommates Eduardo Saverin, Andrew McCollum, Dust ...
, leading to hate speech, threats,
disinformation Disinformation is false information deliberately spread to deceive people. It is sometimes confused with misinformation, which is false information but is not deliberate. The English word ''disinformation'' comes from the application of the ...
, and deaths. Facebook does not have fact-checkers that speak either of the dominant languages spoken in Ethiopia nor do they provide translations of the Community Standards, therefore hate speech on Facebook is largely unmonitored in Ethiopia. Instead, Facebook relies on activists to flag potential hate speech and disinformation, but the many burnout activists feel mistreated. In October 2019, Ethiopian activist
Jawar Mohammed Jawar Mohammed ( om, Jawaar Mahammad; born 12 May 1986) is an Ethiopian political analyst and activist. One of the founders of the Oromia Media Network (OMN), Jawar was a leading organizer of the 2014–2016 Oromo protests. He has been credited ...
falsely announced on Facebook that the police were going to detain him, citing religious and ethnic tension. This prompted the community to protest his alleged detainment and the racial and ethnic tensions, which led to over 70 deaths. A disinformation campaign originated on Facebook centering on popular Ethiopian singer, Hachalu Hundessa, of the Oromo ethnic group. The posts accused Hundessa of supporting their controversial Prime Minister
Abiy Ahmed Abiy Ahmed Ali ( om, Abiyi Ahmed Alii; am, አብይ አሕመድ ዐሊ; born 15 August 1976) is an Ethiopian politician who has been the 4th prime minister of the Federal Democratic Republic of Ethiopia since 2 April 2018. He won the 2019 ...
, whom Oromo
nationalists Nationalism is an idea and movement that holds that the nation should be congruent with the state. As a movement, nationalism tends to promote the interests of a particular nation (as in a group of people), Smith, Anthony. ''Nationalism: The ...
disproved of for his catering to other ethnic groups. Hundessa was assassinated in June 2020 following the hateful Facebook posts, prompting public outrage. Facebook users blamed the Amhara people for Hundessa's assassination without any evidence in a long thread of hateful content. According to The Network Against Hate Speech, many Facebook posts called for "
genocidal Genocide is the intentional destruction of a people—usually defined as an ethnic, national, racial, or religious group—in whole or in part. Raphael Lemkin coined the term in 1944, combining the Greek word (, "race, people") with the L ...
attacks against an ethnic group or a religion — or both at the same time; and ordering people to burn civilians' properties, kill them brutally, and displace them." The violence in the streets and on Facebook escalated to the point that the Ethiopian Government shut down the Internet for three weeks. However, neighboring countries could still post and access the hateful content of the matter, and the volunteer activists could not access the Internet to flag hate speech. Therefore "there are hours of video that came from the diaspora community, extremist content, saying we need to exterminate this ethnic group," according to Professor Endalk Chala of Hamline University. Facebook officials ventured to Ethiopia to investigate, but did not release their findings. Facebook announced that they are hiring moderators who can speak Amharic and other languages in Ethiopia but did not provide extensive detail. ;late 2020–2021 Online hate speech occurred during the
Tigray War The Tigray War; ; . was an armed conflict that lasted from 3 November 2020 to 3 November 2022. The war was primarily fought in the Tigray Region of Ethiopia between the Ethiopian federal government and Eritrea on one side, and the Tigray Peop ...
in which military conflict and war crimes by all sides, possibly amounting to
crimes against humanity Crimes against humanity are widespread or systemic acts committed by or on behalf of a ''de facto'' authority, usually a state, that grossly violate human rights. Unlike war crimes, crimes against humanity do not have to take place within the ...
, started in November 2020. In online social media hate speech in November 2021, journalists, politicians and pro-federal-government activists called ethnic Tigrayans "traitors", called for neighbours to "weed" them, and called for authorities to detain ethnic Tigrayans in "concentration camps". Mass detentions of ethnic Tigrayans took place, with federal legal justification under the 2021 Ethiopian state of emergency.


Private companies

Internet intermediaries have developed disparate definitions of hate speech and guidelines to regulate it. Some companies do not use the term hate speech, but have a descriptive list of terms related to it.


Yahoo!

Yahoo! Yahoo! (, styled yahoo''!'' in its logo) is an American web services provider. It is headquartered in Sunnyvale, California and operated by the namesake company Yahoo Inc., which is 90% owned by investment funds managed by Apollo Global Mana ...
's terms of service prohibit the posting of "content that is unlawful, harmful, threatening, abusive, harassing, tortuous,
defamatory Defamation is the act of communicating to a third party false statements about a person, place or thing that results in damage to its reputation. It can be spoken (slander) or written (libel). It constitutes a tort or a crime. The legal defini ...
, vulgar, obscene,
libellous Defamation is the act of communicating to a third party false statements about a person, place or thing that results in damage to its reputation. It can be spoken (slander) or written (libel). It constitutes a tort or a crime. The legal defini ...
, invasive of another's privacy, hateful, or racially, ethnically or otherwise objectionable."


Twitter

In December 2017,
Twitter Twitter is an online social media and social networking service owned and operated by American company Twitter, Inc., on which users post and interact with 280-character-long messages known as "tweets". Registered users can post, like, and ...
began enforcing new policies towards hate speech, banning multiple accounts as well as setting new guidelines for what will be allowed on their platform. There is an entire page in the Twitter Help Center devoted to describing their Hateful Conduct Policy, as well as their enforcement procedures. The top of this page states "Freedom of expression means little if voices are silenced because people are afraid to speak up. We do not tolerate behavior that harasses, intimidates, or uses fear to silence another person’s voice. If you see something on Twitter that violates these rules, please report it to us." Twitter's definition of
hate speech Hate speech is defined by the ''Cambridge Dictionary'' as "public speech that expresses hate or encourages violence towards a person or group based on something such as race, religion, sex, or sexual orientation". Hate speech is "usually thoug ...
ranges from "violent threats" and "wishes for the physical harm, death, or disease of individuals or groups" to "repeated and/or non-consensual slurs, epithets, racist and sexist tropes, or other content that degrades someone." Punishments for violations range from suspending a user's ability to tweet until they take down their offensive/ hateful post to the removal of an account entirely. In a statement following the implementation of their new policies, Twitter said "In our efforts to be more aggressive here, we may make some mistakes and are working on a robust appeals process" . . . "We’ll evaluate and iterate on these changes in the coming days and weeks, and will keep you posted on progress along the way". These changes come amidst a time where action is being taken to prevent hate speech around the globe, including new laws in Europe which pose fines for sites unable to address
hate speech Hate speech is defined by the ''Cambridge Dictionary'' as "public speech that expresses hate or encourages violence towards a person or group based on something such as race, religion, sex, or sexual orientation". Hate speech is "usually thoug ...
reports within 24 hours.


YouTube

YouTube YouTube is a global online video sharing and social media platform headquartered in San Bruno, California. It was launched on February 14, 2005, by Steve Chen, Chad Hurley, and Jawed Karim. It is owned by Google, and is the second mo ...
, a subsidiary of the tech company
Google Google LLC () is an American Multinational corporation, multinational technology company focusing on Search Engine, search engine technology, online advertising, cloud computing, software, computer software, quantum computing, e-commerce, ar ...
, allows for easy
content distribution Digital distribution, also referred to as content delivery, online distribution, or electronic software distribution, among others, is the delivery or distribution of digital media content such as audio, video, e-books, video games, and other so ...
and access for any content creator, which creates opportunity for the audience to access content that shifts right or left of the '
moderate Moderate is an ideological category which designates a rejection of radical or extreme views, especially in regard to politics and religion. A moderate is considered someone occupying any mainstream position avoiding extreme views. In American ...
' ideology common in
mainstream media In journalism, mainstream media (MSM) is a term and abbreviation used to refer collectively to the various large mass news media that influence many people and both reflect and shape prevailing currents of thought. Chomsky, Noam, ''"What makes ma ...
.
YouTube YouTube is a global online video sharing and social media platform headquartered in San Bruno, California. It was launched on February 14, 2005, by Steve Chen, Chad Hurley, and Jawed Karim. It is owned by Google, and is the second mo ...
provides incentives to popular content creators, prompting some creators to optimize the
YouTuber A YouTuber is an online personality and/or influencer who produces videos on the video-sharing platform YouTube, typically posting to their personal YouTube channel. The term was first used in the English language in 2006. Influence Influe ...
experience and post shock-valued content that may promote extremist, hateful ideas. Content diversity and
monetization Monetization ( also spelled monetisation) is, broadly speaking, the process of converting something into money. The term has a broad range of uses. In banking, the term refers to the process of converting or establishing something into legal tend ...
on YouTube directs a broad audience to the potentially harmful content from extremists. YouTube allows creators to personally brand themselves, making it easy for young subscribers to form a parasocial relationship with them and act as "regular" customers. In 2019, YouTube demonetized political accounts, but radical content creators still have their channels and
subscribers The subscription business model is a business model A business model describes how an organization creates, delivers, and captures value,''Business Model Generation'', Alexander Osterwalder, Yves Pigneur, Alan Smith, and 470 practitioners f ...
to keep them culturally relevant and financially afloat.
YouTube YouTube is a global online video sharing and social media platform headquartered in San Bruno, California. It was launched on February 14, 2005, by Steve Chen, Chad Hurley, and Jawed Karim. It is owned by Google, and is the second mo ...
has outlined a clear "Hate Speech Policy" amidst several other user policies on their website. The policy is worded as such: "We encourage free speech and try to defend your right to express unpopular points of view, but we don't permit hate speech. Hate speech refers to content that promotes violence against or has the primary purpose of inciting hatred against individuals or groups based on certain attributes, such as: race or ethnic origin, religion, disability, gender, age, veteran status, sexual orientation/gender identity". YouTube has built in a user reporting system in order to counteract the growing trend of hate speech. Among the most popular deterrents against hate speech, users are able to anonymously report another user for content they deem inappropriate. The content is then reviewed against YouTube policy and age restrictions, and either taken down or left alone.


Facebook

Facebook Facebook is an online social media and social networking service owned by American company Meta Platforms. Founded in 2004 by Mark Zuckerberg with fellow Harvard College students and roommates Eduardo Saverin, Andrew McCollum, Dust ...
's terms forbid content that is harmful, threatening or which has potential to stir hatred and incite violence. In its community standards, Facebook elaborates that "Facebook removes hate speech, which includes content that directly attacks people based on their: race, ethnicity, national origin, religious affiliation, sexual orientation, sex, gender or gender identity, or serious
disabilities Disability is the experience of any condition that makes it more difficult for a person to do certain activities or have equitable access within a given society. Disabilities may be cognitive, developmental, intellectual, mental, physical, ...
or
disease A disease is a particular abnormal condition that negatively affects the structure or function of all or part of an organism, and that is not immediately due to any external injury. Diseases are often known to be medical conditions that a ...
s." It further states that "We allow humour,
satire Satire is a genre of the visual, literary, and performing arts, usually in the form of fiction and less frequently non-fiction, in which vices, follies, abuses, and shortcomings are held up to ridicule, often with the intent of shaming o ...
or social commentary related to these topics, and we believe that when people use their authentic identity, they are more responsible when they share this kind of commentary. For that reason, we ask that Page owners associate their name and Facebook Profile with any content that is insensitive, even if that content does not violate our policies. As always, we urge people to be conscious of their audience when sharing this type of content."
Instagram Instagram is a photo and video sharing social networking service owned by American company Meta Platforms. The app allows users to upload media that can be edited with filters and organized by hashtags and geographical tagging. Posts can ...
, a photo and video-sharing platform owned by
Facebook Facebook is an online social media and social networking service owned by American company Meta Platforms. Founded in 2004 by Mark Zuckerberg with fellow Harvard College students and roommates Eduardo Saverin, Andrew McCollum, Dust ...
, has similar hate speech guidelines as Facebook, but is not divided in tiers. Instagram's Community Guidelines also forbid misinformation, nudity, self-injury glorification, and posting copyrighted content without authorization. Facebook's hate speech policies are enforced by 7,500 content reviewers, as well as many Artificial Intelligence monitors. Because this requires difficult decision making, controversy arises among content reviewers over enforcement of policies. Some users seem to feel as though the enforcement is inconsistent. One apt past example is two separate but similarly graphic postings that wished death to members of a specific religion. Both post were flagged by users and reviewed by Facebook staff. However, only one was removed even though they carried almost identical sentiments. In a quote regarding hate speech on the platform, Facebook Vice President of Global Operations, Justin Osofky stated, "We’re sorry for the mistakes we have made — they do not reflect the community we want to help build…We must do better." There has been additional controversy due to the specificity of Facebook's
hate speech Hate speech is defined by the ''Cambridge Dictionary'' as "public speech that expresses hate or encourages violence towards a person or group based on something such as race, religion, sex, or sexual orientation". Hate speech is "usually thoug ...
policies. On many occasions there have been reports of status updates and comments that users feel are insensitive and convey hatred. However these posts do not technically breach any Facebook policies because their speech does not attack others based on the company's list of protected classes. For example, the statement "Female sports reporters need to be hit in the head with hockey pucks," would not be considered hate speech on Facebook's platform and therefore would not be removed. While the company protects against gender based hatred, it does not protect against hatred based on occupation. Facebook has been accused of holding bias when policing hate speech, citing political campaign ads that may promote hate or misinformation that have made an impact on the platform. Facebook adjusted their policies after receiving backlash, accusations, and large corporations pulled their ads from the platform to protest the platform's loose handling of hate speech and misinformation. As of 2020, political campaign ads have a "flag" feature that notes that the content is newsworthy but that it may violate some community guidelines. Facebook also tries to accommodate users who promote other hate speech content with the intent of criticizing it. In these cases, users are required make it clear that their intention is to educate others. If this intention is unclear then Facebook reserves the right to censor the content. When Facebook initially flags content that may contain hate speech, they then designate it to a Tier 1, 2, and 3 scale, based on the content's severity. Tier 1 is the most severe and Tier 3 is the least. Tier 1 includes anything that conveys "violent speech or support for death/disease/harm." Tier 2 is classified as content that slanders another user's image mentally, physically, or morally. Tier 3 includes anything that can potentially exclude or discriminate against others, or that uses slurs about protected groups, but does not necessarily apply to arguments to restrict immigration or criticism of existing immigration policies. In March 2019, Facebook banned content supporting
white nationalism White nationalism is a type of racial nationalism or pan-nationalism which espouses the belief that white people are a raceHeidi Beirich and Kevin Hicks. "Chapter 7: White nationalism in America". In Perry, Barbara. ''Hate Crimes''. Greenwood ...
and
white separatism White supremacy or white supremacism is the belief that white people are superior to those of other races and thus should dominate them. The belief favors the maintenance and defense of any power and privilege held by white people. White su ...
, extending a previous ban of
white supremacy White supremacy or white supremacism is the belief that white people are superior to those of other races and thus should dominate them. The belief favors the maintenance and defense of any power and privilege held by white people. White ...
content. In May 2019, it announced bans on several prominent people for violations of its prohibition on hate speech, including
Alex Jones Alexander Emerick Jones (born February 11, 1974) is an American far-right and alt-right radio show host and prominent conspiracy theorist. He hosts ''The Alex Jones Show'' from Austin, Texas, which the Genesis Communications Network broadcas ...
,
Louis Farrakhan Louis Farrakhan (; born Louis Eugene Walcott, May 11, 1933) is an American religious leader, Black supremacy, black supremacist, Racism, anti-white and Antisemitism, antisemitic Conspiracy theory, conspiracy theorist, and former singer who hea ...
,
Milo Yiannopoulos Milo Yiannopoulos (; born Milo Hanrahan, 18 October 1984), who has also published as Milo Andreas Wagner and the mononym Milo, is a British alt-right political commentator. His speeches and writings often ridicule Islam, feminism, social jus ...
,
Laura Loomer Laura Elizabeth Loomer (born May 21, 1993) is an American far-right and anti-Muslim political activist, white nationalist, conspiracy theorist, and internet personality. She was the Republican nominee to represent Florida's 21st congressional ...
, and Paul Nehlen. In 2020, Facebook added guidelines to Tier 1 that forbid
blackface Blackface is a form of theatrical makeup used predominantly by non-Black people to portray a caricature of a Black person. In the United States, the practice became common during the 19th century and contributed to the spread of racial stereo ...
, racial comparisons to animals, racial or religious
stereotype In social psychology, a stereotype is a generalized belief about a particular category of people. It is an expectation that people might have about every person of a particular group. The type of expectation can vary; it can be, for exampl ...
s, denial of historical events, and
objectification In social philosophy, objectification is the act of treating a person, as an object or a thing. It is part of dehumanization, the act of disavowing the humanity of others. Sexual objectification, the act of treating a person as a mere object of sex ...
of women and the
LGBTQIA+ ' is an initialism that stands for lesbian, gay, bisexual, and transgender. In use since the 1990s, the initialism, as well as some of its common variants, functions as an umbrella term for sexuality and gender identity. The LGBT term is an ...
community. Hate Speech on Facebook and Instagram quadrupled in 2020, leading to the removal of 22.5 million posts on Facebook and 3.3 million posts on Instagram in the second quarter of 2020 alone. In October 2022,
Media Matters Media Matters for America (MMfA) is a politically left-leaning 501(c)(3), nonprofit organization and media watchdog group. MMfA was founded in 2004 by journalist and political activist David Brock as a counterweight to the conservative Media ...
published a report that Facebook and Instagram were still profiting off advertisements using the slur " groomer" for
LGBT ' is an initialism that stands for lesbian, gay, bisexual, and transgender. In use since the 1990s, the initialism, as well as some of its common variants, functions as an umbrella term for sexuality and gender identity. The LGBT term ...
people. The article reported that Meta had previously confirmed that the use of this word for the LGBT community violates its hate speech policies. The story was subsequently picked up by other news outlets such as the ''
New York Daily News The New York ''Daily News'', officially titled the ''Daily News'', is an American newspaper based in Jersey City, NJ. It was founded in 1919 by Joseph Medill Patterson as the ''Illustrated Daily News''. It was the first U.S. daily printed in ...
'', ''
PinkNews ''PinkNews'' is a UK-based online newspaper marketed to the lesbian, gay, bisexual and transgender community ( LGBT) in the UK and worldwide. It was founded by Benjamin Cohen in 2005. It closely follows political progress on LGBT rights a ...
'', and ''
LGBTQ Nation ''LGBTQ Nation'' is an American online news magazine headquartered in San Francisco, California. It was founded in 2009 and is currently owned by ''Q.Digital''. The website is primarily marketed to the lesbian, gay, bisexual, transgender, and que ...
''.


Microsoft

Microsoft Microsoft Corporation is an American multinational technology corporation producing computer software, consumer electronics, personal computers, and related services headquartered at the Microsoft Redmond campus located in Redmond, Washi ...
has specific rules concerning hate speech for a variety of its
applications Application may refer to: Mathematics and computing * Application software, computer software designed to help the user to perform specific tasks ** Application layer, an abstraction layer that specifies protocols and interface methods used in a c ...
. Its
policy Policy is a deliberate system of guidelines to guide decisions and achieve rational outcomes. A policy is a statement of intent and is implemented as a procedure or protocol. Policies are generally adopted by a governance body within an orga ...
for mobile phones prohibits applications that "contain any content that advocates discrimination, hatred, or violence based on considerations of race, ethnicity, national origin, language, gender, age, disability, religion, sexual orientation, status as a veteran, or membership in any other social group." The company has also rules regarding online gaming, which prohibit any communication that is indicative of "hate speech, controversial religious topics and sensitive current or historical events."


TikTok

TikTok TikTok, known in China as Douyin (), is a short-form video hosting service owned by the Chinese company ByteDance. It hosts user-submitted videos, which can range in duration from 15 seconds to 10 minutes. TikTok is an international version o ...
lacks clear guidelines and control on hate speech, which allows
bullying Bullying is the use of force, coercion, hurtful teasing or threat, to abuse, aggressively dominate or intimidate. The behavior is often repeated and habitual. One essential prerequisite is the perception (by the bully or by others) of an ...
,
harassment Harassment covers a wide range of behaviors of offensive nature. It is commonly understood as behavior that demeans, humiliates or embarrasses a person, and it is characteristically identified by its unlikelihood in terms of social and moral ...
,
propaganda Propaganda is communication that is primarily used to influence or persuade an audience to further an agenda, which may not be objective and may be selectively presenting facts to encourage a particular synthesis or perception, or using loaded ...
, and hate speech to become part of normal discourse on
TikTok TikTok, known in China as Douyin (), is a short-form video hosting service owned by the Chinese company ByteDance. It hosts user-submitted videos, which can range in duration from 15 seconds to 10 minutes. TikTok is an international version o ...
. Far-right hate groups and terrorist organizations thrive on
TikTok TikTok, known in China as Douyin (), is a short-form video hosting service owned by the Chinese company ByteDance. It hosts user-submitted videos, which can range in duration from 15 seconds to 10 minutes. TikTok is an international version o ...
by spreading and encouraging hate to an audience as young as 13 years old. Children are naive and easily influenced by other people and messages, therefore they are more likely to listen and repeat what they are being shown or told. The Internet does not have an excessively monitored space that guarantees safety for children, so as long as the internet is public, children and teenagers are bound to come across hate speech. From there, young teenagers have a tendency to let their curiosity lead them into furthering their interest and research into radical ideas. However, children cannot take accountability for their actions in the way that adults can and should, placing the blame on not only the person who posted the vulgar content, but the social media platform itself. Therefore,
TikTok TikTok, known in China as Douyin (), is a short-form video hosting service owned by the Chinese company ByteDance. It hosts user-submitted videos, which can range in duration from 15 seconds to 10 minutes. TikTok is an international version o ...
is criticized for their handling of hate speech on the platform. While
TikTok TikTok, known in China as Douyin (), is a short-form video hosting service owned by the Chinese company ByteDance. It hosts user-submitted videos, which can range in duration from 15 seconds to 10 minutes. TikTok is an international version o ...
prohibits
bullying Bullying is the use of force, coercion, hurtful teasing or threat, to abuse, aggressively dominate or intimidate. The behavior is often repeated and habitual. One essential prerequisite is the perception (by the bully or by others) of an ...
,
harassment Harassment covers a wide range of behaviors of offensive nature. It is commonly understood as behavior that demeans, humiliates or embarrasses a person, and it is characteristically identified by its unlikelihood in terms of social and moral ...
, and any vulgar or hateful speech in its Terms & Conditions,
TikTok TikTok, known in China as Douyin (), is a short-form video hosting service owned by the Chinese company ByteDance. It hosts user-submitted videos, which can range in duration from 15 seconds to 10 minutes. TikTok is an international version o ...
has not been active long enough to have developed an effective method to monitor this content. Other social media platforms such as
Instagram Instagram is a photo and video sharing social networking service owned by American company Meta Platforms. The app allows users to upload media that can be edited with filters and organized by hashtags and geographical tagging. Posts can ...
,
Twitter Twitter is an online social media and social networking service owned and operated by American company Twitter, Inc., on which users post and interact with 280-character-long messages known as "tweets". Registered users can post, like, and ...
, and
Facebook Facebook is an online social media and social networking service owned by American company Meta Platforms. Founded in 2004 by Mark Zuckerberg with fellow Harvard College students and roommates Eduardo Saverin, Andrew McCollum, Dust ...
have been active long enough to know how to battle online hate speech and vulgar content, but the audience on those platforms are old enough to take accountability for the messages they spread.
TikTok TikTok, known in China as Douyin (), is a short-form video hosting service owned by the Chinese company ByteDance. It hosts user-submitted videos, which can range in duration from 15 seconds to 10 minutes. TikTok is an international version o ...
, on the other hand, has to take some responsibility for the content distributed to its young audience.
TikTok TikTok, known in China as Douyin (), is a short-form video hosting service owned by the Chinese company ByteDance. It hosts user-submitted videos, which can range in duration from 15 seconds to 10 minutes. TikTok is an international version o ...
users are required to be of at least 13 years of age, however that requirement can be easily waived, as apps cannot physically access users' age. Researcher Robert Mark Simpson concluded that combatting hate speech on youth-targeted media "might bear more of a resemblance to regulations governing adult entertainment than to prohibitions on Holocaust denial."


Media and Information Literacy

Media and Information Literacy Media may refer to: Communication * Media (communication), tools used to deliver information or data ** Advertising media, various media, content, buying and placement for advertising ** Broadcast media, communications delivered over mass e ...
aims to help people to engage in a digital society by being able to use, understand, inquire, create, communicate and think critically; while being able to effectively access, organize, analyze, evaluate, and create messages in a variety of forms.
Citizenship Citizenship is a "relationship between an individual and a state to which the individual owes allegiance and in turn is entitled to its protection". Each state determines the conditions under which it will recognize persons as its citizens, and ...
education focuses on preparing individuals to be informed and responsible citizens through the study of rights, freedoms, and responsibilities and has been variously employed in societies emerging from violent conflict. One of its main objectives is raising awareness on the political, social and cultural rights of individuals and groups, including
freedom of speech Freedom of speech is a principle that supports the freedom of an individual or a community to articulate their opinions and ideas without fear of retaliation, censorship, or legal sanction. The right to freedom of expression has been recogni ...
and the responsibilities and social implications that emerge from it. The concern of citizenship education with hate speech is twofold: it encompasses the knowledge and skills to identify hate speech, and should enable individuals to counteract messages of hatred. One of its current challenges is adapting its goals and strategies to the digital world, providing not only
argumentative In the American legal system, argumentative is an evidentiary objection raised in response to a question which prompts a witness to draw inferences from facts of the case. One common misconception is that argumentative questions are meant only t ...
but also
technological Technology is the application of knowledge to reach practical goals in a specifiable and reproducible way. The word ''technology'' may also mean the product of such an endeavor. The use of technology is widely prevalent in medicine, science, ...
knowledge and skills that a citizen may need to counteract online hate speech.
Information literacy The Association of College & Research Libraries defines information literacy as a "set of integrated abilities encompassing the reflective discovery of information, the understanding of how information is produced and valued and the use of infor ...
cannot avoid issues such as rights to free expression and privacy, critical citizenship and fostering
empowerment Empowerment is the degree of autonomy and self-determination in people and in communities. This enables them to represent their interests in a responsible and self-determined way, acting on their own authority. It is the process of becoming strong ...
for
political participation Citizen Participation or Public Participation in social science refers to different mechanisms for the public to express opinions—and ideally exert influence—regarding political, economic, management or other social decisions. Participato ...
. Multiple and complementary literacies become critical. The emergence of new technologies and social media has played an important role in this shift. Individuals have evolved from being only
consumer A consumer is a person or a group who intends to order, or uses purchased goods, products, or services primarily for personal, social, family, household and similar needs, who is not directly related to entrepreneurial or business activities. ...
s of media messages to producers, creators and curator of information, resulting in new models of participation that interact with traditional ones, like
voting Voting is a method by which a group, such as a meeting or an electorate, can engage for the purpose of making a collective decision or expressing an opinion usually following discussions, debates or election campaigns. Democracies elect holde ...
or joining a
political party A political party is an organization that coordinates candidates to compete in a particular country's elections. It is common for the members of a party to hold similar ideas about politics, and parties may promote specific ideological or p ...
. Teaching strategies are changing accordingly, from fostering critical reception of media messages to include empowering the creation of media content. The concept of media and information literacy itself continues to evolve, being augmented by the dynamics of the Internet. It is beginning to embrace issues of
identity Identity may refer to: * Identity document * Identity (philosophy) * Identity (social science) * Identity (mathematics) Arts and entertainment Film and television * ''Identity'' (1987 film), an Iranian film * ''Identity'' (2003 film), an ...
, ethics and rights in
cyberspace Cyberspace is a concept describing a widespread interconnected digital technology. "The expression dates back from the first decade of the diffusion of the internet. It refers to the online world as a world 'apart', as distinct from everyday re ...
. Some of these skills can be particularly important when identifying and responding to hate speech online. Series of initiatives aimed both at providing information and practical tools for Internet users to be active
digital citizen The term digital citizen is used with different meanings. According to the definition provided by Karen Mossberger, one of the authors of ''Digital Citizenship: The Internet, Society, and Participation'', digital citizens are "those who use the in ...
s: * ‘No place for hate' by
Anti-Defamation League The Anti-Defamation League (ADL), formerly known as the Anti-Defamation League of B'nai B'rith, is an international Jewish non-governmental organization based in the United States specializing in civil rights law. It was founded in late Septe ...
(ADL),
United States The United States of America (U.S.A. or USA), commonly known as the United States (U.S. or US) or America, is a country Continental United States, primarily located in North America. It consists of 50 U.S. state, states, a Washington, D.C., ...
; * ‘In other words' project by Provincia di Mantova and the
European Commission The European Commission (EC) is the executive of the European Union (EU). It operates as a cabinet government, with 27 members of the Commission (informally known as "Commissioners") headed by a President. It includes an administrative body ...
; * ‘Facing online hate' by MediaSmarts,
Canada Canada is a country in North America. Its ten provinces and three territories extend from the Atlantic Ocean to the Pacific Ocean and northward into the Arctic Ocean, covering over , making it the world's second-largest country by to ...
; * ‘No hate speech movement' by Youth Department of the
Council of Europe The Council of Europe (CoE; french: Conseil de l'Europe, ) is an international organisation founded in the wake of World War II to uphold human rights, democracy and the rule of law in Europe. Founded in 1949, it has 46 member states, with a p ...
,
Europe Europe is a large peninsula conventionally considered a continent in its own right because of its great physical size and the weight of its history and traditions. Europe is also considered a Continent#Subcontinents, subcontinent of Eurasia ...
; * ‘Online hate' by the Online Hate Prevention Institute,
Australia Australia, officially the Commonwealth of Australia, is a sovereign country comprising the mainland of the Australian continent, the island of Tasmania, and numerous smaller islands. With an area of , Australia is the largest country by ...
. Education is also seen as being a tool against hate speech. Laura Geraghty from the ‘No Hate Speech Movement' affirmed: "Education is key to prevent hate speech online. It is necessary to raise awareness and empower people to get online in a responsible way; however, you still need the legal background and instruments to prosecute hate crimes, including hate speech online, otherwise the preventive aspect won't help."Interview: Laura Geraghty, No Hate Speech Movement, 25 November 2014.


Sources


References

{{Censorship Hate speech