HOME

TheInfoList



OR:

Online hate speech is a type of speech that takes place online with the purpose of attacking a person or a group based on their
race Race, RACE or "The Race" may refer to: * Race (biology), an informal taxonomic classification within a species, generally within a sub-species * Race (human categorization), classification of humans into groups based on physical traits, and/or s ...
,
religion Religion is usually defined as a social- cultural system of designated behaviors and practices, morals, beliefs, worldviews, texts, sanctified places, prophecies, ethics, or organizations, that generally relates humanity to supernatural, ...
,
ethnic origin An ethnic group or an ethnicity is a grouping of people who identify with each other on the basis of shared attributes that distinguish them from other groups. Those attributes can include common sets of traditions, ancestry, language, history, ...
,
sexual orientation Sexual orientation is an enduring pattern of romantic or sexual attraction (or a combination of these) to persons of the opposite sex or gender, the same sex or gender, or to both sexes or more than one gender. These attractions are generall ...
,
disability Disability is the experience of any condition that makes it more difficult for a person to do certain activities or have equitable access within a given society. Disabilities may be cognitive, developmental, intellectual, mental, physical, ...
, and/or
gender Gender is the range of characteristics pertaining to femininity and masculinity and differentiating between them. Depending on the context, this may include sex-based social structures (i.e. gender roles) and gender identity. Most cultures ...
. Online hate speech is not easily defined, but can be recognized by the degrading or dehumanizing function it serves.
Multilateral treaties A multilateral treaty is a treaty to which two or more sovereign states are parties. Each party owes the same obligations to all other parties, except to the extent that they have stated reservations. Examples of multilateral treaties include the ...
such as the
International Covenant on Civil and Political Rights The International Covenant on Civil and Political Rights (ICCPR) is a multilateral treaty that commits nations to respect the civil and political rights of individuals, including the right to life, freedom of religion, freedom of speech, fr ...
(ICCPR) have sought to define its contours. Multi-stakeholders processes (e.g. the Rabat Plan of Action) have tried to bring greater clarity and suggested mechanisms to identify hateful messages. Yet, hate speech is still a generic term in everyday discourse, mixing concrete threats to individuals and/or groups with cases in which people may be simply venting their anger against authority. Internet
intermediaries An intermediary (or go-between) is a third party that offers intermediation services between two parties, which involves conveying messages between principals in a dispute, preventing direct contact and potential escalation of the issue. In la ...
—organizations and
social networks A social network is a social structure made up of a set of social actors (such as individuals or organizations), sets of dyadic ties, and other social interactions between actors. The social network perspective provides a set of methods for a ...
that mediate online communication such as
Facebook Facebook is an online social media and social networking service owned by American company Meta Platforms. Founded in 2004 by Mark Zuckerberg with fellow Harvard College students and roommates Eduardo Saverin, Andrew McCollum, Dustin Mosk ...
,
Twitter Twitter is an online social media and social networking service owned and operated by American company Twitter, Inc., on which users post and interact with 280-character-long messages known as "tweets". Registered users can post, like, and ...
, and
Google Google LLC () is an American Multinational corporation, multinational technology company focusing on Search Engine, search engine technology, online advertising, cloud computing, software, computer software, quantum computing, e-commerce, ar ...
—have advanced their own definitions of hate speech that bind users to a set of rules and allow companies to limit certain forms of expression. National and regional bodies have sought to promote understandings of the term that are more rooted in local
tradition A tradition is a belief or behavior (folk custom) passed down within a group or society with symbolic meaning or special significance with origins in the past. A component of cultural expressions and folklore, common examples include holidays or ...
s. The
Internet The Internet (or internet) is the global system of interconnected computer networks that uses the Internet protocol suite (TCP/IP) to communicate between networks and devices. It is a '' network of networks'' that consists of private, pub ...
's speed and reach makes it difficult for governments to enforce national legislation in the
virtual world A virtual world (also called a virtual space) is a computer-simulated environment which may be populated by many users who can create a personal avatar, and simultaneously and independently explore the virtual world, participate in its activities ...
. Social media is a private space for public expression, which makes it difficult for regulators. Some of the companies owning these spaces have become more responsive towards tackling the problem of online hate speech. Politicians, activists, and academics discuss the character of online hate speech and its relation to offline speech and action, but the debates tend to be removed from systematic empirical evidence. The character of perceived hate speech and its possible consequences has led to placing much emphasis on the solutions to the problem and on how they should be grounded in
international human rights law International human rights law (IHRL) is the body of international law designed to promote human rights on social, regional, and domestic levels. As a form of international law, international human rights law are primarily made up of treaties, a ...
. Yet this very focus has also limited deeper attempts to understand the causes underlying the phenomenon and the dynamics through which certain types of content emerge, diffuse and lead—or not—to actual discrimination,
hostility Hostility is seen as form of emotionally charged aggressive behavior. In everyday speech it is more commonly used as a synonym for anger and aggression. It appears in several psychological theories. For instance it is a facet of neuroticism in ...
, or
violence Violence is the use of physical force so as to injure, abuse, damage, or destroy. Other definitions are also used, such as the World Health Organization's definition of violence as "the intentional use of physical force or power, threatened ...
.


Definitions


Hate speech

The concept of hate speech touches on the clash of
freedom of expression Freedom of speech is a principle that supports the freedom of an individual or a community to articulate their opinions and ideas without fear of retaliation, censorship, or legal sanction. The right to freedom of expression has been recog ...
and individual, collective, and
minority rights Minority rights are the normal individual rights as applied to members of racial, ethnic, class, religious, linguistic or gender and sexual minorities, and also the collective rights accorded to any minority group. Civil-rights movements ...
, as well as concepts of
dignity Dignity is the right of a person to be valued and respected for their own sake, and to be treated ethically. It is of significance in morality, ethics, law and politics as an extension of the Enlightenment-era concepts of inherent, inalienable ...
,
liberty Liberty is the ability to do as one pleases, or a right or immunity enjoyed by prescription or by grant (i.e. privilege). It is a synonym for the word freedom. In modern politics, liberty is understood as the state of being free within society fr ...
, and
equality Equality may refer to: Society * Political equality, in which all members of a society are of equal standing ** Consociationalism, in which an ethnically, religiously, or linguistically divided state functions by cooperation of each group's elit ...
. It is not easily defined but can be recognized by its function. In national and international legislation, hate speech refers to expressions that advocate incitement to harm, including acts of discrimination,
hostility Hostility is seen as form of emotionally charged aggressive behavior. In everyday speech it is more commonly used as a synonym for anger and aggression. It appears in several psychological theories. For instance it is a facet of neuroticism in ...
,
radicalization Radicalization (or radicalisation) is the process by which an individual or a group comes to adopt increasingly views in opposition to a political, social, or religious status quo. The ideas of society at large shape the outcomes of radicalizat ...
, verbal and/or
physical violence Violence is the use of physical force so as to injure, abuse, damage, or destroy. Other definitions are also used, such as the World Health Organization's definition of violence as "the intentional use of physical force or power, threatened ...
, based upon the targets' social and/or demographic identity. Hate speech may include, but is not limited to, speech that advocates, threatens, or encourages violent acts. The concept may extend also to expressions that foster a climate of prejudice and intolerance on the assumption that this may fuel targeted discrimination, hostility, and violent attacks. At critical times, such as during political elections, the concept of hate speech may be prone to manipulation; accusations of instigating hate speech may be traded among political opponents or used by those in power to curb
dissent Dissent is an opinion, philosophy or sentiment of non-agreement or opposition to a prevailing idea or policy enforced under the authority of a government, political party or other entity or individual. A dissenting person may be referred to as ...
and criticism. Hate speech (be it conveyed through text, images, and/or sound) can be identified by approximation through the degrading or dehumanizing functions that it serves. Legal scholar and political theorist
Jeremy Waldron Jeremy Waldron (; born 13 October 1953) is a New Zealand professor of law and philosophy. He holds a University Professorship at the New York University School of Law, is affiliated with the New York University Department of Philosophy, and was ...
argues that hate speech always contains two messages: first, to let members of the out-group feel unwelcome or afraid; and second, to let members of the in-group feel that their hateful beliefs are legitimate.


Characteristics of online hate speech

The proliferation of hate speech online, observed by the
UN Human Rights Council The United Nations Human Rights Council (UNHRC), CDH is a United Nations body whose mission is to promote and protect human rights around the world. The Council has 47 members elected for staggered three-year terms on a regional group basis ...
Special Rapporteur on Minority Issues poses a new set of challenges. Both social networking platforms and organizations created to combat hate speech have recognized that hateful messages disseminated online are increasingly common and have elicited unprecedented attention to develop adequate responses. According to HateBase, a web-based application that collects instances of hate speech online worldwide, the majority of cases of hate speech target individuals based on ethnicity and
nationality Nationality is a legal identification of a person in international law, establishing the person as a subject, a ''national'', of a sovereign state. It affords the state jurisdiction over the person and affords the person the protection of the ...
, but incitements to hatred focusing on
religion Religion is usually defined as a social- cultural system of designated behaviors and practices, morals, beliefs, worldviews, texts, sanctified places, prophecies, ethics, or organizations, that generally relates humanity to supernatural, ...
and social class have also been on the rise. While hate speech online is not intrinsically different from similar expressions found offline, there are peculiar challenges unique to online content and its regulation. Those challenges related to its permanence, itinerancy, anonymity and complex cross-jurisdictional character.


Permanence

Hate speech can stay online for a long time in different formats across multiple platforms, which can be linked repeatedly. As Andre Oboler, the CEO of the Online Hate Prevention Institute, has noted, "The longer the content stays available, the more damage it can inflict on the victims and empower the perpetrators. If you remove the content at an early stage you can limit the exposure. This is just like cleaning litter, it doesn't stop people from littering but if you do not take care of the problem it just piles up and further exacerbates."
Twitter Twitter is an online social media and social networking service owned and operated by American company Twitter, Inc., on which users post and interact with 280-character-long messages known as "tweets". Registered users can post, like, and ...
's conversations organized around trending topics may facilitate the quick and wide spreading of hateful messages, but they also offer the opportunity for influential speakers to shun messages and possibly end popular threads inciting violence.
Facebook Facebook is an online social media and social networking service owned by American company Meta Platforms. Founded in 2004 by Mark Zuckerberg with fellow Harvard College students and roommates Eduardo Saverin, Andrew McCollum, Dustin Mosk ...
, on the contrary, may allow multiple threads to continue in parallel and go unnoticed; creating longer lasting spaces that offend, discriminate, and ridicule certain individuals and groups.


Itinerance

Hate speech online can be itinerant. Even when content is removed, it may find expression elsewhere, possibly on the same platform under a different name or on different online spaces. If a
website A website (also written as a web site) is a collection of web pages and related content that is identified by a common domain name and published on at least one web server. Examples of notable websites are Google, Facebook, Amazon, and Wi ...
is shut down, it can quickly reopen using a web-hosting service with less stringent
regulation Regulation is the management of complex systems according to a set of rules and trends. In systems theory, these types of rules exist in various fields of biology and society, but the term has slightly different meanings according to context. Fo ...
s or via the reallocation to a country with laws imposing higher threshold for hate speech. The itinerant nature of hate speech also means that poorly formulated thoughts, or under-the-influence behavior, that would have not found public expression and support in the past may now land on spaces where they can be visible to large audiences.


Anonymity

Anonymity can also present a challenge to dealing with online hate speech. Internet discussions may be anonymous or
pseudonymous A pseudonym (; ) or alias () is a fictitious name that a person or group assumes for a particular purpose, which differs from their original or true name ( orthonym). This also differs from a new name that entirely or legally replaces an individu ...
, which can make people feel more safe expressing their opinions but can just as easily accelerate destructive behavior. As Drew Boyd, Director of Operations at The Sentinel Project, has stated, "the Internet grants individuals the ability to say horrific things because they think they will not be discovered. This is what makes online hate speech so unique, because people feel much more comfortable speaking hate as opposed to real life when they have to deal with the consequences of what they say." China and
South Korea South Korea, officially the Republic of Korea (ROK), is a country in East Asia, constituting the southern part of the Korean Peninsula and sharing a land border with North Korea. Its western border is formed by the Yellow Sea, while its eas ...
enforce real-name policies for
social media Social media are interactive media technologies that facilitate the creation and sharing of information, ideas, interests, and other forms of expression through virtual communities and networks. While challenges to the definition of ''social medi ...
.
Facebook Facebook is an online social media and social networking service owned by American company Meta Platforms. Founded in 2004 by Mark Zuckerberg with fellow Harvard College students and roommates Eduardo Saverin, Andrew McCollum, Dustin Mosk ...
,
LinkedIn LinkedIn () is an American business and employment-oriented online service that operates via websites and mobile apps. Launched on May 5, 2003, the platform is primarily used for professional networking and career development, and allows job se ...
, and
Quora Quora () is a social question-and-answer website based in Mountain View, California. It was founded on June 25, 2009, and made available to the public on June 21, 2010. Users can collaborate by editing questions and commenting on answers that ...
have sought to activate a
real-name system A real-name system is a system in which users can register an account on a blog, website or bulletin board system using their legal name. Users are required to provide identification credentials and their legal name. A public pseudonym can also ...
to have more control on online hate speech. Such measures have been deeply contested as they are seen to violate the
right to privacy The right to privacy is an element of various legal traditions that intends to restrain governmental and private actions that threaten the privacy of individuals. Over 150 national constitutions mention the right to privacy. On 10 December 194 ...
and its intersection with free expression. Many instances of online hate speech are posted by Internet "trolls", which are typically pseudonymous users who post shocking, vulgar, and overall untrue content that is explicitly intended to trigger a negative reaction, though may also be indended to influence or recruit the reader to their beliefs, if they share the same opinion. Social media has also provided a platform for radical and
extremist Extremism is "the quality or state of being extreme" or "the advocacy of extreme measures or views". The term is primarily used in a political or religious sense to refer to an ideology that is considered (by the speaker or by some implied share ...
political or religious groups to form, network, and collaborate to spread their messages of anti-establishment and anti-political correctness, and promote beliefs and ideologies that are racist, anti-feminist,
homophobic Homophobia encompasses a range of negative attitudes and feelings toward homosexuality or people who are identified or perceived as being lesbian, gay or bisexual. It has been defined as contempt, prejudice, aversion, hatred or antipathy, m ...
,
transphobic Transphobia is a collection of ideas and phenomena that encompass a range of negative attitudes, feelings, or actions towards transgender people or transness in general. Transphobia can include fear, aversion, hatred, violence or anger tow ...
, etc. Fully-anonymous online communication is rare, as it requires the user to employ highly technical measures to ensure that they cannot be easily identified.


Cross-jurisdictional spread

A further complication is the transnational reach of the
Internet The Internet (or internet) is the global system of interconnected computer networks that uses the Internet protocol suite (TCP/IP) to communicate between networks and devices. It is a '' network of networks'' that consists of private, pub ...
, raising issues of cross jurisdictional co-operation in regard to legal mechanisms for combating hate speech. While there are Mutual Legal Assistance treaties in place across
Europe Europe is a large peninsula conventionally considered a continent in its own right because of its great physical size and the weight of its history and traditions. Europe is also considered a subcontinent of Eurasia and it is located entirel ...
,
Asia Asia (, ) is one of the world's most notable geographical regions, which is either considered a continent in its own right or a subcontinent of Eurasia, which shares the continental landmass of Afro-Eurasia with Africa. Asia covers an are ...
, and North America, these are characteristically slow to work. The transnational reach of many
private-sector The private sector is the part of the economy, sometimes referred to as the citizen sector, which is owned by private groups, usually as a means of establishment for profit or non profit, rather than being owned by the government. Employment Th ...
Internet intermediaries may provide a more effective channel for resolving issues in some cases, although these bodies are also often impacted upon by cross-jurisdictional appeals for data (such as revealing the identity of the author(s) of a particular content). Different jurisdictions also have unique definitions for hate speech, making it difficult to prosecute perpetrators who may seek haven in less stringent jurisdictions. Unlike the dissemination of hate speech through conventional channels, victims of online hate speech may face difficulties knowing to whom they should turn to help, as the platform, their local law enforcement, and the local law enforcement of the person or people using hate speech, may all feel as though the issue does not fall into their jurisdiction, even when hate speech policies and laws are in place.
Nongovernmental organizations A non-governmental organization (NGO) or non-governmental organisation (see spelling differences) is an organization that generally is formed independent from government. They are typically nonprofit entities, and many of them are active in ...
and
lobby groups Advocacy groups, also known as interest groups, special interest groups, lobbying groups or pressure groups use various forms of advocacy in order to influence public opinion and ultimately policy. They play an important role in the developm ...
have been raising awareness and encourage different stakeholders to take action.


Artificial intelligence

Some tech companies, such as
Facebook Facebook is an online social media and social networking service owned by American company Meta Platforms. Founded in 2004 by Mark Zuckerberg with fellow Harvard College students and roommates Eduardo Saverin, Andrew McCollum, Dustin Mosk ...
, use Artificial Intelligence (AI) systems to monitor hate speech. However, AI may not always be an effective way of monitoring hate speech, since the systems lack the judgment skills that humans have. For example, a user might post or comment something that classifies as hate speech, or violates community guidelines, but if the target word is misspelled, or some letters are replaced with symbols, the AI systems will not recognize it. This weakness has led to the proliferation of attempts to circumvent censorship algorithms using deliberate misspellings, such as the use of "vachscenes" instead of "vaccines" by
anti-vaxxers Vaccine hesitancy is a delay in acceptance, or refusal, of vaccines despite the availability of vaccine services and supporting evidence. The term covers refusals to vaccinate, delaying vaccines, accepting vaccines but remaining uncertain abou ...
during
COVID-19 Coronavirus disease 2019 (COVID-19) is a contagious disease caused by a virus, the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). The first known case was identified in Wuhan, China, in December 2019. The disease quickly ...
. Therefore, humans still have to monitor the AI systems that monitor hate speech; a common problem in AI technology which is referred to as "Automation's Last Mile.", meaning the last 10% or 1% of the job is the hardest to complete.


Frameworks


''Stormfront'' Precedent

In the aftermath of
2014 File:2014 Events Collage.png, From top left, clockwise: Stocking up supplies and personal protective equipment (PPE) for the Western African Ebola virus epidemic; Citizens examining the ruins after the Chibok schoolgirls kidnapping; Bundles of wat ...
's dramatic incidents, calls for more restrictive or intrusive measures to contain the Internet's potential to spread hate and violence are common, as if the links between online and offline violence were well known. On the contrary, as the following example indicates, appearances may often be deceiving. Stormfront is considered the first "hate website." Launched in March 1995 by a former Ku Klux Klan leader, it quickly became a popular space for discussing ideas related to Neo-Nazism,
White nationalism White nationalism is a type of racial nationalism or pan-nationalism which espouses the belief that white people are a raceHeidi Beirich and Kevin Hicks. "Chapter 7: White nationalism in America". In Perry, Barbara. ''Hate Crimes''. Greenwo ...
and
White separatism White supremacy or white supremacism is the belief that white people are superior to those of other races and thus should dominate them. The belief favors the maintenance and defense of any power and privilege held by white people. White su ...
, first in the
United States of America The United States of America (U.S.A. or USA), commonly known as the United States (U.S. or US) or America, is a country primarily located in North America. It consists of 50 states, a federal district, five major unincorporated territo ...
and then globally. The forum hosts calls for a racial holy war and incitement to use violence to resist
immigration Immigration is the international movement of people to a destination country of which they are not natives or where they do not possess citizenship in order to settle as permanent residents or naturalized citizens. Commuters, tourists, a ...
. and is considered a space for recruiting
activists Activism (or Advocacy) consists of efforts to promote, impede, direct or intervene in social, political, economic or environmental reform with the desire to make changes in society toward a perceived greater good. Forms of activism range fro ...
and possibly coordinating violent acts. The few studies that have explored the identities of Stormfront actually depict a more complex picture. Rather than seeing it as a space for coordinating actions. Well-known extreme right activists have accused the forum to be just a gathering for "
keyboard warrior {{Short pages monitor