
In
computing
Computing is any goal-oriented activity requiring, benefiting from, or creating computer, computing machinery. It includes the study and experimentation of algorithmic processes, and the development of both computer hardware, hardware and softw ...
, a news aggregator, also termed a feed aggregator, content aggregator, feed reader, news reader, or simply an aggregator, is client software or a
web application
A web application (or web app) is application software that is created with web technologies and runs via a web browser. Web applications emerged during the late 1990s and allowed for the server to dynamically build a response to the request, ...
that aggregates digital
content such as
online newspaper
An online newspaper (or electronic news or electronic news publication) is the electronic publishing, online version of a newspaper, either as a stand-alone publication or as the online version of a printed periodical literature, periodical.
Goin ...
s,
blog
A blog (a Clipping (morphology), truncation of "weblog") is an informational website consisting of discrete, often informal diary-style text entries also known as posts. Posts are typically displayed in Reverse chronology, reverse chronologic ...
s,
podcast
A podcast is a Radio program, program made available in digital format for download over the Internet. Typically, a podcast is an Episode, episodic series of digital audio Computer file, files that users can download to a personal device or str ...
s, and
video blogs
A vlog (), also known as a video blog or video log, is a form of blog for which the medium is video. Vlog entries often combine embedded video (or a video link) with supporting text, images, and other metadata. Entries can be recorded in one ta ...
(vlogs) in one location for easy viewing. The updates distributed may include journal tables of contents, podcasts, videos, and news items.
Contemporary news aggregators include
MSN,
Yahoo! News
Yahoo News (stylized as Yahoo! News) is a news website that originated as an internet-based news aggregator by Yahoo. The site was created by Yahoo software engineer Brad Clawsie in August 1996. Articles originally came from news services such ...
,
Feedly,
Inoreader, and
Mozilla Thunderbird
Mozilla Thunderbird is a free and open-source email client that also functions as a personal information manager with a Digital calendar, calendar and contactbook, as well as an RSS feed reader, chat client (IRC/XMPP/Matrix (protocol), Matrix), ...
.
Function

Aggregation technology often consolidates (sometimes
syndicated) web content into one page that can show only the new or updated information from many sites. Aggregators reduce the time and effort needed to regularly check websites for updates, creating a unique information space or ''personal newspaper''. Once subscribed to a feed, an aggregator is able to check for new content at user-determined intervals and retrieve the update. The content is sometimes described as being ''
pulled'' to the subscriber, as opposed to ''
pushed'' with email or IM. Unlike recipients of some push information, the aggregator user can easily unsubscribe from a feed. The feeds are often in the
RSS
RSS ( RDF Site Summary or Really Simple Syndication) is a web feed that allows users and applications to access updates to websites in a standardized, computer-readable format. Subscribing to RSS feeds can allow a user to keep track of many ...
or
Atom
Atoms are the basic particles of the chemical elements. An atom consists of a atomic nucleus, nucleus of protons and generally neutrons, surrounded by an electromagnetically bound swarm of electrons. The chemical elements are distinguished fr ...
formats which use Extensible Markup Language (
XML
Extensible Markup Language (XML) is a markup language and file format for storing, transmitting, and reconstructing data. It defines a set of rules for encoding electronic document, documents in a format that is both human-readable and Machine-r ...
) to structure pieces of information to be aggregated in a feed reader that displays the information in a user-friendly interface.
Before subscribing to a feed, users have to install either "feed reader" or "news aggregator" applications in order to read it. The aggregator provides a consolidated view of the content in one browser display or desktop application. "Desktop applications offer the advantages of a potentially richer user interface and of being able to provide some content even when the computer is not connected to the Internet. Web-based feed readers offer the great convenience of allowing users to access up-to-date feeds from any Internet-connected computer."
Although some applications will have an automated process to subscribe to a news feed, the basic way to subscribe is by simply clicking on the web feed icon and/or text link.
Aggregation features are frequently built into
web portal
A web portal is a specially designed website that brings information from diverse sources, like emails, online forums and search engines, together in a uniform way. Usually, each information source gets its dedicated area on the page for displayin ...
sites, in the
web browser
A web browser, often shortened to browser, is an application for accessing websites. When a user requests a web page from a particular website, the browser retrieves its files from a web server and then displays the page on the user's scr ...
s themselves, in
email
Electronic mail (usually shortened to email; alternatively hyphenated e-mail) is a method of transmitting and receiving Digital media, digital messages using electronics, electronic devices over a computer network. It was conceived in the ...
applications, or in
application software
Application software is any computer program that is intended for end-user use not operating, administering or programming the computer. An application (app, application program, software application) is any program that can be categorized as ...
designed specifically for reading feeds. Aggregators with
podcast
A podcast is a Radio program, program made available in digital format for download over the Internet. Typically, a podcast is an Episode, episodic series of digital audio Computer file, files that users can download to a personal device or str ...
ing capabilities can automatically download media files, such as
MP3
MP3 (formally MPEG-1 Audio Layer III or MPEG-2 Audio Layer III) is a coding format for digital audio developed largely by the Fraunhofer Society in Germany under the lead of Karlheinz Brandenburg. It was designed to greatly reduce the amount ...
recordings. In some cases, these can be automatically loaded onto
portable media player
A portable media player (PMP) or digital audio player (DAP) is a portable consumer electronics device capable of storing and playing digital media such as audio, images, and video files. Normally they refer to small, Electric battery, batter ...
s (like
iPod
The iPod is a series of portable media players and multi-purpose mobile devices that were designed and marketed by Apple Inc. from 2001 to 2022. The iPod Classic#1st generation, first version was released on November 10, 2001, about mon ...
s) when they are connected to the end-users computer. By 2011, so-called ''RSS narrators'' appeared, which aggregated text-only news feeds, and converted them into audio recordings for offline listening. The syndicated content an aggregator will retrieve and interpret is usually supplied in the form of
RSS
RSS ( RDF Site Summary or Really Simple Syndication) is a web feed that allows users and applications to access updates to websites in a standardized, computer-readable format. Subscribing to RSS feeds can allow a user to keep track of many ...
or other
XML
Extensible Markup Language (XML) is a markup language and file format for storing, transmitting, and reconstructing data. It defines a set of rules for encoding electronic document, documents in a format that is both human-readable and Machine-r ...
-formatted data, such as
RDF/XML or
Atom
Atoms are the basic particles of the chemical elements. An atom consists of a atomic nucleus, nucleus of protons and generally neutrons, surrounded by an electromagnetically bound swarm of electrons. The chemical elements are distinguished fr ...
.
History
RSS began in 1999 when it was first introduced by web browser pioneer
Netscape
Netscape Communications Corporation (originally Mosaic Communications Corporation) was an American independent computer services company with headquarters in Mountain View, California, and then Dulles, Virginia. Its Netscape web browser was o ...
.
In the beginning, RSS was not a user-friendly gadget and it took some years to spread. "...RDF-based data model that people inside Netscape felt was too complicated for end users."
The rise of RSS began in the early 2000s when the New York Times implemented RSS: "One of the first, most popular sites that offered users the option to subscribe to RSS feeds was the New York Times, and the company's implementation of the format was revered as the 'tipping point' that cemented RSS's position as a de facto standard." "In 2005, major players in the web browser market started integrating the technology directly into their products, including Microsoft's
Internet Explorer
Internet Explorer (formerly Microsoft Internet Explorer and Windows Internet Explorer, commonly abbreviated as IE or MSIE) is a deprecation, retired series of graphical user interface, graphical web browsers developed by Microsoft that were u ...
,
Mozilla's Firefox
Mozilla Firefox, or simply Firefox, is a free and open-source web browser developed by the Mozilla Foundation and its subsidiary, the Mozilla Corporation. It uses the Gecko rendering engine to display web pages, which implements current ...
and
Apple's Safari." according to BuiltWith.com, there were 20,516,036 live websites using RSS.
Types
Web aggregators gather material from a variety of sources for display in one location. They may additionally process the information after retrieval for individual clients.
For instance,
Google News
Google News is a news aggregator service developed by Google. It presents a continuous flow of links to articles organized from thousands of publishers and magazines.
Google News is available as an app on Android, iOS, and the Web. Google ...
gathers and publishes material independent of customers' needs while
Awasu is created as an individual RSS tool to control and collect information according to clients' criteria. There are a variety of software applications and components available to collect, format, translate, and republish XML feeds, a demonstration of presentation-independent data.
News aggregation websites
A news aggregator provides and updates information from different sources in a systematized way. "Some news aggregator services also provide update services, whereby a user is regularly updated with the latest news on a chosen topic".
Websites such as
Google News
Google News is a news aggregator service developed by Google. It presents a continuous flow of links to articles organized from thousands of publishers and magazines.
Google News is available as an app on Android, iOS, and the Web. Google ...
,
Yahoo News
Yahoo News (stylized as Yahoo! News) is a news website that originated as an internet-based news aggregator by Yahoo. The site was created by Yahoo software engineer Brad Clawsie in August 1996. Articles originally came from news services such ...
,
Bing News, and
NewsNow where aggregation is entirely automatic, using algorithms which carry out contextual analysis and group similar stories together.
Websites such as
Drudge Report
The Drudge Report (stylized in all caps as DRUDGE REPORT) is an American-based news aggregator, news aggregation website founded by Matt Drudge, and run with the help of Charles Hurt and Daniel Halper. The site prior to the 2020 United States p ...
and ''
HuffPost
''HuffPost'' (''The Huffington Post'' until 2017, itself often abbreviated as ''HPo'') is an American progressive news website, with localized and international editions. The site offers news, satire, blogs, and original content, and covers p ...
'' supplement aggregated news headline RSS feeds from a number of reputable mainstream and alternative news outlets, while including their own articles in a separate section of the website.
News aggregation websites began with content selected and entered by humans, while automated selection algorithms were eventually developed to fill the content from a range of either automatically selected or manually added sources. Google News launched in 2002 using automated story selection, but humans could add sources to its search engine, while the older Yahoo News, as of 2005, used a combination of automated news crawlers and human editors.
Web-based feed readers
Web-based feeds readers allow users to find a web feed on the internet and add it to their feed reader. These are meant for personal use and are hosted on remote servers. Because the application is available via the web, it can be accessed anywhere by a user with an
internet
The Internet (or internet) is the Global network, global system of interconnected computer networks that uses the Internet protocol suite (TCP/IP) to communicate between networks and devices. It is a internetworking, network of networks ...
connection. There are even more specified web-based RSS readers.
More advanced methods of aggregating feeds are provided via
Ajax
Ajax may refer to:
Greek mythology and tragedy
* Ajax the Great, a Greek mythological hero, son of King Telamon and Periboea
* Ajax the Lesser, a Greek mythological hero, son of Oileus, the king of Locris
* Ajax (play), ''Ajax'' (play), by the an ...
coding techniques and
XML
Extensible Markup Language (XML) is a markup language and file format for storing, transmitting, and reconstructing data. It defines a set of rules for encoding electronic document, documents in a format that is both human-readable and Machine-r ...
components called
web widget
A web widget is a web page or web application that is embedded as an element of a host web page but which is substantially independent of the host page, having limited or no interaction with the host. A web widget commonly provides users of t ...
s. Ranging from full-fledged applications to small fragments of
source code
In computing, source code, or simply code or source, is a plain text computer program written in a programming language. A programmer writes the human readable source code to control the behavior of a computer.
Since a computer, at base, only ...
that can be integrated into larger programs, they allow users to aggregate
OPML files, email services, documents, or feeds into one interface. Many customizable homepage and portal implementations provide such functionality.
In addition to aggregator services mainly for individual use, there are web applications that can be used to aggregate several blogs into one. One such variety—called ''planet'' sites—are used by online communities to aggregate community blogs in a centralized location. They are named after the
Planet aggregator, a server application designed for this purpose.
Feed reader applications
Feed aggregation applications are installed on a PC, smartphone or tablet computer and designed to collect news and interest feed subscriptions and group them together using a user-friendly interface. The graphical user interface of such applications often closely resembles that of popular
e-mail client
An email client, email reader or, more formally, message user agent (MUA) or mail user agent is a computer program used to access and manage a user's email.
A web app, web application which provides message management, composition, and receptio ...
s, using a three-panel composition in which subscriptions are grouped in a frame on the left, and individual entries are browsed, selected, and read in frames on the right.
Software aggregators can also take the form of
news ticker
A news ticker (sometimes called a crawler, crawl, slide, zipper, ticker tape, or chyron) is a horizontal or vertical (depending on the language's writing system) text-based display either in the form of a graphic that typically resides in the ...
s which scroll feeds like
ticker tape
Ticker tape was the earliest electrical dedicated financial communications medium, transmitting stock price information over electrical telegraph, telegraph lines, in use from around 1870 to 1970. It consisted of a paper strip that ran through ...
, alerters that display updates in windows as they are refreshed, web browser macro tools or as smaller components (sometimes called
plugins or
extensions), which can integrate feeds into the
operating system
An operating system (OS) is system software that manages computer hardware and software resources, and provides common daemon (computing), services for computer programs.
Time-sharing operating systems scheduler (computing), schedule tasks for ...
or software applications such as a web browser.
Social news aggregators
Social news aggregators collect the most popular stories on the Internet, selected, edited, and proposed by a wide range of people. "In these social news aggregators, users submit news items (referred to as "stories"), communicate with peers through direct messages and comments, and collaboratively select and rate submitted stories to get to a real-time compilation of what is currently perceived as "hot" and popular on the Internet." Social news aggregators are based on engagement of community. Their responses, engagement level, and contribution to stories create the content and determine what will be generated as RSS feed.
Frame- and media-bias–aware news aggregators
Media bias
Media bias occurs when journalists and news producers show bias in how they report and cover news. The term "media bias" implies a pervasive or widespread bias contravening of the standards of journalism, rather than the perspective of an ...
and
framing are concepts that fundamentally explain deliberate or accidental differences in news coverage. A simple example is comparing media coverage of a topic in two countries, which are in (armed) conflict with another: one can easily imagine that news outlets, particularly if state-controlled, will report differently or even contrarily on the same events (for instance, the
Russo-Ukrainian War
The Russo-Ukrainian War began in February 2014 and is ongoing. Following Ukraine's Revolution of Dignity, Russia Russian occupation of Crimea, occupied and Annexation of Crimea by the Russian Federation, annexed Crimea from Ukraine. It then ...
). While media bias and framing have been subject to manual research for a couple of decades in the social sciences, only recently have automated methods and systems been proposed to analyze and show such differences. Such systems make use of text-features, e.g., news aggregators that extract key phrases that describe a topic differently, or other features, such as matrix-based news aggregation, which spans a matrix over two dimensions, the first dimension being which country an article was published in, and the second being which country it is reporting on.
[Felix Hamborg, Norman Meuschke, and Bela Gipp]
Matrix-based News Aggregation: Exploring Different News Perspectives
in Proceedings of the ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL), 2017.[Felix Hamborg, Norman Meuschke and Bela Gipp]
Bias-aware News Analysis using Matrix-based News Aggregation
in the International Journal on Digital Libraries (IJDL), 2018.
Media aggregators
Media aggregators are sometimes referred to as ''podcatchers'' due to the popularity of the term ''
podcast
A podcast is a Radio program, program made available in digital format for download over the Internet. Typically, a podcast is an Episode, episodic series of digital audio Computer file, files that users can download to a personal device or str ...
'' used to refer to a web feed containing audio or video. Media aggregators are client software or web-based applications which maintain subscriptions to feeds that contain audio or video
media enclosures. They can be used to automatically download media, playback the media within the application interface, or synchronize media content with a portable media player. Multimedia aggregators are the current focus. EU launched the project Reveal This to embedded different media platforms in RSS system. "Integrated infrastructure that will allow the user to capture, store, semantically index, categorize and retrieve multimedia, and multilingual digital content across different sources – TV, radio, music, web, etc. The system will allow the user to personalize the service and will have semantic search, retrieval, summarization."
Broadcatching
Broadcatching is a mechanism that automatically downloads BitTorrent files advertised through RSS feeds. Several
BitTorrent
BitTorrent is a Protocol (computing), communication protocol for peer-to-peer file sharing (P2P), which enables users to distribute data and electronic files over the Internet in a Decentralised system, decentralized manner. The protocol is d ...
client software applications such as Azureus and μTorrent have added the ability to ''
broadcatch'' torrents of distributed multimedia through the aggregation of web feeds.
Feed filtering
One of the problems with news aggregators is that the volume of articles can sometimes be overwhelming, especially when the user has many web feed subscriptions. As a solution, many feed readers allow users to
tag each feed with one or more keywords which can be used to sort and filter the available articles into easily navigable categories. Another option is to import the user's
Attention Profile to filter items based on their relevance to the user's interests.
RSS and marketing
Some bloggers predicted the death of RSS when Google Reader was shut down. Later, however, RSS was considered more of a success as an appealing way to obtain information. "Feedly, likely the most popular RSS reader today, has gone from around 5,000 paid subscribers in 2013 to around 50,000 paid subscribers in early 2015 – that's a 900% increase for Feedly in two years." Customers use RSS to get information more easily while businesses take advantage of being able to spread announcements. "RSS serves as a delivery mechanism for websites to ''push'' online content to potential users and as an information aggregator and filter for users." However, it has been pointed out that in order to ''push the content'' RSS should be user-friendly to ensure proactive interaction so that the user can remain engaged without feeling "trapped", good design to avoid being overwhelmed by stale data, and optimization for both desktop and mobile use. RSS has a positive impact on marketing since it contributes to better search engine rankings, to building and maintaining brand awareness, and increasing site traffic.
See also
*
Content moderation
On websites that allow users to create content, content moderation is the process of detecting contributions that are irrelevant, obscene, illegal, harmful, or insulting. The purpose of content moderation is to remove or apply a warning label to ...
*
Comparison of feed aggregators
The following is a comparison of RSS feed aggregators. E-mail programs and web browsers that have the ability to display RSS feeds are listed, as well as some cloud-based services that offer feed aggregation.
Many BitTorrent clients support ...
*
History of web syndication technology
*
Lifestreaming
*
Metasearch engine
A metasearch engine (or search aggregator) is an online information retrieval tool that uses the data of a web search engine to produce its own results. Metasearch engines take input from a user and immediately query search engines for results. ...
*
Social media
Social media are interactive technologies that facilitate the Content creation, creation, information exchange, sharing and news aggregator, aggregation of Content (media), content (such as ideas, interests, and other forms of expression) amongs ...
*
Social network aggregation
Social network aggregation is the process of collecting content from multiple social network services into a unified presentation. Examples of social network aggregators include Hootsuite or FriendFeed, which may pull together information into a s ...
*
Web feed
On the World Wide Web, a web feed (or news feed) is a data format used for providing users with frequently updated content. Content distributors ''syndicate'' a web feed, thereby allowing users to ''subscribe'' a channel to it by adding the fee ...
*
Web syndication
Web syndication is making Content (media), content available from one website to other sites. Most commonly, websites are made available to provide either summaries or full renditions of a website's recently added content. The term may also describ ...
References
External links
{{DEFAULTSORT:News aggregator
Information Age