|
ChatGPT
ChatGPT (Generative Pre-trained Transformer) is a chatbot launched by OpenAI in November 2022. It is built on top of OpenAI's GPT-3 family of large language models, and is fine-tuned (an approach to transfer learning) with both supervised and reinforcement learning techniques. ChatGPT was launched as a prototype on November 30, 2022, and quickly garnered attention for its detailed responses and articulate answers across many domains of knowledge. Its uneven factual accuracy was identified as a significant drawback. Following the release of ChatGPT, OpenAI was valued at $29 billion. Training ChatGPT was fine-tuned on top of GPT-3.5 using supervised learning as well as reinforcement learning. Both approaches used human trainers to improve the model's performance. In the case of supervised learning, the model was provided with conversations in which the trainers played both sides: the user and the AI assistant. In the reinforcement step, human trainers first ranked responses ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Hallucination (NLP)
In artificial intelligence, a hallucination or artificial hallucination is a confident response by an artificial intelligence that does not seem to be justified by its training data when the model has a tendency of "hallucinating" deceptive data. The term is derived from the psychological concept of hallucination because they share similar characteristics. One of the dangers of hallucinations is that the output of the model will look correct even if it is wrong. In natural language processing In natural language processing, a hallucination is often defined as "generated content that is nonsensical or unfaithful to the provided source content". Errors in encoding and decoding between text and representations can cause hallucinations. AI training to produce diverse responses can also lead to hallucination. Hallucinations can also occur when the AI is trained on a dataset wherein labeled summaries, despite being factually accurate, are not directly grounded in the labeled data purp ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
OpenAI
OpenAI is an artificial intelligence (AI) research laboratory consisting of the for-profit corporation OpenAI LP and its parent company, the non-profit OpenAI Inc. The company conducts research in the field of AI with the stated goal of promoting and developing friendly AI in a way that benefits humanity as a whole. The organization was founded in San Francisco in late 2015 by Sam Altman, Elon Musk, and others, who collectively pledged US$1 billion. Musk resigned from the board in February 2018 but remained a donor. In 2019, OpenAI LP received a 1 billion investment from Microsoft. OpenAI is headquartered at the Pioneer Building in Mission District, San Francisco. History In December 2015, Sam Altman, Elon Musk, Greg Brockman, Reid Hoffman, Jessica Livingston, Peter Thiel, Amazon Web Services (AWS), Infosys, and YC Research announced the formation of OpenAI and pledged over 1 billion to the venture. The organization stated it would "freely collaborate" wi ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Language Model
A language model is a probability distribution over sequences of words. Given any sequence of words of length , a language model assigns a probability P(w_1,\ldots,w_m) to the whole sequence. Language models generate probabilities by training on text corpora In linguistics, a corpus (plural ''corpora'') or text corpus is a language resource consisting of a large and structured set of texts (nowadays usually electronically stored and processed). In corpus linguistics, they are used to do statistical ... in one or many languages. Given that languages can be used to express an infinite variety of valid sentences (the property of digital infinity), language modeling faces the problem of assigning non-zero probabilities to linguistically valid sequences that may never be encountered in the training data. Several modelling approaches have been designed to surmount this problem, such as applying the Markov assumption or using neural architectures such as recurrent neural networks or ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Language Models
A language model is a probability distribution over sequences of words. Given any sequence of words of length , a language model assigns a probability P(w_1,\ldots,w_m) to the whole sequence. Language models generate probabilities by training on text corpora in one or many languages. Given that languages can be used to express an infinite variety of valid sentences (the property of digital infinity), language modeling faces the problem of assigning non-zero probabilities to linguistically valid sequences that may never be encountered in the training data. Several modelling approaches have been designed to surmount this problem, such as applying the Markov assumption or using neural architectures such as recurrent neural networks or transformers. Language models are useful for a variety of problems in computational linguistics; from initial applications in speech recognition to ensure nonsensical (i.e. low-probability) word sequences are not predicted, to wider use in machine tra ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Chatbot
A chatbot or chatterbot is a Software agent, software application used to conduct an on-line chat conversation via text or Speech synthesis, text-to-speech, in lieu of providing direct contact with a live human agent. Designed to convincingly simulate the way a human would behave as a conversational partner, chatbot systems typically require continuous tuning and testing, and many in production remain unable to adequately converse, while none of them can pass the standard Turing test. The term "ChatterBot" was originally coined by Michael Loren Mauldin, Michael Mauldin (creator of the first Verbot) in 1994 to describe these conversational programs. Chatbots are used in dialog systems for various purposes including customer service, request routing, or information gathering. While some chatbot applications use extensive word-classification processes, natural language processing, natural-language processors, and sophisticated Artificial intelligence, AI, others simply scan for gene ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
GPT-3
Generative Pre-trained Transformer 3 (GPT-3) is an autoregressive language model that uses deep learning to produce human-like text. Given an initial text as prompt, it will produce text that continues the prompt. The architecture is a standard transformer network (with a few engineering tweaks) with the unprecedented size of 2048- token-long context and 175 billion parameters (requiring 800 GB of storage). The training method is "generative pretraining", meaning that it is trained to predict what the next token is. The model demonstrated strong few-shot learning on many text-based tasks. It is the third-generation language prediction model in the GPT-n series (and the successor to GPT-2) created by OpenAI, a San Francisco-based artificial intelligence research laboratory. GPT-3, which was introduced in May 2020, and was in beta testing as of July 2020, is part of a trend in natural language processing (NLP) systems of pre-trained language representations. The quality of the t ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Goodhart's Law
Goodhart's law is an adage often stated as, "When a measure becomes a target, it ceases to be a good measure". It is named after British economist Charles Goodhart, who is credited with expressing the core idea of the adage in a 1975 article on monetary policy in the United Kingdom: It was used to criticize the British Thatcher government for trying to conduct monetary policy on the basis of targets for broad and narrow money, but the law reflects a much more general phenomenon. Priority and background Numerous concepts are related to this idea, at least one of which predates Goodhart's statement. Notably, Campbell's law likely has precedence, as Jeff Rodamar has argued, since various formulations date to 1969. Other academics had similar insights at the time. Jerome Ravetz's 1971 book ''Scientific Knowledge and Its Social Problems'' also predates Goodhart, though it does not formulate the same law. He discusses how systems in general can be gamed, focuses on cases where the goa ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Algorithmic Bias
Algorithmic bias describes systematic and repeatable errors in a computer system that create "unfair" outcomes, such as "privileging" one category over another in ways different from the intended function of the algorithm. Bias can emerge from many factors, including but not limited to the design of the algorithm or the unintended or unanticipated use or decisions relating to the way data is coded, collected, selected or used to train the algorithm. For example, algorithmic bias has been observed in search engine results and social media platforms. This bias can have impacts ranging from inadvertent privacy violations to reinforcing social biases of race, gender, sexuality, and ethnicity. The study of algorithmic bias is most concerned with algorithms that reflect "systematic and unfair" discrimination. This bias has only recently been addressed in legal frameworks, such as the European Union's General Data Protection Regulation (2018) and the proposed Artificial Intelligence A ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Man Pages
A man page (short for manual page) is a form of software documentation usually found on a Unix or Unix-like operating system. Topics covered include computer programs (including library and system calls), formal standards and conventions, and even abstract concepts. A user may invoke a man page by issuing the man command. By default, man typically uses a terminal pager program such as more or less to display its output. Man pages are often referred to as an ''on-line'' or ''online'' form of software documentation, * even though the man command does not require internet access, dating back to the times when printed ''out-of-band'' manuals were the norm. History In the first two years of the history of Unix, no documentation existed. The Unix Programmer's Manual' was first published on November 3, 1971. The first actual man pages were written by Dennis Ritchie and Ken Thompson at the insistence of their manager Doug McIlroy in 1971. Aside from the man pages, the ''Programmer' ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
The New York Times
''The New York Times'' (''the Times'', ''NYT'', or the Gray Lady) is a daily newspaper based in New York City with a worldwide readership reported in 2020 to comprise a declining 840,000 paid print subscribers, and a growing 6 million paid digital subscribers. It also is a producer of popular podcasts such as '' The Daily''. Founded in 1851 by Henry Jarvis Raymond and George Jones, it was initially published by Raymond, Jones & Company. The ''Times'' has won 132 Pulitzer Prizes, the most of any newspaper, and has long been regarded as a national " newspaper of record". For print it is ranked 18th in the world by circulation and 3rd in the U.S. The paper is owned by the New York Times Company, which is publicly traded. It has been governed by the Sulzberger family since 1896, through a dual-class share structure after its shares became publicly traded. A. G. Sulzberger, the paper's publisher and the company's chairman, is the fifth generation of the family to head the pa ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Voyages Of Christopher Columbus
Between 1492 and 1504, Italian explorer Christopher Columbus led four Spanish transatlantic maritime expeditions of discovery to the Americas. These voyages led to the widespread knowledge of the New World. This breakthrough inaugurated the period known as the Age of Discovery, which saw the colonization of the Americas, a related biological exchange, and trans-Atlantic trade. These events, the effects and consequences of which persist to the present, are often cited as the beginning of the modern era. Born in the Republic of Genoa, Columbus was a navigator who sailed for the Crown of Castile (a predecessor to the modern Kingdom of Spain) in search of a westward route to the Indies, thought to be the East Asian source of spices and other precious oriental goods obtainable only through arduous overland routes. Columbus was partly inspired by 13th-century Italian explorer Marco Polo in his ambition to explore Asia and never admitted his failure in this, incessantly claiming an ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Christopher Columbus
Christopher Columbus * lij, Cristoffa C(or)ombo * es, link=no, Cristóbal Colón * pt, Cristóvão Colombo * ca, Cristòfor (or ) * la, Christophorus Columbus. (; born between 25 August and 31 October 1451, died 20 May 1506) was an Italian explorer and navigator who completed Voyages of Christopher Columbus, four voyages across the Atlantic Ocean sponsored by the Catholic Monarchs of Spain, opening the way for the widespread European Age of Discovery, exploration and colonization of the Americas. His expeditions were the first known European contact with the Caribbean, Central America, and South America. The name ''Christopher Columbus'' is the anglicisation of the Latin . Scholars generally agree that Columbus was born in the Republic of Genoa and spoke a dialect of Ligurian (Romance language), Ligurian as his first language. He went to sea at a young age and travelled widely, as far north as the British Isles and as far south as what is now Ghana. He married Port ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
_-1.jpg "Click for more on -> ChatGPT")
.png "Click for more on -> The New York Times")
