The Conference and Workshop on Neural Information Processing Systems (abbreviated as NeurIPS and formerly NIPS) is a
machine learning
Machine learning (ML) is a field of inquiry devoted to understanding and building methods that 'learn', that is, methods that leverage data to improve performance on some set of tasks. It is seen as a part of artificial intelligence.
Machine ...
and
computational neuroscience
Computational neuroscience (also known as theoretical neuroscience or mathematical neuroscience) is a branch of neuroscience which employs mathematical models, computer simulations, theoretical analysis and abstractions of the brain to u ...
conference held every December. The conference is currently a double-track meeting (single-track until 2015) that includes invited talks as well as oral and poster presentations of refereed papers, followed by parallel-track workshops that up to 2013 were held at ski resorts.
History
The NeurIPS meeting was first proposed in 1986 at the annual invitation-only Snowbird Meeting on
Neural Networks for Computing organized by
The California Institute of Technology
The California Institute of Technology (branded as Caltech or CIT)The university itself only spells its short form as "Caltech"; the institution considers other spellings such a"Cal Tech" and "CalTech" incorrect. The institute is also occasional ...
and
Bell Laboratories
Nokia Bell Labs, originally named Bell Telephone Laboratories (1925–1984),
then AT&T Bell Laboratories (1984–1996)
and Bell Labs Innovations (1996–2007),
is an American industrial research and scientific development company owned by mult ...
. NeurIPS was designed as a complementary open interdisciplinary meeting for researchers exploring biological and artificial
Neural Networks. Reflecting this multidisciplinary approach, NeurIPS began in 1987 with information theorist
Ed Posner
Edward Charles "Ed" Posner (August 10, 1933 – June 15, 1993) was an American information theorist and neural network researcher who became chief technologist at the Jet Propulsion Laboratory and founded the Conference on Neural Information Proces ...
as the conference president and learning theorist
Yaser Abu-Mostafa as program chairman. Research presented in the early NeurIPS meetings included a wide range of topics from efforts to solve purely engineering problems to the use of computer models as a tool for understanding biological nervous systems. Since then, the biological and artificial systems research streams have diverged, and recent NeurIPS proceedings have been dominated by papers on
machine learning
Machine learning (ML) is a field of inquiry devoted to understanding and building methods that 'learn', that is, methods that leverage data to improve performance on some set of tasks. It is seen as a part of artificial intelligence.
Machine ...
,
artificial intelligence
Artificial intelligence (AI) is intelligence—perceiving, synthesizing, and inferring information—demonstrated by machines, as opposed to intelligence displayed by animals and humans. Example tasks in which this is done include speech r ...
and
statistics.
From 1987 until 2000 NeurIPS was held in
Denver
Denver () is a consolidated city and county, the capital, and most populous city of the U.S. state of Colorado. Its population was 715,522 at the 2020 census, a 19.22% increase since 2010. It is the 19th-most populous city in the Unit ...
, United States. Since then, the conference was held in
Vancouver
Vancouver ( ) is a major city in western Canada, located in the Lower Mainland region of British Columbia. As the List of cities in British Columbia, most populous city in the province, the 2021 Canadian census recorded 662,248 people in the ...
, Canada (2001–2010),
Granada, Spain (2011), and
Lake Tahoe, United States (2012–2013). In 2014 and 2015, the conference was held in
Montreal
Montreal ( ; officially Montréal, ) is the second-most populous city in Canada and most populous city in the Canadian province of Quebec. Founded in 1642 as '' Ville-Marie'', or "City of Mary", it is named after Mount Royal, the triple ...
, Canada, in Barcelona, Spain in 2016, in Long Beach, United States in 2017, in Montreal, Canada in 2018 and Vancouver, Canada in 2019. Reflecting its origins at
Snowbird, Utah
Snowbird is an unincorporated community in Little Cottonwood Canyon in the Wasatch Range of the Rocky Mountains near Salt Lake City, Utah, United States. It is most famous for Snowbird Ski and Summer Resort, an alpine skiing and snowboarding ar ...
, the meeting was accompanied by workshops organized at a nearby ski resort up until 2013, when it outgrew ski resorts.
The first NeurIPS Conference was sponsored by the
IEEE
The Institute of Electrical and Electronics Engineers (IEEE) is a 501(c)(3) professional association for electronic engineering and electrical engineering (and associated disciplines) with its corporate office in New York City and its operat ...
. The following NeurIPS Conferences have been organized by the NeurIPS Foundation, established by
Ed Posner
Edward Charles "Ed" Posner (August 10, 1933 – June 15, 1993) was an American information theorist and neural network researcher who became chief technologist at the Jet Propulsion Laboratory and founded the Conference on Neural Information Proces ...
.
Terrence Sejnowski
Terrence Joseph Sejnowski (born 13 August 1947) is the Francis Crick Professor at the Salk Institute for Biological Studies where he directs the Computational Neurobiology Laboratory and is the director of the Crick-Jacobs center for theoretical ...
has been the president of the NeurIPS Foundation since Posner's death in 1993. The board of trustees consists of previous general chairs of the NeurIPS Conference.
The first
proceedings
In academia and librarianship, conference proceedings is a collection of academic papers published in the context of an academic conference or workshop. Conference proceedings typically contain the contributions made by researchers at the confere ...
was published in book form by the
American Institute of Physics
The American Institute of Physics (AIP) promotes science and the profession of physics, publishes physics journals, and produces publications for scientific and engineering societies. The AIP is made up of various member societies. Its corpora ...
in 1987, and was entitled ''Neural Information Processing Systems'', then the
proceedings
In academia and librarianship, conference proceedings is a collection of academic papers published in the context of an academic conference or workshop. Conference proceedings typically contain the contributions made by researchers at the confere ...
from the following conferences have been published by
Morgan Kaufmann (1988–1993),
MIT Press
The MIT Press is a university press affiliated with the Massachusetts Institute of Technology (MIT) in Cambridge, Massachusetts (United States). It was established in 1962.
History
The MIT Press traces its origins back to 1926 when MIT publish ...
(1994–2004) and Curran Associates (2005–present) under the name ''Advances in Neural Information Processing Systems''.
The conference was originally abbreviated as "NIPS". By 2018 a few commentators were criticizing the abbreviation as encouraging sexism due to its association with the word ''
nipple
The nipple is a raised region of tissue on the surface of the breast from which, in females, milk leaves the breast through the lactiferous ducts to feed an infant. The milk can flow through the nipple passively or it can be ejected by smooth m ...
s'', and as being a
slur against Japanese. The board changed the abbreviation to "NeurIPS" in November 2018.
Topics
Along with machine learning and neuroscience, other fields represented at NeurIPS include
cognitive science,
psychology
Psychology is the scientific study of mind and behavior. Psychology includes the study of conscious and unconscious phenomena, including feelings and thoughts. It is an academic discipline of immense scope, crossing the boundaries between ...
,
computer vision, statistical
linguistics
Linguistics is the science, scientific study of human language. It is called a scientific study because it entails a comprehensive, systematic, objective, and precise analysis of all aspects of language, particularly its nature and structure ...
, and
information theory. Over the years, NeurIPS became a premier conference on machine learning and although the 'Neural' in the NeurIPS acronym had become something of a historical relic, the resurgence of
deep learning in neural networks since 2012, fueled by faster computers and big data, has led to achievements in speech recognition,
object recognition
Object recognition – technology in the field of computer vision for finding and identifying objects in an image or video sequence. Humans recognize a multitude of objects in images with little effort, despite the fact that the image of the ...
in images,
image captioning, language translation and world championship performance in the game of Go, based on neural architectures inspired by the hierarchy of areas in the visual cortex (ConvNet) and reinforcement learning inspired by the basal ganglia (Temporal difference learning).
Notable affinity groups have emerged from the NeurIPS conference and displayed diversity, including
Black in AI
Black in AI, formally called the Black in AI Workshop, is a technology research organization and affinity group, founded by Computer science, computer scientists Timnit Gebru and Rediet Abebe in 2017. It started as a conference workshop, later p ...
(in 2017),
Queer in AI (in 2016), and others.
Named lectures
In addition to invited talks and symposia, NeurIPS also organizes two named lectureships to recognize distinguished researchers. The NeurIPS Board introduced the Posner Lectureship in honor of NeurIPS founder
Ed Posner
Edward Charles "Ed" Posner (August 10, 1933 – June 15, 1993) was an American information theorist and neural network researcher who became chief technologist at the Jet Propulsion Laboratory and founded the Conference on Neural Information Proces ...
; two Posner Lectures were given each year up to 2015. Past lecturers have included:
*2021 –
Peter Bartlett
*2018 –
Joëlle Pineau
*2017 –
John Platt
*2016 –
Yann LeCun
Yann André LeCun ( , ; originally spelled Le Cun; born 8 July 1960) is a French computer scientist working primarily in the fields of machine learning, computer vision, mobile robotics and computational neuroscience. He is the Silver Professo ...
*2015 –
Zoubin Ghahramani
Zoubin Ghahramani FRS ( fa, زوبین قهرمانی; born 8 February 1970) is a British-Iranian researcher and Professor of Information Engineering at the University of Cambridge. He holds joint appointments at University College London and t ...
and
Vladimir Vapnik
Vladimir Naumovich Vapnik (russian: Владимир Наумович Вапник; born 6 December 1936) is one of the main developers of the Vapnik–Chervonenkis theory of statistical learning, and the co-inventor of the support-vector machin ...
*2014 –
Michael Kearns and
John Hopfield
John Joseph Hopfield (born July 15, 1933) is an American scientist most widely known for his invention of an associative neural network in 1982. It is now more commonly known as the Hopfield network.
Biography
Hopfield was born in 1933 to Po ...
*2013 –
Daphne Koller
Daphne Koller ( he, דפנה קולר; born August 27, 1968) is an Israeli-American computer scientist. She was a professor in the department of computer science at Stanford University and a MacArthur Foundation fellowship recipient. She is one ...
and
Peter Dayan
Peter Dayan is director at the Max Planck Institute for Biological Cybernetics in Tübingen, Germany. He is co-author of ''Theoretical Neuroscience'', an influential textbook on computational neuroscience. He is known for applying Bayesian metho ...
*2012 –
Thomas Dietterich
Thomas G. Dietterich is emeritus professor of computer science at Oregon State University. He is one of the pioneers of the field of machine learning. He served as executive editor of ''Machine Learning (journal)'' (1992–98) and helped co-found ...
and
Terry Sejnowski
Terrence Joseph Sejnowski (born 13 August 1947) is the Francis Crick Professor at the Salk Institute for Biological Studies where he directs the Computational Neurobiology Laboratory and is the director of the Crick-Jacobs center for theoretical ...
*2011 –
Rich Sutton and
Bernhard Schölkopf
Bernhard Schölkopf is a German computer scientist (born 20 February 1968) known for his work in machine learning, especially on kernel methods and causality. He is a director at the Max Planck Institute for Intelligent Systems in Tübingen, ...
*2010 –
Josh Tenenbaum and
Michael I. Jordan
In 2015, the NeurIPS Board introduced the Breiman Lectureship to highlight work in statistics relevant to conference topics. The lectureship was named for statistician
Leo Breiman
Leo Breiman (January 27, 1928 – July 5, 2005) was a distinguished statistician at the University of California, Berkeley. He was the recipient of numerous honors and awards, and was a member of the United States National Academy of Sciences.
...
, who served on the NeurIPS Board from 1994 to 2005. Past lecturers have included:
*2021 – Gabor Lugosi
*2020 –
Marloes Maathuis
*2019 –
Bin Yu
*2018 –
David Spiegelhalter
Sir David John Spiegelhalter (born 16 August 1953) is a British statistician and a Fellow of Churchill College, Cambridge. From 2007 to 2018 he was Winton Professor of the Public Understanding of Risk in the Statistical Laboratory at the Un ...
*2017 –
Yee Whye Teh
*2016 –
Susan Holmes
*2015 –
Robert Tibshirani
Robert Tibshirani (born July 10, 1956) is a professor in the Departments of Statistics and Biomedical Data Science at Stanford University. He was a professor at the University of Toronto from 1985 to 1998. In his work, he develops statistical to ...
The NIPS experiment
In NIPS 2014, the program chairs duplicated 10% of all submissions and sent them through separate reviewers to evaluate randomness in the reviewing process.
Several researchers interpreted the result.
Regarding whether the decision in NIPS is completely random or not,
John Langford writes: "Clearly not—a purely random decision would have arbitrariness of ~78%. It is, however, quite notable that 60% is much closer to 78% than 0%." He concludes that the result of the reviewing process is mostly arbitrary.
Editions
Past editions:
* 1987–2000:
Denver
Denver () is a consolidated city and county, the capital, and most populous city of the U.S. state of Colorado. Its population was 715,522 at the 2020 census, a 19.22% increase since 2010. It is the 19th-most populous city in the Unit ...
,
Colorado
Colorado (, other variants) is a state in the Mountain states, Mountain West subregion of the Western United States. It encompasses most of the Southern Rocky Mountains, as well as the northeastern portion of the Colorado Plateau and the wes ...
, United States
* 2001–2010:
Vancouver
Vancouver ( ) is a major city in western Canada, located in the Lower Mainland region of British Columbia. As the List of cities in British Columbia, most populous city in the province, the 2021 Canadian census recorded 662,248 people in the ...
,
British Columbia
British Columbia (commonly abbreviated as BC) is the westernmost province of Canada, situated between the Pacific Ocean and the Rocky Mountains. It has a diverse geography, with rugged landscapes that include rocky coastlines, sandy beaches, ...
, Canada
* 2011:
Granada, Spain, EU
* 2012 & 2013:
Stateline,
Nevada
Nevada ( ; ) is a state in the Western region of the United States. It is bordered by Oregon to the northwest, Idaho to the northeast, California to the west, Arizona to the southeast, and Utah to the east. Nevada is the 7th-most extensive, ...
, United States
* 2014 & 2015:
Montréal
Montreal ( ; officially Montréal, ) is the second-most populous city in Canada and most populous city in the Canadian province of Quebec. Founded in 1642 as '' Ville-Marie'', or "City of Mary", it is named after Mount Royal, the triple-p ...
,
Quebec
Quebec ( ; )According to the Canadian government, ''Québec'' (with the acute accent) is the official name in Canadian French and ''Quebec'' (without the accent) is the province's official name in Canadian English is one of the thirtee ...
, Canada
* 2016:
Barcelona
Barcelona ( , , ) is a city on the coast of northeastern Spain. It is the capital and largest city of the autonomous community of Catalonia, as well as the second most populous municipality of Spain. With a population of 1.6 million within ci ...
, Spain, EU
* 2017:
Long Beach
Long Beach is a city in Los Angeles County, California. It is the 42nd-most populous city in the United States, with a population of 466,742 as of 2020. A charter city, Long Beach is the seventh-most populous city in California.
Incorporate ...
,
California
California is a state in the Western United States, located along the Pacific Coast. With nearly 39.2million residents across a total area of approximately , it is the most populous U.S. state and the 3rd largest by area. It is also the m ...
, United States
* 2018:
Montréal
Montreal ( ; officially Montréal, ) is the second-most populous city in Canada and most populous city in the Canadian province of Quebec. Founded in 1642 as '' Ville-Marie'', or "City of Mary", it is named after Mount Royal, the triple-p ...
,
Quebec
Quebec ( ; )According to the Canadian government, ''Québec'' (with the acute accent) is the official name in Canadian French and ''Quebec'' (without the accent) is the province's official name in Canadian English is one of the thirtee ...
, Canada
* 2019:
Vancouver
Vancouver ( ) is a major city in western Canada, located in the Lower Mainland region of British Columbia. As the List of cities in British Columbia, most populous city in the province, the 2021 Canadian census recorded 662,248 people in the ...
,
British Columbia
British Columbia (commonly abbreviated as BC) is the westernmost province of Canada, situated between the Pacific Ocean and the Rocky Mountains. It has a diverse geography, with rugged landscapes that include rocky coastlines, sandy beaches, ...
, Canada
* 2020:
Vancouver
Vancouver ( ) is a major city in western Canada, located in the Lower Mainland region of British Columbia. As the List of cities in British Columbia, most populous city in the province, the 2021 Canadian census recorded 662,248 people in the ...
,
British Columbia
British Columbia (commonly abbreviated as BC) is the westernmost province of Canada, situated between the Pacific Ocean and the Rocky Mountains. It has a diverse geography, with rugged landscapes that include rocky coastlines, sandy beaches, ...
, Canada
(virtual conference)
* 2021: Virtual conference
* 2022:
,
Louisiana
Louisiana , group=pronunciation (French: ''La Louisiane'') is a state in the Deep South and South Central regions of the United States. It is the 20th-smallest by area and the 25th most populous of the 50 U.S. states. Louisiana is borde ...
, United States
Nips.cc - 2022 Conference
/ref>
See also
* CIBB
* COSYNE
* ICLR
* ICML
The International Conference on Machine Learning (ICML) is the leading international academic conference in machine learning. Along with NeurIPS and ICLR, it is one of the three primary conferences of high impact in machine learning and artifici ...
* AAAI
The Association for the Advancement of Artificial Intelligence (AAAI) is an international scientific society devoted to promote research in, and responsible use of, artificial intelligence. AAAI also aims to increase public understanding of artif ...
Notes
External links
2019 Conference
NeurIPS proceedings
NIPS 2011 video lectures
NIPS 2012 video lectures
Video Journal of Machine Learning Abstracts – Volume 3
{{Authority control
Artificial intelligence conferences
Neuroscience conferences
Computational neuroscience
Signal processing conferences
International conferences in Canada