David RumelhartDavid Everett Rumelhart (June 12, 1942 – March 13, 2011) was an American psychologist who made many contributions to the formal analysis of human cognition, working primarily within the frameworks of mathematical psychology, symbolic artificial intelligence, and parallel distributed processing. He also admired formal linguistic approaches to cognition, and explored the possibility of formulating a formal grammar to capture the structure of stories.
Artificial intelligenceIntelligence in machinesArtificial intelligence (AI) is the capability of computational systems to perform tasks typically associated with human intelligence, such as learning, reasoning, problem-solving, perception, and decision-making.
Neural network (machine learning)In machine learning, a neural network (NN) or artificial neural network (ANN) is a computational model inspired by the structure and functions of biological neural networks. A neural network consists of connected units or nodes called artificial neurons, which loosely model the neurons in the brain. These are connected by edges, which model the synapses in the brain.
Google BrainGoogle Brain was a deep learningartificial intelligence research team that served as the sole AI branch of Google before being incorporated under the newer umbrella of Google AI, a research division at Google dedicated to artificial intelligence. Formed in 2011, it combined open-ended machine learning research with information systems and large-scale computing resources.
Deep learningBranch of machine learningRepresenting images on multiple layers of abstraction in deep learningIn machine learning, deep learning (DL) focuses on utilizing multilayered neural networks to perform tasks such as classification, regression, and representation learning. The field takes inspiration from biological neuroscience and revolves around stacking artificial neurons into layers and "training" them to process data.
University of TorontoPublic research university in Ontario, CanadaNot to be confused with Toronto Metropolitan University.The University of Toronto (U of T) is a publicresearch university with three main campuses in the Greater Toronto Area of Ontario, Canada. Based on the grounds that surround Queen's Park in Toronto, it was founded by royal charter in 1827 as King's College, the first institution of higher learning in Upper Canada.
Ronald J. WilliamsRonald James Williams (1945 – February 16, 2024) was an American mathematician and computer scientist who spent the majority of his career at Northeastern University. He is considered one of the pioneers of neural networks. In 1986, he co-authored the seminal paper in Nature on the backpropagation algorithm along with David Rumelhart and Geoffrey Hinton, which triggered a boom in neural network research. Education and careerWilliams was born in Southern California.
BackpropagationOptimization algorithm for artificial neural networksIn machine learning, backpropagation is a gradient computation method commonly used for training a neural network in computing parameter updates. It is an efficient application of the chain rule to neural networks. Backpropagation efficiently computes the gradient of the loss with respect to the network weights for a single input–output example.
Vector Institute (Canada)The Vector Institute (French: Institut Vecteur) is a private, non-profit artificial intelligence research institute in Toronto founded in 2017, focusing primarily on machine learning and deep learning research. As of 2023, it consists of 143 faculty members and affiliates—38 of whom are CIFAR AI chairs—57 postdoctoral fellows, and 502 students.Computer scientistA computer scientist is a scientist who specializes in the academic study of computer science and technology. Computer scientists typically work on the theoretical side of computation.
Nobel Prize in PhysicsThe Nobel Prize in Physics is an annual award given by the Royal Swedish Academy of Sciences for those who have made the most outstanding contributions to mankind in the field of physics. It is one of the five Nobel Prizes established by the will of Alfred Nobel in 1895 and awarded since 1901, the others being the Nobel Prize in Chemistry, Nobel Prize in Literature, Nobel Peace Prize, and Nobel Prize in Physiology or Medicine.
AlexNetAlexNet is a convolutional neural network architecture developed for image classification tasks, notably achieving prominence through its performance in the ImageNet Large Scale Visual Recognition Challenge (ILSVRC). It classifies images into 1,000 distinct object categories and is regarded as the first widely recognized application of deep convolutional networks in large-scale visual recognition.
Cognitive scienceInterdisciplinary scientific study of cognitive processesFigure illustrating the fields that contributed to the birth of cognitive science, including philosophy of mind, linguistics, neuroscience, artificial intelligence, anthropology, and psychologyCognitive science is the interdisciplinary, scientific study of the mind and its processes. It examines the nature, the tasks, and the functions of cognition (in a broad sense).*As an Amazon Associate I earn from qualifying purchases.