Robot learning is a research field at the intersection of
machine learning
Machine learning (ML) is a field of study in artificial intelligence concerned with the development and study of Computational statistics, statistical algorithms that can learn from data and generalise to unseen data, and thus perform Task ( ...
and
robotics
Robotics is the interdisciplinary study and practice of the design, construction, operation, and use of robots.
Within mechanical engineering, robotics is the design and construction of the physical structures of robots, while in computer s ...
. It studies techniques allowing a robot to acquire novel skills or adapt to its environment through learning algorithms. The embodiment of the robot, situated in a physical embedding, provides at the same time specific difficulties (e.g. high-dimensionality, real time constraints for collecting data and learning) and opportunities for guiding the learning process (e.g. sensorimotor synergies, motor primitives).
Example of skills that are targeted by learning algorithms include sensorimotor skills such as locomotion, grasping, active
object categorization, as well as interactive skills such as joint manipulation of an object with a human peer, and linguistic skills such as the grounded and situated
meaning of human language. Learning can happen either through autonomous self-exploration or through guidance from a human teacher, like for example in robot learning by imitation.
Robot learning can be closely related to
adaptive control
Adaptive control is the control method used by a controller which must adapt to a controlled system with parameters which vary, or are initially uncertain. For example, as an aircraft flies, its mass will slowly decrease as a result of fuel consump ...
,
reinforcement learning
Reinforcement learning (RL) is an interdisciplinary area of machine learning and optimal control concerned with how an intelligent agent should take actions in a dynamic environment in order to maximize a reward signal. Reinforcement learnin ...
as well as
developmental robotics which considers the problem of autonomous lifelong acquisition of repertoires of skills.
While
machine learning
Machine learning (ML) is a field of study in artificial intelligence concerned with the development and study of Computational statistics, statistical algorithms that can learn from data and generalise to unseen data, and thus perform Task ( ...
is frequently used by
computer vision
Computer vision tasks include methods for image sensor, acquiring, Image processing, processing, Image analysis, analyzing, and understanding digital images, and extraction of high-dimensional data from the real world in order to produce numerical ...
algorithms employed in the context of robotics, these applications are usually not referred to as "robot learning".
Imitation learning
Many research groups are developing techniques where robots learn by imitating. This includes various techniques for learning from demonstration (sometimes also referred to as "
programming by demonstration") and
observational learning
Observational learning is learning that occurs through observing the behavior of others. It is a form of Social learning theory, social learning which takes various forms, based on various processes. In humans, this form of learning seems to not n ...
.
Sharing learned skills and knowledge
In Tellex's "Million Object Challenge," the goal is robots that learn how to spot and handle simple items and upload their data to the cloud to allow other robots to analyze and use the information.
RoboBrain is a knowledge engine for robots which can be freely accessed by any device wishing to carry out a task. The database gathers new information about tasks as robots perform them, by searching the Internet, interpreting natural language text, images, and videos,
object recognition
Object recognition – technology in the field of computer vision for finding and identifying objects in an image or video sequence. Humans recognize a multitude of objects in images with little effort, despite the fact that the image of the ...
as well as interaction. The project is led by
Ashutosh Saxena at
Stanford University
Leland Stanford Junior University, commonly referred to as Stanford University, is a Private university, private research university in Stanford, California, United States. It was founded in 1885 by railroad magnate Leland Stanford (the eighth ...
.
RoboEarth is a project that has been described as a "
World Wide Web
The World Wide Web (WWW or simply the Web) is an information system that enables Content (media), content sharing over the Internet through user-friendly ways meant to appeal to users beyond Information technology, IT specialists and hobbyis ...
for robots" − it is a network and database repository where robots can share information and learn from each other and a cloud for outsourcing heavy computation tasks. The project brings together researchers from five major universities in Germany, the Netherlands and Spain and is backed by the
European Union
The European Union (EU) is a supranational union, supranational political union, political and economic union of Member state of the European Union, member states that are Geography of the European Union, located primarily in Europe. The u ...
.
Google Research,
DeepMind
DeepMind Technologies Limited, trading as Google DeepMind or simply DeepMind, is a British–American artificial intelligence research laboratory which serves as a subsidiary of Alphabet Inc. Founded in the UK in 2010, it was acquired by Go ...
, and
Google X have decided to allow their robots share their experiences.
See also
*
*
*
*
References
External links
IEEE RAS Technical Committee on Robot Learning (official IEEE website)IEEE RAS Technical Committee on Robot Learning (TC members website) Robot Learning at the Max Planck Institute for Intelligent Systems and the Technical University DarmstadtRobot Learning at the Computational Learning and Motor Control labHumanoid Robot Learning at the Advanced Telecommunication Research Center (ATR)
Learning Algorithms and Systems Laboratory at EPFL (LASA)at th
of
Juergen Schmidhuber at
IDSIA and
Technical University of Munich
The Technical University of Munich (TUM or TU Munich; ) is a public research university in Munich, Bavaria, Germany. It specializes in engineering, technology, medicine, and applied and natural sciences.
Established in 1868 by King Ludwig II ...
The Humanoid Project Peter Nordin,
Chalmers University of Technology
Chalmers University of Technology (, commonly referred to as Chalmers) is a private university, private research university located in Gothenburg, Sweden. Chalmers focuses on engineering and science, but more broadly it also conducts research ...
Inria and Ensta ParisTech FLOWERS team, France Autonomous lifelong learning in developmental robotics
CITEC at University of Bielefeld, Germany Department of Adaptive Machine Systems, Graduate School of Engineering, Osaka University, Japan
The Laboratory for Perceptual Robotics University of Massachusetts Amherst
The University of Massachusetts Amherst (UMass Amherst) is a public land-grant research university in Amherst, Massachusetts, United States. It is the flagship campus of the University of Massachusetts system and was founded in 1863 as the ...
Amherst, USA
Centre for Robotics and Neural SystemsPlymouth UniversityPlymouth, United Kingdom
Robot Learning Labat
Carnegie Mellon University
Carnegie Mellon University (CMU) is a private research university in Pittsburgh, Pennsylvania, United States. The institution was established in 1900 by Andrew Carnegie as the Carnegie Technical Schools. In 1912, it became the Carnegie Institu ...
Project Learning Humanoid Robotsat
University of Bonn
The University of Bonn, officially the Rhenish Friedrich Wilhelm University of Bonn (), is a public research university in Bonn, North Rhine-Westphalia, Germany. It was founded in its present form as the () on 18 October 1818 by Frederick Willi ...
Skilligent Robot Learning and Behavior Coordination System (commercial product)Robot Learning classat
Cornell University
Cornell University is a Private university, private Ivy League research university based in Ithaca, New York, United States. The university was co-founded by American philanthropist Ezra Cornell and historian and educator Andrew Dickson W ...
Robot Learning and Interaction Labat
Italian Institute of Technology
Reinforcement learning for robotics at
Delft University of Technology
The Delft University of Technology (TU Delft; ) is the oldest and largest Dutch public university, public Institute of technology, technical university, located in Delft, Netherlands. It specializes in engineering, technology, computing, design, a ...
{{Robotics
Learning
Learning is the process of acquiring new understanding, knowledge, behaviors, skills, value (personal and cultural), values, Attitude (psychology), attitudes, and preferences. The ability to learn is possessed by humans, non-human animals, and ...
Machine learning
Learning