TheInfoListRev V5.1.84
Xfr/
SummaryRelatedTreeNews

Related topics

Multimodal learning

Sponsored
Shop Amazon for paper shredders
Browse products on Amazon.
Search Amazon →
As an Amazon Associate I earn from qualifying purchases.

Multimodal learning is a type of deep learning that integrates and processes multiple types of data, referred to as modalities, such as text, audio, images, or video. This integration allows for a more holistic understanding of complex data, improving model performance in tasks like visual question answering, cross-modal retrieval, text-to-image generation, aesthetic ranking, and image captioning. Multimodal learning was proposed in 2011 at the beginning of the deep learning period.

Vision transformerVision transformerA vision transformer (ViT) is a transformer designed for computer vision. A ViT decomposes an input image into a series of patches (rather than text into tokens), serializes each patch into a vector, and maps it to a smaller dimension with a single matrix multiplication. These vector embeddings are then processed by a transformer encoder as if they were token embeddings.Deep learningDeep learningBranch of machine learningRepresenting images on multiple layers of abstraction in deep learningIn machine learning, deep learning (DL) focuses on utilizing multilayered neural networks to perform tasks such as classification, regression, and representation learning. The field takes inspiration from biological neuroscience and revolves around stacking artificial neurons into layers and "training" them to process data.Modality (human–computer interaction)In the context of human–computer interaction, a modality is the classification of a single independent channel of input/output between a computer and a human. Such channels may differ based on sensory nature (e.g., visual vs. auditory), or other significant differences in processing (e.g., text vs. image). A system is designated unimodal if it has only one modality implemented, and multimodal if it has more than one.Cross-modal retrievalCross-modal retrieval is a subfield of information retrieval that enables users to search for and retrieve information across different data modalities, such as text, images, audio, and video. Unlike traditional information retrieval systems that match queries and documents within the same modality (e.g., text-to-text search), cross-modal retrieval bridges different types of media to facilitate more flexible information access.ProprioceptionProprioceptionSense of self-movement, force, and body positionSchematics and images of types of limb proprioceptor neurons in mammals (top) and insects (bottom)Proprioception ( ) is the sense of self-movement, force, and body position. Proprioception is mediated by proprioceptors, a type of sensory receptor, located within muscles, tendons, and joints.GPT-4oGPT-4oGPT-4o ("o" for "") is a multilingual, multimodalgenerative pre-trained transformer developed by OpenAI and released in May 2024 as part of its GPT series of models. It can process and generate text, images and audio. Upon release, GPT-4o was free in ChatGPT, though paid subscribers had higher usage limits. GPT-4o was removed from ChatGPT in August 2025 when GPT-5 was released, but OpenAI reintroduced it for paid subscribers after users complained about the sudden removal.Multilayer perceptronMultilayer perceptronIn deep learning, a multilayer perceptron (MLP) is a kind of modern feedforwardneural network consisting of fully connected neurons with nonlinear activation functions, organized in layers, notable for being able to distinguish data that is not linearly separable. Modern neural networks are trained using backpropagation and are colloquially referred to as "vanilla" networks.Google GeminiGoogle GeminiGemini, sometimes marketed as Google Gemini and originally known as Bard, is a generative artificial intelligence chatbot and virtual assistant developed by Google. It is powered by the family of large language models (LLMs) of the same name, previously based on LaMDA and PaLM 2. The Gemini chatbot can process and generate text, computer code, images, audio, and video simultaneously.Robot controlRobot controlRobotic control is the system that contributes to the movement of robots. This involves the mechanical aspects and programmable systems that make it possible to control robots. Robotics can be controlled by various means including manual, wireless, semi-autonomous (a mix of fully automatic and wireless control), and fully autonomous (using artificial intelligence).LlamaLlamaThe llama (; Spanish pronunciation: or ; Lama glama) is a domesticated South Americancamelid, widely used as a meat and pack animal by Andean cultures since the pre-Columbian era. Llamas are social animals and live with others as a herd. Their wool is soft and contains only a small amount of lanolin. Llamas can learn simple tasks after a few repetitions. When using a pack, they can carry about 25 to 30% of their body weight for 8 to 13 km (5–8 miles).Large language modelLarge language modelType of machine learning modelThe number of publications about large language models by year grouped by publication typesA large language model (LLM) is an AI model (typically a neural network) trained on a vast amount of text for natural language processing tasks, especially language generation. LLMs can typically generate, summarize, translate, and analyze text in many contexts.PalmPalmPalm most commonly refers to: Palm of the hand, the central region of the front of the handPalm plants, of family ArecaceaeList of Arecaceae generaPalm oilSeveral other plants known as "palm"Palm or Palms may also refer to: MusicPalm (band), an American rock bandPalms (band), an American rock band featuring members of Deftones and Isis Palms (Palms album), their 2013 albumPalms (Thrice album), a 2018 album by American rock band ThriceBusinesses and organizationsPalm, Inc., d…

*As an Amazon Associate I earn from qualifying purchases.

AboutPrivacyContact

TheInfoList organizes topic information and links to original sources.

Loading topic…