HOME

TheInfoList



OR:

A context model (or context modeling) defines how context data are structured and maintained (It plays a key role in supporting efficient context management). It aims to produce a formal or semi-formal description of the context information that is present in a context-aware system. In other words, the context is the surrounding element for the system, and a model provides the mathematical interface and a behavioral description of the surrounding environment. It is used to represent the reusable context information of the components (The top-level classes consist of
Operating system An operating system (OS) is system software that manages computer hardware and software resources, and provides common daemon (computing), services for computer programs. Time-sharing operating systems scheduler (computing), schedule tasks for ...
, component container, hardware requirement and
Software Software consists of computer programs that instruct the Execution (computing), execution of a computer. Software also includes design documents and specifications. The history of software is closely tied to the development of digital comput ...
requirement). A key role of context model is to simplify and introduce greater structure into the task of developing context-aware applications.


Examples of context models

The
Unified Modeling Language The Unified Modeling Language (UML) is a general-purpose visual modeling language that is intended to provide a standard way to visualize the design of a system. UML provides a standard notation for many types of diagrams which can be roughly ...
as used in systems engineering defines a context model as the physical scope of the system being designed, which could include the user as well as the environment and other actors. A
system context diagram A system context diagram in engineering is a diagram that defines the boundary between the system, or part of a system, and its environment, showing the entities that interact with it. This diagram is a high level view of a system. It is similar ...
represents the context graphically.. Several examples of context models occur under other domains. * In the situation of parsing a
grammar In linguistics, grammar is the set of rules for how a natural language is structured, as demonstrated by its speakers or writers. Grammar rules may concern the use of clauses, phrases, and words. The term may also refer to the study of such rul ...
, a context model defines the surrounding text of a lexical element. This enables a context sensitive grammar that can have
deterministic Determinism is the metaphysical view that all events within the universe (or multiverse) can occur only in one possible way. Deterministic theories throughout the history of philosophy have developed from diverse and sometimes overlapping mo ...
or
stochastic Stochastic (; ) is the property of being well-described by a random probability distribution. ''Stochasticity'' and ''randomness'' are technically distinct concepts: the former refers to a modeling approach, while the latter describes phenomena; i ...
rules. In the latter case, a
hidden Markov model A hidden Markov model (HMM) is a Markov model in which the observations are dependent on a latent (or ''hidden'') Markov process (referred to as X). An HMM requires that there be an observable process Y whose outcomes depend on the outcomes of X ...
can provide the probabilities for the surrounding context.Klein, Dan, and Christopher D. (2002) Manning.
"A generative constituent-context model for improved grammar induction."
In Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, pp. 128-135. Association for Computational Linguistics.
* A context model can also apply to the surrounding elements in a
gene sequence In biology, the word gene has two meanings. The Mendelian gene is a basic unit of heredity. The molecular gene is a sequence of nucleotides in DNA that is transcribed to produce a functional RNA. There are two types of molecular genes: protei ...
. Like the context rules of a grammar disambiguating a lexical element, this helps to disambiguate the role of the gene. * Within an
ontology Ontology is the philosophical study of existence, being. It is traditionally understood as the subdiscipline of metaphysics focused on the most general features of reality. As one of the most fundamental concepts, being encompasses all of realit ...
, a context model provides disambiguation of a subject via semantic analysis of information related to the subject. * In terms of a physical environment, a context model defines the external interfaces that a system will interact with. This type of context model has been used to create models for
virtual environment A virtual environment is a networked application that allows a user to interact with both the computing environment and the work of other users. Email, chat, and web-based document sharing applications are all examples of virtual environments. Sim ...
s such as the
Adaptive Vehicle Make Adaptive Vehicle Make was a portfolio of programs overseen by DARPA, of the United States Department of Defense. AVM attempted to address revolutionary approaches to the design, verification, and manufacturing of complex defense systems and vehicle ...
program. A context model used during design defines land, aquatic, or atmospheric characteristics (stated in terms of mathematical algorithms or a simulation) that the eventual product will face in the real environment. Component, Context, and Manufacturing Model Library – 2 (C2M2L-2)
Broad Agency Announcement, DARPA-BAA-12-30, February 24, 2012
* In the context of
large language model A large language model (LLM) is a language model trained with self-supervised machine learning on a vast amount of text, designed for natural language processing tasks, especially language generation. The largest and most capable LLMs are g ...
s, a context model refers to a component or aspect of the
language model A language model is a model of the human brain's ability to produce natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation,Andreas, Jacob, Andreas Vlachos, and Stephen Clark (2013)"S ...
that focuses on understanding and incorporating contextual information from the input text. The main purpose of a context model is to provide the language model with a better understanding of the context surrounding words, phrases, or sentences, so that it can generate more coherent and contextually appropriate responses. In
deep learning Deep learning is a subset of machine learning that focuses on utilizing multilayered neural networks to perform tasks such as classification, regression, and representation learning. The field takes inspiration from biological neuroscience a ...
-based language models like
GPT-4 Generative Pre-trained Transformer 4 (GPT-4) is a multimodal large language model trained and created by OpenAI and the fourth in its series of GPT foundation models. It was launched on March 14, 2023, and made publicly available via the p ...
or BERT, the context model is an inherent part of the architecture. These models use mechanisms such as
attention mechanism In machine learning, attention is a method that determines the importance of each component in a sequence relative to the other components in that sequence. In natural language processing, importance is represented b"soft"weights assigned to eac ...
s and multi-layered
transformer (machine learning) The transformer is a deep learning architecture based on the multi-head attention mechanism, in which text is converted to numerical representations called tokens, and each token is converted into a vector via lookup from a word embedding table. ...
architectures to capture contextual information from the input sequence. The context model takes into account the relationships between words and their surrounding text, helping the language model understand the meaning of a word in a specific context, handle ambiguities, and generate more accurate and coherent responses. * Examples of AI-based
numerical weather prediction Numerical weather prediction (NWP) uses mathematical models of the atmosphere and oceans to weather forecasting, predict the weather based on current weather conditions. Though first attempted in the 1920s, it was not until the advent of comput ...
systems that apply context models include
Google DeepMind DeepMind Technologies Limited, trading as Google DeepMind or simply DeepMind, is a British–American artificial intelligence research laboratory which serves as a subsidiary of Alphabet Inc. Founded in the UK in 2010, it was acquired by Goo ...
's GraphCast,
Huawei Huawei Technologies Co., Ltd. ("Huawei" sometimes stylized as "HUAWEI"; ; zh, c=华为, p= ) is a Chinese multinational corporationtechnology company in Longgang, Shenzhen, Longgang, Shenzhen, Guangdong. Its main product lines include teleco ...
's PanguWeather, and
NVIDIA Nvidia Corporation ( ) is an American multinational corporation and technology company headquartered in Santa Clara, California, and incorporated in Delaware. Founded in 1993 by Jensen Huang (president and CEO), Chris Malachowsky, and Curti ...
's FourCastNet, drawing from historical and re-analysis context data. In general, the approach is to match up current conditions using past data as context and then apply a mix of physics and historical outcomes to form a projection.


References

{{reflist Systems analysis