Semantic memory refers to general world
knowledge
Knowledge can be defined as awareness of facts or as practical skills, and may also refer to familiarity with objects or situations. Knowledge of facts, also called propositional knowledge, is often defined as true belief that is distinc ...
that humans have accumulated throughout their lives. This
general knowledge
General knowledge is information that has been accumulated over time through various mediums and sources. It excludes specialized learning that can only be obtained with extensive training and information confined to a single medium. General kn ...
(word meanings, concepts, facts, and ideas) is intertwined in experience and dependent on
culture
Culture () is an umbrella term which encompasses the social behavior, institutions, and norms found in human societies, as well as the knowledge, beliefs, arts, laws, customs, capabilities, and habits of the individuals in these groups.Tyl ...
. We can learn about new concepts by applying our knowledge learned from things in the past.
Semantic memory is distinct from
episodic memory
Episodic memory is the memory of everyday events (such as times, location geography, associated emotions, and other contextual information) that can be explicitly stated or conjured. It is the collection of past personal experiences that occurred ...
, which is our memory of experiences and specific events that occur during our lives, from which we can recreate at any given point. For instance, semantic memory might contain information about what a cat is, whereas episodic memory might contain a specific memory of petting a particular cat.
Semantic memory and episodic memory are both types of
explicit memory (or declarative memory), that is, memory of facts or events that can be consciously recalled and "declared". The counterpart to declarative or explicit memory is
nondeclarative memory or
implicit memory
In psychology, implicit memory is one of the two main types of long-term human memory. It is acquired and used unconsciously, and can affect thoughts and behaviours. One of its most common forms is procedural memory, which allows people to perfo ...
.
History
The idea of semantic memory was first introduced following a conference in 1972 between
Endel Tulving
Endel Tulving (born May 26, 1927) is an Estonian-born Canadian experimental psychologist and cognitive neuroscientist. In his research on human memory he proposed the distinction between semantic and episodic memory. Tulving is a professor emerit ...
, of the
University of Toronto
The University of Toronto (UToronto or U of T) is a public research university in Toronto, Ontario, Canada, located on the grounds that surround Queen's Park. It was founded by royal charter in 1827 as King's College, the first institution ...
, and W. Donaldson on the role of organization in human memory. Tulving constructed a proposal to distinguish between
episodic memory
Episodic memory is the memory of everyday events (such as times, location geography, associated emotions, and other contextual information) that can be explicitly stated or conjured. It is the collection of past personal experiences that occurred ...
and what he termed semantic memory. He was mainly influenced by the ideas of Reiff and Scheers, who in 1959 made the distinction between two primary forms of memory. One form was entitled "remembrances", the other "memoria". The remembrance concept dealt with memories that contained experiences of an autobiographic index, whereas the
memoria
Memoria was the term for aspects involving memory in Western classical rhetoric. The word is Latin, and can be translated as "memory".
It was one of five canons in classical rhetoric (the others being inventio, dispositio, elocutio, and pronunt ...
concept dealt with those memories that did not reference experiences having an autobiographic index. Semantic memory reflects our knowledge of the world around us, hence the term 'general knowledge' is often used. It holds generic information that is more than likely acquired across various contexts and is used across different situations. According to Madigan in his book titled ''Memory'', semantic memory is the sum of all knowledge one has obtained—whether it be vocabulary, understanding of math, or all the facts one knows. In his book titled ''Episodic and Semantic Memory'', Endel Tulving adopted the term "semantic" from linguists to refer to a system of memory for "words and verbal symbols, their meanings and referents, the relations between them, and the rules, formulas, or algorithms for influencing them." The use of semantic memory is quite different from that of episodic memory. Semantic memory refers to general facts and meanings one shares with others whereas episodic memory refers to unique and concrete personal experiences.
Tulving's proposal of this distinction between semantic and episodic memory was widely accepted, primarily because it allowed the separate conceptualization of knowledge of the world. Tulving discusses conceptions of episodic and semantic memory in his book titled ''Precise of Elements of Episodic Memory'', in which he states that several factors differentiate between episodic memory and semantic memory in ways that include
# the characteristics of their operations,
# the kind of information they process,
# their application to the real world as well as the memory laboratory.
In a recent work, researchers Felipe De Brigard, Sharda Umanath, and
Muireann Irish
Muireann Irish is a cognitive neuropsychologist at the Brain and Mind Centre at the University of Sydney. She has a history of winning numerous International and National awards, including an Australian Research Council Future Fellowship and ...
argue that Tulving conceptualized semantic memory as different from episodic memory in that "episodic memories were viewed as supported via spatiotemporal relations while information in semantic memory was mediated through conceptual, meaning-based associations."
Before Tulving's proposal, this area of human memory had been neglected by experimental
psychologists
A psychologist is a professional who practices psychology and studies mental states, perceptual, cognitive, emotional, and social processes and behavior. Their work often involves the experimentation, observation, and interpretation of how indi ...
. Since Tulving's inception of these distinctions, several experimenters have conducted tests to determine the validity of his hypothesized differences between episodic and semantic memory.
Recent research has focused on the idea that when people access a word's meaning, sensorimotor information that is used to perceive and act on the concrete object the word suggests is automatically activated. In the theory of
grounded cognition, the meaning of a particular word is grounded in the sensorimotor systems. For example, when one thinks of a pear, knowledge of grasping, chewing, sights, sounds, and tastes used to encode episodic experiences of a pear are recalled through sensorimotor simulation. A grounded simulation approach refers to context-specific re-activations that integrate the important features of episodic experience into a current depiction. Such research has challenged previously utilized amodal views. The brain encodes multiple inputs such as words and pictures to integrate and create a larger conceptual idea by using amodal views (also known as
amodal perception Amodal perception is the perception of the whole of a physical structure when only parts of it affect the sensory receptors. For example, a table will be perceived as a complete volumetric structure even if only part of it—the facing surface—pro ...
). Instead of being representations in modality-specific systems, semantic memory representations had previously been viewed as redescriptions of modality-specific states. Some accounts of category-specific semantic deficits that are amodal remain even though researchers are beginning to find support for theories in which knowledge is tied to modality-specific brain regions. This research defines a clear link between episodic experiences and semantic memory. The concept that semantic representations are grounded across modality-specific brain regions can be supported by the fact that episodic and semantic memory appear to function in different yet mutually dependent ways. The distinction between semantic and episodic memory has become a part of the broader scientific discourse. For example, researchers speculate that semantic memory captures the stable aspects of our personality while episodes of illness may have a more episodic nature.
Empirical evidence
Jacoby and Dallas (1981)
This study was not created to solely provide evidence for the distinction of semantic and episodic memory stores. However, they did use the experimental dissociation method which provides evidence for Tulving's hypothesis.
; Part one
Subjects were presented with 60 words (one at a time) and were asked different questions.
* Some questions asked were to cause the subject to pay attention to the visual appearance: Is the word typed in bold letters?
* Some questions caused the participants to pay attention to the sound of the word: Does the word rhyme with ball?
* Some questions caused the subjects to pay attention to the meaning of the word: Does the word refer to a form of communication?
* Half of the questions were "no" answers and the other half "yes"
; Part Two
In the second phase of the experiment, 60 "old words" seen in stage one and "20 new words" not shown in stage one were presented to the subjects one at a time.
The subjects were given one of two tasks:
* ''Perceptual Identification task (semantic)'': The words were flashed on a video-screen for 35ms and the subjects were required to say what the word was.
* ''Episodic Recognition Task'': Subjects were presented with each word and had to decide whether they had seen the word in the previous stage of the experiment.
; Results
:
* The percentages correct in the Semantic task (perceptual identification) did not change with the encoding conditions of appearance, sound, or meaning.
* The percentages for the episodic task increased from the appearance condition (.50), to the sound condition (.63), to the meaning condition (.86). – The effect was also greater for the "yes" encoding words than the "no" encoding words. (see stage one)
; Conclusion
:
It displays a strong distinction of performance of episodic and semantic tasks, thus supporting Tulving's hypothesis.
Models
The essence of semantic memory is that its contents are not tied to any particular instance of experience, as in episodic memory. Instead, what is stored in semantic memory is the "gist" of experience, an abstract structure that applies to a wide variety of experiential objects and delineates categorical and functional relationships between such objects. Thus, a complete theory of semantic memory must account not only for the representational structure of such "gists", but also for how they can be extracted from experience. There are numerous sub-theories related to semantic memory that have developed since Tulving initially posited his argument on the differences between semantic and episodic memory. One example among these is the belief in hierarchies of semantic memory, in which we associate different information we have learned with specific levels of related knowledge. According to this theory, our brains are able to associate specific information with other disparate ideas despite not having unique memories that correspond to when that knowledge was stored in the first place. This, of course, is only one example among many models of semantic memory which have been proposed; they are summarized below. Additionally, this theory of hierarchies has also been applied to episodic memory, as in the case of work by William Brewer on the concept of autobiographical memory.
Network models
Networks
Network, networking and networked may refer to:
Science and technology
* Network theory, the study of graphs as a representation of relations between discrete objects
* Network science, an academic field that studies complex networks
Mathematics
...
of various sorts play an integral part in many theories of semantic memory. Generally speaking, a network is composed of a set of nodes connected by links. The nodes may represent concepts, words, perceptual features, or nothing at all. The links may be weighted such that some are stronger than others or, equivalently, have a length such that some links take longer to traverse than others. All these features of networks have been employed in models of semantic memory, examples of which are found below.
Teachable Language Comprehender (TLC)
One of the first examples of a network model of semantic memory is the Teachable Language Comprehender (TLC). In this model, each node is a word, representing a concept (like "Bird"). With each node is stored a set of properties (like "can fly" or "has wings") as well as pointers (i.e., links) to other nodes (like "Chicken"). A node is directly linked to those nodes of which it is either a subclass or superclass (i.e., "Bird" would be connected to both "Chicken" and "Animal"). Thus, TLC is a hierarchical knowledge representation in that high-level nodes representing large categories are connected (directly or indirectly, via the nodes of subclasses) to many instances of those categories, whereas nodes representing specific instances are at a lower level, connected only to their superclasses. Furthermore, properties are stored at the highest category level to which they apply. For example, "is yellow" would be stored with "Canary", "has wings" would be stored with "Bird" (one level up), and "can move" would be stored with "Animal" (another level up). Nodes may also store negations of the properties of their superordinate nodes (i.e., "NOT-can fly" would be stored with "penguin"). This provides an economy of representation in that properties are only stored at the category level at which they become essential, that is, at which point they become critical features (see below).
Processing in TLC is a form of
spreading activation. That is, when a node becomes active, that activation spreads to other nodes via the links between them. In that case, the time to answer the question "Is a chicken a bird?" is a function of how far the activation between the nodes for "Chicken" and "Bird" must spread, i.e., the number of links between the nodes "Chicken" and "Bird".
The original version of TLC did not put weights on the links between nodes. This version performed comparably to humans in many tasks, but failed to predict that people would respond faster to questions regarding more typical category instances than those involving less typical instances.
Collins
Collins may refer to:
People Surname
Given name
* Collins O. Bright (1917–?), Sierra Leonean diplomat
* Collins Chabane (1960–2015), South African Minister of Public Service and Administration
* Collins Cheboi (born 1987), Kenyan middle- ...
and Quillian later updated TLC to include weighted connections to account for this effect. This updated TLC is capable of explaining both the
familiarity effect
Familiarity is knowledge, awareness or understanding of someone or something, such as facts, information, descriptions, or skills, which is acquired through experience or education by perceiving, discovering, or learning. It may also refer to:
* F ...
and the
typicality effect. Its biggest advantage is that it clearly explains
priming
Priming may refer to:
* Priming (agriculture), a form of seed planting preparation, in which seeds are soaked before planting
* Priming (immunology), a process occurring when a specific antigen is presented to naive lymphocytes causing them to d ...
: you are more likely to retrieve information from memory if related information (the "prime") has been presented a short time before. There are still a number of memory phenomena for which TLC has no account, including why people are able to respond quickly to obviously false questions (like "is a chicken a meteor?"), when the relevant nodes are very far apart in the network.
Semantic networks
TLC is an instance of a more general class of models known as
semantic networks
A semantic network, or frame network is a knowledge base that represents semantic relations between concepts in a network. This is often used as a form of knowledge representation. It is a directed or undirected graph consisting of vertices, ...
. In a semantic network, each node is to be interpreted as representing a specific concept, word, or feature. That is, each node is a symbol. Semantic networks generally do not employ distributed representations for concepts, as may be found in a
neural network
A neural network is a network or circuit of biological neurons, or, in a modern sense, an artificial neural network, composed of artificial neurons or nodes. Thus, a neural network is either a biological neural network, made up of biological ...
. The defining feature of a semantic network is that its links are almost always directed (that is, they only point in one direction, from a base to a target) and the links come in many different types, each one standing for a particular relationship that can hold between any two nodes. Processing in a semantic network often takes the form of spreading activation (see above).
Semantic networks see the most use in models of
discourse
Discourse is a generalization of the notion of a conversation to any form of communication. Discourse is a major topic in social theory, with work spanning fields such as sociology, anthropology, continental philosophy, and discourse analysis. ...
and
logic
Logic is the study of correct reasoning. It includes both formal and informal logic. Formal logic is the science of deductively valid inferences or of logical truths. It is a formal science investigating how conclusions follow from premises ...
al
comprehension, as well as in
Artificial Intelligence
Artificial intelligence (AI) is intelligence—perceiving, synthesizing, and inferring information—demonstrated by machines, as opposed to intelligence displayed by animals and humans. Example tasks in which this is done include speech re ...
. In these models, the nodes correspond to words or word stems and the links represent syntactic relations between them. For an example of a computational implementation of semantic networks in knowledge representation, see Cravo and Martins (1993).
Feature models
Feature models view semantic categories as being composed of relatively unstructured sets of features. The
semantic feature-comparison model The semantic feature comparison model is used "to derive predictions about categorization times in a situation where a subject must rapidly decide whether a test item is a member of a particular target category".Smith, E. E., Shoben. E. J., and Rips ...
, proposed by Smith, Shoben, and Rips (1974),
describes memory as being composed of feature lists for different concepts. According to this view, the relations between categories would not be directly retrieved, they would be indirectly computed. For example, subjects might verify a sentence by comparing the feature sets that represent its subject and predicate concepts. Such computational feature-comparison models include the ones proposed by Meyer (1970), Rips (1975), Smith, et al. (1974).
Early work in perceptual and conceptual categorization assumed that categories had critical features and that category membership could be determined by logical rules for the combination of features. More recent theories have accepted that categories may have an ill-defined or "fuzzy" structure and have proposed probabilistic or global similarity models for the verification of category membership.
Associative models
The "
association
Association may refer to:
*Club (organization), an association of two or more people united by a common interest or goal
*Trade association, an organization founded and funded by businesses that operate in a specific industry
*Voluntary associatio ...
"—a relationship between two pieces of information—is a fundamental concept in psychology, and associations at various levels of mental representation are essential to models of memory and cognition in general. The set of associations among a collection of items in memory is equivalent to the links between nodes in a network, where each node corresponds to a unique item in memory. Indeed, neural networks and semantic networks may be characterized as associative models of cognition. However, associations are often more clearly represented as an ''N''×''N'' matrix, where ''N'' is the number of items in memory. Thus, each cell of the matrix corresponds to the strength of the association between the row item and the column item.
Learning of associations is generally believed to be a
Hebbian
Hebbian theory is a neuroscientific theory claiming that an increase in synaptic efficacy arises from a presynaptic cell's repeated and persistent stimulation of a postsynaptic cell. It is an attempt to explain synaptic plasticity, the adaptation ...
process; that is, whenever two items in memory are simultaneously active, the association between them grows stronger, and the more likely either item is to activate the other. See below for specific operationalizations of associative models.
Search of Associative Memory (SAM)
A standard model of memory that employs association in this manner is the Search of Associative Memory (SAM) model. Though SAM was originally designed to model episodic memory, its mechanisms are sufficient to support some semantic memory representations, as well. The SAM model contains a short-term store (STS) and long-term store (LTS), where STS is a briefly activated subset of the information in the LTS. The STS has limited capacity and affects the retrieval process by limiting the amount of information that can be sampled and limiting the time the sampled subset is in an active mode. The retrieval process in LTS is cue dependent and probabilistic, meaning that a cue initiates the retrieval process and the selected information from memory is random. The probability of being sampled is dependent on the strength of association between the cue and the item being retrieved, with stronger associations being sampled and finally one is chosen. The buffer size is defined as r, and not a fixed number, and as items are rehearsed in the buffer the associative strengths grow linearly as a function of the total time inside the buffer. In SAM, when any two items simultaneously occupy a working memory buffer, the strength of their association is incremented. Thus, items that co-occur more often are more strongly associated. Items in SAM are also associated with a specific context, where the strength of that association determined by how long each item is present in a given context. In SAM, then, memories consist of a set of associations between items in memory and between items and contexts. The presence of a set of items and/or a context is more likely to evoke, then, some subset of the items in memory. The degree to which items evoke one another—either by virtue of their shared context or their co-occurrence—is an indication of the items'
semantic relatedness
Semantic similarity is a metric defined over a set of documents or terms, where the idea of distance between items is based on the likeness of their meaning or semantic content as opposed to lexicographical similarity. These are mathematical tool ...
.
In an updated version of SAM, pre-existing semantic associations are accounted for using a semantic
matrix
Matrix most commonly refers to:
* ''The Matrix'' (franchise), an American media franchise
** ''The Matrix'', a 1999 science-fiction action film
** "The Matrix", a fictional setting, a virtual reality environment, within ''The Matrix'' (franchis ...
. During the experiment, semantic associations remain fixed showing the assumption that semantic associations are not significantly impacted by the episodic experience of one experiment. The two measures used to measure semantic relatedness in this model are the Latent semantic analysis (LSA) and the Word association spaces (WAS). The LSA method states that similarity between words is reflected through their co-occurrence in a local context. WAS was developed by analyzing a database of free association norms. In WAS, "words that have similar associative structures are placed in similar regions of space."
ACT-R: a production system model
The ACT (Adaptive Control of Thought) (and later
ACT-R
ACT-R (pronounced /ˌækt ˈɑr/; short for "Adaptive Control of Thought—Rational") is a cognitive architecture mainly developed by John Robert Anderson and Christian Lebiere at Carnegie Mellon University. Like any cognitive architecture, ACT-R ...
(Adaptive Control of Thought-Rational)) theory of cognition represents
declarative memory
Explicit memory (or declarative memory) is one of the two main types of long-term human memory, the other of which is implicit memory. Explicit memory is the conscious, intentional recollection of factual information, previous experiences, and con ...
(of which semantic memory is a part) with "chunks", which consist of a label, a set of defined relationships to other chunks (i.e., "this is a _", or "this has a _"), and any number of chunk-specific properties. Chunks, then, can be mapped as a semantic network, given that each node is a chunk with its unique properties, and each link is the chunk's relationship to another chunk. In ACT, a chunk's activation decreases as a function of the time since the chunk was created and increases with the number of times the chunk has been retrieved from memory. Chunks can also receive activation from
Gaussian
Carl Friedrich Gauss (1777–1855) is the eponym of all of the topics listed below.
There are over 100 topics all named after this German mathematician and scientist, all in the fields of mathematics, physics, and astronomy. The English eponymo ...
noise
Noise is unwanted sound considered unpleasant, loud or disruptive to hearing. From a physics standpoint, there is no distinction between noise and desired sound, as both are vibrations through a medium, such as air or water. The difference arise ...
, and from their similarity to other chunks. For example, if "chicken" is used as a retrieval cue, "canary" will receive activation by virtue of its similarity to the cue (i.e., both are birds, etc.). When retrieving items from memory, ACT looks at the most active chunk in memory; if it is above threshold, it is retrieved, otherwise an "error of omission" has occurred, i.e., the item has been forgotten. There is, additionally, a retrieval latency, which varies inversely with the amount by which the activation of the retrieved chunk exceeds the retrieval threshold. This latency is used in measuring the response time of the ACT model, to compare it to human performance.
While ACT is a model of cognition in general, and not memory in particular, it nonetheless posits certain features of the structure of memory, as described above. In particular, ACT models memory as a set of related symbolic chunks which may be accessed by retrieval cues. While the model of memory employed in ACT is similar in some ways to a semantic network, the processing involved is more akin to an associative model.
Statistical models
Some models characterize the acquisition of semantic information as a form of
statistical inference
Statistical inference is the process of using data analysis to infer properties of an underlying probability distribution, distribution of probability.Upton, G., Cook, I. (2008) ''Oxford Dictionary of Statistics'', OUP. . Inferential statistical ...
from a set of discrete experiences, distributed across a number of "
contexts". Though these models differ in specifics, they generally employ an (Item × Context)
matrix
Matrix most commonly refers to:
* ''The Matrix'' (franchise), an American media franchise
** ''The Matrix'', a 1999 science-fiction action film
** "The Matrix", a fictional setting, a virtual reality environment, within ''The Matrix'' (franchis ...
where each cell represents the number of times an item in memory has occurred in a given context. Semantic information is gleaned by performing a statistical analysis of this matrix.
Many of these models bear similarity to the algorithms used in
search engines
A search engine is a software system designed to carry out web searches. They search the World Wide Web in a systematic way for particular information specified in a textual web search query. The search results are generally presented in a ...
(for example, see Griffiths, ''et al.'', 2007 and Anderson, 1990), though it is not yet clear whether they really use the same computational mechanisms.
Latent Semantic Analysis (LSA)
Perhaps the most popular of these models is
Latent Semantic Analysis
Latent semantic analysis (LSA) is a technique in natural language processing, in particular distributional semantics, of analyzing relationships between a set of documents and the terms they contain by producing a set of concepts related to the do ...
(LSA). In LSA, a T × D
matrix
Matrix most commonly refers to:
* ''The Matrix'' (franchise), an American media franchise
** ''The Matrix'', a 1999 science-fiction action film
** "The Matrix", a fictional setting, a virtual reality environment, within ''The Matrix'' (franchis ...
is constructed from a text corpus where T is the number of terms in the corpus and D is the number of documents (here "context" is interpreted as "document" and only words—or word phrases—are considered as items in memory). Each cell in the matrix is then transformed according to the equation:
where
is the probability that context
is active, given that item
has occurred (this is obtained simply by dividing the raw frequency,
by the total of the item vector,
). This transformation—applying the
logarithm
In mathematics, the logarithm is the inverse function to exponentiation. That means the logarithm of a number to the base is the exponent to which must be raised, to produce . For example, since , the ''logarithm base'' 10 o ...
, then dividing by the
information entropy
In information theory, the entropy of a random variable is the average level of "information", "surprise", or "uncertainty" inherent to the variable's possible outcomes. Given a discrete random variable X, which takes values in the alphabet \ ...
of the item over all contexts—provides for greater differentiation between items and effectively weights items by their ability to predict context, and vice versa (that is, items that appear across many contexts, like "the" or "and", will be weighted less, reflecting their lack of semantic information). A
Singular Value Decomposition
In linear algebra, the singular value decomposition (SVD) is a factorization of a real or complex matrix. It generalizes the eigendecomposition of a square normal matrix with an orthonormal eigenbasis to any \ m \times n\ matrix. It is related ...
(SVD) is then performed on the matrix
, which allows the number of dimensions in the matrix to be reduced, thus clustering LSA's semantic representations and providing for indirect association between items. For example, "cat" and "dog" may never appear together in the same context, so their close semantic relationship may not be well-captured by LSA's original matrix
. However, by performing the SVD and reducing the number of dimensions in the matrix, the context vectors of "cat" and "dog"—which would be very similar—would migrate toward one another and perhaps merge, thus allowing "cat" and "dog" to act as retrieval cues for each other, even though they may never have co-occurred. The degree of semantic relatedness of items in memory is given by the cosine of the angle between the items' context vectors (ranging from 1 for perfect synonyms to 0 for no relationship). Essentially, then, two words are closely semantically related if they appear in similar types of documents.
Hyperspace Analogue to Language (HAL)
The Hyperspace Analogue to Language (HAL) model considers context only as the words that immediately surround a given word. HAL computes an NxN matrix, where N is the number of words in its lexicon, using a 10-word reading frame that moves incrementally through a corpus of text. Like in SAM (see above), any time two words are simultaneously in the frame, the association between them is increased, that is, the corresponding cell in the NxN matrix is incremented. The bigger the distance between the two words, the smaller the amount by which the association is incremented (specifically,
, where
is the distance between the two words in the frame). As in
LSA (see above), the semantic similarity between two words is given by the cosine of the angle between their vectors (
dimension reduction
Dimensionality reduction, or dimension reduction, is the transformation of data from a high-dimensional space into a low-dimensional space so that the low-dimensional representation retains some meaningful properties of the original data, ideally ...
may be performed on this matrix, as well). In HAL, then, two words are semantically related if they tend to appear with the same words. Note that this may hold true even when the words being compared never actually co-occur (i.e., "chicken" and "canary").
Other statistical models of semantic memory
The success of LSA and HAL gave birth to a whole field of statistical models of language. A more up-to-date list of such models may be found under the topic
Measures of semantic relatedness.
Location of semantic memory in the brain
The
cognitive neuroscience
Cognitive neuroscience is the scientific field that is concerned with the study of the biological processes and aspects that underlie cognition, with a specific focus on the neural connections in the brain which are involved in mental proces ...
of semantic memory is a somewhat controversial issue with two dominant views.
On the one hand, many researchers and clinicians believe that semantic memory is stored by the same
brain
A brain is an organ that serves as the center of the nervous system in all vertebrate and most invertebrate animals. It is located in the head, usually close to the sensory organs for senses such as vision. It is the most complex organ in a v ...
systems involved in
episodic memory
Episodic memory is the memory of everyday events (such as times, location geography, associated emotions, and other contextual information) that can be explicitly stated or conjured. It is the collection of past personal experiences that occurred ...
, that is, the medial
temporal lobes
The temporal lobe is one of the four major lobes of the cerebral cortex in the brain of mammals. The temporal lobe is located beneath the lateral fissure on both cerebral hemispheres of the mammalian brain.
The temporal lobe is involved in pro ...
(MTL), including the
hippocampal formation
The hippocampal formation is a compound structure in the Temporal lobe#Medial temporal lobe, medial temporal lobe of the brain. It forms a c-shaped bulge on the floor of the temporal horn of the Lateral ventricles, lateral ventricle. There is no ...
. In this system, the hippocampal formation "encodes" memories, or makes it possible for memories to form at all, and the neocortex stores memories after the initial encoding process is completed.
Recently, new evidence has been presented in support of a more precise interpretation of this hypothesis. The hippocampal formation includes, among other structures: the hippocampus itself, the
entorhinal cortex
The entorhinal cortex (EC) is an area of the brain's allocortex, located in the medial temporal lobe, whose functions include being a widespread network hub for memory, navigation, and the perception of time.Integrating time from experience in the ...
, and the
perirhinal cortex
The perirhinal cortex is a cortical region in the medial temporal lobe that is made up of Brodmann areas 35 and 36. It receives highly processed sensory information from all sensory regions, and is generally accepted to be an important region f ...
. These latter two make up the "parahippocampal cortices". Amnesics with damage to the hippocampus but some spared parahippocampal cortex were able to demonstrate some degree of intact semantic memory despite a total loss of episodic memory. This strongly suggests that encoding of information leading to semantic memory does not have its physiological basis in the hippocampus.
Other researchers believe the
hippocampus
The hippocampus (via Latin from Greek , 'seahorse') is a major component of the brain of humans and other vertebrates. Humans and other mammals have two hippocampi, one in each side of the brain. The hippocampus is part of the limbic system, a ...
is only involved in
episodic memory
Episodic memory is the memory of everyday events (such as times, location geography, associated emotions, and other contextual information) that can be explicitly stated or conjured. It is the collection of past personal experiences that occurred ...
and spatial
cognition
Cognition refers to "the mental action or process of acquiring knowledge and understanding through thought, experience, and the senses". It encompasses all aspects of intellectual functions and processes such as: perception, attention, thought, ...
. This then raises the question where semantic memory may be located. Some believe semantic memory lives in
temporal cortex
The temporal lobe is one of the four major lobes of the cerebral cortex in the brain of mammals. The temporal lobe is located beneath the lateral fissure on both cerebral hemispheres of the mammalian brain.
The temporal lobe is involved in pro ...
. Others believe that semantic knowledge is widely distributed across all brain areas. To illustrate this latter view, consider your knowledge of dogs. Researchers holding the 'distributed semantic knowledge' view believe that your knowledge of the sound a dog makes exists in your
auditory cortex
The auditory cortex is the part of the temporal lobe that processes auditory information in humans and many other vertebrates. It is a part of the auditory system, performing basic and higher functions in hearing, such as possible relations to ...
, whilst your ability to recognize and imagine the visual features of a dog resides in your
visual cortex
The visual cortex of the brain is the area of the cerebral cortex that processes visual information. It is located in the occipital lobe. Sensory input originating from the eyes travels through the lateral geniculate nucleus in the thalamus and ...
. Recent evidence supports the idea that the
temporal pole
The vertebrate cerebrum (brain) is formed by two cerebral hemispheres that are separated by a groove, the longitudinal fissure. The brain can thus be described as being divided into left and right cerebral hemispheres. Each of these hemispheres ...
bilaterally is the convergence zone for unimodal semantic representations into a multimodal representation. These regions are particularly vulnerable to damage in
semantic dementia
Semantic dementia (SD), also known as semantic variant primary progressive aphasia (svPPA), is a progressive neurodegenerative disorder characterized by loss of semantic memory in both the verbal and non-verbal domains. However, the most common p ...
, which is characterised by a global semantic deficit.
Neural correlates and biological workings
The hippocampal areas are important to semantic memory's involvement with declarative memory. The left inferior
prefrontal cortex
In mammalian brain anatomy, the prefrontal cortex (PFC) covers the front part of the frontal lobe of the cerebral cortex. The PFC contains the Brodmann areas BA8, BA9, BA10, BA11, BA12, BA13, BA14, BA24, BA25, BA32, BA44, BA45, BA46, ...
(PFC) and the left posterior
temporal areas are other areas involved in semantic memory use.
Temporal lobe
The temporal lobe is one of the four Lobes of the brain, major lobes of the cerebral cortex in the brain of mammals. The temporal lobe is located beneath the lateral fissure on both cerebral hemispheres of the mammalian brain.
The temporal lobe ...
damage affecting the lateral and medial cortexes have been related to semantic impairments. Damage to different areas of the brain affect semantic memory differently.
Neuroimaging evidence suggests that left hippocampal areas show an increase in activity during semantic memory tasks. During semantic retrieval, two regions in the right
middle frontal gyrus
The middle frontal gyrus makes up about one-third of the frontal lobe of the human brain. (A ''gyrus'' is one of the prominent "bumps" or "ridges" on the surface of the human brain.)
The middle frontal gyrus, like the inferior frontal gyrus an ...
and the area of the right
inferior temporal gyrus
The inferior temporal gyrus is one of three gyri of the temporal lobe and is located below the middle temporal gyrus, connected behind with the inferior occipital gyrus; it also extends around the infero-lateral border on to the inferior surface ...
similarly show an increase in activity.
Damage to areas involved in semantic memory result in various deficits, depending on the area and type of damage. For instance, Lambon Ralph, Lowe, & Rogers (2007) found that category-specific impairments can occur where patients have different knowledge deficits for one semantic category over another, depending on location and type of damage. Category-specific impairments might indicate that knowledge may rely differentially upon sensory and motor properties encoded in separate areas (Farah and McClelland, 1991).
Category-specific impairments can involve cortical regions where living and nonliving things are represented and where feature and conceptual relationships are represented. Depending on the damage to the semantic system, one type might be favored over the other. In many cases, there is a point where one domain is better than the other (i.e. - representation of living and nonliving things over feature and conceptual relationships or vice versa)
Different diseases and disorders can affect the biological workings of semantic memory. A variety of studies have been done in an attempt to determine the effects on varying aspects of semantic memory. For example, Lambon, Lowe, & Rogers (2007) studied the different effects
semantic dementia
Semantic dementia (SD), also known as semantic variant primary progressive aphasia (svPPA), is a progressive neurodegenerative disorder characterized by loss of semantic memory in both the verbal and non-verbal domains. However, the most common p ...
and herpes simplex virus encephalitis have on semantic memory. They found that semantic dementia has a more generalized semantic impairment. Additionally, deficits in semantic memory as a result of herpes simplex virus encephalitis tend to have more category-specific impairments. Other disorders that affect semantic memory - such as
Alzheimer's disease
Alzheimer's disease (AD) is a neurodegeneration, neurodegenerative disease that usually starts slowly and progressively worsens. It is the cause of 60–70% of cases of dementia. The most common early symptom is difficulty in short-term me ...
- has been observed clinically as errors in naming, recognizing, or describing objects. Whereas researchers have attributed such impairment to degradation of semantic knowledge (Koenig et al. 2007).
Various neural imaging and research points to semantic memory and
episodic memory
Episodic memory is the memory of everyday events (such as times, location geography, associated emotions, and other contextual information) that can be explicitly stated or conjured. It is the collection of past personal experiences that occurred ...
resulting from distinct areas in the brain. Still other research suggests that both semantic memory and
episodic memory
Episodic memory is the memory of everyday events (such as times, location geography, associated emotions, and other contextual information) that can be explicitly stated or conjured. It is the collection of past personal experiences that occurred ...
are part of a singular
declarative memory
Explicit memory (or declarative memory) is one of the two main types of long-term human memory, the other of which is implicit memory. Explicit memory is the conscious, intentional recollection of factual information, previous experiences, and con ...
system, yet represent different sectors and parts within the greater whole. Different areas within the brain are activated depending on whether semantic or
episodic memory
Episodic memory is the memory of everyday events (such as times, location geography, associated emotions, and other contextual information) that can be explicitly stated or conjured. It is the collection of past personal experiences that occurred ...
is accessed. Certain experts are still arguing whether or not the two types of memory are from distinct systems or whether the neural imaging makes it appear that way as a result of the activation of different mental processes during retrieval.
Disorders
Category specific semantic impairments
Category specific semantic impairments are a neuropsychological occurrence in which an individual ability to identify certain categories of objects is selectively impaired while other categories remain undamaged.
This condition can result in brain damage which can be widespread, patchy, or localized to a specific part of the brain. Research suggests that the temporal lobe, more specifically the structural description system
might be responsible for category specific impairments of semantic memory disorders.
Impairment categories
Category specific semantic deficits tend to fall into two different categories, each of which can be spared or emphasized depending on the individual's specific deficit. The first category consists of animate objects with "animals" being the most common deficit. The second category consists of inanimate objects with two subcategories of "fruits and vegetables" (biological inanimate objects) and "artifacts" being the most common deficits. The type of deficit, however, does not indicate a lack of conceptual knowledge associated with that category. This is because the visual system used to identify and describe the structure of objects functions independently of an individual's conceptual knowledge base.
Most of the time, these two categories are consistent with case-study data. However, there are a few exceptions to the rule as is the case with most neuropsychological conditions. Things like food, body parts, and musical instruments have been shown to defy the animate/inanimate or biological/non-biological categorical division. For example, it has been shown that musical instruments tend to be impaired in patients with damage to the living things category despite the fact that musical instruments fall in the non-biological/inanimate category. However, there are also cases of biological impairment where musical instrument performance is at a normal level. Similarly, food has been shown to be impaired in those with biological category impairments. The category of food specifically can present some irregularities though because it can be natural, but it can also be highly processed. This can be seen in a case study of an individual who had impairments for vegetables and animals, while their category for food remained intact. These findings are all based on individual case studies, so although they are the most reliable source of information, they are also full of inconsistencies because every brain and every instance of brain damage is unique in its own way.
Theories
When looking at category specific semantic deficits, it is important to consider how semantic information is stored in the brain. Theories on this subject tend to fall into two different groups based on their underlying principles. Theories based on the "correlated structure principle", which states that conceptual knowledge organization in the brain is a reflection of how often an object's properties occur, assume that the brain reflects the statistical relation of object properties and how they relate to each other. Theories based on the "neural structure principle", which states that the conceptual knowledge organization in the brain is controlled by representational limits imposed by the brain itself, assume that organization is internal. These theories assume that natural selective pressures have caused neural circuits specific to certain domains to be formed, and that these are dedicated to problem-solving and survival. Animals, plants, and tools are all examples of specific circuits that would be formed based on this theory.
The role of modality
Modality refers to a semantic category of meaning which has to do with necessity and probability expressed through language. In linguistics, certain expressions are said to have modal meanings. A few examples of this include conditionals, auxiliaries, adverbs, and nouns. When looking at category specific semantic deficits, there is another kind of modality that looks at word relationships which is much more relevant to these disorders and impairments.
For category specific impairments, there are modality-specific theories which all rest on a few general predictions. These theories state that damage to the visual modality will result in a deficit of biological objects while damage to the functional modality will result in a deficit of non-biological objects (artifacts). Modality-based theories also assume that if there is damage to modality-specific knowledge, then all the categories that fall under it will be damaged. In this case, damage to the visual modality would result in a deficit for all biological objects with no deficits restricted to the more specific categories. In other words, there would be no category specific semantic deficits for just "animals" or just "fruits and vegetables".
Category specific semantic deficit causes
= Semantic Dementia
=
Semantic Dementia
Semantic dementia (SD), also known as semantic variant primary progressive aphasia (svPPA), is a progressive neurodegenerative disorder characterized by loss of semantic memory in both the verbal and non-verbal domains. However, the most common p ...
is a semantic memory disorder that causes patients to lose the ability to match words or images to their meanings.
However, it is fairly rare for patients with semantic dementia to develop category specific impairments, though there have been documented cases of it occurring. Typically, a more generalized semantic impairment results from dimmed semantic representations in the brain.
Alzheimer's disease
Alzheimer's disease (AD) is a neurodegeneration, neurodegenerative disease that usually starts slowly and progressively worsens. It is the cause of 60–70% of cases of dementia. The most common early symptom is difficulty in short-term me ...
is a subcategory of semantic dementia which can cause similar symptoms. The main difference between the two being that Alzheimer's is categorized by atrophy to both sides of the brain while semantic dementia is categorized by loss of brain tissue in the front portion of the left temporal lobe.
With Alzheimer's disease in particular, interactions with semantic memory produce different patterns in deficits between patients and categories over time which is caused by distorted representations in the brain.
For example, in the initial onset of Alzheimer's disease, patients have mild difficulty with the artifacts category. As the disease progresses, the category specific semantic deficits progress as well, and patients see a more concrete deficit with natural categories. In other words, the deficit tends to be worse with living things as opposed to non-living things.
= Herpes Simplex Virus Encephalitis
=
Herpes Simplex Virus Encephalitis (HSVE) is a neurological disorder which causes inflammation of the brain. It is caused by the herpes simplex virus type 1. Early symptoms include headache, fever, and drowsiness, but over time symptoms including diminished ability to speak, memory loss, and aphasia will develop. HSVE can also cause category specific semantic deficits to occur. When this does happen, patients typically have damage temporal lobe damage that affects the medial and lateral cortex as well as the frontal lobe. Studies have also shown that patients with HSVE have a much higher incidence of category specific semantic deficits than those with semantic dementia, though both cause a disruption of flow through the temporal lobe.
Brain lesions
A
brain lesion refers to any abnormal tissue in or on the brain. Most often, this is caused by a trauma or infection. In one particular case study, a patient underwent surgery to remove an aneurysm, and the surgeon had to clip the anterior communicating artery which resulted in basal forebrain and fornix lesions. Before surgery, this patient was completely independent and had no semantic memory issues. However, after the operation and the lesions occurred, the patient reported difficulty with naming and identifying objects, recognition tasks, and comprehension. For this particular case, the patient had a much more significant amount of trouble with objects in the living category which could be seen in the drawings of animals which the patient was asked to do and in the data from the matching and identification tasks. Every lesion is different, but in this case study researchers suggested that the semantic deficits presented themselves as a result of disconnection of the temporal lobe. This would lead to the conclusion that any type of lesion in the temporal lobe, depending on severity and location, has the potential to cause semantic deficits.
Semantic differences in gender
The following table summarizes conclusions from the ''
Journal of Clinical and Experimental Neuropsychology''.
These results give us a baseline for the differences in semantic knowledge across gender for healthy subjects. When looking at category specific semantic deficits, we can compare the data to the table above to see if the results line up. Experimental data tells us that men with category specific semantic deficits are mainly impaired with fruits and vegetables while women with category specific semantic deficits are mainly impaired with animals and artifacts. This leads to the conclusion that there are significant gender differences when it comes to category specific semantic deficits, and that the patient will tend to be impaired in categories that had less existing knowledge to begin with.
Modality specific impairments
Semantic memory is also discussed in reference to
modality
Modality may refer to:
Humanities
* Modality (theology), the organization and structure of the church, as distinct from sodality or parachurch organizations
* Modality (music), in music, the subject concerning certain diatonic scales
* Modaliti ...
. Different components represent information from different sensorimotor channels. Modality specific impairments are divided into separate subsystems on the basis of input modality. Examples of different input modalities include visual, auditory and tactile input. Modality specific impairments are also divided into subsystems based on the type of information. Visual vs. verbal and perceptual vs. functional information are examples of information types. Modality specificity can account for category specific impairments in semantic memory disorders. Damage to visual semantics primarily impairs knowledge of living things, and damage to functional semantics primarily impairs knowledge of nonliving things.
Semantic refractory access and semantic storage disorders
Semantic memory disorders fall into two groups. Semantic refractory access disorders are contrasted with semantic storage disorders according to four factors. Temporal factors, response consistency, frequency and semantic relatedness are the four factors used to differentiate between semantic refractory access and semantic storage disorders. A key feature of semantic refractory access disorders is temporal distortions. Decreases in response time to certain stimuli are noted when compared to natural response times. Response consistency is the next factor. In access disorders you see inconsistencies in comprehending and responding to stimuli that have been presented many times. Temporal factors impact response consistency. In storage disorders, you do not see an inconsistent response to specific items like you do in refractory access disorders. Stimulus frequency determines performance at all stages of cognition. Extreme word frequency effects are common in semantic storage disorders while in semantic refractory access disorders word frequency effects are minimal. The comparison of 'close' and 'distant' groups tests semantic relatedness. 'Close' groupings have words that are related because they are drawn from the same category. For example, a listing of clothing types would be a 'close' grouping. 'Distant' groupings contain words with broad categorical differences. Non-related words would fall into this group. Comparing close and distant groups shows that in access disorders semantic relatedness had a negative effect. This is not observed in semantic storage disorders. Category specific and modality specific impairments are important components in access and storage disorders of semantic memory.
Present and future research
Semantic memory has had a comeback in interest in the past 15 years, due in part to the development of functional
neuroimaging
Neuroimaging is the use of quantitative (computational) techniques to study the structure and function of the central nervous system, developed as an objective way of scientifically studying the healthy human brain in a non-invasive manner. Incre ...
methods such as
positron emission tomography
Positron emission tomography (PET) is a functional imaging technique that uses radioactive substances known as radiotracers to visualize and measure changes in Metabolism, metabolic processes, and in other physiological activities including bl ...
(PET) and
functional magnetic resonance imaging
Functional magnetic resonance imaging or functional MRI (fMRI) measures brain activity by detecting changes associated with blood flow. This technique relies on the fact that cerebral blood flow and neuronal activation are coupled. When an area o ...
(fMRI), which have been used to address some of the central questions about our understanding of semantic memory.
Positron emission tomography (PET) and functional magnetic resonance (fMRI) allow
cognitive
Cognition refers to "the mental action or process of acquiring knowledge and understanding through thought, experience, and the senses". It encompasses all aspects of intellectual functions and processes such as: perception, attention, thought, ...
neuroscientists to explore different hypotheses concerning the neural network organization of semantic memory. By using these neuroimaging techniques researchers can observe the brain activity of participants while they perform cognitive tasks. These tasks can include, but are not limited to, naming objects, deciding if two stimuli belong in the same object category, or matching pictures to their written or spoken names.
Rather than any one brain region playing a dedicated and privileged role in the representation or retrieval of all sorts of semantic knowledge, semantic memory is a collection of functionally and anatomically distinct systems, where each attribute-specific system is tied to a
sensorimotor modality
Modality may refer to:
Humanities
* Modality (theology), the organization and structure of the church, as distinct from sodality or parachurch organizations
* Modality (music), in music, the subject concerning certain diatonic scales
* Modaliti ...
(i.e. vision) and even more specifically to a property within that modality (i.e.
color
Color (American English) or colour (British English) is the visual perceptual property deriving from the spectrum of light interacting with the photoreceptor cells of the eyes. Color categories and physical specifications of color are associ ...
). Neuroimaging studies also suggest a distinction between semantic processing and sensorimotor processing.
A new idea that is still at the early stages of development is that semantic memory, like perception, can be subdivided into types of visual information—color, size, form, and motion. Thompson-Schill (2003) found that the left or bilateral ventral
temporal cortex
The temporal lobe is one of the four major lobes of the cerebral cortex in the brain of mammals. The temporal lobe is located beneath the lateral fissure on both cerebral hemispheres of the mammalian brain.
The temporal lobe is involved in pro ...
appears to be involved in retrieval of knowledge of color and form, the left lateral temporal cortex in knowledge of motion, and the
parietal cortex
The parietal lobe is one of the four major lobes of the cerebral cortex in the brain of mammals. The parietal lobe is positioned above the temporal lobe and behind the frontal lobe and central sulcus.
The parietal lobe integrates sensory inform ...
in knowledge of size.
Neuroimaging studies suggest a large, distributed network of semantic representations that are organized minimally by attribute, and perhaps additionally by category. These networks include "extensive regions of ventral (form and color knowledge) and lateral (motion knowledge)
temporal cortex
The temporal lobe is one of the four major lobes of the cerebral cortex in the brain of mammals. The temporal lobe is located beneath the lateral fissure on both cerebral hemispheres of the mammalian brain.
The temporal lobe is involved in pro ...
,
parietal cortex
The parietal lobe is one of the four major lobes of the cerebral cortex in the brain of mammals. The parietal lobe is positioned above the temporal lobe and behind the frontal lobe and central sulcus.
The parietal lobe integrates sensory inform ...
(size knowledge), and
premotor cortex
The premotor cortex is an area of the motor cortex lying within the frontal lobe of the brain just anterior to the primary motor cortex. It occupies part of Brodmann's area 6. It has been studied mainly in primates, including monkeys and humans. ...
(manipulation knowledge). Other areas, such as more anterior regions of temporal cortex, may be involved in the representation of nonperceptual (e.g. verbal) conceptual knowledge, perhaps in some categorically-organized fashion."
It is suggested that within the temporoparietal network, the anterior temporal lobe is relatively more important for semantic processing, and posterior language regions are relatively more important for lexical retrieval.
See also
*
Memory semantics
*
Sparse distributed memory Sparse distributed memory (SDM) is a mathematical model of human long-term memory introduced by Pentti Kanerva in 1988 while he was at NASA Ames Research Center. It is a generalized random-access memory (RAM) for long (e.g., 1,000 bit) binary words. ...
References
Further reading
* William Damon, Richard M. Lerner, Nancy Eisenberg. 2006. Handbook of Child Psychology, Social, Emotional, and Personality Development. Publisher John Wiley & Sons. , 9780471272908
* John Hart, Michael A. Kraut. 2007. Neural Basis of Semantic Memory. Publisher-Cambridge University Press. , 9780521848701
* Frank Krüger. 2000. Coding of temporal relations in semantic memory. Publisher-Waxmann Verlag. , 9783893259434
* Sarí Laatu. 2003. Semantic memory deficits in Alzheimer's disease, Parkinson's disease and multiple sclerosis: impairments in conscious understanding of concept meanings and visual object recognition. Publisher-Turun Yliopisto
* Laura Eileen Matzen. 2008. Semantic and Phonological Influences on Memory, False Memory, and Reminding. Publisher-ProQuest. , 9780549909958
* Rosale McCarthy. 1995. Semantic Knowledge And Semantic Representations: A Special Issue Of Memory. Publisher Psychology Press. , 9780863779367
*
*
*
* Wietske Vonk. 1979. Retrieval from semantic memory. Publisher Springer-Verlag.
* Sandra L. Zoccoli. 2007. Object Features and Object Recognition: Semantic Memory Abilities During the Normal Aging Process. Publisher-ProQuest. , 9780549321071
External links
* http://www.newscientist.com/article.ns?id=dn10012
* http://diodor.eti.pg.gda.pl An application of computational semantic memory model. Plays 20 questions game on animals domain
S-Space Package an open source Java library that includes several semantic memory implementations, such as PEN and IS for generating
Statistical semantics
In linguistics, statistical semantics applies the methods of statistics to the problem of determining the meaning of words or phrases, ideally through unsupervised learning, to a degree of precision at least sufficient for the purpose of informat ...
from a text corpus
* http://www.semantikoz.com/blog/2008/02/25/hyperspace-analogue-to-language-hal-introduction/ Hyperspace Analogue to Language (HAL) variation of semantic memory explained in detail
{{DEFAULTSORT:Semantic Memory
Memory
Semantics