In
semiotics
Semiotics (also called semiotic studies) is the systematic study of sign processes ( semiosis) and meaning making. Semiosis is any activity, conduct, or process that involves signs, where a sign is defined as anything that communicates something ...
, a modality is a particular way in which
information
Information is an abstract concept that refers to that which has the power to inform. At the most fundamental level information pertains to the interpretation of that which may be sensed. Any natural process that is not completely random ...
is to be
encoded
In communications and information processing, code is a system of rules to convert information—such as a letter, word, sound, image, or gesture—into another form, sometimes shortened or secret, for communication through a communication ...
for presentation to humans, i.e. to the type of
sign and to the status of reality ascribed to or claimed by a sign, text, or genre. It is more closely associated with the semiotics of
Charles Peirce (1839–1914) than
Ferdinand de Saussure (1857–1913) because
meaning is conceived as an effect of a set of signs. In the Peircean model, a reference is made to an ''object'' when the sign (or ''representamen'') is interpreted recursively by another sign (which becomes its ''
interpretant''), a conception of meaning that does in fact imply a classification of sign types.
Discussion of sign-type
The
psychology of perception suggests the existence of a common cognitive system that treats all or most sensorily conveyed meanings in the same way. If all signs must also be objects of perception, there is every reason to believe that their modality will determine at least part of their nature. Thus, the
sensory modalities Stimulus modality, also called sensory modality, is one aspect of a stimulus or what is perceived after a stimulus. For example, the temperature modality is registered after heat or cold stimulate a receptor. Some sensory modalities include: light, ...
will be
visual
The visual system comprises the sensory organ (the eye) and parts of the central nervous system (the retina containing photoreceptor cells, the optic nerve, the optic tract and the visual cortex) which gives organisms the sense of sight (th ...
,
auditory,
tactile
Tactile may refer to:
* Tactile, related to the sense of touch
* Haptics (disambiguation)
* Tactile (device), a text-to-braille translation device
See also
* Tangibility, in law
* Somatosensory system, where sensations are processed
* CD96
CD ...
,
olfactory,
gustatory
The gustatory system or sense of taste is the sensory system that is partially responsible for the perception of taste (flavor). Taste is the perception produced or stimulated when a substance in the mouth reacts chemically with taste receptor ...
,
kinesthetic
Proprioception ( ), also referred to as kinaesthesia (or kinesthesia), is the sense of self-movement, force, and body position. It is sometimes described as the "sixth sense".
Proprioception is mediated by proprioceptors, mechanosensory neurons ...
, etc. A list of sign types would include:
writing
Writing is a medium of human communication which involves the representation of a language through a system of physically inscribed, mechanically transferred, or digitally represented symbols.
Writing systems do not themselves constitute h ...
,
symbol, index,
image,
map
A map is a symbolic depiction emphasizing relationships between elements of some space, such as objects, regions, or themes.
Many maps are static, fixed to paper or some other durable medium, while others are dynamic or interactive. Although ...
,
graph
Graph may refer to:
Mathematics
*Graph (discrete mathematics), a structure made of vertices and edges
**Graph theory, the study of such graphs and their properties
*Graph (topology), a topological space resembling a graph in the sense of discre ...
,
diagram, etc. Some combinations of signs can be multi-modal, i.e. different types of signs grouped together for effect. But the distinction between a ''medium'' and a modality should be clarified:
*''text'' is a medium for presenting the modality of natural language;
*''image'' is both a medium and a modality;
*''music'' is a modality for the auditory media.
So, the ''modality'' refers to a certain type of information and/or the representation format in which information is stored. The ''medium'' is the means whereby this information is delivered to the senses of the interpreter. Natural language is the primary modality, having many invariant properties across the auditory media as spoken language, the visual media as written language, the tactile media as
Braille
Braille (Pronounced: ) is a tactile writing system used by people who are visually impaired, including people who are blind, deafblind or who have low vision. It can be read either on embossed paper or by using refreshable braille disp ...
, and kinetic media as
sign language
Sign languages (also known as signed languages) are languages that use the visual-manual modality to convey meaning, instead of spoken words. Sign languages are expressed through manual articulation in combination with non-manual markers. Sign l ...
. When meaning is conveyed by spoken language, it is converted into sound waves broadcast by the speaker and received by another's ears. Yet this
stimulus
A stimulus is something that causes a physiological response. It may refer to:
*Stimulation
**Stimulus (physiology), something external that influences an activity
**Stimulus (psychology), a concept in behaviorism and perception
*Stimulus (economi ...
cannot be divorced from the visual evidence of the speaker's manner and
gestures, and the general awareness of the physical location and its possible
connotative
A connotation is a commonly understood cultural or emotional association that any given word or phrase carries, in addition to its explicit or literal meaning, which is its denotation.
A connotation is frequently described as either positive or ...
significance. Similarly, meaning that is contained in a visual form cannot be divorced from the
iconicity
In functional- cognitive linguistics, as well as in semiotics, iconicity is the conceived similarity or analogy between the form of a sign (linguistic or otherwise) and its meaning, as opposed to arbitrariness (which is typically assumed in ...
and implications of the form. If handwritten, is the writing neat or does it evidence emotion in its style. What type of paper is used, what colour ink, what kind of writing instrument: all such questions are relevant to an interpretation of the significance of what is represented. But images are distinguishable from natural language. For
Roland Barthes
Roland Gérard Barthes (; ; 12 November 1915 – 26 March 1980) was a French literary theorist, essayist, philosopher, critic, and semiotician. His work engaged in the analysis of a variety of sign systems, mainly derived from Western popula ...
(1915–80), language functions with relatively determinate meanings whereas images "say" nothing. Nevertheless, there is a
rhetoric for arranging the parts that are to signify, and an emerging, if not yet generally accepted,
syntax that articulates their parts and binds them into an effective whole. Rhetorician Thomas Rosteck defined rhetoric as “the use of language and other symbolic systems to make sense of our experiences, construct our personal and collective identities, produce meaning, and prompt action in the world".
See also
*
Denotation
*
Narrative paradigm
*
Modality (human–computer interaction)
In the context of human–computer interaction, a modality is the classification of a single independent channel of sensory input/output between a computer and a human.
A system is designated unimodal if it has only one modality implemented, and mu ...
*
Semantics
Semantics (from grc, σημαντικός ''sēmantikós'', "significant") is the study of reference, meaning, or truth. The term can be used to refer to subfields of several distinct disciplines, including philosophy, linguistics and comp ...
*
Syntactics
*
Pragmatics
In linguistics and related fields, pragmatics is the study of how context contributes to meaning. The field of study evaluates how human language is utilized in social interactions, as well as the relationship between the interpreter and the in ...
References
{{Reflist
*Barthes, Roland. ''Elements of Semiology''. (Translated by Annette Lavers & Colin Smith). London: Jonathan Cape. (
9641967)
*Barthes, Roland. "The Rhetoric of the Image" in ''Image, Music, Text'' (Translated by Stephen Heath). Hill and Wang. (1977)
*
Chandler, Daniel. (2001/2007). ''Semiotics: The Basics''. London: Routledge.
Semiotics