Cloze Deletions
   HOME

TheInfoList



OR:

A cloze test (also cloze deletion test or occlusion test) is an exercise, test, or assessment consisting of a portion of
language Language is a structured system of communication. The structure of a language is its grammar and the free components are its vocabulary. Languages are the primary means by which humans communicate, and may be conveyed through a variety of ...
with certain items, words, or signs removed (cloze text), where the participant is asked to replace the missing language item. Cloze tests require the ability to understand the context and
vocabulary A vocabulary is a set of familiar words within a person's language. A vocabulary, usually developed with age, serves as a useful and fundamental tool for communication and acquiring knowledge. Acquiring an extensive vocabulary is one of the la ...
in order to identify the correct language or part of speech that belongs in the deleted passages. This exercise is commonly administered for the assessment of native and second
language learning Language acquisition is the process by which humans acquire the capacity to perceive and comprehend language (in other words, gain the ability to be aware of language and to understand it), as well as to produce and use words and sentences to ...
and instruction. The word ''
cloze A cloze test (also cloze deletion test or occlusion test) is an exercise, test, or assessment consisting of a portion of language with certain items, words, or signs removed (cloze text), where the participant is asked to replace the missing la ...
'' is derived from ''closure'' in
Gestalt theory Gestalt may refer to: Psychology * Gestalt psychology, a school of psychology * Gestalt therapy, a form of psychotherapy * Bender Visual-Motor Gestalt Test, an assessment of development disorders * Gestalt Practice, a practice of self-exploration ...
. The exercise was first described by W. L. Taylor in 1953. Words may be deleted from the text in question either mechanically (every nth word) or selectively, depending on exactly what aspect it is intended to test for. The methodology is the subject of extensive academic literature; nonetheless, teachers commonly devise ad hoc tests.


Examples

A language teacher may give the following passage to students: Students would then be required to fill in the blanks with words that would best complete the passage. The context in language and content terms is essential in most, if not all, cloze tests. The first blank is preceded by "the"; therefore, a
noun A noun () is a word that generally functions as the name of a specific object or set of objects, such as living creatures, places, actions, qualities, states of existence, or ideas.Example nouns for: * Living creatures (including people, alive, ...
, an
adjective In linguistics, an adjective (abbreviated ) is a word that generally modifies a noun or noun phrase or describes its referent. Its semantic role is to change information given by the noun. Traditionally, adjectives were considered one of the ma ...
or an
adverb An adverb is a word or an expression that generally modifies a verb, adjective, another adverb, determiner, clause, preposition, or sentence. Adverbs typically express manner, place, time, frequency, degree, level of certainty, etc., answering ...
must follow. However, a
conjunction Conjunction may refer to: * Conjunction (grammar), a part of speech * Logical conjunction, a mathematical operator ** Conjunction introduction, a rule of inference of propositional logic * Conjunction (astronomy), in which two astronomical bodies ...
follows the blank; the sentence would not be grammatically correct if anything other than a noun was in the blank. The words "milk and eggs" are important for deciding which noun to put in the blank; "supermarket" is a possible answer; depending on the student, however, the first blank could be store, supermarket,
shop Shop or shopping refers to: Business and commerce * A casual word for a commercial establishment or for a place of business * Machine shop, a workshop for machining *"In the shop", referring to a car being at an automotive repair shop *A wood ...
, shops,
market Market is a term used to describe concepts such as: *Market (economics), system in which parties engage in transactions according to supply and demand *Market economy *Marketplace, a physical marketplace or public market Geography *Märket, an ...
, or
grocer A grocery store ( AE), grocery shop ( BE) or simply grocery is a store that primarily retails a general range of food products, which may be fresh or packaged. In everyday U.S. usage, however, "grocery store" is a synonym for supermarket, a ...
while
umbrella An umbrella or parasol is a folding canopy supported by wooden or metal ribs that is usually mounted on a wooden, metal, or plastic pole. It is designed to protect a person against rain or sunlight. The term ''umbrella'' is traditionally use ...
, brolly or
raincoat A raincoat is a waterproof or water-resistant garment worn on the upper body to shield the wearer from rain. The term rain jacket is sometimes used to refer to raincoats with long sleeves that are waist-length. A rain jacket may be combined with ...
could fit the second. A possible completed passage would be: Besides use for testing linguistic fluency, a cloze test may also be used for testing factual knowledge, for example:
________ is the anaerobic catabolism of glucose.
Possible answers would then include
lactic acid fermentation Lactic acid fermentation is a metabolic process by which glucose or other six-carbon sugars (also, disaccharides of six-carbon sugars, e.g. sucrose or lactose) are converted into cellular energy and the metabolite lactate, which is lactic acid i ...
, anaerobic glycolysis, and
anaerobic respiration Anaerobic respiration is respiration using electron acceptors other than molecular oxygen (O2). Although oxygen is not the final electron acceptor, the process still uses a respiratory electron transport chain. In aerobic organisms undergoing r ...
.


Assessment

The definition of success in a given cloze test varies, depending on the broader goals behind the exercise. Assessment may depend on whether the exercise is objective (i.e. students are given a list of words to use in a cloze) or subjective (i.e. students are to fill in a cloze with words that would make a given sentence grammatically correct). Given the above passage, students' answers may then vary depending on their vocabulary skills and their personal opinions. However, the placement of the blank at the end of the sentence restricts the possible words that may complete the sentence; following an adverb and finishing the sentence, the word is most likely an adjective. Romantic,
chivalrous Chivalry, or the chivalric code, is an informal and varying code of conduct developed in Europe between 1170 and 1220. It was associated with the medieval Christian institution of knighthood; knights' and gentlemen's behaviours were governed by ...
or gallant may, for example, occupy the blank, as well as
fool Fool, The Fool, or Fools may refer to: *A jester, also called a ''fool'', a type of historical entertainer known for their witty jokes *An insult referring to someone of low intelligence or easy gullibility Arts, entertainment and media Fictio ...
ish or cheesy. Using those answers, a teacher may ask students to reflect on the opinions drawn from the given cloze. Recent research using eye-tracking has posited that cloze/gapfill items where a selection of words are given as options may be testing different kinds of reading skills depending on the language abilities of the participants taking the test. Lower ability test takers are suggested to be more likely to be concentrating on the information contained in the words immediately surrounding the gap, while higher ability test takers are thought to be able to use more global information in their selection of a word to fit the gap. A number of the methodological problems pointed out by researchers regarding the open-ended type cloze item (readers must supply a correct word from long-term memory, how to score acceptable responses that are not the exact replacement, etc.) can be solved by the use of carefully designed multiple-choice cloze items. Se
sample test
an
practice activity
from a pilot study in a rural Latin American community. Mostow and associates also showed how this approach is both practical and informative.


Implementation

In addition to the usage in testing, cloze deletion can be used in learning, particularly
language learning Language acquisition is the process by which humans acquire the capacity to perceive and comprehend language (in other words, gain the ability to be aware of language and to understand it), as well as to produce and use words and sentences to ...
, but also learning facts. This may be done manually – for example, by covering sections of a text with paper, or highlighting sections of text with a highlighter, then covering the line with a colored ruler in the complementary color (say, a red ruler for a green highlighter) so the highlighted text disappears; this is popular in Japan, for instance . Cloze deletion can also be used as part of
spaced repetition Spaced repetition is an evidence-based learning technique that is usually performed with flashcards. Newly introduced and more difficult flashcards are shown more frequently, while older and less difficult flashcards are shown less frequently i ...
software. For example the
SuperMemo SuperMemo (from "Super Memory") is a learning method and software package developed by SuperMemo World and SuperMemo R&D with Piotr Woźniak in Poland from 1985 to the present. It is based on research into long-term memory, and is a practical ...
and Anki applications feature semi-automated creation of cloze tests. Cloze deletion can also be applied to a
graphic organizer A graphic organizer, also known as a knowledge map, concept map, story map, cognitive organizer, advance organizer, or concept diagram is a pedagogical tool that uses visual symbols to express knowledge and concepts through relationships between the ...
, wherein a diagram, map, grid, or image is presented and contextual clues must be used to fill in some labels. In particular, when learning an image-heavy subject, such as anatomy, a user of Anki may employ an ''image occlusion'' to occlude parts of an image.


Comparison to other testing methodologies

Glover, 1989 compared different forms of recall and their effectiveness after time passed for forgetting to occur. Glover referred to cloze tests as ''cued recall,'' which was found to be less effective than free recall testing (generic cue was given to pupil, the pupil was expected to recall all they knew), but more effective than recognition tests.


Natural language processing

Cloze test is often used as an evaluation task in natural language processing (NLP) to assess the performance of the trained
language models A language model is a probability distribution over sequences of words. Given any sequence of words of length , a language model assigns a probability P(w_1,\ldots,w_m) to the whole sequence. Language models generate probabilities by training on ...
. The tasks have a few different variants, like predicting the answer for the blank with and without providing the right options, predicting the ending sentence of a story or passage, etc.


See also

*
Communicative competence The concept of communicative competence, as developed in linguistics, originated in response to perceived inadequacy of the notion of linguistic competence. That is, communicative competence encompasses a language user's grammatical knowledge of sy ...
*
English language learning and teaching English-Language Learner (often abbreviated as ELL) is a term used in some English-speaking countries such as the US and Canada to describe a person who is learning the English language and has a native language that is not English. Some educatio ...
*
Form letter A form letter is a letter written from a template, rather than being specially composed for a specific recipient. The most general kind of form letter consists of one or more regions of boilerplate text interspersed with one or more substitution p ...
*
Mad Libs Mad Libs is a phrasal template word game created by Leonard Stern and Roger Price. It consists of one player prompting others for a list of words to substitute for blanks in a story before reading aloud. The game is frequently played as a par ...
* Sentence completion tests


References


More Information

* *{{cite journal , last1=McCray , first1=Gareth, last2=Brunfaut , first2=Tineke, date = November 2016 , title=Investigating the Construct Measured by Banked Gap-fill Items: Evidence from Eye-tracking, journal=Language Testing, volume=35, pages=51–73, doi=10.1177/0265532216677105, doi-access=free Language assessment