Dual Process Theory (moral Psychology)
   HOME

TheInfoList



OR:

Dual process theory within moral psychology is an influential theory of human
moral judgment Moral reasoning is the study of how people think about right and wrong and how they acquire and apply moral rules. It is a subdiscipline of moral psychology that overlaps with moral philosophy, and is the foundation of descriptive ethics. Des ...
that posits that human beings possess two distinct cognitive subsystems that compete in
moral reasoning Moral reasoning is the study of how people think about right and wrong and how they acquire and apply moral rules. It is a subdiscipline of moral psychology that overlaps with moral philosophy, and is the foundation of descriptive ethics. Descri ...
processes: one fast, intuitive and emotionally-driven, the other slow, requiring conscious deliberation and a higher
cognitive load In cognitive psychology, cognitive load refers to the amount of working memory resources used. There are three types of cognitive load: ''intrinsic'' cognitive load is the effort associated with a specific topic; ''extraneous'' cognitive load refe ...
. Initially proposed by Joshua Greene along with Brian Sommerville, Leigh Nystrom, John Darley, Jonathan David Cohen and others, the theory can be seen as a domain-specific example of more general dual process accounts in
psychology Psychology is the scientific study of mind and behavior. Psychology includes the study of conscious and unconscious phenomena, including feelings and thoughts. It is an academic discipline of immense scope, crossing the boundaries between ...
, such as Daniel Kahneman's "system1"/"system 2" distinction popularised in his book, ''
Thinking, Fast and Slow ''Thinking, Fast and Slow'' is a 2011 book by psychologist Daniel Kahneman. The book's main thesis is a differentiation between two modes of thought: "System 1" is fast, instinctive and emotional; "System 2" is slower, more deliberative, and mo ...
''. Greene has often emphasized the
normative Normative generally means relating to an evaluative standard. Normativity is the phenomenon in human societies of designating some actions or outcomes as good, desirable, or permissible, and others as bad, undesirable, or impermissible. A norm in ...
implications of the theory, which has started an extensive debate in
ethics Ethics or moral philosophy is a branch of philosophy that "involves systematizing, defending, and recommending concepts of right and wrong behavior".''Internet Encyclopedia of Philosophy'' The field of ethics, along with aesthetics, concer ...
. The dual-process theory has had significant influence on research in moral psychology. The original fMRI investigation proposing the dual process account has been cited in excess of 2000 scholarly articles, generating extensive use of similar methodology as well as criticism.


Core commitments

The dual-process theory of moral judgement asserts that moral decisions are the product of either one of two distinct mental processes. # The automatic-emotional process is fast and unconscious, which gives way to intuitive behaviours and judgments. The factors affecting moral judgment of this type may be consciously inaccessible. # The conscious-controlled process involves slow and deliberative reasoning. Moral judgments of this type are less influenced by the immediate emotional features of decision-making. Instead, they may draw from general knowledge and abstract moral conceptions, combined with a more controlled analysis of situational features. Following neuroscientific experiments, in which subjects were confronted with ethical dilemmas following the logic of Philippa Foot's famous
Trolley Case A suitcase is a form of luggage. It is a rectangular container with a handle typically used to carry one's clothes and other belongings while traveling. The first suitcases appeared in the late 19th century due to the increased popularity of ma ...
(see Figure 1), Joshua Greene claims that the two processes can be linked to two classes of ethical theories respectively. He calls this the Central Tension Problem: Moral judgments that can be characterised as
deontological In moral philosophy, deontological ethics or deontology (from Greek: + ) is the normative ethical theory that the morality of an action should be based on whether that action itself is right or wrong under a series of rules and principles, r ...
are preferentially supported by automatic-emotional processes and intuitions. Characteristically
utilitarian In ethical philosophy, utilitarianism is a family of normative ethical theories that prescribe actions that maximize happiness and well-being for all affected individuals. Although different varieties of utilitarianism admit different charac ...
judgments, on the other hand, seem to be supported by conscious-controlled processes and deliberative reasoning.


Camera analogy

As an illustration of his dual-process theory of moral reasoning, Greene compares the dual-process in human brains to a
digital SLR A digital single-lens reflex camera (digital SLR or DSLR) is a digital camera that combines the optics and the mechanisms of a single-lens reflex camera with a digital imaging sensor. The reflex design scheme is the primary difference between ...
camera which operates in two complementary modes: automatic and manual. A photographer can either employ the automatic "point-and-shoot" setting, which is fast and highly efficient, or adjust and refine settings in manual mode, which gives the photographer greater flexibility. Dual-process moral reasoning is an effective response to a similar efficiency-flexibility trade-off. We often rely on our "automatic settings" and allow intuitions to guide our behaviour and judgement. In "manual mode", judgments draw from both general knowledge about "how the world works" and explicit understanding of special situational features. The operations of this "manual mode" system requires effortful conscious deliberation. Greene concedes that his analogy has limited force. While a photographer can switch back-and-forth between automatic and manual mode, the automatic-intuitive processes of human reasoning are always active: conscious deliberations needs to "override" our intuitions. In addition to that, automatic settings of our brains are not necessarily "hard-wired", but can be changed through (cultural) learning.


Interaction between systems

There is lack of agreement on whether and how the two processes interact with one another. It is unclear whether deontological responders, for example, rely blindly on the intuitively cued response without any thought of utilitarian considerations or whether they recognise the alternative utilitarian response but, on consideration, decide against it. These alternative interpretations point to different models of interaction: a serial (or "default-interventionist") model, and a parallel model. Serial models assume that there is initially an exclusive focus on the intuitive system to make judgements but that this default processing might be followed by deliberative processing at a later stage. Greene et al.'s model is usually placed within this category. In contrast, in a parallel model, it is assumed that both processes are simultaneously engaged from the beginning. Models of the former category lend support to the view that humans, in an effort to minimise cognitive effort, will choose to refrain from the more demanding deliberative system where possible. Only utilitarian responders will have opted into it. This further implies that deontological responders will not experience any conflict from the "utilitarian pull" of the dilemma: they have not engaged in the processing that gives rise to these considerations in the first place. In contrast, in a parallel model both utilitarian ''and'' deontological responders will have engaged both processing systems. Deontological responders ''recognise'' that they face conflicting responses, but they do not engage in deliberative processing to a sufficient extent to enable them to override the intuitive (deontological) response. Within generic dual process research, some scientists have argued that serial and parallel models fail to capture the true nature of the interaction between dual process systems. They contend that some operations that are commonly said to belong to the deliberative system can in fact also be cued by the intuitive system and we need to think about ''hybrid'' models in light of this evidence. Hybrid models would lend support to the notion of a "utilitarian intuition" - a utilitarian response cued by the automatic, "emotion-driven" cognitive system.


Scientific evidence


Neuroimaging

Greene uses
fMRI Functional magnetic resonance imaging or functional MRI (fMRI) measures brain activity by detecting changes associated with blood flow. This technique relies on the fact that cerebral blood flow and neuronal activation are coupled. When an area ...
to evaluate the brain activities and responses of people confronted with different variants of the famous
Trolley problem The trolley problem is a series of thought experiments in ethics and psychology, involving stylized ethical dilemmas of whether to sacrifice one person to save a larger number. The series usually begins with a scenario in which a runaway tram or ...
in ethics. There are 2 versions of trolley problem. They are trolley driver dilemma and footbridge dilemma presented as follows. ''The Switch Case “You are at the wheel of a runaway trolley quickly approaching a fork in the tracks. On the tracks extending to the left is a group of five railway workmen. On the tracks extending to the right is a single railway workman. If you do nothing the trolley will proceed to the left, causing the deaths of the five workmen. The only way to avoid the deaths of these workmen is to hit a switch on your dashboard that will cause the trolley to proceed to the right, causing the death of the single workman. Is it appropriate for you to hit the switch in order to avoid the deaths of the five workmen?'' (Most people judge that it is appropriate to hit the switch in this case.) ''The Footbridge Case: “A runaway trolley is heading down the tracks toward five workmen who will be killed if the trolley proceeds on its present course. You are on a footbridge over the tracks, in between the approaching trolley and the five workmen. Next to you on this footbridge is a stranger who happens to be very large. The only way to save the lives of the five workmen is to push this stranger off the bridge and onto the tracks below where his large body will stop the trolley. The stranger will die if you do this, but the five workmen will be saved. Is it appropriate for you to push the stranger onto the tracks in order to save the five workmen?'' (Most people judge that it is not appropriate to push the stranger onto the tracks.) Greene and his colleagues carried out fMRI experiments in order to investigate which regions of the brain were activated in subjects while responding to 'personal dilemmas' such as the footbridge dilemma and 'impersonal dilemmas' such as the switch dilemma. 'Personal dilemmas' were defined as any satisfying three conditions: a) The action in question could reasonably be expected to lead to bodily harm, b) The harm is inflicted in particular persons or members of a particular group and c) The harm is not a result of diverting a previously existing threat onto another party. All other dilemmas were classed as 'impersonal'. It was observed that when responding to personal dilemmas, the subjects displayed increased activity in regions of the brain associated with emotion (the medial
Prefrontal cortex In mammalian brain anatomy, the prefrontal cortex (PFC) covers the front part of the frontal lobe of the cerebral cortex. The PFC contains the Brodmann areas BA8, BA9, BA10, BA11, BA12, BA13, BA14, BA24, BA25, BA32, BA44, BA45, BA46 ...
, the posterior Cingulate cortex/
Precuneus In neuroanatomy, the precuneus is the portion of the superior parietal lobule on the medial surface of each brain hemisphere. It is located in front of the cuneus (the upper portion of the occipital lobe). The precuneus is bounded in front by th ...
, the posterior
Superior temporal sulcus The superior temporal sulcus (STS) is the sulcus separating the superior temporal gyrus from the middle temporal gyrus in the temporal lobe of the brain. A sulcus (plural sulci) is a deep groove that curves into the largest part of the brain, ...
/
Inferior parietal lobule The inferior parietal lobule (subparietal district) lies below the horizontal portion of the intraparietal sulcus, and behind the lower part of the postcentral sulcus. Also known as Geschwind's territory after Norman Geschwind, an American neur ...
and the
Amygdala The amygdala (; plural: amygdalae or amygdalas; also '; Latin from Greek, , ', 'almond', 'tonsil') is one of two almond-shaped clusters of nuclei located deep and medially within the temporal lobes of the brain's cerebrum in complex verte ...
), while when they responded to impersonal dilemmas, they displayed increased activity in regions of the brain associated with
working memory Working memory is a cognitive system with a limited capacity that can hold information temporarily. It is important for reasoning and the guidance of decision-making and behavior. Working memory is often used synonymously with short-term memory, ...
(the
Dorsolateral prefrontal cortex The dorsolateral prefrontal cortex (DLPFC or DL-PFC) is an area in the prefrontal cortex of the primate brain. It is one of the most recently derived parts of the human brain. It undergoes a prolonged period of maturation which lasts until adultho ...
and the
Parietal lobe The parietal lobe is one of the four major lobes of the cerebral cortex in the brain of mammals. The parietal lobe is positioned above the temporal lobe and behind the frontal lobe and central sulcus. The parietal lobe integrates sensory informa ...
). In recent work, Greene has stated that the
Amygdala The amygdala (; plural: amygdalae or amygdalas; also '; Latin from Greek, , ', 'almond', 'tonsil') is one of two almond-shaped clusters of nuclei located deep and medially within the temporal lobes of the brain's cerebrum in complex verte ...
is primarily responsible for the emotional response, whilst the
Ventromedial prefrontal cortex The ventromedial prefrontal cortex (vmPFC) is a part of the prefrontal cortex in the mammalian brain. The ventral medial prefrontal is located in the frontal lobe at the bottom of the cerebral hemispheres and is implicated in the processing of r ...
is responsible for weighing up the consequentialist response against the emotional response. Thus, three brain regions are primarily implicated in the making of moral judgements. This gives way to what Greene calls the ''Central Tension Principle'': "Characteristically deontological judgements are preferentially supported by automatic emotional responses, while characteristically consequentialist judgments are preferentially supported by conscious reasoning and allied processes of cognitive control". Greene points to a large body of evidence from cognitive science suggesting that inclination to deontological or consequentialist judgment depends on whether emotional-intuitive reactions or more calculated ones were involved in the judgment-making process. For example, encouraging deliberation or removing time pressure leads to an increase in consequentialist response. Being under cognitive load while making a moral judgement decreases consequentialist responses. In contrast, solving a difficult math problem before making a moral judgement (meant to make participants more skeptical of their intuitions) increases the number of consequentialist responses. When asked to explain or justify their responses, subjects preferentially chose consequentialist principles – even for explaining characteristically deontological responses. Further evidence shows that consequentialist responses to trolley-problem-like dilemmas are associated with deficits in emotional awareness in people with alexithymia or psychopathic tendencies. On the other hand, subjects being primed to be more emotional or empathetic give more characteristically deontological answers. In addition, Greene's results show that some brain areas, such as the medial prefrontal cortex, the posterior cingulate/precuneus, the posterior superior temporal sulcus/inferior parietal lobe, and the amygdala, are associated with emotional processes. Subjects exhibited increased activity in these brain regions when presented with situations involving the use of personal force (e.g. the 'footbridge' case). The dorsolateral prefrontal cortex and the parietal lobe are 'cognitive' brain regions; subjects show increased activity in these two regions when presented with impersonal moral dilemmas. Arguments for the dual process theory relying on neuroimaging data have been criticized for their reliance on reverse inference.


Brain lesions

Neuropsychological evidence from lesion studies focusing on patients with damage to the
ventromedial prefrontal cortex The ventromedial prefrontal cortex (vmPFC) is a part of the prefrontal cortex in the mammalian brain. The ventral medial prefrontal is located in the frontal lobe at the bottom of the cerebral hemispheres and is implicated in the processing of r ...
also points to a possible dissociation between emotional and rational decision processes. Damage to this area is typically associated with antisocial personality traits and impairments of moral decision making. Patients with these lesions tend to show a more frequent endorsement of the "utilitarian" path in trolley problem dilemmas. Greene et al. claim that this shows that when emotional information is removed through context or damage to brain regions necessary to render such information, the process associated with rational, controlled reasoning dominates decision making A popular medical case, studied in particular by neuroscientist
Antonio Damasio Antonio Damasio ( pt, António Damásio) is a Portuguese-American neuroscientist. He is currently the David Dornsife Chair in Neuroscience, as well as Professor of Psychology, Philosophy, and Neurology, at the University of Southern California, ...
, was that of American railroad worker Phineas Gage. On the 13th of September 1848, while working on a railway track in
Vermont Vermont () is a state in the northeast New England region of the United States. Vermont is bordered by the states of Massachusetts to the south, New Hampshire to the east, and New York to the west, and the Canadian province of Quebec to ...
, he was involved in an accident: an "iron rod used to cram down the explosive powder shot into Gage's cheek, went through the front of his brain, and exited via the top of his head". Surprisingly, not only Gage survived, but he also went back to his normal life just in less than two months. Although his physical capacities were restored, however, his personality and his character radically changed. He became vulgar and anti-social: "Where he had once been responsible and self-controlled, now he was impulsive, capricious, and unreliable". Damasio wrote: "Gage was no longer Gage." Moreover, also his moral intuitions were transformed. Further studies by means of
neuroimaging Neuroimaging is the use of quantitative (computational) techniques to study the structure and function of the central nervous system, developed as an objective way of scientifically studying the healthy human brain in a non-invasive manner. Incr ...
showed a correlation between such "moral" and character transformations and injuries to the ventromedial prefrontal cortex. In his book '' Descartes' Error'', commenting on Phineas Gage case, Damasio said that after the accident the railroad worker was able "To know, but not to feel." As explained by David Edmonds, Joshua Greene thought that this could explain the difference in moral intuitions in different versions of the trolley problem: "We ''feel'' that we shouldn't push the fat man. But we ''think'' it better to save five rather than one life. And the feeling and the thought are distinct.”


Reaction times

Another critical piece of evidence supporting the dual process account comes from reaction time data associated with moral dilemma experiments. Subjects who choose the "utilitarian" path in moral dilemmas showed increased reaction times under high
cognitive load In cognitive psychology, cognitive load refers to the amount of working memory resources used. There are three types of cognitive load: ''intrinsic'' cognitive load is the effort associated with a specific topic; ''extraneous'' cognitive load refe ...
in "personal" dilemmas, while those choosing the "deontological" path remained unaffected. Cognitive load, in general, is also found to increase the likelihood of "deontological" judgment These laboratory findings are supplemented by work that looks at the decision-making processes of real-world altruists in life-or-death situations. These heroes overwhelming described their actions as fast, intuitive, and virtually never as carefully reasoned.


Evolutionary rationale

The
dual process theory In psychology, a dual process theory provides an account of how thought can arise in two different ways, or as a result of two different processes. Often, the two processes consist of an implicit (automatic), unconscious process and an explicit (c ...
is often given an evolutionary rationale (in this basic sense, the theory is an example of
evolutionary psychology Evolutionary psychology is a theoretical approach in psychology that examines cognition and behavior from a modern evolutionary perspective. It seeks to identify human psychological adaptations with regards to the ancestral problems they evol ...
). In pre-
Darwinian Darwinism is a theory of biological evolution developed by the English naturalist Charles Darwin (1809–1882) and others, stating that all species of organisms arise and develop through the natural selection of small, inherited variations that ...
thinking, such as Hume's
Treatise of Human Nature '' A Treatise of Human Nature: Being an Attempt to Introduce the Experimental Method of Reasoning into Moral Subjects'' (1739–40) is a book by Scottish philosopher David Hume, considered by many to be Hume's most important work and one of th ...
’ we find speculations about the origins of
morality Morality () is the differentiation of intentions, decisions and actions between those that are distinguished as proper (right) and those that are improper (wrong). Morality can be a body of standards or principles derived from a code of co ...
as deriving from natural phenomena common to all humans. For instance, he mentions the "common or natural cause of our passions" and the generation of love for others represented through self-sacrifice for the greater good of the group. Hume's work is sometimes cited as an inspiration for contemporary dual process theories. Darwin's
evolutionary theory Evolution is change in the heritable characteristics of biological populations over successive generations. These characteristics are the expressions of genes, which are passed on from parent to offspring during reproduction. Variation ...
gives a better descriptive process for how these moral norms are derived from evolutionary processes and natural selection. For example, selective pressures favour self-sacrifice for the benefit of the group and punish those who do not. This provides a better explanation of the cost-benefit ratio for the generation of love for others as originally mentioned by Hume. Another example of an evolutionarily derived
norm Naturally occurring radioactive materials (NORM) and technologically enhanced naturally occurring radioactive materials (TENORM) consist of materials, usually industrial wastes or by-products enriched with radioactive elements found in the envi ...
is
justice Justice, in its broadest sense, is the principle that people receive that which they deserve, with the interpretation of what then constitutes "deserving" being impacted upon by numerous fields, with many differing viewpoints and perspective ...
, which is born out of the ability to detect those who cheat.
Peter Singer Peter Albert David Singer (born 6 July 1946) is an Australian moral philosopher, currently the Ira W. DeCamp Professor of Bioethics at Princeton University. He specialises in applied ethics and approaches ethical issues from a Secularit ...
explains justice from the evolutionary perspective by stating the instinct of reciprocity improved fitness for survival, therefore those who did not reciprocate were considered cheaters and cast-off from the group.
Peter Singer Peter Albert David Singer (born 6 July 1946) is an Australian moral philosopher, currently the Ira W. DeCamp Professor of Bioethics at Princeton University. He specialises in applied ethics and approaches ethical issues from a Secularit ...
agrees with
Greene Greene may refer to: Places United States *Greene, Indiana, an unincorporated community *Greene, Iowa, a city *Greene, Maine, a town ** Greene (CDP), Maine, in the town of Greene *Greene (town), New York ** Greene (village), New York, in the town ...
that
consequentialist In ethical philosophy, consequentialism is a class of normative, teleological ethical theories that holds that the consequences of one's conduct are the ultimate basis for judgment about the rightness or wrongness of that conduct. Thus, from a ...
judgements are to be favored over
deontological In moral philosophy, deontological ethics or deontology (from Greek: + ) is the normative ethical theory that the morality of an action should be based on whether that action itself is right or wrong under a series of rules and principles, r ...
judgements. According to him, moral constructivism searches for reasonable grounds whereas deontological judgements rely on hasty and emotional responses. Singer argues our most immediate moral intuitions should be challenged. A normative ethic must not be evaluated by the extent to which it matches those moral intuitions. He gives the example of a brother and sister who secretly decide to have sex with each other using contraceptives. Our first intuitive reaction is a firm condemnation of
incest Incest ( ) is human sexual activity between family members or close relatives. This typically includes sexual activity between people in consanguinity (blood relations), and sometimes those related by affinity (marriage or stepfamily), adopti ...
as morally wrong. However, a consequentialist judgement brings another conclusion. As the brother and sister did not tell anyone and they used contraceptives, the incest did not have any harmful consequences. Thus, in that case, incest is not necessarily wrong.
Singer Singing is the act of creating musical sounds with the voice. A person who sings is called a singer, artist or vocalist (in jazz and/or popular music). Singers perform music (arias, recitatives, songs, etc.) that can be sung with or withou ...
relies on evolutionary theories to justify his claim. For most of our evolutionary history, human beings have lived in small groups where violence was ubiquitous. Deontological judgements linked to emotional and intuitive responses were developed by human beings as they were confronted with personal and close interactions with others. In the past century, our social organizations were altered and so these types of interactions have become less frequent. Therefore, Singer argues that we should rely on more sophisticated consequentialist judgements that fit better in our modern times than the deontological judgements that were useful for more rudimentary interactions.


Scientific criticisms

Several scientific criticisms have been leveled against the dual process account. One asserts that the dual emotional/rational
model A model is an informative representation of an object, person or system. The term originally denoted the plans of a building in late 16th-century English, and derived via French and Italian ultimately from Latin ''modulus'', a measure. Models c ...
ignores the motivational aspect of decision making in human social contexts. A more specific example of this criticism focuses on the ventromedial prefrontal cortex lesion data. Although patients with this damage display characteristically "cold-blooded" behaviour in the trolley problem, they show more likelihood of endorsement of emotionally laden choices in the
Ultimatum Game The ultimatum game is a game that has become a popular instrument of economic experiments. An early description is by Nobel laureate John Harsanyi in 1961. One player, the proposer, is endowed with a sum of money. The proposer is tasked with s ...
. It is argued that moral decisions are better understood as integrating emotional, rational, and motivational information, the last of which has been shown to involve areas of the brain in the limbic system and
brain stem The brainstem (or brain stem) is the posterior stalk-like part of the brain that connects the cerebrum with the spinal cord. In the human brain the brainstem is composed of the midbrain, the pons, and the medulla oblongata. The midbrain is co ...
.


Methodological Worries

Other criticisms focus on the methodology of using moral dilemmas such as the trolley problem. These criticisms note the lack of affective realism in contrived moral dilemmas and their tendency to use the actions of strangers to offer a view of human moral sentiments. Paul Bloom, in particular, has argued that a multitude of attitudes towards the agents involved is important in evaluating an individual's moral stance, as well as evaluating the motivations that may inform those decisions. Kahane and Shackel scrutinize the questions and dilemmas Greene et al. use, and claim that the methodology used in the neuroscientific study of intuitions needs to be improved. However, after Kahane and colleagues engineered a set of moral dilemmas specifically meant to falsify Greene's theory, their moral dilemmas turned out to confirm it instead. Berker has raised three methodological worries about Greene's empirical findings. First It is not the case that only deontological judgements are tied to cognitive processes. In fact, one region of the brain traditionally associated with the emotions – the posterior cingulate –  appears to be activated for characteristically consequentialist judgements. While it is not clear how crucial a role this region plays in moral judgements, one can argue that all moral judgements seem to involve at least some emotional processing. This would disprove the simplest version of the dual-process hypothesis. Greene responded to this argument by proposing that emotions that drive deontological judgements are "alarmlike", whereas those that are present during consequentialist judgements are "more like currency." A response which Berker regards to be without empirical backing. Berker's second methodological worry is that Greene et al.  presented the response-time data to moral dilemmas in a statistically invalid way. Rather than calculating the average difference in response time between the “appropriate” responses and “inappropriate responses for ''each'' moral dilemma, Greene et al.  calculated the average response time of the ''combined'' “appropriate” and the ''combined'' “inappropriate” responses. Because of this way of calculating, the differences from question to question significantly skewed the results, Berkner points out that some questions involved “easy” cases that should not be classified as dilemmas. This is because of the way these cases were framed, people found one of the choices to be obviously inappropriate. Third, Berker argues Greene's criteria to classify impersonal and personal moral dilemmas do not map onto the distinction of deontological and consequentialist moral judgements. It is not the case consequentialist judgements only arise if cases involve impersonal factors. Berkner highlights the “Lazy Susan Case”, where the only way to save five people who sit on a Lazy Susan is to push the lazy Susan into an innocent bystander, killing him. so that serves as a counter-example. Although this thought experiment involves personal harm, the philosopher Francis Kamm arrives at an intuitive consequentialist judgement, thinking it is permissible to kill one to save five. Notwithstanding the above, the later criticism has been considered b
Greene
More recent methodological concerns stem from new evidence suggesting that deontological inclinations are not necessarily more emotional or less rational than utilitarian inclinations. For example, cognitive reflection predicts ''both'' utilitarian and deontological inclinations, but only by dissociating these moral inclinations with a more advanced protocol that was not used in early dual process theoretic research. Further, there is evidence that utilitarian decisions are associated with more emotional regret than deontological decisions. Evidence like this complicates dual process theorists' claims that utilitarian thinking is more rational or that deontological thinking is more emotional.


Failure of the non-negotiability hypothesis

Guzmán, Barbato, Sznycer, and Cosmides pointed out that moral dilemmas were a recurrent adaptive problem for ancestral humans, whose social life created multiple responsibilities to others (siblings, parents and offspring, cooperative partners, coalitional allies, and so on). Intermediate solutions, ones that strike a balance between conflicting moral values, would have often promoted fitness better than neglecting one value to fully satisfy others. A capacity to make intermediate or “compromise” judgments would have been favored by natural selection. The dual process model, however, rules out the possibility of moral compromises. According to Greene and colleagues, people experience the footbridge problem as a dilemma because “two issociable psychologicalprocesses yield different answers to the same question”. On the one hand, System 2 outputs a utilitarian judgment: “push the bystander.” On the other hand, System 1 activates an “alarm bell” emotion: “do not harm the bystander.” Greene and colleagues claim that the prohibition to harm is “nonnegotiable”: It cannot be weighed against other values, including utilitarian considerations. They argue that “ tractable dilemmas arise when psychological systems produce outputs that are… non-negotiable because their outputs are processed as absolute demands, rather than fungible preferences.” The dual-process model predicts that subtle changes in context will cause people to flip between extreme judgments: deontic and utilitarian. Moral compromises will be infrequent “trembling hand mistakes.” Trolley problems cannot be used to test for non-negotiability, because they force extreme responses (e.g., push or do not push). So, to test the prediction, Guzmán and colleagues designed a sacrificial moral dilemma that permits compromise judgments, of the form “sacrifice ''x'' people to save ''y''”, where ''N'' > 1 people are saved for each one sacrificed. Their experimental results show that people make many compromise judgments, which respect the axioms of rational choice. These results contradict the dual-process model, which claims that only deontic judgments are the product of moral rationality. The results indicate the existence of a moral tradeoff system that weighs competing moral considerations and finds a solution that is most right, which can be a compromise judgment.


Alleged ethical implications

Greene ties the two processes to two existing classes of ethical theories in moral philosophy. He argues that the existing tension between deontological theories of ethics that focus on "right action" and utilitarian theories that focus on "best results" can be explained by the dual-process organisation of the human mind. Ethical decisions that fall under 'right action' correspond to automatic-emotional (system 1) processing, whereas 'best results' correspond to conscious-controlled reasoning (system 2). One illustration of this tension are intuitions about trolley-cases that differ across the dimension of personal force. When people are asked whether it would be right or wrong to flick a switch in order to divert a trolley from killing five people, their intuitions usually indicate that flicking the switch is the morally right choice. However, when the same scenario is presented to people, but instead of flicking a switch, subjects are asked whether they would push a fat man onto the rails in order to stop the trolley, intuitions usually have it that pushing the fat man is the wrong choice. Given that both actions lead to the saving of five people, why is one judged to be right, whereas the other one wrong? According to Greene, there is no moral justification for this difference of intuitions between the 'switch' and the 'fat man' trolley-case. Instead, what leads to such difference is the morally irrelevant fact that the 'fat man' case involves the use of personal force (thus leading most people to judge that pushing the fat man is the wrong action), whereas the 'switch' case doesn't (thus leading most people to judge that flicking the switch is the right action). Greene takes such observations as point of departure to argue that judgments produced by automatic-emotional processes lack normative force in comparison to those produced by conscious-controlled processes. Relying on automatic, emotional responses when dealing with unfamiliar moral dilemmas would mean to bank on "''cognitive miracles"''. Greene subsequently proposes that this vindicates consequentialism. He rejects deontology as a moral framework as holds that deontological theories may be reduced to "post-hoc" rationalisations of arbitrary emotional responses.


Greene's "direct route"

Greene firstly argues that scientific findings can help us reach interesting
normative Normative generally means relating to an evaluative standard. Normativity is the phenomenon in human societies of designating some actions or outcomes as good, desirable, or permissible, and others as bad, undesirable, or impermissible. A norm in ...
conclusions, without crossing the is–ought gap. For example, he considers the normative statement "capital juries make good judgements". Scientific findings could lead us to revise this judgement if it were found that capital juries were, in fact, sensitive to race if we accept the uncontroversial normative
premise A premise or premiss is a true or false statement that helps form the body of an argument, which logically leads to a true or false conclusion. A premise makes a declarative statement about its subject matter which enables a reader to either agre ...
that capital juries ought not to be sensitive to race. Greene then states that the evidence for dual-process theory might give us reason to question judgements which are based upon moral intuitions, in cases where those moral intuitions might be based upon morally irrelevant factors. He gives the example of incestuous siblings. Intuition might tell us that this is morally wrong, but Greene suggests that this intuition is the result of incest historically being evolutionary disadvantageous. However, if the siblings take extreme precautions, such as vasectomy, in order to avoid the risk of genetic mutation in their offspring, the cause of the moral intuition is no longer relevant. In such cases, scientific findings have given us reason to ignore some of our moral intuitions, and in turn revise the moral judgements which are based upon these intuitions.


Greene's "indirect route"

Greene is not making the claim that moral judgements based on emotion are categorically bad. His position is that the different “settings” are appropriate for different scenarios. With regards to automatic settings, Greene says we should only rely on these when faced with a moral problem that is sufficiently “familiar” to us. Familiarity, on Greene's conception, can arise from three sources - evolutionary history,
culture Culture () is an umbrella term which encompasses the social behavior, institutions, and norms found in human societies, as well as the knowledge, beliefs, arts, laws, customs, capabilities, and habits of the individuals in these groups ...
and personal experience. It is possible that fear of snakes, for instance, can be traced to genetic dispositions, whereas a reluctance to place one's hand on a stove is caused by previous experience on burning one's hand on a hot stove. The appropriateness of applying our intuitive and automatic mode of reasoning to a given moral problem thus hinges on how the process was formed in the first place. Shaped by trial-and-error experience, automatic settings will only function well when one has sufficient experience of the situation at hand. In light of these considerations, Greene formulates the "No Cognitive Miracles Principle": This has implications for philosophical discussion of what Greene calls "unfamiliar problems", or ethical problems ones with which we have inadequate evolutionary, cultural, or personal experience. We might have to attentively revise our intuitions for topics like
climate change In common usage, climate change describes global warming—the ongoing increase in global average temperature—and its effects on Earth's climate system. Climate change in a broader sense also includes previous long-term changes to ...
, genetic engineering, global terrorism, global poverty, etc. As Greene states, this doesn't mean that our intuitions will always be wrong, but it means we need to pay attention as to where they come from and how they fare compared to more rational argument.


Philosophical criticisms

Thomas Nagel Thomas Nagel (; born July 4, 1937) is an American philosopher. He is the University Professor of Philosophy and Law Emeritus at New York University, where he taught from 1980 to 2016. His main areas of philosophical interest are legal philosophy, ...
has argued that Joshua Greene, in his book ''Moral Tribes,'' is too quick to conclude utilitarianism specifically from the general goal of constructing an impartial morality; for example, he says,
Immanuel Kant Immanuel Kant (, , ; 22 April 1724 – 12 February 1804) was a German philosopher and one of the central Enlightenment thinkers. Born in Königsberg, Kant's comprehensive and systematic works in epistemology, metaphysics, ethics, and ...
and
John Rawls John Bordley Rawls (; February 21, 1921 – November 24, 2002) was an American moral, legal and political philosopher in the liberal tradition. Rawls received both the Schock Prize for Logic and Philosophy and the National Humanities Medal in ...
offer other impartial approaches to ethical questions. Robert Wright has called Joshua Greene's proposal for global harmony ambitious adding, "I like ambition!" But he also claims that people have a tendency to see facts in a way that serves their
ingroup In sociology and social psychology, an in-group is a social group to which a person psychologically identifies as being a member. By contrast, an out-group is a social group with which an individual does not identify. People may for example ide ...
, even if there's no disagreement about the underlying moral principles that govern the disputes. "If indeed we're wired for tribalism," Wright explains, "then maybe much of the problem has less to do with differing moral visions than with the simple fact that my tribe is my tribe and your tribe is your tribe. Both Greene and Paul Bloom cite studies in which people were randomly divided into two groups and immediately favored members of their own group in allocating resources -- even when they knew the assignment was random." Instead, Wright proposes that "nourishing the seeds of enlightenment indigenous to the world's tribes is a better bet than trying to convert all the tribes to utilitarianism -- both more likely to succeed, and more effective if it does."


Berker's criticisms

In a widely cited critique of Greene's work and the philosophical implications of the dual process theory, Harvard philosophy professo
Selim Berker
critically analyzed four arguments that might be inferred from Greene and Singer's conclusion. He labels three of them as merely rhetoric or "bad arguments", and the last one as "the argument from irrelevant factors". According to Berker, all of them are
fallacious A fallacy is the use of invalid or otherwise faulty reasoning, or "wrong moves," in the construction of an argument which may appear stronger than it really is if the fallacy is not spotted. The term in the Western intellectual tradition was intr ...
.


Three bad arguments

While the three bad arguments identified by Berker are not explicitly made by Greene and Singer, Berker considers them as implicit in their reasoning. The first is the “Emotions Bad, Reasoning Good” argument. According to it, our
deontological In moral philosophy, deontological ethics or deontology (from Greek: + ) is the normative ethical theory that the morality of an action should be based on whether that action itself is right or wrong under a series of rules and principles, r ...
intuitions are driven by emotions, while
consequentialist In ethical philosophy, consequentialism is a class of normative, teleological ethical theories that holds that the consequences of one's conduct are the ultimate basis for judgment about the rightness or wrongness of that conduct. Thus, from a ...
intuitions imply abstract reasoning. Therefore, deontological intuitions don't have any normative force, whereas consequentialist intuitions do. Berker claims that this is question begging for two reasons. First, because there is no support for the claim that emotionally driven intuitions are less reliable than those guided by reason. Secondly, because the argument seems to rely on the assumption that deontological intuitions involve ''only'' emotional processes whereas consequentialist intuitions involve ''only'' abstract reasoning. For Berker, this assumption also lacks
empirical evidence Empirical evidence for a proposition is evidence, i.e. what supports or counters this proposition, that is constituted by or accessible to sense experience or experimental procedure. Empirical evidence is of central importance to the sciences ...
. As a matter of fact, Greene's research itself shows that consequentialist responses to personal moral dilemmas involve at least one brain region - the ''
posterior cingulate The posterior cingulate cortex (PCC) is the caudal part of the cingulate cortex, located posterior to the anterior cingulate cortex. This is the upper part of the " limbic lobe". The cingulate cortex is made up of an area around the midline of th ...
-'' that is associated with emotional processes. Hence, the claim that deontological judgements are less reliable than consequentialist judgements because they are influenced by emotions cannot be justified. The second bad argument presented by Berker is “The Argument from
Heuristic A heuristic (; ), or heuristic technique, is any approach to problem solving or self-discovery that employs a practical method that is not guaranteed to be optimal, perfect, or rational, but is nevertheless sufficient for reaching an immediate ...
s”, which is an improved version of the "Emotions Bad, Reasoning Good" argument. It is claimed that emotion-driven processes tend to involve fast heuristics, which makes them unreliable. It follows that deontological intuitions, being an emotional form or reasoning themselves, should not be trusted. According to Berker this line of thought is also flawed. This is so because forms of reasoning that consist in heuristics are usually those in which we have a clear notion of what is right and wrong. Hence, in the moral domain, where these notions are highly disputed, "it is question begging to assume that the emotional processes underwriting deontological intuitions consist in heuristics". Berker also challenges the very assumption that heuristics lead to unreliable judgements. Additionally, he argues that, as far as we know, consequentialist judgements may also rely on heuristics, given that it is highly unlikely that they could always be the product of accurate and comprehensive mental calculations of all the possible outcomes. The third bad argument is “The Argument from Evolutionary History”. It draws on the idea that our different moral responses towards personal and impersonal harms are evolutionarily based. In fact, since personal violence has been known since ancient age, human developed emotional responses as innate ''alarm systems'' in order to adapt, handle and promptly respond to such situations of violence within their groups. Cases of impersonal violence, instead, do not raise the same innate alarm and therefore they leave room for more accurate and analytical judgement of the situation. Thus, according to this argument, unlike consequentialist intuitions, emotion-based deontological intuitions are the side effects of this evolutionary adaption to the pre-existing environment. Therefore, “deontological intuitions, unlike consequentialist intuitions, do not have any normative force". Berker states that this is an incorrect conclusion because there is no reason to think that consequentialist intuitions are not also by-products of evolution. Moreover, he argues that the invitation, advanced by Singer, to separate evolutionary-based moral judgements (allegedly unreliable) from those that are based on reason, is misleading because it is based on a
false dichotomy A false dilemma, also referred to as false dichotomy or false binary, is an informal fallacy based on a premise that erroneously limits what options are available. The source of the fallacy lies not in an invalid form of inference but in a false ...
.


The Argument from Morally Irrelevant Factors

Berker argued that the most promising argument from neural "is" to moral "ought" is the following.
“P1. The emotional processing that gives rise to deontological intuitions responds to factors that make a dilemma personal rather than impersonal. P2. The factors that make a dilemma personal rather than impersonal are morally irrelevant. C1. So, the emotional processing that gives rise to deontological intuitions responds to factors that are morally irrelevant. C2. So, deontological intuitions, unlike consequentialist intuitions, do not have any genuine normative force.”
Berker criticises both premises and the move from C1 to C2. Regarding P1, Berker is not convinced that deontological judgments are correctly characterized as merely appealing to factors that make the dilemma personal. For example, Kamm's 'Lazy Susan' trolley case is an example of a 'personal' dilemma which elicits a characteristically ''consequentialist'' response. Regarding P2, he argues that factors that make a dilemma personal or impersonal are not necessarily morally irrelevant. Moreover, he adds, P2 is 'armchair philosophizing': it cannot be deduced from neuroscientific results that the closeness of a dilemma is bears on its ''moral'' relevance. Eventually, Berker concludes that even if we accept P1 and P2, C1 doesn't necessarily entail C2. This is because it may be the case that consequentialist intuitions ''also'' respond to morally irrelevant factors. Unless we can show that this is not the case, the inference from C1 to C2 is invalid.


Intuition as wisdom

Many philosophers appeal to what is colloquially known as the yuck factor, or the belief that a widespread common negative intuition towards something is evidence that there is something morally wrong about it. This opposes Greene's conclusion that intuitions should not be expected to "perform well" or give us good ethical reasoning for some ethical problems.
Leon Kass Leon Richard Kass (born February 12, 1939) is an American physician, scientist, educator, and public intellectual. Kass is best known as a proponent of liberal arts education via the "Great Books," as a critic of human cloning, life extension, eut ...
's ''Wisdom of Repugnance'' presents a prime example of a feelings-based response to an
ethical dilemma In philosophy, ethical dilemmas, also called ethical paradoxes or moral dilemmas, are situations in which an agent stands under two (or more) ''conflicting moral requirements'', none of which ''overrides'' the other. A closely related definition c ...
. Kass attempts to make a case against human cloning on the basis of the widespread strong feelings of repugnance at cloning. He lists examples of the various unpalatable consequences of cloning and appeals to notions of
human nature Human nature is a concept that denotes the fundamental dispositions and characteristics—including ways of thinking, feeling, and acting—that humans are said to have naturally. The term is often used to denote the essence of humankind, or ...
and
dignity Dignity is the right of a person to be valued and respected for their own sake, and to be treated ethically. It is of significance in morality, ethics, law and politics as an extension of the Enlightenment-era concepts of inherent, inalienable ...
to show that our disgust is the emotional expression of deep wisdom that is not fully articulable. There is a widespread debate on the role of moral emotions, such as
guilt Guilt may refer to: *Guilt (emotion), an emotion that occurs when a person feels that they have violated a moral standard *Culpability, a legal term *Guilt (law), a legal term Music * ''Guilt'' (album), a 2009 album by Mims * "Guilt" (The Long Bl ...
or
empathy Empathy is the capacity to understand or feel what another person is experiencing from within their frame of reference, that is, the capacity to place oneself in another's position. Definitions of empathy encompass a broad range of social, co ...
and their role in philosophy, and intuitions' relationship to them.


The role of empathy

In particular, the role of empathy in morality has recently been heavily criticized by commentators such as Jess Prinz, who describes it as "prone to biases that render moral judgment potentially harmful.” Similarly Paul Bloom, author of 'Against Empathy'': The Case for Rational Compassion''' labels empathy as ''"narrow-minded, parochial, and innumerate",'' primarily due to the deleterious effects that can arise when entrusting emotional, un-reasoned responses to tackling complex ethical issues, which can only be adequately addressed via rationality and reflection. An example of this is 'The Identifiable victim effect', where subjects exhibit a much stronger emotional reaction to the suffering of a ''known'' victim, as opposed to the weaker emotional response experienced when responding to the suffering of a large-scale, anonymous group (even though the benefit conferred by the subject would be of equal utility in both cases). This exemplifies the potential for empathy to 'misfire' and motivates the widely shared consensus in the moral enhancement debate that more is required than the amplification of certain emotions. Increasing an agent's empathy by artificially raising oxytocin levels will likely be ineffective in improving their overall moral agency, because such a disposition relies heavily on psychological, social and situational contexts, as well as their deeply held convictions and beliefs. Rather, "it is likely that augmenting higher-order capacities to ''modulate'' one's moral responses in a flexible, reason-sensitive, and context-dependent way would be a more reliable, and in most cases more desirable, means to agential moral enhancement."


References

{{Reflist Moral psychology Psychological theories