Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business...
-
Upload
rudolf-sullivan -
Category
Documents
-
view
216 -
download
0
Transcript of Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business...
![Page 1: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/1.jpg)
Blinking on the Bench: How Judges Make Decisions
Jeffrey J. Rachlinski
Cornell Law School
Business Litigation Section,
Dallas Bar Association
April 12, 2011
![Page 2: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/2.jpg)
My Thesis
• Judges rely on simple rules of thumb that produce intuitions about how to decide cases
• These intuitions can be accurate, but often lead to error
• Accurate judging requires that judges engage in a deliberative assessment of the cases before them
![Page 3: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/3.jpg)
Compare: Psychology of Judgment and Choice
• System 1 -- intuitive, associative, affective, rapid judgment– Legal Realism?
• System 2 -- deliberative, rule-based, calculating, mathematical, deductive, slow judgment– Legal Formalism?
![Page 4: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/4.jpg)
Judging: Generally and in the Courtroom
• In ordinary life, people must use both System 1 and System 2– But System 1 is faster, and a bit less conscious– Knowing when to suppress intuition is essential
to sound judgment
• Why would judgments made in the courtroom be any different?
![Page 5: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/5.jpg)
Our Research Program
• Over 3,000 trial judges & 400 lawyers
• Participating in judicial education conferences
• Hypothetical questions
![Page 6: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/6.jpg)
Are Judges Different? The Cognitive-Reflection Test
• Frederick & Kahnman (2002)
• 3 questions
• Participants asked to answer them “as best as you can”
![Page 7: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/7.jpg)
CRT: Question #1
• A bat and a ball together cost $1.10. The bat costs $1.00 more than the ball. How much does the ball cost?
Intuition: 10 ¢
Answer: 5 ¢
![Page 8: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/8.jpg)
CRT: Question #2
• If it takes 5 machines 5 minutes to make 5 widgets, how long would it take 100 machines to make 100 widgets?
Intuition: 100 minutes
Answer: 5 minutes
![Page 9: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/9.jpg)
CRT: Question #3
• In a lake, there is a patch of lily pads. Every day the patch doubles in size. If it takes 48 days for the patch to cover the entire lake, how long would it take for the patch to cover half of the lake?
Intuition: 24 days
Answer: 47 days
![Page 10: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/10.jpg)
CRT: Three Basic Findings
1. Even though the questions are not difficult, most people get most of them wrong.
2. The wrong answer most commonly chosen tends to be the intuitive one
3. Those who get a problem wrong tend to think it an easier problem than those who get it right
![Page 11: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/11.jpg)
CRT & Judges: Would they Perform Differently?
• Maybe judges are, by nature, System 2 people– Such as engineering students
• 300 trial judges in Florida
![Page 12: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/12.jpg)
CRT Results in Judges
1. Judges got most of the questions wrong:-Average score 1.23 out of 3.00
2. The most common wrong answers were the intuitive ones
-chosen by 97%, 60% & 58% of the judges
3. Judges who chose the intuitive answer thought the problem was easier
-e.g., 90% v 66% on question #1.
![Page 13: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/13.jpg)
Judges Versus Others on CRT
MIT students 2.18
Carnegie Mellon students 1.51
Harvard students 1.43
Florida trial judges 1.23
Web-based participants 1.10
---- State appellate judges 0.95
M----- State students 0.79
![Page 14: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/14.jpg)
The (Unfortunate) Headline:
“Judges Flunk Math Test”-American Bar Association Journal
![Page 15: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/15.jpg)
Judges’ Responses
• “SO WHO CARES about widgets?? What does this have to do with “who gets custody of a child”
• “These questions have nothing to do with making decisions.”
![Page 16: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/16.jpg)
Can Intuition Lead Judges Astray in Legal Settings?
1. Exemplar Cuing
2. Anchoring
3. Consistency seeking
4. Confirmation Bias
![Page 17: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/17.jpg)
1. Exemplar Cuing
Context highlights different aspects of a fact pattern
![Page 18: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/18.jpg)
“Jellybean Phenomenon”
• Suppose I’ll give you $20 if you draw a red jellybean from an urn filled with red and white jellybeans
![Page 19: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/19.jpg)
Choice of Two Urns
Urn #1: 1 red 9 white Urn #2: 10 red 90 white
![Page 20: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/20.jpg)
Civil Commitment & Judges-Monahan & Silver 2003
• Standard: danger to self or others• Description of a mentally disturbed patient
• What threshold risk of violence would justify a civil commitment?– Using two different (but identical) scales:
• % chance of a violent act• n/100 people like this commit a violent act
![Page 21: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/21.jpg)
Civil Commitment: Format Variations
Risk of violence (in %) :
1% 8% 26% 56% 76%
Risk of violence (n/100):
1 8 26 56 76
![Page 22: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/22.jpg)
Sentencing Problem
• 136 Trial Judges at National Conference in US
• Criminal sentencing decision
• Defendant stabbed victim to death after victim taunted him about fiance
• Defendant is guilty of voluntary manslaughter
• Without regard to your jurisdiction, what is the appropriate sentence?
![Page 23: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/23.jpg)
Sentencing Format Variation
______/Years
______/Months
![Page 24: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/24.jpg)
Average Sentencing by Format
10 9 8 7 6 5 4 3 2 1 0
12010896847260483624120
Years Months
![Page 25: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/25.jpg)
2. Anchoring
The tendency to base numeric estimates on numeric reference points, even when the reference points are random
![Page 26: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/26.jpg)
Anchoring: An Example
• What is the average price of a textbook in the campus bookstore?
• Before you answer, is it more or less than $103,471
![Page 27: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/27.jpg)
Anchoring in Judges
• Civil rights violation • Defendant is a public-sector employee• Plaintiff is a secretary• Supervisor calls her racial epithets and ridicules
her ancestry in front of co-workers and her daughter
• Plaintiff finds other position, but City human rights commission brings case on her behalf
• Only damages are for “mental anguish”
![Page 28: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/28.jpg)
The Anchor
• No Anchor—Plaintiff asserts that she recently saw a case similar to hers on a “court television show where the plaintiff received a compensatory damage award for mental anguish.”
• Anchor—Plaintiff asserts that she recently saw a case similar to hers on a “court television show where the plaintiff received a compensatory damage award of $415,300 for mental anguish.”
![Page 29: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/29.jpg)
Irrelevant Anchor: Results(Median Award, in $ thousand)
0
10
20
30
40
50
60
70
No Anchor
Anchor
![Page 30: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/30.jpg)
Irrelevant Anchor #2:Personal Injury Suit (large)
(Median Award, in $ thousand)
0
400
500
600
700
800
900
1,000
No Anchor
Anchor ($75k)
![Page 31: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/31.jpg)
Irrelevant Anchor #3: Personal Injury Suit (small)
(Median Award, in $ thousand)
0
40
50
60
70
80
90
100
No Anchor
Anchor ($332k)
![Page 32: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/32.jpg)
Irrelevant Anchor #4:Sentencing Order
• Military trial judges sentencing 2 defendants– Threatening with an unloaded weapon (3 years)– Voluntary manslaughter (15 years)
• Order of sentencing varied– Half sentenced “threat” then “manslaughter”– Half sentenced “manslaughter” then “threat”
• 75% of appellate judges stated order has no effect
![Page 33: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/33.jpg)
Sentencing (Threat): Results(average sentence in years)
![Page 34: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/34.jpg)
Sentencing (Manslaughter): Results(average sentence in years)
![Page 35: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/35.jpg)
3. Consistency Seeking
• The tendency to see the facts and law in ways that are consistent (even when they need not be consistent)
![Page 36: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/36.jpg)
Immigration Case
• Defendant, a Peruvian citizen, pled guilty to using a false identification document, a misdemeanor- Forged U.S. entry visa was pasted into genuine
Peruvian passport• Two different reasons for attempting to enter United States
illegally, either- Father: find a job to pay for daughter’s liver transplant- Killer: track down a rogue member of a cartel who
had stolen drug proceeds
![Page 37: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/37.jpg)
Immigration Case
• Legal issue of first impression: does pasting a forged U.S. entry visa into a genuine foreign passport constitute “forgery of an identification card”
• If so, 6 months in prison (deportation follows either way)
![Page 38: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/38.jpg)
Consistency Seeking: Results% finding against defendant?
![Page 39: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/39.jpg)
Consistency Seeking in New Judges% finding against defendant?
![Page 40: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/40.jpg)
4. Confirmation Bias
• Tendency to seek information that is consistent with a hypothesis—even when that information is logically irrelevant to that hypothesis
![Page 41: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/41.jpg)
Card-Selection Problem
• “If there is a vowel on one side of the card, then there is an even number on the other side.”
E P 4 7
•Which one(s) must you turn over to test the hypothesis?
X X
![Page 42: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/42.jpg)
Logical Problem• “If there is a vowel on one side of the card, then there is an even
number on the other side.” • 4 cards:
– 1: the letter “E” on one side and the number ___ on the other– 2: the letter “P” on one side and the number ___ on the other– 3: the number “4” on one side and the letter ___ on the other– 4: the number “7” on one side and the letter ___ on the other
• Which one(s) must you turn over?
![Page 43: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/43.jpg)
Gender Discrimination Problem• “male supervisors only promote male employees”• 4 people:
– 1: a male supervisor who recently promoted a ___ employee
– 2: a female supervisor who recently promoted a ___ employee
– 3: a male employee who was recently promoted by a ___ supervisor
– 4: a female employee who was recently promoted by a ___ supervisor
• Which one(s) must you identify?
![Page 44: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/44.jpg)
Logical/Discrimination Problem: Previous Results
(% Correct)
• Logical Problem: 9% correct
• Discrimination Problem: 14% correct
![Page 45: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/45.jpg)
Addendum: What About Lawyers?
• “Decision makers often pursue non-instrumental information—information that appears relevant but, if simply available, would have no impact on choice. Once they pursue such information, people then use it to make their decision.”– Bastardi & Shafir, 1998
![Page 46: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/46.jpg)
Useless Information: Materials
• Plaintiff is a worker in auto-assembly plant• Injured by defendant’s robotic welding unit• Serious facial scaring• Defendant offers to settle for $400,000• Plaintiff feels it is low, but reluctant to take risks• Government safety report on cause of the accident
![Page 47: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/47.jpg)
The “Useless” Information
• Simple version– Government report blames the manufacturer,
rather than the worker– Settle for $400,000?
• 2-Stage version– Report is not out yet—should you wait?– If wait, told that it blames manufacturer—
should you settle?
![Page 48: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/48.jpg)
Useless Information: Results
• Simple version: 62% settle– The report is irrelevant to this group
• 2-Stage version: 55% wait for report
• Once report is out: 23% settle
![Page 49: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/49.jpg)
Conclusions
• Intuitive thinking can lead judges astray, even in legal contexts in which they are expert
• Mechanisms to engage the slower, deliberative system are essential to quality judicial decision making
![Page 50: Blinking on the Bench: How Judges Make Decisions Jeffrey J. Rachlinski Cornell Law School Business Litigation Section, Dallas Bar Association April 12,](https://reader036.fdocuments.in/reader036/viewer/2022062409/56649de65503460f94ade622/html5/thumbnails/50.jpg)
“When all is said and done, we must face the fact that judges are human.”
-Jerome Frank, 1949