FIREARMS & TOOLMARK IDENTIFICATION
Transcript of FIREARMS & TOOLMARK IDENTIFICATION
![Page 1: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/1.jpg)
FIREARMS & TOOLMARKIDENTIFICATION:
FORENSIC PATTERN MATCHING PRACTICES
F O R D H A M C L E – M A R C H 2 3 , 2 0 1 8P R E S E N T E R S : DA N A D E S & S U S A N N A D E L A PAVA
aka “This NYPD
Detective is Not An
Expert in Anything”
aka “How to Try a
Toolmark Case”
![Page 2: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/2.jpg)
WHAT CASES WILL HAVE TOOLMARK EVIDENCE?
•A shooting
•Gun
•Shell casings or spent bullets or bullet fragments
•Any case where a firearm is discharged or someone is shot or fired at, start to think that toolmark may come into play
![Page 3: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/3.jpg)
WHAT DOES IT ENTAIL?
Ballistics comparison at the NYPD lab
Ballistics comparison paperwork packet
Testimony at trial by NYPD Detective
Will claim to be expert in “firearm identification and microscopic comparison”
![Page 4: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/4.jpg)
“REASONABLE DEGREE OF SCIENTIFIC CERTAINTY”
![Page 5: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/5.jpg)
ROADMAP – WHAT TO DO
Try and keep it out (Frye Motion & Citywide Challenge)Keep it out
If it comes in, try and severely limit it (language, scope)Limit
If it comes in, completely discredit itDiscredit
Thematically debunk the “science” at each stage, voir dire, openings, X, etc.Debunk
![Page 6: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/6.jpg)
DEMYSTIFY THE “SCIENCE”
•Scientific Foundations of Forensic Feature-Comparison Methods:
There are NONE
•It is “scientifically indefensible”
![Page 7: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/7.jpg)
TRIBOLOGY
The science and engineering of friction, lubrication, and wear, of materials (generally metals) in contact and in relative motion.
![Page 8: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/8.jpg)
NYPD APPROACH
Ballistics lab
Detectives from the Firearm Analysis Section
AFTE (Association of Firearm and Toolmark Examiners)
Will claim to be experts in microscopically comparing ballistics evidence
![Page 9: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/9.jpg)
NYPD FIREARM EXAMINER TRAINING PROGRAM(FROM DETECTIVE PARLO - BROOKLYN)
25 months
Formal and informal lectures
Practical exercises
Training assignments
Job training with senior examiners
![Page 10: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/10.jpg)
BROOKLYN EXAMPLE – FIREARMS ANALYSIS SECTION
3 different Detectives handle Kings County shooting cases, 2 in every other borough
Example - Detective Matthew Parlo: 18 years NYPD
8 years firearms examiner
As of 2016 , qualified 140 times (never denied expert status)
Has tested 2000 firearms
“thousands” of microscopic exams”
Degree from SUNY Farmingdale – Applied Science Degree in Computer Information Systems and Technology (“vocational degree?” “correct”)
No publications
Claims to have been involved in validation studies
Dan’s X about validation studies v. proficiency exams
![Page 11: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/11.jpg)
BASICS OF FIREARM EXAMINATIONS
Examiners use 2 characteristics: Striations (aka “striae”)
Impressions
NYPD Detectives will claim “the markings left on the shells are UNIQUE to that firearm”
![Page 12: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/12.jpg)
BASICS OF FIREARM EXAMINATIONS
Class characteristics – when manufactured (p. 188 Ades X – Parlo’s gibberish) Barrel – 5 lands and groves
Individual characteristics Experts cannot even agree on what you need for individualizations
East Coast standard = 3-5 “matching” striae
West Coast = 6, or two pairs of 3 “consecutively matching” striae
![Page 13: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/13.jpg)
MICROSCOPY
![Page 14: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/14.jpg)
MICROSCOPY
60k side by side microscope (“comparison microscope”)
Connected by an optical bridge
View objects side by side
![Page 15: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/15.jpg)
MICROSCOPY
Leeds Firearms and Toolmarks Comparison Microscope (LCF)
![Page 16: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/16.jpg)
THE -OSCOPY IS FOR SCIENCE
![Page 17: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/17.jpg)
BRIEF PRIMER ON FIREARMS / TOOLMARK
GUN
BULLET
![Page 18: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/18.jpg)
GUN PARTSNote:
barrel, slide, ejection port, main
spring, breech face, extractor
![Page 19: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/19.jpg)
![Page 20: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/20.jpg)
THREE MARKS
Firing pin marks
Ejector or extractor
marks
Breech face marks
![Page 21: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/21.jpg)
![Page 22: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/22.jpg)
AFTE – “THEORY OF IDENTIFICATION”
“The theory of identification as it pertains to the comparison of tool marks enables opinions of common origin to be made when the unique surface contours of two tool marks are in sufficient agreement” There is nothing empirically testable about a conclusion made from this “theory.”
![Page 23: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/23.jpg)
“SUFFICIENT AGREEMENT”
![Page 24: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/24.jpg)
POSSIBLE CONCLUSIONS
1. Identification – class characteristics match and “sufficient agreement” of individual characteristics
2. Inconclusive – quality and character of marks are lacking
3. Elimination – examiners are told to only say this when different make and model of gun are involved
4. Insufficient – not enough marks for opinion
![Page 25: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/25.jpg)
PROBLEMS
No comprehensive or meaningful validation studies Validation studies claimed by examiners are in fact fatally flawed, improperly designed, lack external
validity, never done blind or double blind
It is not a science – no scientific method used
“Uniqueness” has never been established to exist in a scientific fashion
![Page 26: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/26.jpg)
RESPONSE FROM THE SCIENTIFIC COMMUNITY
NAS (“National Academy of Sciences”) – 2008 and 2009 Reports Forensics (4 year study commissioned by DOJ) 2009 p. S5 “With the exception of nuclear DNA analysis, no forensic method has been rigorously
shown to have the capacity to consistently, and with a high degree of certainty, demonstrate a connection between evidence and a specific individual or source.”
![Page 27: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/27.jpg)
RESPONSE FROM THE SCIENTIFIC COMMUNITY
PCAST (“President’s Council of Advisors on Science & Technology – Report to the President”) – September 2016 p. 11 “Individualizing is not supported by relevant science.”
AFTE Theory of Identification is not a scientific theory
“We are unaware of any study that assesses the overall firearm and toolmark discipline’s ability to correctly/consistently categorize evidence by class characteristics, identity subclass [manufacturing] marks, and eliminate items using individual characteristics.” OSAC Research Needs Assessment Form, p. 64
P. 46 – “Without appropriate estimates of accuracy, an examiner’s statement that two samples are similar, or even indistinguishable, is scientifically meaningless: it has no probative value, and considerable potential for prejudicial impact.”
Finding 6 PCAST: “Firearms analysis falls short of the criteria for foundational validity.”
![Page 28: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/28.jpg)
PROBLEMS
No comprehensive or meaningful validation studies Validation studies claimed by examiners are in fact fatally flawed, improperly designed, lack external
validity, never done blind or double blind
It is not a science – no scientific method used
“Uniqueness” has never been established to exist in a scientific fashion
Completely subjective in nature – no science allows 100% subjectivity All based on the examiner’s training and experience – experience alone cannot show scientific validity.
No way to reliably estimate error rates.
AFTE admits that their Theory of Identification is subjective in nature and relies on the examiner’s “training and experience.”
![Page 29: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/29.jpg)
SUBJECTIVE
![Page 30: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/30.jpg)
ADDITIONAL PROBLEMS
No comprehensive or meaningful validation studies Validation studies claimed by examiners are in fact fatally flawed, improperly designed, lack external
validity, never done blind or double blind
It is not a science – no scientific method used
“Uniqueness” has never been established to exist in a scientific fashion
Completely subjective in nature – no science allows 100% subjectivity All based on the examiner’s training and experience – experience alone cannot show scientific validity. No
way to reliably estimate error rates.
AFTE admits that their Theory of Identification is subjective in nature and relies on the examiner’s “training and experience.”
Bias – law enforcement-run laboratory
![Page 31: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/31.jpg)
BIAS
![Page 32: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/32.jpg)
RATES OF ERROR
Practitioners claim = 0.3% to 1%
Reality Check – 11 studies involving misidentifications, misattributions, etc.) – rates between 2.3% and as high as 28.2%
Case study: Detroit Police Lab Firearms Unit
permanently shut down in 2008 – audit was done
Misidentifications made in 3 out of 33 adjudicated cases
10% error rate was cited in the shutdown
Annually analyzing 1,800 cases a year
![Page 33: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/33.jpg)
THE TIDE IS CHANGING PCAST SUGGESTS RECONSIDERATION
US v. Green, 405 F. Supp2d 104 (D. Mass 2005) – Death penalty case –Daubert standard applied. Federal district court judge expressed concern that firearms identification testimony has historically been admitted without adequate inquiry into the reliability of the testing methods. Court severely limited the testimony because the examiner had compared one gun to one set of bullets
and casings. They were not compared to a wide range of ballistics specimens. The Court described this questionable practice as “an evidentiary show-up, not what scientists consider a blind test.”
“[t]he more courts admit this type of toolmark evidence without requiring documentation, proficiency testing, or evidence of reliability, the more sloppy practices will endure; we should require more.”
![Page 34: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/34.jpg)
THE TIDE IS CHANGING PCAST SUGGESTS RECONSIDERATION
Second Circuit – 2007 decision US v. Williams, 506 F.3d 151 while approving expert testimony in that case cautioned: “We do not wish this opinion to be taken as saying any proffered ballistics expert should be routinely
admitted.” p. 161
Older forensic methods should not be “grandfathered” from the gatekeeping scrutiny of Daubert and Kumho Tire.
US Supreme Court – 2009 Melendez-Diaz (129 S. Ct. 2527) – the Court acknowledged that “serious deficiencies have been found in the forensic evidence used at criminal trials,” cited the 2009 NAS Report and pointed out that there exists:
“subjectivity, bias and unreliability of common tests such as latent fingerprint analysis, pattern/impression analysis, and toolmark and firearms analysis.”
![Page 35: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/35.jpg)
SUMMARY
Firearms/toolmark identification is a 100% subjective pattern-matching process with no objective indicia for how to conduct the examinations or validation and high error rates!
![Page 36: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/36.jpg)
IF IT COMES IN…
In limine to limit language
Never allow “match”
Fight over uniqueness
Opinion should be severely limited - “[specific weapon] could not be eliminated as the firing platform.” US v. Glynn, 578 F. Supp2d 567, 574-575 (SDNY 2008) – Expert only allowed to say that the bullet
was “more likely than not” a match to the firearm in question but “nothing more.”
US v. Willock, 696 F.Supp2d 536, 546-547 (D. Md 2010) – Firearms and toolmark examiner could give opinions and conclusions but “without any characterization as to the degree of certainty with which he holds them.”
![Page 37: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/37.jpg)
BEWARE OF “TECHNICAL REVIEW”
![Page 38: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/38.jpg)
REAL WORLD: JUROR QUESTIONS
Most common question in States (WI, AZ, IN, etc.) that allow jurors to submit questions:
“If firearms identification is such “bad science”, then why has it been used for so long in the courts?”
![Page 39: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/39.jpg)
STRATEGIES: ATTACK THE DISCIPLINE
![Page 40: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/40.jpg)
STRATEGIES: ATTACK THE DISCIPLINE
![Page 41: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/41.jpg)
STRATEGIES: ATTACK THE DISCIPLINE
![Page 42: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/42.jpg)
STRATEGIES: ATTACK THE DISCIPLINE
![Page 43: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/43.jpg)
BEWARE OF THE TEN BARREL TEST
![Page 44: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/44.jpg)
BEWARE OF THE TEN BARREL TEST
![Page 45: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/45.jpg)
![Page 46: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/46.jpg)
STRATEGIES: ATTACK THE PERSON
![Page 47: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/47.jpg)
STRATEGIES: ATTACK THE PERSON
![Page 48: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/48.jpg)
STRATEGIES: ATTACK THE PERSON
![Page 49: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/49.jpg)
STRATEGIES: ATTACK THE PERSON
![Page 50: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/50.jpg)
STRATEGIES: ATTACK THE PERSON
![Page 51: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/51.jpg)
STRATEGIES: ATTACK THE EVIDENCE
![Page 52: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/52.jpg)
STRATEGIES: ATTACK THE EVIDENCE
![Page 53: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/53.jpg)
STRATEGIES: ATTACK THE EVIDENCE
![Page 54: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/54.jpg)
STRATEGIES: ATTACK THE EVIDENCE
![Page 55: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/55.jpg)
STRATEGIES: ATTACK THE EVIDENCE
![Page 56: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/56.jpg)
STRATEGIES: ATTACK THE EVIDENCE
![Page 57: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/57.jpg)
STRATEGIES: ATTACK THE EVIDENCE
![Page 58: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/58.jpg)
STRATEGIES: ATTACK THE EVIDENCE
![Page 59: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/59.jpg)
STRATEGIES: ATTACK THE EVIDENCE
![Page 60: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/60.jpg)
STRATEGIES: ATTACK THE EVIDENCE
X
X
![Page 61: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/61.jpg)
STRATEGIES: ATTACK THE EVIDENCE
![Page 62: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/62.jpg)
STRATEGIES: ATTACK THE EVIDENCE
![Page 63: FIREARMS & TOOLMARK IDENTIFICATION](https://reader030.fdocuments.in/reader030/viewer/2022021717/620c431b9db7ba1bf336969d/html5/thumbnails/63.jpg)
STRATEGIES: ATTACK THE EVIDENCE