Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

60
Expert Systems for Expert Systems for Automated STR Analysis Automated STR Analysis SWGDAM SWGDAM Quantico, VA Quantico, VA Mark W. Perlin Mark W. Perlin January, 2003 January, 2003

Transcript of Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

Page 1: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

Expert Systems forExpert Systems forAutomated STR AnalysisAutomated STR Analysis

SWGDAMSWGDAMQuantico, VAQuantico, VA

Mark W. PerlinMark W. PerlinJanuary, 2003January, 2003

Page 2: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

DNA Is Clue to 1971 Murder: A recent, random test links a state prison inmate to the old El Dorado case. January 10, 2003

DNA Clue Cracks Open Unsolved 1979 Slaying: Colorado felon charged in San Pablo girl's death. December 4, 2002

S.F. Transient Held in Rapes of Homeless Women: DNA match led to suspect. October 19, 2002

DNA links felon to rape: The arrest marks the 100th match in state database. August 23, 2002

DNA links parolee to old rape case: Database helps authorities score 'cold hit' on suspect in attack. August 21, 2002

DNA yields arrest warrant in 1978 killing. August 14, 2002

Page 3: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

The analyst will simply submit the items for DNA analysis, using the final data interpretation step to determine relevance to the ongoing investigation ... The bottleneck becomes the interpretation of analytical results and the technical review process. ... Although these processes are currently dependent upon manual applications, software solutions are emerging that can be integrated into an automated approach.

Page 4: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

Collect Crime Scene EvidenceCollect Crime Scene Evidence

Generate DNA DataGenerate DNA Data

Review DataReview Data

Present Results to Legal SystemPresent Results to Legal System

Page 5: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 6: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

Collect Crime Scene EvidenceCollect Crime Scene Evidence

Generate DNA DataGenerate DNA Data

Review DNA DataReview DNA Data

Present Results to Legal SystemPresent Results to Legal System

Page 7: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

TrueAllele™TrueAllele™

Page 8: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

datadata

data peaksdata peakssize + [DNA]size + [DNA]

modelmodel

Page 9: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 10: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

1. Input data

2. Q/C gel run

3. Call alleles

4. Output result

Page 11: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 12: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 13: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 14: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 15: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 16: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

FSS ABI/377 ValidationFSS ABI/377 ValidationResourcesResources• • Data: 22,000 genotypes (SGMplus)Data: 22,000 genotypes (SGMplus)• • People: 6 reviewers + 6 managers People: 6 reviewers + 6 managers • • Time: 8 weeks work + 4 weeks reportTime: 8 weeks work + 4 weeks report

ComponentsComponents• • Peak height correlation (GS vs TA)Peak height correlation (GS vs TA)• • Establish baseline height (error-free)Establish baseline height (error-free)• • Designation accuracy (human vs TA)Designation accuracy (human vs TA)• • Network/computer environmentNetwork/computer environment• • QMS documentationQMS documentation

ResultsResults• • Greater yield with TAGreater yield with TA• • No errors on quality dataNo errors on quality data

Page 17: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 18: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 19: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

denialdenial

angeranger

bargainingbargaining

depressiondepression

acceptanceacceptance

Page 20: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 21: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 22: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

Generate STR DataGenerate STR Data

UK National DNA DatabaseUK National DNA Database

Person reviewsPerson reviewsa fractiona fraction

of the dataof the data

TrueAllele expert systemTrueAllele expert systemscores all STR data and scores all STR data and assesses data qualityassesses data quality

Page 23: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 24: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

Validation MethodValidation Method

1. Obtain original data1. Obtain original data2. Process data in TrueAllele™ ES2. Process data in TrueAllele™ ES (auto-setup, process run, Q/A, (auto-setup, process run, Q/A, call alleles, apply rules, check)call alleles, apply rules, check) computer: accept/reject/editcomputer: accept/reject/edit3. Review all data3. Review all data one person, many computersone person, many computers human: accept/reject/edithuman: accept/reject/edit4. Generate results & stats4. Generate results & stats

Page 25: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

Validation ResultsValidation Results

Computer: ~85% data, no review needed Computer: ~85% data, no review needed Human: Designations are correctHuman: Designations are correct

TrueAllele expert system can eliminateTrueAllele expert system can eliminatemost human review of STR DNA datamost human review of STR DNA data

Page 26: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

JustAllele™JustAllele™

Page 27: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 28: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 29: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 30: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 31: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

Genotype ProbabilityGenotype ProbabilitySample @ D7S820Sample @ D7S820

Option 1Option 1

Option 2Option 2

99% Confidence Allele Set =99% Confidence Allele Set = { { 10, 1110, 11 } } Database SearchingDatabase Searching

Page 32: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

DNA Mixture ModelDNA Mixture ModelLinear Mixture AnalysisLinear Mixture Analysis

M.W. Perlin and B. Szabady, M.W. Perlin and B. Szabady, ““Linear mixture analysis: Linear mixture analysis: a mathematical approach to resolving mixed DNA samples,a mathematical approach to resolving mixed DNA samples,””

Journal of Forensic SciencesJournal of Forensic Sciences, November, 2001., November, 2001.

d = G x w d = G x w + e+ e

Page 33: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

The Contributor ProblemThe Contributor Problem

DATADATAsample profilessample profiles

GENOTYPESGENOTYPESof of

contributorscontributors

WEIGHTSWEIGHTSof of

contributorscontributorsin samplesin samples

contributorscontributors

Page 34: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

One SampleOne Sample

Sample C:Sample C:Unknown (A) 70%Unknown (A) 70%Unknown (G) 30%Unknown (G) 30%

1 ng DNA1 ng DNAPowerPlex16PowerPlex16

ABI/310ABI/310

Page 35: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 36: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

samplesample

con

trib

uto

rsco

ntr

ibu

tors

Page 37: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 38: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 39: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 40: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 41: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

Two SamplesTwo Samples

Sample A: Reference Sample A: Reference &&

Sample C:Sample C:Reference (A) 70%Reference (A) 70%Unknown (G) 30%Unknown (G) 30%

1 ng DNA1 ng DNAPowerPlex16PowerPlex16

ABI/310ABI/310

Page 42: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 43: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

samplessamples

con

trib

uto

rsco

ntr

ibu

tors

Page 44: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 45: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 46: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 47: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 48: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 49: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 50: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 51: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 52: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 53: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 54: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 55: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

Three SamplesThree Samples

Sample D:Sample D:(A) 50%(A) 50%(G) 50%(G) 50%

1, 1/2, 1/4, 1/8 ng DNA1, 1/2, 1/4, 1/8 ng DNAPowerPlex16PowerPlex16

ABI/310ABI/310

Sample C:Sample C:(A) 70%(A) 70%(G) 30%(G) 30%

Sample E:Sample E:(A) 30%(A) 30%(G) 70%(G) 70%

Two Contributors, No ReferenceTwo Contributors, No Reference

Page 56: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 57: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

samplessamples

con

trib

uto

rsco

ntr

ibu

tors

samplessamples

con

trib

uto

rsco

ntr

ibu

tors

1 ng1 ng

1/8 ng1/8 ng

Page 58: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.
Page 59: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

Collect Crime Scene EvidenceCollect Crime Scene Evidence

Generate DNA DataGenerate DNA Data

Review DNA DataReview DNA Data

Present Results to Legal SystemPresent Results to Legal System

Page 60: Expert Systems for Automated STR Analysis SWGDAM Quantico, VA Mark W. Perlin January, 2003.

The analyst will simply submit the items for DNA analysis, using the final data interpretation step to determine relevance to the ongoing investigation ... The bottleneck becomes the interpretation of analytical results and the technical review process. ... Although these processes are currently dependent upon manual applications, software solutions are emerging that can be integrated into an automated approach.