EPA's RSEI Model: Review & Evaluation of RSEI Model - Stan Hayes

Review and Evaluation of the Risk-Review and Evaluation of the Risk-Screening Environmental Indicators Screening Environmental Indicators (RSEI) Model(RSEI) Model

Stan HayesStan HayesENVIRON International CorporationENVIRON International Corporation

Study Sponsored byStudy Sponsored by

American Petroleum InstituteAmerican Petroleum Institute

2009 EPA/ECOS TRI National Training Conference2009 EPA/ECOS TRI National Training Conference

March 30 – April 2, 2009March 30 – April 2, 2009

Bethesda, MarylandBethesda, Maryland

PresentationPresentation

RSEI review and evaluation study

Application to U.S. petroleum refineries

Evaluation findings

Specific recommendations

RSEI Score RSEI Score CalculationCalculation

Computer-based screening tool

Uses reported TRI data for air, water, and other releases

Calculates “risk-related” scores

RSEI Score RSEI Score IntentIntent

EPA:

– “The values are for comparative purposes and only meaningful when compared to other values produced by RSEI. It should be emphasized that the result is not a detailed or quantitative risk assessment.” (p. 1, EPA 2007)

– “It does not provide a detailed or quantitative assessment of risk, and is not designed as a substitute for more comprehensive, site-specific risk assessments.” (p. 17, EPA 2007)

RSEI Score RSEI Score MisinterpretationMisinterpretation

RSEI Score RSEI Score ConsequencesConsequences

Jackson Announces EPA Schools Monitoring Initiative (Washington, D.C. – March 2, 2009) Lisa Jackson, administrator of the U.S. Environmental Protection Agency, announced today a new initiative to further measure levels of toxic air …

DEQ says air around metro schools not toxic

08:56 PM CST on Tuesday, March 3, 2009

NEW ORLEANS – The Department of Environmental Quality says the air around several metro New Orleans area schools is not toxic.

The response comes one day after a USA Today report that said several schools in the state were at or above toxic levels.

DEP FINDS AIR QUALITY AROUND SCHOOLS TO BE SAFE

Findings Refute USA Today Report

HARRISBURG – The Department of Environmental Protection today reported it found no unsafe levels of air pollutants or metals after extensively examining air quality samples taken recently near four Pennsylvania schools.

RSEI Review and Evaluation StudyRSEI Review and Evaluation Study

SCOPE: RSEI model as applied to U.S. petroleum

refineries

Databases and assumptions

Toxicity weighting scheme

Scoring methodology

Evaluation Finding:Evaluation Finding:Wide Disparity in Refinery ScoresWide Disparity in Refinery Scores

010,00020,00030,00040,00050,00060,00070,00080,00090,000

100,000110,000120,000130,000140,000150,000160,000170,000180,000190,000200,000210,000220,000230,000240,000250,000

1 11 21 31 41 51 61 71 81 91 101 111 121 131 141 151 161

Refinery RSEI Score Ranking

RSEI

Sco

re

223,549

Note: Year 2005; 163 facilities in SIC Code 2911 (Petroleum Refining)

13,36590th Percentile

96850th Percentile

31,72195th Percentile

69,6492nd High

Max

Highest 5

Evaluation Finding:Evaluation Finding:Little Consistent PatternLittle Consistent Pattern

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Direct Water - Fish Ing (Rec)

Direct Water - Fish Ing(Sub)

Direct Water

Stack Air

Fugitive Air

Percent of RSEI Score

Refinery #1Refinery #2Refinery #3Refinery #4Refinery #5

Evaluation Finding:Evaluation Finding:Little Consistent PatternLittle Consistent Pattern

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Polycyclic Aromatic Compounds

Naphthalene

Benzene

Ethyl Benzene

1,3-Butadiene

1,2,4-Trimethylbenzene

1,2-Dibromoethane

Mercury & Compounds

Lead & Compounds

Nickel & Compounds

Antimony & Compounds

Molybdenum Trioxide

Sulfuric Acid

Chlorine

Percent of RSEI Score

Refinery #1Refinery #2Refinery #3Refinery #4Refinery #5

Evaluation Finding:Evaluation Finding:Overweights Noncancer Effects Overweights Noncancer Effects

Probability of contracting cancer

Above upper bound of EPA acceptable risk range (100 in million)

Well above acceptable risk for other agencies (e.g., 10 in million)

Hazard Index = 1 (indicator of likelihood of risk, not risk itself)

RfC and RfD “…likely to be without appreciable risk of deleterious effects during a lifetime”

Margin of safety (often several orders of magnitude)

250 in million equivalent to HI = 1

Toxicity Weighting Assumes:

≠

Evaluation Finding:Evaluation Finding:Overweights Noncancer EffectsOverweights Noncancer Effects

RSEI InhalationToxicity Weight0 10,000 20,000 30,000 40,000 50,000 60,000 70,000 80,000 90,000 100,000

Acetaldehyde

Ammonia

Anthracene

Antimony and antimony compounds

Arsenic and arsenic compounds

Benzene

Butadiene, 1,3-

Cadmium and cadmium compounds

Carbonyl sulfide

Chromium and chromium compounds

Cumene

Cyclohexane

Ethylbenzene

Ethylene

Formaldehyde

Glycol Ethers

Hexane, n-

Hydrogen fluoride

Lead and lead compounds

Mercury and mercury compounds

Methanol

Methyl tert-butyl ether

Naphthalene

Nickel and nickel compounds

Polycyclic aromatic compounds

Propylene (Propene)

Styrene

Sulfuric acid

Toluene

Xylene (mixed isomers)

Xylene, m-

Xylene, o-

Xylene, p-

Toxicity determined by:

Cancer effects

Noncancer effects Carcinogens

Benzene

Evaluation Finding:Evaluation Finding:Toxicities Uncertain for Highest-Score ChemicalsToxicities Uncertain for Highest-Score Chemicals

0

50,000

100,000

150,000

200,000

250,000

300,000

350,000

400,000

Sulfu

ric

acid

Poly

cycl

ic a

rom

atic

com

poun

dsM

ercu

ry a

nd m

ercu

ry c

ompo

unds

Lead

and

lead

com

poun

ds1.

2.4-

Trim

ethy

lben

zene

Chl

orin

eAnt

imon

y an

d an

timon

y co

mpo

unds

Nic

kel a

nd n

icke

l com

poun

dsN

apht

hale

neBen

zene

Am

mon

iaD

ieth

anol

amin

eXyl

ene

(mix

ed is

omer

s)Cya

nide

com

poun

dsN

itrat

e co

mpo

unds

Mol

ybde

num

triox

ide

Man

gane

se a

nd m

anga

nese

com

poun

ds1.

3-But

adie

neFo

rmal

dehy

de1.

2-D

ibro

moe

than

eCar

bony

l sul

fide

Chr

omiu

m a

nd c

hrom

ium

com

poun

dsH

ydro

chlo

ric

acid

Cob

alt an

d co

balt

com

poun

dsAcr

olei

nH

ydro

gen

cyan

ide

Hyd

roge

n flu

orid

eSe

leni

um a

nd s

elen

ium

com

poun

dsn-

Hex

ane

Ethy

lene

oxi

deVan

adiu

m a

nd v

anad

ium

com

poun

dsZi

nc a

nd z

inc

com

poun

dsSi

lver

and

silv

er c

ompo

unds

Cop

per

and

copp

er c

ompo

unds

1.2.

3-Trich

loro

prop

ane

Ethy

lben

zene

p-Xyl

ene

Tol

uene

Tet

rach

loro

ethy

lene

(Pe

rchl

oroe

thyl

ene)

Prop

ylen

e (P

rope

ne)

Gly

col e

ther

sm

-Xyl

ene

Cum

ene

Ace

tald

ehyd

eo-

Xyl

ene

Trich

loro

ethy

lene

Chl

orin

e di

oxid

ePh

enol

Met

hyl t

ert-

buty

l eth

erM

etha

nol

Ace

toni

trile

Met

hyl i

sobu

tyl k

eton

eCyc

lohe

xane

Prop

ylen

e ox

ide

1.2-

Dic

hlor

oeth

ane

Ethy

lene

Cre

sol (

mix

ed is

omer

s)Et

hyle

ne g

lyco

lBip

heny

lCar

bon

tetr

achl

orid

eBar

ium

and

bar

ium

com

poun

dsCar

bon

disu

lfide

Dic

yclo

pent

adie

neCad

miu

m a

nd c

adm

ium

com

poun

dsBer

ylliu

m a

nd b

eryl

lium

com

poun

dsSt

yren

eArs

enic

and

ars

enic

com

poun

ds2.

4-D

imet

hylp

heno

ln-

But

yl a

lcoh

olAnt

hrac

ene

tert

-But

yl a

lcoh

olVin

yl a

ceta

teChl

orod

ifluo

rom

etha

ne (

HCFC

-22)

Alu

min

um (

fum

e or

dus

t)1.

1.1-

Trich

loro

etha

neBro

mom

etha

ne (

Met

hyl b

rom

ide)

Ace

toph

enon

eSo

dium

nitr

itese

c-But

yl a

lcoh

olAcr

ylic

aci

dCFC

-11

(trich

loro

fluor

omet

hane

)Ben

zo(g

.h.i)

pery

lene

Dio

xin

and

diox

in-lik

e co

mpo

unds

N-m

ethy

l-2-

pyrr

olid

one

Alu

min

um o

xide

(fib

rous

for

ms)

Asb

esto

s (f

riab

le)

Phos

phor

us (

yello

w o

r w

hite

)Ph

enan

thre

neD

iben

zofu

ran

RSEI

Sco

res

Aggre

gate

d A

cross

Refineri

es

Five Highest-Score Chemicals:

1. Sulfuric Acid

2. Polycyclic Aromatic Compounds

3. Mercury and Mercury Compounds

4. Lead and Lead Compounds

5. 1,2,4-Trimethylbenzene


0

50,000

100,000

150,000

200,000

250,000

300,000

350,000

400,000

Sulfu

ric

acid

Poly

cycl

ic a

rom

atic

com

poun

dsM

ercu

ry a

nd m

ercu

ry c

ompo

unds

Lead

and

lead

com

poun

ds1.

2.4-

Trim

ethy

lben

zene

Chl

orin

eAnt

imon

y an

d an

timon

y co

mpo

unds

Nic

kel a

nd n

icke

l com

poun

dsN

apht

hale

neBen

zene

Am

mon

iaD

ieth

anol

amin

eXyl

ene

(mix

ed is

omer

s)Cya

nide

com

poun

dsN

itrat

e co

mpo

unds

Mol

ybde

num

triox

ide

Man

gane

se a

nd m

anga

nese

com

poun

ds1.

3-But

adie

neFo

rmal

dehy

de1.

2-D

ibro

moe

than

eCar

bony

l sul

fide

Chr

omiu

m a

nd c

hrom

ium

com

poun

dsH

ydro

chlo

ric

acid

Cob

alt an

d co

balt

com

poun

dsAcr

olei

nH

ydro

gen

cyan

ide

Hyd

roge

n flu

orid

eSe

leni

um a

nd s

elen

ium

com

poun

dsn-

Hex

ane

Ethy

lene

oxi

deVan

adiu

m a

nd v

anad

ium

com

poun

dsZi

nc a

nd z

inc

com

poun

dsSi

lver

and

silv

er c

ompo

unds

Cop

per

and

copp

er c

ompo

unds

1.2.

3-Trich

loro

prop

ane

Ethy

lben

zene

p-Xyl

ene

Tol

uene

Tet

rach

loro

ethy

lene

(Pe

rchl

oroe

thyl

ene)

Prop

ylen

e (P

rope

ne)

Gly

col e

ther

sm

-Xyl

ene

Cum

ene

Ace

tald

ehyd

eo-

Xyl

ene

Trich

loro

ethy

lene

Chl

orin

e di

oxid

ePh

enol

Met

hyl t

ert-

buty

l eth

erM

etha

nol

Ace

toni

trile

Met

hyl i

sobu

tyl k

eton

eCyc

lohe

xane

Prop

ylen

e ox

ide

1.2-

Dic

hlor

oeth

ane

Ethy

lene

Cre

sol (

mix

ed is

omer

s)Et

hyle

ne g

lyco

lBip

heny

lCar

bon

tetr

achl

orid

eBar

ium

and

bar

ium

com

poun

dsCar

bon

disu

lfide

Dic

yclo

pent

adie

neCad

miu

m a

nd c

adm

ium

com

poun

dsBer

ylliu

m a

nd b

eryl

lium

com

poun

dsSt

yren

eArs

enic

and

ars

enic

com

poun

ds2.

4-D

imet

hylp

heno

ln-

But

yl a

lcoh

olAnt

hrac

ene

tert

-But

yl a

lcoh

olVin

yl a

ceta

teChl

orod

ifluo

rom

etha

ne (

HCFC

-22)

Alu

min

um (

fum

e or

dus

t)1.

1.1-

Trich

loro

etha

neBro

mom

etha

ne (

Met

hyl b

rom

ide)

Ace

toph

enon

eSo

dium

nitr

itese

c-But

yl a

lcoh

olAcr

ylic

aci

dCFC

-11

(trich

loro

fluor

omet

hane

)Ben

zo(g

.h.i)

pery

lene

Dio

xin

and

diox

in-lik

e co

mpo

unds

N-m

ethy

l-2-

pyrr

olid

one

Alu

min

um o

xide

(fib

rous

for

ms)

Asb

esto

s (f

riab

le)

Phos

phor

us (

yello

w o

r w

hite

)Ph

enan

thre

neD

iben

zofu

ran

RSEI

Sco

res

Aggre

gate

d A

cross

Refineri

es

#1 Sulfuric Acid:

No value specified in EPA IRIS primary toxicity database

Database hierarchy defaults to Cal/EPA

Lack of interagency consensus


0

50,000

100,000

150,000

200,000

250,000

300,000

350,000

400,000

Sulfu

ric

acid

Poly

cycl

ic a

rom

atic

com

poun

dsM

ercu

ry a

nd m

ercu

ry c

ompo

unds

Lead

and

lead

com

poun

ds1.

2.4-

Trim

ethy

lben

zene

Chl

orin

eAnt

imon

y an

d an

timon

y co

mpo

unds

Nic

kel a

nd n

icke

l com

poun

dsN

apht

hale

neBen

zene

Am

mon

iaD

ieth

anol

amin

eXyl

ene

(mix

ed is

omer

s)Cya

nide

com

poun

dsN

itrat

e co

mpo

unds

Mol

ybde

num

triox

ide

Man

gane

se a

nd m

anga

nese

com

poun

ds1.

3-But

adie

neFo

rmal

dehy

de1.

2-D

ibro

moe

than

eCar

bony

l sul

fide

Chr

omiu

m a

nd c

hrom

ium

com

poun

dsH

ydro

chlo

ric

acid

Cob

alt an

d co

balt

com

poun

dsAcr

olei

nH

ydro

gen

cyan

ide

Hyd

roge

n flu

orid

eSe

leni

um a

nd s

elen

ium

com

poun

dsn-

Hex

ane

Ethy

lene

oxi

deVan

adiu

m a

nd v

anad

ium

com

poun

dsZi

nc a

nd z

inc

com

poun

dsSi

lver

and

silv

er c

ompo

unds

Cop

per

and

copp

er c

ompo

unds

1.2.

3-Trich

loro

prop

ane

Ethy

lben

zene

p-Xyl

ene

Tol

uene

Tet

rach

loro

ethy

lene

(Pe

rchl

oroe

thyl

ene)

Prop

ylen

e (P

rope

ne)

Gly

col e

ther

sm

-Xyl

ene

Cum

ene

Ace

tald

ehyd

eo-

Xyl

ene

Trich

loro

ethy

lene

Chl

orin

e di

oxid

ePh

enol

Met

hyl t

ert-

buty

l eth

erM

etha

nol

Ace

toni

trile

Met

hyl i

sobu

tyl k

eton

eCyc

lohe

xane

Prop

ylen

e ox

ide

1.2-

Dic

hlor

oeth

ane

Ethy

lene

Cre

sol (

mix

ed is

omer

s)Et

hyle

ne g

lyco

lBip

heny

lCar

bon

tetr

achl

orid

eBar

ium

and

bar

ium

com

poun

dsCar

bon

disu

lfide

Dic

yclo

pent

adie

neCad

miu

m a

nd c

adm

ium

com

poun

dsBer

ylliu

m a

nd b

eryl

lium

com

poun

dsSt

yren

eArs

enic

and

ars

enic

com

poun

ds2.

4-D

imet

hylp

heno

ln-

But

yl a

lcoh

olAnt

hrac

ene

tert

-But

yl a

lcoh

olVin

yl a

ceta

teChl

orod

ifluo

rom

etha

ne (

HCFC

-22)

Alu

min

um (

fum

e or

dus

t)1.

1.1-

Trich

loro

etha

neBro

mom

etha

ne (

Met

hyl b

rom

ide)

Ace

toph

enon

eSo

dium

nitr

itese

c-But

yl a

lcoh

olAcr

ylic

aci

dCFC

-11

(trich

loro

fluor

omet

hane

)Ben

zo(g

.h.i)

pery

lene

Dio

xin

and

diox

in-lik

e co

mpo

unds

N-m

ethy

l-2-

pyrr

olid

one

Alu

min

um o

xide

(fib

rous

for

ms)

Asb

esto

s (f

riab

le)

Phos

phor

us (

yello

w o

r w

hite

)Ph

enan

thre

neD

iben

zofu

ran

RSEI

Sco

res

Aggre

gate

d A

cross

Refineri

es

#2 Polycyclic Aromatic Compounds:

Toxicity assumed to be B(a)P, most toxic chemical in category

B(a)P small fraction of PAC emissions


0.1

1.0

0.1

0.01 0.001

1.0

0.1

0.0

0.2

0.4

0.6

0.8

1.0

1.2

Benz(a) anthracene

Benzo(a) pyrene

Benzo(b)fluoranthene

Benzo(k)fluoranthene

Chrysene Dibenz(a,h)anthracene

Indeno(1,2,3-cd) pyrene

7-PAH (Probable Human Carcinogens)

EPA R

elat

ive

Pote

ncy

Fac

tor

(RPF)

- B

(a)P

= 1


0.14 0.61 0.15

46.01

0.02

14.70

0.040

5

10

15

20

25

30

35

40

45

50

Benz(a)anthracene

Benzo(a)pyrene

Benzo(b)fluoranthene

Benzo(k)fluoranthene

Chrysene Dibenz(a,h)anthracene

Indeno(1,2,3-cd) pyrene

7-PAH (Probable Human Carcinogens)

2003 E

mis

sions

(tons)

7-PAH air emissions from five refineries in

SCAQMD in 2003

Evaluation Finding:Evaluation Finding:Inconsistent With Standard Risk AssessmentInconsistent With Standard Risk Assessment

RSEI:– Not quantitative estimate of risk– Scoring derived from 1990’s Superfund’s Hazard Ranking System– Combines cancer risk and noncancer hazard into single score

Standard Risk Assessment Practice:– Quantitative estimate of risk– As recommended by National Academy of Sciences and by

EPA in air toxics and Superfund risk assessment guidance– Treats cancer risk and noncancer hazard separately

Many Available Refinery Risk Assessments:– Results may be inconsistent with RSEI scores– Risk drivers may be different– Rank ordering may be different


8

2

0.4

0.1 0.00070.07

0.02 0.0010

1

10

100

Refinery#1

Refinery#2

Refinery#4

Refinery#5

Refinery#1

Refinery#2

Refinery#4

Refinery#5

Cance

r R

isk (

in m

illio

n)

0.0

0.2

0.4

0.6

0.8

1.0

Chro

nic

HI

Cancer Risk

Noncancer Hazard

010,00020,00030,00040,00050,00060,00070,00080,00090,000

100,000110,000120,000130,000140,000150,000160,000170,000180,000190,000200,000210,000220,000230,000240,000250,000

1 11 21 31 41 51 61 71 81 91 101 111 121 131 141 151 161

Refinery RSEI Score Ranking

RSEI

Sco

re

RSEIHighest 5

Source: EPA (2007), “Residual Risk Assessment for MACT I Petroleum Refining Sources”

Inhalation exposure and Refinery MACT 1 sources. Solid bars (Refineries #2 and #5) indicate inhalation major contributor to RSEI scores. Cross-hatched bars (Refineries #1 and #4) indicate non-inhalation pathways major contributors.


Source: EPA (2007), “Residual Risk Assessment for MACT I Petroleum Refining Sources”

Inhalation exposure and Refinery MACT 1 sources.

y = -53.089x + 7318.9

R2 = 0.0004

-

50,000

100,000

150,000

200,000

250,000

0 10 20 30 40 50 60 70 80

Maximum Cancer Risk (in million)

RSEI

Sco

re

RecommendationsRecommendations

1. Verify consistency with available risk assessments

2. Calculate and report cancer and noncancer scores separately

3. Re-equilibrate toxicity weights to better balance cancer and noncancer effects

4. Use composite toxicities for chemical categories, particularly PACs

5. Flag or show uncertainty where substantial interagency consensus does not exist, particularly for sulfuric acid

6. Use more realistic fish ingestion assumptions about fisher population, fishing likelihood and incidence, and fish consumption

7. Verify that surface water discharges actually enter drinking water

8. Allow for systematically conservative TRI data reporting practices

9. Improve reliability of default stack parameters

10. Update databases regularly to incorporate data corrections

EPA's RSEI Model: Review & Evaluation of RSEI Model - Stan Hayes

Documents

Transcript of EPA's RSEI Model: Review & Evaluation of RSEI Model - Stan Hayes