VARIANCE REDUCTION

11
VARIANCE REDUCTION VARIANCE REDUCTION

description

VARIANCE REDUCTION. CALCULATIONS ON VARIANCES: SOME BASICS. Let X and Y be random variables. COV=0 if X and Y are independent. COMMON RANDOM NUMBERS. Built for distinguishing among two systems d i = y i – x i Variance reduced by COV(X, Y) Streaming induces MORE Covariance. STREAMING. - PowerPoint PPT Presentation

Transcript of VARIANCE REDUCTION

Page 1: VARIANCE REDUCTION

VARIANCE VARIANCE REDUCTIONREDUCTION

Page 2: VARIANCE REDUCTION

CALCULATIONS ON CALCULATIONS ON VARIANCES: SOME BASICSVARIANCES: SOME BASICSLet X and Y be random variablesLet X and Y be random variables

],[2][][][)5

][][)4

][][][],[)3

],[2][][][)2

])[(][][)1

2

22

YXCOVYVARXVARYXVAR

XVARccXVAR

YEXEXYEYXCOV

YXCOVYVARXVARYXVAR

XEXEXVAR

COV=0 if X and Y are independent.

Page 3: VARIANCE REDUCTION

COMMON RANDOM NUMBERSCOMMON RANDOM NUMBERS

Built for distinguishing among two systemsBuilt for distinguishing among two systems

ddii = y = yii – x – xii

Variance reduced by COV(X, Y)Variance reduced by COV(X, Y)

Streaming induces MORE CovarianceStreaming induces MORE Covariance

Page 4: VARIANCE REDUCTION

STREAMINGSTREAMING

Segregate the random number generation Segregate the random number generation task into streams connected to task into streams connected to phenomenaphenomena

seed1 seed2

Inter-arrivaltimes

Servicetimes

Zi=aZi-1 mod m

1. Change features of the service.2. Use exact same arrival stream forcomparing each service setting.

Page 5: VARIANCE REDUCTION

ANTITHETIC VARIATESANTITHETIC VARIATES

Use Uniforms U1, U2, ... to generate a sampleUse Uniforms U1, U2, ... to generate a sample

Use Uniforms 1-U1, 1-U2, ... to generate a Use Uniforms 1-U1, 1-U2, ... to generate a second samplesecond sample

Combine the samplesCombine the samples

Extreme values get canceled outExtreme values get canceled out

Depends on... Depends on... effective streamingeffective streaming straightforward straightforward FF-1-1(U) method of variate generation(U) method of variate generation

Page 6: VARIANCE REDUCTION

spreadsheet...spreadsheet...

Page 7: VARIANCE REDUCTION

CONTROL VARIATESCONTROL VARIATES

X is your output variableX is your output variable You seek the Expected Value of XYou seek the Expected Value of X

Y is a random variableY is a random variable Y is one of the variables that we are generatingY is one of the variables that we are generating We know the Expected Value of YWe know the Expected Value of Y

ExampleExample X is the total waiting time of a customerX is the total waiting time of a customer Y is the inter-arrival time before he entered serviceY is the inter-arrival time before he entered service

Page 8: VARIANCE REDUCTION

...more CONTROL VARIATES...more CONTROL VARIATES

Xc is a random variable with less Variance and Xc is a random variable with less Variance and the same Expected Valuethe same Expected Value

pick pick to minimize VAR(Xc) to minimize VAR(Xc)

])[( YEYXXc

Page 9: VARIANCE REDUCTION

OPTIMAL CONTROLOPTIMAL CONTROL

)(

),(*

0),(2)(2)(

),(2)()()(

])[(2

YVAR

YXCOV

YXCOVYVARXcVAR

YXCOVYVARXVARXcVAR

YEYXXc

Page 10: VARIANCE REDUCTION

IMPORTANT IMPORTANT CALCULATIONSCALCULATIONS

Fusing many results in statisticsFusing many results in statistics

)1)((

)()(

),(1)(

)(

),()(

),()(

),(2)(

)(

),()()(

2

2

2

2

XYXVAR

YVARXVAR

YXCOVXVAR

YVAR

YXCOVXVAR

YXCOVYVAR

YXCOVYVAR

YVAR

YXCOVXVARXcVAR

Page 11: VARIANCE REDUCTION

ALSO KNOWN AS...ALSO KNOWN AS...

We are regressing X vs. YWe are regressing X vs. Y

* is the parameter that a regression * is the parameter that a regression package would calculatepackage would calculate

= SQRT[COV(X,Y)= SQRT[COV(X,Y)22/VAR(X)VAR(Y)] /VAR(X)VAR(Y)] is the correlation coefficient of X and Yis the correlation coefficient of X and Y

=1 or -1 implies =1 or -1 implies Y completely explains X and Y completely explains X and VAR(Xc)=0VAR(Xc)=0