Subsampling p-values - University of California, San Diego
Transcript of Subsampling p-values - University of California, San Diego
Subsampling p-values
Arthur BergPenn State University
Timothy L. McMurryDePaul University
Dimitris N. PolitisUniversity of California, San Diego
April 20, 2010
Abstract
A construction of p-values for hypothesis tests based on subsampling and the related m outof n bootstrap is introduced. The p-values are based on a modification of the usual subsamplinghypothesis tests that involves an appropriate centering of the subsampled or bootstrapped teststatistics as in the construction of confidence intervals. This modification makes the hypothesistests more powerful, and as a consequence provides meaningful p-values. The procedure is shownto apply for both i.i.d. and stationary data satisfying mixing conditions. The new p-values havethe desired properties of being asymptotically uniform under the null hypothesis and convergingto zero under the alternative.
1 Introduction
Let X1, . . . , Xn denote a sample of observations taking values in a sample space S with probabilitylaw P , where P is assumed to belong to a class of laws P. We consider the problem of testing thenull hypothesis H0 which asserts that P β P0 versus the alternative, H1, that P β P1, where P0
and P1 are disjoint, and P = P0 βͺP1.Subsampling confidence intervals were developed in Politis and Romano (1994) while subsam-
pling hypothesis testing was studied in Politis and Romano (1996); Politis, Romano, and Wolf(1999) describes these and many other subsampling procedures in detail, including the related m/nbootstrap, i.e., resampling with smaller resample size; see also Bickel, Gotze, and van Zwet (1997).Interestingly, there is little work to date on the construction of p-values for subsampling tests al-though some literature exists on p-values for the bootstrap with full resample size (e.g. Beran, 1986;Davison and Hinkley, 1997; Loh, 1985; Liu and Singh, 1997; Romano, 1988).
In this paper, we attempt to remedy this situation in providing uselful p-values for subsamplingand the m/n bootstrap. At the same time, we revisit the original subsampling tests and show that atest that is essentially based on inverting the subsampling confidence intervals has better power. Thenext section reviews the framework of subsampling-based inference including the aforementionedmodified subsampling test for i.i.d. and dependent data. Section 3 details the p-value constructionwhile Section 4 presents several simulation results; technical proofs have been placed in the lastsection.
1
2 Subsampling confidence intervals and hypothesis tests
2.1 Confidence intervals
Subsampling inference starts with a statistic tn = tn(X1, . . . , Xn) that estimates a parameter t(P ).Of interest is the sampling distribution of tn defined as
Jn(x, P ) = ProbP {Οn(tn(X1, . . . , Xn)β t(P )) β€ x},
where Οn is a normalizing sequence that gives Jn(x, P ) a nontrivial limit as nββ.The fundamental idea behind subsampling is that Jn(x, P ) can be accurately approximated by
the suitably centered and normalized distribution of the same statistic calculated on appropriatelychosen subsets of the data of size b. Let tn,b,i denote the statistic calculated on the ith subset ofsize b, i.e.,
tn,b,i := tb(Xi1 , Xi2 , . . . , Xib).
Also let Nn denote the total number of available subsets of the data of size b. Consider the followingcases:
1. I.i.d. data: subsampling. In this case, the ith subsample is constructed by samplingwithout replacement from the data set {X1, . . . , Xn} with the purpose of forming a subsampleof size b. There are Nn =
(nb
)possible subsamples to choose from but typically this number
is huge, so in practice the procedure is implemented by using a large (but not huge) numberof randomly selected subsets.
2. I.i.d. data: b/n bootstrap. Same as above but sampling with replacement from the dataset {X1, . . . , Xn} with the purpose of forming a resample of size b; we will use b/n instead ofm/n bootstrap for consistency of notation.
3. Strictly stationary and strong mixing data: subsampling. Here, the ith subsampleis the sub-series (Xi, . . . , Xi+bβ1), and Nn = nβ b+ 1.
The subsampling estimator of Jn(x, P ) is defined as follows:
Ln,b(x) := Nβ1n
Nnβi=1
1{Οb(tn,b,i β tn) β€ x}. (1)
As shown in Politis and Romano (1994),
Ln,b(x)β Jn(x, P )βP 0 (2)
under general conditions including
Nn ββ, bββ but bk/nβ 0, (3)
(see Remark 1 below for the appropriate values of k) and that
Οn is such that Οb/Οn β 0 whenever b/nβ 0, (4)
as well as the following:
Assumption 1. As nββ, Jn(x, P ) converges weakly to a continuous (in x) limit law J(x, P ).
2
Remark 1. For subsampling, equation (3) is assumed with k = 1. For the b/n bootstrap, oneneeds k = 2 if no extra conditions are imposed (Politis and Romano, 1993). However, with someadditional structure, it is possible to have k = 1 (see Bickel et al., 1997), or even k = 0 e.g., whenthe full resample size bootstrap works and b = n.
Strictly speaking, eq. (2) only requires continuity of J(x, P ) at x; however, if J(x, P ) is contin-uous and strictly increasing for all x in the region of interest, i.e., in the Ξ±-tail, and we can furtherclaim that
Lβ1n,b(Ξ±)β Jβ1
n (Ξ±, P )β 0 (5)
in probability where Fβ1(Ξ±) denotes the Ξ±-quantile of a distribution F . Eq. (5) is the basis forclaiming that subsampling confidence intervals for t(P ) based on Lβ1
n,b(Ξ±) are asymptotically valid.
2.2 Subsampling hypothesis tests
With great generality, we assume that t(P ) = 0 under H0 : P β P0, and t(P ) > 0 under H1 : P βP1. Hence, the null distribution
Jn(x, P0) = ProbP0{Οntn(X1, . . . , Xn) β€ x}
is now of interest since the ideal Ξ±-level test rejects H0 in favor of H1 when Tn := Οntn(X1, . . . , Xn)is bigger than Jβ1
n (1β Ξ±, P0).Using the same subsampling framework described as in the previous subsection, Politis and
Romano (1996) defined the subsampling estimator of Jn(x, P0) as follows:
Gn,b(x) := Nβ1n
Nnβi=1
1{Οbtn,b,i β€ x}. (6)
Comparing Gn,b(x) to Ln,b(x) note that the former uses the information that t(P ) = 0 under H0
while the latter estimates the centering constant (the statistic tn) from the data.Politis et al. (1999) give a proof of the consistency of the test that rejects the null hypothesis at
level Ξ± when Tn exceeds the 1β Ξ± quantile Gβ1n,b(1β Ξ±). In other words, the test rejects H0 when
Nβ1n
Nnβi=1
1{Tn β₯ Tn,b,i} > 1β Ξ±. (7)
where Tn,b,i = Οbtn,b,i. The intuition behind eq. (7) is that under the null hypothesis, the subsampleddistribution of the Tn,b,i approximates the sampling distribution of Tn, and so we can reject thenull hypothesis if Tn is above the 1β Ξ± quantile of the subsampled distribution.
Due to its very general applicability, this subsampling test has motivated significant theoret-ical and practical development; see, for example, Choi (2005); Choi and Chue (2007); Delgado,RodrΔ±guez-Poo, and Wolf (2001); Gonzalo and Wolf (2005); Lehmann and Romano (2005); Linton,Maasoumi, and Whang (2005); Politis and Romano (2008a,b); Politis, Romano, and Wolf (2001).The shortcoming of this approach is that when the alternative hypothesis is true, Gβ1
n,b(1βΞ±) is nota good approximation of the correct threshold Jβ1
n (1β Ξ±, P0). To see this, note that the center ofthe subsampling distribution of the Tn,b,i drifts towards infinity, albeit more slowly than the sam-pling distribution of Tn. The consequence is a test thatβalthough asymptotically consistentβdoesnot have optimal power, and does not provide an efficient notion of p-value.
This shortcoming can be remedied while, at the same time, improving the power of the subsam-pling test through an appropriate centering. To see how, consider the test constructed by inverting
3
the confidence regions obtained by the quantiles of the data-centered subsampling distributionLn,b(x). Such a test rejects H0 when
Nβ1n
Nnβi=1
1{Οntn β₯ Οb(tn,b,i β tn)} > 1β Ξ±, (8)
i.e., when
Nβ1n
Nnβi=1
1{Tn β₯ Tn,b,i β Οbtn} > 1β Ξ±. (9)
Under the null hypothesis, Οbtn βP 0 by Slutskyβs theorem, so the above test behaves similarlyto test (7) under the null. Under the alternative, however, the subsampling distribution of theΟb(tn,b,i β tn) remains approximately centered at 0 instead of drifting to infinity, and thus test (8)has improved power, as will be formally shown in the next section.
Remark 2. While the tests described in this section appear to be one sided, they can be used totest two sided alternatives through an appropriate choice of test statistic tn. For example, to testH0 : E [Xi] = 0 versus H1 : E [Xi] 6= 0, the statistic tn = |X| with rate Οn = n1/2 is appropriate.By the central limit and continuous mapping theorems, Οntn satisfies the limiting distributionassumptions and produces an asymptotically valid two sided test.
3 Subsampling p-values
The tests in the preceding section, and in all previous subsampling literature, are defined in terms oftheir critical regions which provide asymptotically consistent decision rules. Nonetheless, in practicep-values are often desired as an approximate measure of the strength of the evidence against thenull. In the present section, we describe the construction of p-values for the tests described byequations (7) and (8) and argue that the the centered test (8) is better suited for this purpose thanits uncentered counterpart.
For the uncentered test (7), the p-value equals the proportion of the Tn,b,i which exceed theobserved test statistic Tn. That is, the βuncentered p-valueβ is
puc = Nβ1n
Nnβi=1
1{Tn < Tn,b,i}. (10)
It is clear from this definition that puc is the smallest Ξ± at which the null hypothesis would notbe rejected by subsampling test (7). When the null hypothesis is true, puc is good measure of theprobability of a test statistic being as extreme or more extreme than what was observed. However,when the alternative hypothesis is true, puc is less adequate. In this situation, the subsamplingdistribution of the Tn,b,i has its center of location at Οbt(P ) which tends to infinity as Οb β β.Despite this divergence, the subsampling test (7) has been proven to be consistent, so that puc
tends to zero under the alternative hypothesis. However, this convergence does not occur at anoptimal rate.
To intuitively see why, recall the construction of the data-centered subsampling test (8) wherethe subsampled test statistics are centered at tn. Since tn is a consistent estimate of t(P ) undereither hypothesis, this forces the subsampling distribution Ln,b(x) to have its location centeredaround zero whether or not the null hypothesis is true. For this reason, for the remainder of the
4
paper we focus on the centered subsampling test (8), and investigate its p-value given by
pc = Nβ1n
Nnβi=1
1{Tn < Οb(tn,b,i β tn)}. (11)
Since the subsampling distribution Ln,b(x) stays centered, under the alternative we typically havetn,b,i β tn < tn,b,i, and therefore pc < puc; this will be made precise in Theorem 1 below.
Remark 3. Because of the above discussion, the p-value defined as pc in equation (11) is therecommended one for use with subsampling and similarly with b/n bootstrap tests. Note that thisnotion of p-value is valid even in the full-sample size bootstrap case, i.e., bootstrap with b = n,when the latter has been shown to be valid in the problem at hand.
Before providing our formal results, we first introduce a final assumption on the dependencestructure of the data and the way the subsamples are constructed.
Assumption 2. The data satisfy one of the following two dependence conditions, and the sub-sampling scheme is chosen accordingly, as discussed at the beginning of Section 2.1.
1. The data X1, X2, . . . , Xn are i.i.d., taking values in a sample space S with common probabilitylaw P .
2. X1, X2, . . . , Xn is a sample of stationary observations taking values in a sample space S.Denote the probability law governing the infinite, stationary sequence . . . , Xβ1, X0, X1, . . .by P . Further assume that Ξ±X(m) β 0 as m β β, where Ξ±X(Β·) is the Ξ±-mixing sequencecorresponding to {Xt} (see Rosenblatt, 1956).
Theorem 1. Let b satisfy (3) with k as discussed in Remark 1, and let Οb and Οn satisfy (4). Then,under Assumptions 1β2, if P β P1 the centered p-value, pc given by equation (11) is not bigger thanpuc given by equation (10) with probability tending to one, and if the test statistic tn is nonnegativewith probability 1, then pc β€ puc with probability 1 for all P β P, whether P β P0 or P β P1
(under the null and alternative hypotheses).
Theorem 1 provides formal justification for our claim that the data-centered subsampling test(8) is more powerful than the uncentered test (7). The recommendation of not explicitly imposingthe null hypothesis on the test statistic in question has also been noted in the related frameworkof bootstrap hypothesis testing in regression (Paparoditis and Politis, 2005).
The next theorem establishes that, as desired, the centered p-value has a limiting uniformdistribution under the null hypothesis, and that pc βP 0 under the alternative.
Theorem 2. Under the conditions of Theorem 1,
i. if P β P0, then ProbP {pc β€ x} βP x for 0 < x < 1.
ii. if P β P1, then pc βP 0.
4 Simulations
We ran five simulation experiments in order to test our methods. In each case, we calibrated thesubsampling procedure by choosing a block size b which achieved the desired Ξ± = 0.05 under thenull hypothesis for the centered version of the test; see Chapter 9 in Politis et al. (1999) for furtherdiscussion. Each test was repeated 1000 times.
5
0.0
0.2
0.4
0.6
0.8
1.0
0
Sim
ulat
ed p
βva
lues
ββββββββββββββββββ
βββββ
ββββββ
β
β
β
ββββββ
β
ββββββ
β
β
β
β
β
ββββββ
β
βββ
ββ
βββββββββββββ
βββββββ β
ββββ
ββββββ
β
β
β
ββββββ
β
ββββββ
β
β
β
β
β
ββββββ
β
βββ
ββ
βββββββββββββ
βββββββ
β
β
β
β
β
ββ
β
ββ
β
β
β
β
β
β
β
β
β
ββ
βββ
β
β
β
ββ
β
β
β
β
β
β
β
ββ
β
ββ
β
β
ββ
βββ
β
β
β
β
β
ββ
β
β
β
ββ
β
β
β
β
β
β
ββ
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
ββββ
β
β
β
β
β
β
β
β
β
ββ
β
β
ββ
β
β
β
β
βββ
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
ββ
β
β
β
β
β
ββ
β
β
β
β
β
β
β
ββ
β
ββ
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
ββββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
ββ
β
β
ββ
β
β
β
ββ
β
β
β
β
β
β
ββ
β
β
β
β
ββ
β
β
β
β
β
ββ
β
β
β
β
β
β
ββ
β
ββ
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
ββ
β
β
β
β
β
β
β
β
ββββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
βββ
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
ββ
β
β
β
β
β
ββ
β
β
β
β
β
β
β
ββ
β
ββ
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
ββββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
ββ
β
β
ββ
β
β
β
ββ
β
β
β
β
β
β
ββ
β
β
β
β
ββ
β
β
β
β
β
ββ
β
β
β
β
β
β
ββ
β
ββ
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
ββ
β
β
β
β
β
β
β
β
ββββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
βββββ
β
β
ββ
β
β
ββ
β
β
β
ββ
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
ββββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
ββ
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
βββ
β
β
ββ
β
β
ββ
β
β
ββ
β
β
β
ββ
ββ
β
β
βββββ
β
β
β
β
β
β
β
β
βββ
β
β
β
ββ
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
ββ
β
ββ
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββββ
β
β
β
β
β
β
β
β
β
β
β
β
ββ
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
ββ
β
β
β
ββ
β
β
β
β
β
β
β
ββ
β
ββ
β
β
ββββ
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
ββ
β
ββ
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
βββ
β
β
β
β
β
β
β
β
β
β
β
β
βββ
β
β
β
β
β
ββ
β
β
β
β
β
β
ββ
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
βββ
β
β
ββ
β
β
β
ββ
β
β
ββ
β
β
β
βββ
ββ
β
β
βββββ
β
β
β
β
β
β
β
β
βββ
β
β
β
ββ
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
ββ
β
ββ
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββββ
β
β
β
β
β
β
β
β
β
β
β
β
ββ
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
ββ
β
β
β
ββ
β
β
β
β
β
β
β
ββ
β
ββ
β
β
ββββ
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
ββ
β
ββ
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
βββ
β
β
β
β
β
β
β
β
β
β
β
β
βββ
β
β
β
β
β
ββ
β
β
β
β
β
β
ββ
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
βββ
β
β
ββ
β
β
β
ββ
β
β
ββ
β
β
β
βββ
β
β
ββ
ββ
ββ
β
βββββ
ββ
β
β
ββββββ
βββ
β
ββββ
β
β
ββ
ββ
β
ββ
β
β
ββ
β
ββ
β
βββββ
β
β
β
β
ββ
β
β
β
β
β
β
ββ
β
β
β
ββ
β
β
ββ
β
ββ
ββ
β
β
β
ββ
β
ββββ
β
β
βββ
ββ
β
βββ
β
β
βββ
β
β
ββ
β
βββββββ
β
β
ββ
ββ
β
β
β
β
β
β
ββ
β
β
βββ
β
ββ
ββ
βββ
β
βββ
β
β
βββ
ββββ
βββ
β
βββββ
ββ
β
β
βββββββ
ββ
β
ββ
β
ββββββ
β
β
βββββ
β
βββ
β
β
βββββ
β
βββββ
β
β
β
β
β
ββ
β
β
β
β
β
β
β
ββ
β
β
β
β
ββββ
β
β
β
β
β
β
ββ
β
β
ββ
β
βββββ
β
β
ββ
β
β
ββββ
β
ββββ
β
ββββ
β
ββ
β
ββ
β
ββββββ
β
βββ
ββ
ββ
β
β
β
ββ
β
β
ββ
β
β
β
βββββββ
ββββ
β
β
β
βββ
β
β
β
ββββ
β
βββββ
ββ
β
ββββββ
β
βββ
β
βββ
ββ
β
β
β
β
ββ
β
β
β
β
β
βββ
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
ββ
ββ
β
β
ββ
β
β
β
β
ββββ
β
βββ
β
β
βββ
β
β
β
β
β
ββββ
β
β
ββ
ββ
β
β
β
ββ
ββ
β
β
β
ββββ
ββ
ββββ
β
βββ
β
β
βββ
ββββ
βββ
β
βββββ
ββ
β
β
βββββββ
ββ
β
ββ
β
ββββββ
β
β
βββββ
β
βββ
β
β
βββββ
β
βββββ
β
β
β
β
β
ββ
β
β
β
β
β
β
β
ββ
β
β
β
β
ββββ
β
β
β
β
β
β
ββ
β
β
ββ
β
βββββ
β
β
ββ
β
β
ββββ
β
ββββ
β
ββββ
β
ββ
β
ββ
β
ββββββ
β
βββ
ββ
ββ
β
β
β
ββ
β
β
ββ
β
β
β
βββββββ
ββββ
β
β
β
βββ
β
β
β
ββββ
β
βββββ
ββ
β
ββββββ
β
βββ
β
βββ
ββ
β
β
β
β
ββ
β
β
β
β
β
βββ
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
ββ
ββ
β
β
ββ
β
β
β
β
ββββ
β
βββ
β
β
βββ
β
β
β
β
β
ββββ
β
β
ββ
ββ
β
β
β
ββ
ββ
β
β
β
ββββ
ββ
ββββ
β
βββ β
β
β
ββ
β
ββ
β
β
ββββββ
β
ββ
β
ββββ
β
ββ
β
ββββββ
β
βββ
ββββ
β
β
β
ββ
βββββββββββ
β
ββ
β
β
β
ββββ
β
β
β
ββ
β
βββββββ
ββββ
β
β
ββββββ
β
βββββββββββββββββββββββββββ
ββ
β
βββ
β
β
βββββ
β
β
ββ
β
βββ
β
ββββββββ
ββ
βββ
β
β
ββββ
β
β
β
βββββββ β
β
ββ
β
βββ
β
β
β
βββ
β
ββ
β
ββββ
β
ββββββββββββββ
β
βββββββ
β
ββββββββββββββββ
βββ
β
ββ
β
ββββ
β
βββββββββββββββββββββββββ
β
ββββββββββ
β
βββββββββββββββββββββββββββββββββ
βββββ
β
β
β
βββββββββ
β
ββ
β
βββββ
β
ββββββββ
β
β
ββββ
β
βββββ
β
β
β
βββββββββ
βββ
β
β
β
ββ
β
β
β
βββ
β
ββ
β
ββββ
β
ββββββ
β
ββββββββββ
β
ββ
β
β
βββ
β
ββ
ββββββββββββ
β
βββββ
β
ββββββ
ββ
βββββββββββββββ
β
β
ββββ
ββ
β
ββ
β
β
β
ββββββββ
β
β
ββ
β
ββββ
β
β
ββββ ββ
ββ
β
βββ
β
β
β
βββ
β
ββ
β
ββββ
β
ββββββββββββββ
β
βββββββ
β
ββββββββββββββββ
βββ
β
ββ
β
ββββ
β
βββββββββββββββββββββββββ
β
ββββββββββ
β
βββββββββββββββββββββββββββββββββ
βββββ
β
β
β
βββββββββ
β
ββ
β
βββββ
β
ββββββββ
β
β
ββββ
β
βββββ
β
β
β
βββββββββ
βββ
β
β
β
ββ
β
β
β
βββ
β
ββ
β
ββββ
β
ββββββ
β
ββββββββββ
β
ββ
β
β
βββ
β
ββ
ββββββββββββ
β
βββββ
β
ββββββ
ββ
βββββββββββββββ
β
β
ββββ
ββ
β
ββ
β
β
β
ββββββββ
β
β
ββ
β
ββββ
β
β
βββββ
β
ββββββββββββββββββββββ
β
ββ
β
ββββββ
β
ββββββββββββββββββββββββββββββββββββββ
β
ββββ
β
βββ
β
β
β
βββββββββ
β
βββββ
β
βββββββββββ
β
ββββββββββ
β
βββββββ
β
ββββ
β
βββββββββββ
β
ββββββββββββ
β
ββββββββββ
βββββββββββββ
ββ
βββββ
β
βββββββββββββββ
β
ββ
β
βββββββ
β
ββ
β
ββββββ
β
ββββββ
β
ββββ
β
ββ
β
ββββββββ
β
βββββββ
β
ββββββ β
βββββββββββββββββββββ
ββ
βββββββ
β
βββββββββββββββββββββββββββββββ
β
βββ
β
βββββββββββ
β
ββββ
β
βββββββββ
β
βββββββββ
β
ββββββ
β
ββββ
β
ββββββββββ
β
βββββββββ
β
βββββββ
βββββββββββββ
ββ
βββββ
β
βββββββββββββββ
β
ββ
β
βββββββ
β
ββ
β
ββββββ
β
ββββββ
β
ββββ
β
ββ
β
ββββββββ
β
βββββββ
β
ββββββ β
βββββββββββββββββββββ
ββ
βββββββ
β
βββββββββββββββββββββββββββββββ
β
βββ
β
βββββββββββ
β
ββββ
β
βββββββββ
β
βββββββββ
β
ββββββ
β
ββββ
β
ββββββββββ
β
βββββββββ
β
βββββββ
βββββββββββββββββββββββββββββ
β
ββββββββββββββββββββββ
β
ββββββββββββββββββββββββ
β
β
βββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β
ββββ
β
βββββββββββββββββββββββββββββββββββββββββββ βββββββ
β
β
βββββββββββ
ββ
βββββββββ
β
β
βββββββββ ββββββββββ
β
β
ββββββββββ
β
βββββββββββββ
β
β
ββββββββββββββββββββ
β
β
β
ββββββββββββββ βββββββ
β
β
βββββββββββ
ββ
βββββββββ
β
β
βββββββββ ββββββββββ
β
β
ββββββββββ
β
βββββββββββββ
β
β
ββββββββββββββββββββ
β
β
β
ββββββββββββββ βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββββββββ βββββββββββ ββββββββββββββββββββ
ββββββββ βββββββββββ ββββββββββββββββββββ
ββββββββ
0.0 0.1 0.2 0.3 0.4 0.5
0.0
0.2
0.4
0.6
0.8
1.0
Difference in means
Pow
er
TβtestBCBUSCSU
Figure 1: One sample tests for the mean of normal data.
The results of each experiment are presented as a two panel plot. The bottom panel showsempirical power curves, and the top panel shows boxplots of the simulated p-values for each of fivetypes of hypothesis tests at each considered true value of the parameter in question. Each clusterof five box plots shows the distributions of p-values at one value of the parameter. The boxeswithin a cluster correspond to the five following tests in order from left to right: a classical test; thecentered b/n bootstrap; uncentered b/n bootstrap; centered subsampling; and finally uncenteredsubsampling. The x-axis position of the middle box in each cluster indicates the true value of theparameter.
Experiment 1 (t-test): For the first experiment, we simulated n = 100 observations from aN(Β΅, 1) distribution for Β΅ = 0.0, 0.05, . . . , 0.5. We tested the hypothesis H0 : Β΅ = 0 versusthe alternative H1 : Β΅ 6= 0 using the test statistic tn = |X|, the absolute value of the samplemean. The chosen block size was b = 1; in this setting a constant block size will provideasymptotically correct results because the limiting sampling distribution and the finite samplesampling distribution are the same. Results are shown in Figure 1. The centered subsamplingand bootstrap tests are slightly biased towards rejecting the null hypothesis, but are extremelycompetitive with the classical, and optimal, t-test. The two uncentered tests are only slightlyless powerful than the t-test.
Experiment 2 (Ο2 independence test): In the second simulation, we ran a simple test for in-dependence on a 2 Γ 2 table with sample size n = 100. Pairs of Bernoulli random variables(X,Y ) were generated from the model defined by P (X = 1) = 1/2, and P (Y = 1|X = 1) = py
and P (Y = 1|X = 0) = 1βpy, so the null hypothesis of independence is satisfied for py = 1/2and not satisfied otherwise. In simulation we considered values py = 0.5, 0.525, . . . , 0.75. Thetest statistic was taken to be tn = X2/n, where X2 is the standard Ο2 test statistic. Theresults are compared with the classical Ο2 test. In this case, the subsampling tests appearmore powerful than their bootstrap counterparts, and the centered subsampling test may
6
0.0
0.2
0.4
0.6
0.8
1.0
0
Sim
ulat
ed p
βva
lues
βββ
β
β
β
β
ββ
ββ
β
β
ββ
β
βββ
β
β
βββ
β
β
βββ
β
ββ
β
β
β
β
β
β
β
β
ββ
β
βββ
β
β
β
β
βββ
β
β
β
β
β
β
ββ
β
ββ
β
β
ββ
β
β
β
β
β
β
ββββ
β
β
ββββ
β
β
β
β
β
β
β
ββ
β
ββ
β
β
β
ββ
β
β
β
β
β
β
βββ
β
ββ
β
β
β
ββ
β
β
ββ
ββ
ββ
β
β
β
β
βββ
β
β
β
βββ
βββ
ββ
β
β
β
β
β
β
β
β
β
ββ
β
βββ
β
β
β
β
βββ
β
β
β
β
β
β
ββ
ββββββ
ββββ
β
β
β
β
β
βββββ
β
β
ββββ
ββ
β
β
ββ
β
β
ββ
β
ββ
β
β
βββ
β
β
β
ββ
β
β
βββ
ββ
β
β
ββ
ββ
β
ββ
ββ
β
β
ββ
β
β
β
β
βββ
β
β
β
β
βββ
β
ββ
ββ
β
β
β
β
β
β
β
β
β
ββ
β
βββ
β
β
ββ
β
βββ
β
β
β
β
β
β
ββ
βββββ
β
β
ββ
β
β
β
β
ββ
β
ββββ
β
β
ββββ
β
β
β
β
β
β
β
β
β
ββ
β
ββ
β
β
β
β
β
ββ
β
β
β
β
βββ
β
ββ
β
β
β
ββ
β
ββ
ββ
β
β
ββ
β
β
β
β
βββ
β
β
β
β
βββ
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
ββ
β
βββ
β
β
β
β
β
βββ
β
β
β
β
β
β
ββ
ββββββ
ββββ
β
β
β
β
ββ
βββββ
β
β
βββ
β
β
ββ
β
β
β
β
β
β
β
ββ
β
β
ββ
β
β
βββ
β
β
β
ββ
β
β
β
β
β
β
β
β
βββ
β
β
ββ
β
β
β
β
β
β
ββ
β
βββ
β
β
ββ
β
β
ββ
β
β
βββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
βββ
β
β
β
β
β
β
β
β
βββ
β
β
β
β
β
β
βββ
β
βββββ
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
ββ
β
ββ
β
β
β
βββ
β
β
βββ
β
β
β
β
β
β
β
β
β
β
β
ββ
βββ
β
β
β
β
β
β
β
βββ
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
ββ
β
β
β
βββ
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
βββ
β
β
β
β
β
βββ
β
β
β
β
β
β
β
β
β
βββ
ββ
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
ββ
β
βββ
β
β
ββ
β
β
ββ
β
β
ββββ
β
β
β
β
β
β
β
β
β
β
β
β
β
βββ
βββ
β
β
β
β
β
β
β
β
βββ
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
ββ
β
β
β
β
β
β
ββ
β
β
βββ
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
βββ
β
β
β
β
β
β
β
βββ
β
β
β
β
β
β
β
β
β
β
βββ
ββ
β
β β
ββ
β
β
β
β
β
ββ
β
β
β
ββ
β
β
β
β
ββ
ββ
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
ββ
β
ββ
β
β
β
βββ
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
ββ
β
β
β
β
ββ
β
β
β
β
β
β
β
ββ
ββ
β
ββ
β
ββ
β
β
ββ
ββ
β
β
β
β
β
ββ
β
β
ββ
ββ
β
β
β
β
β
β
ββ
β
β
β
ββ
β
β
βββ
β
β
β
ββ
β
β
β
β
ββ
ββββββ
β
β
β
β
β
β
ββββ
β
β
β
ββ
β
β
β
ββ
β
ββ
β
β
β
β
βββ
β
β
β
ββ
ββ
β
β
β
ββ
β
βββ
β
ββ
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
ββ
ββ
ββ
β
β
β
β
β
β
ββ
β
β
βββ
β
β
β
β
ββ
β
β
β
β
ββ
β
β
β
ββ
ββ
β
β
β
β
β
ββ
β
β
β
β
βββ
β
β
β
β
βββ
β
β
βββ
β
ββ
β
ββ
β
β
β
β
ββ
β
βββ
βββ
β
ββ
β
β
β
β
ββββ
β
β
β
β
β
β
β
β
βββ
β
ββ
β
β
β
β
β
βββ
β
ββ
β
β
ββ
β
β
β
β
β
β
βββ
β
βββ
β
β
β
β
ββ
β
β
β
βββ
β
β
βββ
β
ββ
β
β
β
β
β
β
β
β
βββββββ
β
ββ
β
β
β
β
ββββ
β
β
βββ
β
β
β
ββ
βββ
β
β
β
β
ββ
β
β
ββ
ββ
β
β
β
β
β
β
ββ
β
βββ
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββββ
β
ββ
βββ
ββ
ββ
βββ
β
ββ
β
β
β
ββ
β
β
β
ββ
ββ
β
β
ββ
β
βββ
β
ββ
β
ββ
β
β
β
β
β
ββ
ββ
β
ββ
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
ββ
β
β
β
β
ββ
β
ββ
β
β
βββββ
β
ββ
β
β
β
β
β
β
ββ
β
β
ββ
βββ
β
β
βββββ
ββ
β
β
β
β
β
βββ
β
ββ
β
ββ
βββ
β
ββ
β
β
β
β
β
β
β
β
β
βββββββ
ββ
ββ
βββββ
β
ββ
β
ββ
ββ
βββ
β
β
β
β
βββ
ββββ
ββββ
β
β
β
β
βββββ
β
ββ
β
β
ββ
β
ββ
ββ
ββββ
β
β
β
β
β
β
ββ
β
ββββββββββ
βββ
βββ
ββ
ββ
β
ββ
β
β
β
β
β
βββββ
ββ
ββ
ββ
β
β
βββ
ββ
ββββ
β
ββ
β
ββββ
β
β
β
β
β
βββ
β
ββ
β
ββ
β
β
ββ
β
β
β
ββ
β
βββββββ
β
ββββ
β
β
β
β
β
β
β
β
β
βββββββββ
ββ
ββ
βββββ
β
βββ
β
ββ
ββββ
ββββ
ββ
β
β
β
βββ
βββββ
βββββ
β
β
ββ
β
ββββββ
β
ββ
β
β
βββ
β
ββ
ββ
ββββ
β
β
β
β
β
β
ββ
β
β
βββββββββββββ
βββ
β
ββββ
ββ
β
β
β
β
β
β
β
β
β
β
βββββ
ββ
βββββ
β
ββ
β
ββ
ββ
βββββ
β
ββ
β
ββββββ
ββ
β
β
β
β
βββββ
β
ββ
β
β
βββ
β
β
ββ
ββ
β
β
β
ββ
β
β
ββββββββββββ
β
ββββ
β
β
ββ
β
ββ
β
βββ
β
ββββββββββββ
β
βββ
βββββββββββββ
β
β
ββββ
β
ββββ
ββ
ββ
βββββββ
β
ββ
β
ββ
β
β
βββ
β
β
β
β
β
β
ββββ
β
ββ
β
β
β
β
β
ββ
β
βββββββ
β
β
β
βββ
β
ββββ
β
ββββββ
β
ββββββββ
β
β
β
β
β
β
β
β
β
β
ββββββ
ββ
βββ
β
ββββ
β
βββββ
β
βββββββ
βββ β
βββ
β
βββ
β
βββββββββββββββββββββββ
β
ββββ
β
ββββββββ
βββ
β
ββββ
β
β
β
βββ
ββββ
βββ
β
β
ββββ
β
βββ
β
βββ
β
βββββββββββββββ
β
βββ
ββββ
ββ
ββ
β
β
βββββββββββββββ
βββ
β
βββ
βββββββββββββββββ
β
ββ
β
ββββ
ββββββββββ
β
β
ββ
β
βββ
βββ
β
β
ββ
β
β
β
β
β
βββββββββββββββ
β
ββ
βββ
ββ
β
βββββββββββ
ββββ
β
βββββββββββββββββββββββββββ
β
ββββ
βββββββββ
βββ
βββ
βββ
ββββββ
β
ββββββββ
ββββ
ββββββββ
β
ββββ
β
βββββ
β
βββββββββββββββββββ
ββ
β
ββββββ
ββ
βββ
β
βββββββββββ
ββ βββ
β
β
βββββββββββββββββββββββββ
β
βββ
β
βββββββββββ
β
β
βββββ
β
β
βββββββ
β
βββ
β
β
ββββ
β
βββ
β
β
β
ββββββββββββββββ
βββ
ββββ
ββ
ββ
β
β
ββββββββββ
ββ
ββββββββββ
β
β
ββ
β
ββ
β
β
βββββββ
β
ββββββ
β
β
β
βββββββββ
β
βββββ
β
β
β
βββββββββββββββββββββ
β
ββ
β
β
β
βββββββββββββββββββ
βββββββββββ
β
βββββββββββββββββ
β
βββ
β
ββββββββββββββββ
β
β
β
ββββββββββββββ
β
ββββββ
β
ββ βββββββββ
ββββ
β
β
β
β
βββββββ
β
βββββ
β
β
ββββββββ
β
ββββββ
β
ββββββββββββββββββββ
β
βββββββββββββ
ββ
ββββββββ
β
ββββββββββ
β
ββ
β
ββββββββββ
ββ
βββββββββββ
β
βββββββ
β
ββββββ
ββ
ββ
β
β
β
ββββββ
β
βββ
ββ
ββββββ
β
ββ
β
β
β
βββββββββββββ
β
ββββββββββββββ
β
ββββ
β
β
β
ββββ
ββ
βββββββ
β
β
β
βββββββββββββ
β
ββ
ββ
ββββββββ
β
ββββ
β
ββ
β
ββββββββββ
β
ββββββ
β
ββββββββββββββββββββ
β
ββββββββββββββββββββββ
β
ββββββββββββ
β
ββ
β
βββββββββ
β
β
β
ββββββββββ
β
ββββββββ ββββ
βββββ
β
β
βββββββ
β
ββββ
β
β
β
βββββββ
β
βββ
β
β
β
βββββββββββ
βββ
β
βββββββββββββββββββββ
ββββββ
β
ββ
β
ββββββββ
β
β
β
ββββββββββ
β
βββββ
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β
β
β
βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ βββββ
βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β
ββ
β
βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ ββββ
βββββββββββββββββββββββββββββββββββββββββββββββββ
β
βββββββββββββββββββββ
β
βββββ
β
β
β
βββββββββββββββββββββββββββββββββββ
β
ββββββββ
βββββββ βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β
β
β
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ ββββ
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β
β
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β
βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ βββββββββββ
βββββββββββββββββββββββββββββββββββββββ
β
βββββββββββββββββββββββββββββββββββββββββββββββββββββββββ ββββ
ββββββββββ
β
ββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β
βββββββββββββ
β
βββββββββββββββββββββββββββ
βββββββββββββ
ββββ
ββββββ
β
βββββββββββββββββββββββββββββ βββββββββ
ββββββββββββββββ
β
βββββββββββββββββββββββββββββββββββββββββββββββββ βββββ
βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β
ββββββββββββββββββββββββββββββββββββββββ
0.50 0.55 0.60 0.65 0.70 0.75
0.0
0.2
0.4
0.6
0.8
1.0
p_y
Pow
er
ChiβSqBCBUSCSU
Figure 2: Tests for independence using the Ο2 test statistic.
be somewhat more powerful than the classical test (which is slightly biased under H0); seeFigure 2.
Experiment 3 (regression coefficient): For the third experiment, we generated n = 100 pairs(X,Y ) with X distributed N(0, 1) and Y = Ξ²X + Ξ΅, with Ξ΅ independent of X and having a t-distribution on 5 degrees of freedom. We tested whether the slope of the fitted linear regressionwas statistically significant by subsampling/bootstrapping pairs (Xi, Yi). The simulation wasrun for Ξ² = 0.0, 0.05, . . . , 0.5, and we used the test statistic tn = |Ξ²|, where Ξ² is the slope ofthe linear regression fitted with intercept. The results are shown in Figure 3. The centeredsubsampling and bootstrap tests are as powerful as the classical alternative.
Experiment 4 (Wilcoxon test): For the fourth experiment we generated n = 100 observationsfrom a Cauchy distribution and performed a two sided test for the null hypothesis that thelocation of the median was 0 based on Wilcoxonβs signed rank test statistic, W . We used thetest statistic tn = |W/[n(n+1)/4]β1|, which asymptotically satisfies the limiting distributionassumptions with rate Οn = n1/2 (see DasGupta, 2008, Chapter 24). The simulations wererun with true simulated medians 0.0, 0.1, . . . , 1.0. The two centered tests showed no loss inefficiency as compared with the Wilcoxon procedure. The subsampled test statistic tb hasa discrete sampling distribution on a relatively small number of values; this discreteness isclearly visible in the p-value boxplots in Figure 4.
Experiment 5 (Kolmogorov-Smirnov): In the final experiment we generated n = 100 obser-vations from the mixture distribution
fX(x) =(
12Ο(xβ Β΅) +
12Ο(x+ Β΅)
),
7
0.0
0.2
0.4
0.6
0.8
1.0
0
Sim
ulat
ed p
βva
lues
ββ
ββ
ββββββ
ββ
β
ββ
β
ββ
ββ
ββ
ββ
β
βββββ
β
ββ
ββ
β
β
β
βββ
β
β
ββ
β
β
β
β
β
β
β
ββ
β
β
ββ
β
ββ
β
ββ
β
β
β
ββββ
β
ββ
β
β
β
β
ββ
β
β
β
β
β
ββ
ββ
β
βββ
ββ
β
β
β
β
β
β
β
ββ
β
β
β
β
ββ
β
βββ
ββ
β
βββ
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
ββ
ββββ
βββ
ββ
β
ββ
ββ
β
ββ
ββ
ββ
β
βββββ
β
ββ
βββ
ββββ
ββ
β
β
β
ββ
β
ββ
β
β
ββ
β
ββ
β
ββ
β
ββ
ββ
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
ββ
β
ββ
β
β
β
β
β
β
β
ββ
β
β
β
β
ββ
β
βββ
ββ
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
βββ
ββ
ββββ
ββ
β
β
ββ
β
ββ
β
βββββ
β
ββ
β
βββββ
β
ββ
βββ
β
β
β
β
β
β
β
ββ
β β
β
β
ββ
β
β
β
β
β
β
ββ
β
β
ββ
ββ
β
β
ββ
β
β
β
β
β
ββ
β
β
β
β
β
ββ
ββ
β
β
β
β
β
β
β
ββ
β
β
β
ββ
β
β
β
β
ββ
β
β
β
ββ
ββ
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
ββ
β
β
β
β
β
βββ
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
βββ
β
β
β
ββ
β
βββ
β
β
β
β
β
β
β
ββ
β
β
ββ
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
ββ
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
ββ
β
β
β
β
β
ββ
ββ
β
β
β
β
β
ββ
ββ
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
ββ
ββ
β
ββ
β
β
β
β
ββ
β
β
ββ
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
ββ
β
βββ
β
β
β
β
β
β
ββββ
β
β
β
β
β
β
β
ββ
β
β
ββ
β
β
β
β
ββ
β
β
β
β
β
ββ
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
ββ
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
ββββ
β
β
β
β
β
β
ββ
β
β
β
β
β
ββ
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
ββ
ββ
β
β
β
β
β
β
β
β
ββ
β
β
ββ
β
β
ββ
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
ββ
β
ββ
β
β
β
β
β
ββ
β
β
β
β
β
ββββ
β
β
ββ
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
ββ
β
β
βββ
β
β
β
β
β
β
β
β
β
ββ
βββ
ββ
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
ββ
β
βββ
β
β
ββ
β
β
β
β
β
ββ
β
β
β
β
ββ
β
ββ
β
β
ββ
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
ββ
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
βββ
β
β
β
β
β
ββ
β
β
β
β
β
ββ
β
β
ββ
β
β
β
ββ
β
β
β
β
ββ
β
β
ββ
β
β
β
β
ββ
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
ββ
β
βββ
β
β
β
β
β
β
ββ
β
β
β
β
ββ
β
β
ββ
ββ
ββ
β
β
β
β
β
ββ
β
β
β
β
ββ
β
β
β
β
β
β
β
β
βββ
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
ββ
β
ββ
β
β
β
β
β
β
ββ
ββββ
β
ββ
β
ββ
β
β
β
ββ
β
ββ
β
β
β
ββ
ββ
β
ββ
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
ββ
β
ββ
β
β
β
ββ
β
β
β
β
β
ββ
βββ
β
β
β
β
ββ
β
β
ββ
β
β
β
β
ββ
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
ββ
β
β
β
β
ββ
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
ββ
β
β
β
β
β
ββ
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
ββ
β
β
β
ββ
β
β
β
β
β
β
βββ
β
β
ββ
β
ββ
ββ
β
β
ββ
β
β
β
ββ
β
β
β
ββ
β
ββ
β
β
β
β
β
β
ββ
β
β
β
β
β
ββ
ββ
β
β
β
β
β
ββ
β
β
β
ββ
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
βββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
βββββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
βββ
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
βββ
β
β
β
ββ
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
ββ
ββββ
β
β
β
β
β
β
β
β
β
β
β
βββ
βββ
β
ββ
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
βββ
ββ
β
β
β
β
β
β
β
β
β
β
β
ββββ
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
ββ
ββ
β
β
ββ
β
β
β
β
β
βββββββ
β
β
β
β
β
β
β
ββ
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
ββββ
β
β
β
β
β
β
β
βββ
β
β
β
β
β
β
β
ββ
β
β
ββ
β
β
β
β
βββ
βββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
ββ
β
β
β
β
β
β
β
β
β
β
β
β
ββ
ββββ
β
β
β
ββ
β
β
β
β
β
β
β
βββ
β
β
β
β
β
ββ
ββ
β
β
β
β
β
βββ
β
ββ
β
βββ
βββ
ββ
β
β
β
β
β
β
β
β
ββ
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
ββ
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
βββ
ββββ
ββ
β
β
β
β
β
β
β
β
β
β
β
β
βββ
β
β
β
β
β
ββ
β
β
ββ
ββ
ββ
β
ββ
β
β
β
β
β
β
β
β
β
ββ
β
β
ββ
β
β
β
ββ
β
β
β
β
β
β
ββ
β
β
β
β
ββ
β
ββ
β
β
β
β
β
ββ
β
β
ββ
β
β
βββ
β
ββ
β
ββ
β
β
β
β
β
ββ
β
β
β
β
β
βββ
β
ββ
β
ββ
β
ββ
β
β
β
ββββ
β
ββββ
β
ββ
βββ
β
βββ
β
β
β
β
ββ
β
β
β
ββ
β
β
β
β
ββ
β
β
β
β
β
ββββ
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
ββββ
β
ββ
β
β
β
β
β
β
β
ββββ
β
βββ
β
β
β
β
β
β
β
β
β
ββ
ββ
β
β
β
ββββ
ββ
β
β
βββββ
β
β
βββ
β
β
β
β
β
β
ββ
βββ
β
β
ββ
ββββ
β
βββ
β
β
ββ
β
β
β
β
β
ββ
β
β
β
β
ββ
β
β
ββ
β
β
ββ
β
β
β
β
β
β
ββββ
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
ββ
β
β
ββ
β
β
ββ
ββββ
β
ββ
β
βββ
β
βββββ
β
β
β
ββββ
ββ
β
β
β
β
ββ
β
β
β
β
ββ
β
β
β
β
β
βββ
β
β
ββ
β
β
β
β
β
ββ
β
β
β
β
βββ
β
βββββ
β
ββ
β
β
β
β
β
ββ
β
βββ
β
βββ
ββ
β
β
ββ
β
ββ
β
β
β
β
ββ
β
β
ββββ
βββ
β
ββββ
β
β
ββ
β
β
ββ
β
β
β
β
β
βββ
βββ
β
β
ββββββ
β
βββ
β
β
βββ
β
β
β
β
ββ
β
β
β
β
ββ
β
β
β
β
β
β
ββ
β
β
β
β
β
β
ββββ
β
β
β
β
β
β
β
ββ
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
ββββ
ββ
β
ββ
β
β
βββ
βββ
β
β
ββββ
ββ
β
β
β
β
βββ
β
ββ
ββ
ββ
ββ
βββββββββββ
β
ββ
βββ
β
ββββ
β
β
β
βββ
βββ
β
β
β
ββββ
β
β
β
ββ
β
β
β
β
β
βββ
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
βββββββ
ββββ
ββ
β
β
ββ
β
β
β
β
β
β
β
β
ββ
ββ
β
β
βββββ
β
βββ
β
β
βββββ
β
β
β
β
β
ββ
β
β
β
β
ββ
β
β
ββ
β
βββββ
β
β
β
β
β
ββ
β
ββ
β
ββ
β
β
β
β
β
β
β
βββ
β
β
βββββ
β
ββββ
β
ββ
β
β
β
β
βββ
β
β
β
β
β
β
β
β
β
β
β
β
ββ
ββ
β
β
β
β
β
β
β
β
β
β
ββββββββ
ββ
β
β
β
βββ
βββββ
β
β
ββ
βββββββ
ββββ
β
β
ββββββ
β
β
β
β
β
β
β
β
β
βββ
β
ββ
β
βββββ
ββ
β
β
ββ
ββ
β
β
β
β
β β
β
β
βββββ
β
ββ
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββββ
ββ
β
ββ
β
ββ
βββ
ββ
β
ββ
β
β
β
ββ
β
β
β
β
β
β
ββ
ββββ
β
β
β
βββ
ββ
β
β
ββ
β
β
β
β
β
β
β
ββ
β
β
ββββββ
β
βββββ
β
ββ
β
β
β
βββ
ββ
ββ
ββ
β
β
β
ββ
β
β
β
ββββββ
β
β
β
β
β
βββ
β
β
β
ββββββββ
β
β
β
β
ββ
βββββ
ββ
β
β
ββββββββββ
β
βββββββ
β
β
β
β
ββ
ββ
ββββ
β
ββ
β
ββββββ
ββ
β
β
β
ββ
β
β
β
β
β
β
β
ββ
β
β
ββββ
β
ββ
β
β
β
β
β
ββ
β
β
ββ
β
β
β
ββ
β
β
β
ββββ
β
β
β
ββ
β
β
β
β
βββββ
β
β
β
ββ
β
β
β
ββ
ββ
β
β
βββββ
β
β
β
β
β
β
β
ββ
βββ
β
β
β
ββ
ββ
β
β
βββ
β
β
β
β
β
βββ
β
ββββ
β
β
β
βββββ
ββββ
β
ββ
ββ
ββ
ββ
βββββββββββββββββ
ββββ
ββββ
β
βββ
β
βββββ
β
β
β
ββββββββ
β
ββ
ββββββ
β
ββββββββ
β
ββββββββββββββββββββ
βββββββββββ
β
ββββββββ
β
β
β
ββ
β
βββββ
β
ββββββ
β
ββββββββββββββ β
β
ββ
β
β
β
βββββββ
β
βββ
β
ββ
ββ
ββββββ
β
ββ
βββ
β
β
β
ββ
β
β
βββββββββ
βββββββββββ
βββββββββββββββ
βββ
β
β
ββ
β
ββ
β
ββββ
β
βββββββββ
β
β
ββ
β
ββ
β
ββββββ
β
βββ
β
ββ
β
ββ
ββ
β
β
β
β
β
β
β
β
β
β
ββββββ
ββββββ
β
β
β
βββββ
β
βββ
ββ
β
β
β
ββ
β
β
β
β
ββ
β
βββββββ
β
β
ββ
β
ββββ
β
β
β
ββββββββ
β
ββ
ββ
βββββββββββ
β
ββββββ
βββ
β
β
βββββ
β
β
β
βββββ
β
ββ
ββββββββββββ
ββ
ββββββββββββββββββββ
β
βββββ
β
β
βββ
β
βββ
β
ββββββ
β
βββββββββββββ
β
β
ββββ
β
ββ
βββββ
β
β
β
ββ
β
β
ββββ
β
β
β
β
β
β
β
β
β
ββββββ
βββββββ
β
β
βββββ
β
βββββ
β
ββ
β
β
ββ
β
βββ
β
βββ
β
βββββββ
β
β
0.0 0.1 0.2 0.3 0.4 0.5
0.0
0.2
0.4
0.6
0.8
1.0
True slope
Pow
er
TβtestBCBUSCSU
Figure 3: Tests for the significance of a regression coefficient.
0.0
0.2
0.4
0.6
0.8
1.0
0
Sim
ulat
ed p
βva
lues
ββ
β
βββββββββββββββββββββββββββββββββ
β
ββββββββββββββββββββββ ββββββ
β
βββββββ
β
β ββ
β
βββββββββββββββββββββββββββββββββ
β
ββββββββββββββββββββββ ββββββ
β
βββββββ
β
β ββββββββββββββββββββββββββ
β
βββββββββββββββββββββββββββββββββββββββ βββββββββββ
β
βββββββββββββ ββββββββββββββββββββββββββ
β
βββββββββββββββββββββββββββββββββββββββ βββββββββββ
β
βββββββββββββ βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β
ββββββββββββ
β
ββββββββββββββββββββββββββββββββ
β
ββββββββββββββββββββββββββββββββββββ
β
ββββββ
β
ββββ
β
βββββββββββββββββββ
β
βββββββββββββββββββββββββββββββββββββ
β
βββββββββββββββ
β
ββββββββββββββββ
β
ββββββββββββ
β
βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β
ββββββββββββ
β
ββββββββββββββββββββββββββββββββ
β
ββββββββββββββββββββββββββββββββββββ
β
ββββββ
β
ββββ
β
βββββββββββββββββββ
β
βββββββββββββββββββββββββββββββββββββ
β
βββββββββββββββ
β
ββββββββββββββββ
β
ββ
β
βββββββββ
β
β
βββ
β
β
ββ
β
β
βββ
β
β
βββ
β
ββ
β
β
β
β
β
βββ
β
β
β
ββββ
ββ
ββββ
β
β
ββ
β
β
β
ββ
β
β
β
βββ
β
β
βββ
β
β
β
β
β
β
ββββββββββββββββββββββββββββββββββββββββββββββ
β
βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β
βββββββββββββββββββββ
β
βββββββββββββββββββββ
β
ββββββββ
β
β
ββββββββββββββ
β
β
β
ββββββββββββββββββββββββββββββββββββββββββββββ
β
βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β
βββββββββββββββββββββ
β
βββββββββββββββββββββ
β
βββββββββ
β
ββββββββββββββ
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
ββ
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
βββ
β
ββ
β
β
β
β
β
β
β
β
β
β
ββ
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
βββ
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
ββ
β
ββ
β
β
ββ
β
β
β
β
β
βββββ
β
β
β
β
β
β
β
β
β
β
ββ
β
β
βββ
βββ
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
βββββ
β
β
β
β
ββ
ββ
β
ββ
β
ββ
β
ββ
β
β
β
β
β
ββ
β
ββ
β
ββ
β
β
β
ββ
ββ
β
β
ββ
β
β
β
β
β
β
ββ
βββββ
β
βββ
β
β
β
ββ
β
ββββ
βββ
β
ββ
β
β
β
ββ
β
β
βββ
β
β
β
βββββββ
β
β
ββ
β
βββ
β
β
β
βββ
β
β
βββββ
ββ
βββββ
βββββ
βββ
β
β
β
β
β
β
β
β
β
ββ
ββ
β
β
β
ββββ
β
ββ
β
β
β
β
β
ββ
β
β
βββββββββββββββββ
β
βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β
βββββββββββββββββββ
β
βββββββββββββββββ βββββββββββββββββ
β
βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β
βββββββββββββββββββ
β
βββββββββββββββββ
βββ
β
βββ
β
β
β
β
β
βββ
β
β
β
β
β
ββββββ
β
ββββ
β
β
β
β
β
ββ
ββββββββ
β
β
ββββ
ββ
βββββ
β
ββ
ββββ
β
β
β
ββ
ββ
ββ
β
β
β
βββ
β
βββ
β
β
ββ
ββ
β
ββββββββββββββββ
ββ
βββ
β
ββββ
β
ββ
β
ββ
β
β
β
β
β
βββ
ββββ
β
ββββ
β
β
β
βββ
β
β
β
ββ
β
β
ββββ
β
β
β
β
β
βββββββββββββββββββ
β
β
βββββββββ
β
ββββββββ
β
βββββββββββββ
β
ββββββ
β
ββ
β
ββββββββββ ββ
β
ββββββββββββββββββββ
β
βββββββββββββββββββ
β
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β
β
ββββββββββββββββββ β
β
βββββββββββββββββββ
β
β
βββββββββ
β
ββββββββ
β
βββββββββββββ
β
ββββββ
β
ββ
β
ββββββββββ ββ
β
ββββββββββββββββββββ
β
βββββββββββββββββββ
β
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β
β
ββββββββββββββββββ
βββββββββββ
β
β
ββββ
β
ββββ
β
ββββββ
β
β
β
β
β
β
ββ
β
β
ββββββββββ
β
βββββ
β
β
β
β
β
βββ
ββ
βββ
β
ββββ
β
ββ
β
β
β
ββββββββ
β
βββββ
β
ββ
β
ββ
β
β
β
β
β
ββ
β
βββββββββ
β
βββββββββββ
β
β
βββββ
β
β
β
βββ
β
ββ
β
βββββββββββ
β
βββββββ
β
ββ
βββββββββββββββ
β
βββββββββββββββββββββββ ββββββββββββββββββ
β
βββββββββββββββββββββββββββββββββββββββββββββββ
β
βββββββββββββββββββββββββββββββββββββββββ
β
ββ
β
ββββββ βββββββββββββββ
β
βββββββββββββββββββββββ ββββββββββββββββββ
β
βββββββββββββββββββββββββββββββββββββββββββββββ
β
βββββββββββββββββββββββββββββββββββββββββ
β
ββ
β
ββββββ
βββββββ
βββββββββ
β
ββββββββββββββββββ
β
β
β
βββ
β
βββββββ
β
βββββββ
β
β
ββββββββββββββββββββββββββ
β
ββββ
ββββββββββββββ
β
ββββββ
β
ββββββββ
βββββββ
βββββββββ
β
βββ
β
ββ
β
β
βββββββββββ
ββββ
β
βββ
β
βββββββ βββββββββββββββ
β
βββββββββββ
β
βββ
β
βββββββββββββββ ββββ
β
βββ
β
βββββββ βββββββββββββββ
β
βββββββββββ
β
βββ
β
βββββββββββββββ
βββββββββββββββββββββββ
β
βββ
β
βββββββββ
β
β
β
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β
βββββββββββββββ
β
ββββββββ
β
ββββββ
β
βββββ
β
β
ββββββ ββββββββββββββ
β
ββββββ β
β
ββββββ ββββββββββββββ
β
ββββββ
0.0 0.2 0.4 0.6 0.8 1.0
0.0
0.2
0.4
0.6
0.8
1.0
Difference in medians
Pow
er
WilcoxonBCBUSCSU
Figure 4: Signed rank test on Cauchy data.
8
0.0
0.2
0.4
0.6
0.8
1.0
0
Sim
ulat
ed p
βva
lues
β
ββ
βββ
β
ββββββ
βββββ ββ
ββββββ
ββββββ
βββ
βββββββββ
β
β
ββββββββββ
β
β
ββ
βββ
ββ
β
ββ
ββ
ββββββ
β
ββ
β
ββ
β
β
β
β
β
ββ
βββ
ββ
β
β
β
ββ
β
β
ββ
β
ββ
β
β
βββββ
β
β
β
ββ
β
ββββββ
β
β
β
ββ
β
β
ββ
β
ββ
βββ
βββ
β
ββ
β
β
β
β
β
ββ
β
ββ
β
β
β
βββ
ββ
β
β
β
β
β
ββ
β
β
β
βββ
ββ
β
β
ββ
β
ββ
β
ββ
ββββ
ββ
β
ββββ
β
β
β
β
ββ
ββ
ββ
β
ββ
β
β
β
β
β
β
β
β
β
β
β
ββ
β
ββ
β
β
β
β
βββ
β
ββ
β
ββ
β
ββ
βββ
β
β
ββ
βββ
β
β
βββ
β
ββ
β
β
β
β
β
β
β
β
β
βββ
β
ββ
β
β
βββββ
βββ
βββββ
β
β
β
β
ββ
ββ
β
ββ
β
βββββ
β
β
β
β
β
β
β
β
β
β
β
ββ
β
ββ
β
β
ββ
β
β
β
ββ
β
ββ
ββ
β
ββ
β
β
ββ
ββ
β
β
β
β
ββ
βββ
β
β
ββ
β
β
ββ
β
β
ββ
β
β
β
β
β
β
β
β
βββ
β
ββ
β
β
ββ
βββββ
β
β
ββ
ββββ
β
β
β
β
β
β
ββ
β
β
β
ββ
β
β
β
β
β
β
ββ
β
β
β
β
ββ
ββ
β
β
β
ββββ
β
β
β
ββ
β
β
β
β
β
β
β
β
β
β
β
β
β
β
βββ
β
β
β
βββββ
β
βββ
β
β
βββ
β
β
β
ββ
β
ββ
β
ββ
ββ
ββββ
ββ
β
ββββ
β
β
ββ
β
ββ
ββ
βββ
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
βββ
ββββ
β
β
ββββ
β
ββββ
β
β
βββ
ββ
βββ
ββ
ββ
ββ
β
β
β
β
β
β
β
β
ββ
β
β
βββββ
β
β
βββ
β
β
β
β
ββ
β
β
ββ
β
β
ββ
β
ββ
β
ββ
ββ
ββββ
ββ
β
ββ
β
β
ββ
β
β
ββ
β
ββ
ββ
β
β
β
βββ
β
β
β
β
β
β
ββ
β
β
β
β
β
β
β
β
βββ
ββββ
β
β
βββ
β
ββ
β
β
β
ββ
β
β
ββ
ββ
ββ
β
β
β
ββ
ββ
β
ββ
β
β
β
β
β
ββ
β
β
β
βββ
β
ββββ
β
β
ββββ
β
ββ
β
βββ
β
β
ββ
βββ
β
β
βββ
βββ
β
ββββ
β
β
β
β
β
ββ
β
β
βββ
β
ββ
β
ββ
β
ββββββββ
βββββ
β
β
β
β
β
β
β
β
β
β
ββββ
ββ
β
β
βββ
βββββββββββ
β
ββββ
βββ
β
βββββββ
ββββββ
β
β
ββββββββ
ββ
βββββ
ββββ
βββ
ββββ
β
ββ
β
β
β
βββββββββββββ
βββββ
ββ
β
β
β
β
βββ
β
βββββ
β
β
βββββ
β
ββ
β
β
β
ββ
β
β
β
ββ
ββ
β
β
βββ
β
β
β
β
β
βββ
β
β
ββ
βββββββ
β
β
β
β
β
ββ
β
β
ββββββββββββββββ
β
ββββββ
βββ
βββββββββ
β
β
βββββ
β
β
βββββ
βββ
β
β
ββββββββ
β
βββ
β
ββββββββββ
β
β
ββ
ββββββββββββββββββββββββ
β
β
β
β
βββ
β
ββββββββ
β
β
ββββ
β
β
ββ
βββ
ββ
ββ
β
βββ
ββ
β
β
βββ
β
β
β
β
βββ
β
ββββ
βββ
βββββββ
β
β
β
β
β
βββ
βββββββββββ
β
ββ
β
β
β
ββ
ββ
ββ
β
ββ
β
β
β
β
ββ
β
ββ
β
βββββββββ
ββ
β
ββ
β
β
β
β
β
ββ
ββ
ββ
β
βββ
βββββ
βββ
ββββββββββββββββββ
βββββββββββββ
β
ββββββββ
β
ββ
β
ββββ
β
ββββββββ
β
ββββββββββββββββββββ
β
ββ
β
β
β
ββ
β
βββββ
β
βββββββββ
β
ββββββββββββββββββ
βββ
β
β
β
ββββ
β
ββ
β
β
ββ
β
ββ
β
βββββ
ββ
β
β
ββ
β
β
ββ
β
β
β
β
β
βββββββββ
β
ββββββββββββββββββββββ
βββββββββββ
β
ββββββββββ
β
ββ
β
βββ
β
ββββββββ
β
ββββββββββββββββββββββββββββββββββ
β
ββββββββββββββββββββββββββββββ
ββββ
β
β
β
β
β
βββ
β
ββ
β
β
ββ
β
ββ
β
ββββ
ββ
β
β
ββ
β
β
β
ββ
βββ
β
βββββββββ
β
βββββββββ
βββ
β
ββ
β
βββββββββ
β
ββββ
ββ
β
βββ
ββββββββββββββββββββββββββββββββββ
β
β
βββββββββββββββ
β
ββββ
ββββββββββββββββββββββββββββββββββββββββββ
β
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β
ββββββββββββββββββββββββββββββββββββββ
ββββββββββ
β
β
βββββ
βββββ
βββββββββββββ
β
ββββββββ
β
β
βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β
βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
βββββββββ
β
β
βββββ
β
ββββ
β
ββββββββ
β
βββββββββββββ
β
βββββββββββ
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
βββ
β
βββββββββββββββββββββ
β
ββββββββββββββββββββββββββββββββββββββββββββ
ββββ
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
βββββββββββ
βββββββββββββββ
β
βββββββββββββββββββββββββββββββββββββββββββββββββββββββ
ββββ
β
βββββββββββββββββ βββββββββββββββ
ββββββββββββββββββββββββββββββββββββββββββββββ
β
βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
βββββββββββββββββββββββββββββ
βββββββββ
β
βββββββββββββββββββββββββββββββββββββ
β
βββββββ
β
ββββββββββββββββββ
βββββββ
ββββββ
βββββββββββββββββββββββββββββ
ββββββββββββββββββββββ
ββββββββββ
ββββββββββββββββββββββββββββββββββββββββββββ
β
ββββββββ
β
βββββββββββββββββββββ
ββββββββββββ
β
βββββββββββ
0.0 0.5 1.0 1.5 2.0 2.5 3.0
0.0
0.2
0.4
0.6
0.8
1.0
True value of mu
Pow
er
KβSBCBUSCSU
Figure 5: Kolmogorov-Smirnov tests on mean 0 variance 1 mixtures of normal data.
where Ο is the standard normal density, and we then scaled the data by (1 + Β΅2)β1/2 so thatthe mean and variance were always 0 and 1 respectively. We considered Β΅ = 0.0, 0.25, . . . , 3.0.We then tested the hypothesis that the data were N(0, 1) using the Kolmogorov-Smirnovtest statistic tn = supx |Fn(x) β Ξ¦(x)| . This is the only test we ran in which subsamplingperformed poorly compared with the classical alternative. No choice of block size producedsimulated Ξ± for the centered tests close to the desired Ξ± = 0.05, so we chose the block size togive the uncentered tests the desired Ξ±. The centered tests were quite powerful but heavilybiased. The uncentered tests were somewhat less powerful than the classical test.
5 Technical proofs
Proof of Theorem 1: Recall that under the alternative hypothesis, tn βP t(P ) > 0. Therefore,when the alternative hypothesis is true, tn,b,i > tn,b,i β tn with probability approaching one. Theconsequence is that, with probability approaching one,
1{Tn < Οb(tn,b,i β tn)} β€ 1{Tn < Tn,b,i}.
Hence,
pc = Nβ1n
Nnβi=1
1{Tn < Οb(tn,b,i β tn)} β€ Nβ1n
Nnβi=1
1{Tn < Tn,b,i} = puc.
If tn β₯ 0 with probability one, then the above inequalities hold with probability one under boththe null and alternative hypotheses. οΏ½
Proof of Theorem 2: The proofs of both parts rely on Theorems 2.2.1 and 3.2.1 in Politis et al.(1999), which establish consistency of subsampling confidence intervals for i.i.d. and mixing data,and proves uniform convergence in probability of Ln,b(x) to Jn(x, P ). We begin with part (i).
9
By equations (11) and (1), pc = 1 β Ln,b(Tn). Let En be the event that supx |Ln,b(x) βJn(x, P )| < Ξ΅. By Theorem 2.2.1 and Theorem 3.2.1 in Politis et al. (1999), En has probabilitytending to one.
So, with probability tending to one,
1β Jn(Tn, P )β Ξ΅ < pc < 1β Jn(Tn, P ) + Ξ΅.
By the above, we can estimate the distribution of p by from the distribution of 1βJn(Tn, P ). SinceJn(x, P ) is the distribution of Tn and since it itself has a continuous limit law J(x, P ), Jn(Tn, P )tends to the uniform distribution on [0, 1]. Therefore, with probability tending to one,
ProbP {1β Jn(Tn, P ) + Ξ΅ < x} β€ ProbP {pc < x} β€ ProbP {1β Jn(Tn, P )β Ξ΅ < x}xβ Ξ΅ β€ ProbP {pc < x} β€ x+ Ξ΅.
To prove (ii), recall that puc has the property of being the smallest Ξ± at which the null hypothesiswould not be rejected using the uncentered test. By Theorems 2.6.1 and 3.5.1 in Politis et al. (1999),the uncentered subsampling test rejects the null hypothesis with probability approaching one atany fixed Ξ± > 0. Therefore, puc βP 0. By Theorem 1, puc < pc with probability approaching one,so the result follows. οΏ½
References
R. Beran. Simulated power functions. The Annals of Statistics, 14(1):151β173, 1986.
P.J. Bickel, F. Gotze, and W.R. van Zwet. Resampling fewer than n observations: gains, losses,and remedies for losses. Statistica Sinica, 7:1β32, 1997.
I. Choi. Subsampling vector autoregressive tests of linear constraints. Journal of Econometrics,124(1):55β89, 2005.
I. Choi and T.K. Chue. Subsampling hypothesis tests for nonstationary panels with applicationsto exchange rates and stock prices. Journal of Applied Econometrics, 22(2), 2007.
A. DasGupta. Asymptotic theory of statistics and probability. Springer Verlag, New York, 2008.
A.C. Davison and D.V. Hinkley. Bootstrap methods and their application. Cambridge Univ Pr,1997.
M.A. Delgado, J.M. RodrΔ±guez-Poo, and M. Wolf. Subsampling inference in cube root asymptoticswith an application to Manskiβs maximum score estimator. Economics Letters, 73(2):241β250,2001.
J. Gonzalo and M. Wolf. Subsampling inference in threshold autoregressive models. Journal ofEconometrics, 127(2):201β224, 2005.
E.L. Lehmann and J.P. Romano. Testing Statistical Hypotheses. Springer Verlag, 2005.
O. Linton, E. Maasoumi, and Y.J. Whang. Consistent testing for stochastic dominance undergeneral sampling schemes. The Review of Economic Studies, 72(3):735β765, 2005.
R.Y. Liu and K. Singh. Notions of limiting P values based on data depth and bootstrap. Journalof the American Statistical Association, 92(437):266β277, 1997.
10
W.Y. Loh. A new method for testing separate families of hypotheses. Journal of the AmericanStatistical Association, 80(390):362β368, 1985.
E. Paparoditis and D.N. Politis. Bootstrap hypothesis testing in regression models. Statistics andProbability Letters, 74(4):356β365, 2005.
D.N. Politis and J.P. Romano. Estimating the distribution of a Studentized statistic by subsampling.Bulletin of the International Statistical Institute, 49th Session, 2:315β316, 1993.
D.N. Politis and J.P. Romano. Large sample confidence regions based on subsamples under minimalassumptions. The Annals of Statistics, 22(4):2031β2050, 1994.
D.N. Politis and J.P. Romano. Subsampling for econometric models β comments on bootstrappingtime series models. Econometric Rev., 15(2):169β176, 1996.
D.N. Politis and J.P. Romano. K-sample Subsampling. Functional and Operational Statistics,Springer Verlag, Heidelberg, pages 247β254, 2008a.
D.N. Politis and J.P. Romano. K-sample subsampling in general spaces: The case of independenttime series. Journal of Multivariate Analysis, 2008b.
D.N. Politis, J.P. Romano, and M. Wolf. Subsampling. Springer Verlag, 1999.
D.N. Politis, J.P. Romano, and M. Wolf. On the asymptotic theory of subsampling. StatisticaSinica, 11(4):1105β1124, 2001.
J.P. Romano. A bootstrap revival of some nonparametric distance tests. Journal of the AmericanStatistical Association, 83(403):698β708, 1988.
M. Rosenblatt. A central limit theorem and a strong mixing condition. Proceedings of the NationalAcademy of Sciences of the United States of America, 42(1):43β47, 1956.
11