The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth...

132
The Properties of L-moments Compared to Conventional Moments August 17, 2009

Transcript of The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth...

Page 1: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

The Properties of L-moments

Compared to Conventional Moments

August 17, 2009

Page 2: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

THE ISLAMIC UNIVERSITY OF GAZA

DEANERY OF HIGHER STUDIES

FACULTY OF SCIENCE

DEPARTMENT OF MATHEMATICS

The Properties of L-moments Comparedto Conventional Moments

PRESENTED BY

Mohammed Soliman Hamdan

SUPERVISED BY

Prof. Mohamed I Riffi.

A THESIS SUBMITTED IN PARTIAL FULFILMENT OF THE REQUIREMENT

FOR THE DEGREE OF MASTER OF MATHEMATICS

Page 3: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Dedication

To the spirit of my father...

To my mother

To my wife

To all knowledge seekers...

Page 4: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Contents

Acknowledgments V

Abstract VI

Introduction 1

1 Preliminaries 5

1.1 Distribution Functions and Probability Density or Mass Functions . . . . . 6

1.2 Random Samples . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8

1.3 Estimators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9

1.4 Moment and Moment Generating Functions . . . . . . . . . . . . . . . . . 10

1.5 Skewness and Kurtosis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

1.6 The Shifted Legendre Polynomials . . . . . . . . . . . . . . . . . . . . . . . 21

1.7 Order Statistics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25

2 L-MOMENTS OF PROBABILITY DISTRIBUTIONS 28

2.1 Definitions and Basic Properties . . . . . . . . . . . . . . . . . . . . . . . . 29

2.2 Probability Weighted Moments . . . . . . . . . . . . . . . . . . . . . . . . 37

2.3 Relation of L-moments with Order Statistic . . . . . . . . . . . . . . . . . 40

2.4 Properties of L-moments . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46

2.5 L-skewness and L-kurtosis . . . . . . . . . . . . . . . . . . . . . . . . . . . 52

2.6 L-moments of a Polynomial Function of Random Variables . . . . . . . . . 54

2.7 Approximating a Quantile Function . . . . . . . . . . . . . . . . . . . . . 57

II

Page 5: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

2.8 L-moments as Measures of Distributional Shape . . . . . . . . . . . . . . . 59

2.9 L-moments for some Distributions . . . . . . . . . . . . . . . . . . . . . . . 63

2.9.1 L-moments for Uniform Distribution . . . . . . . . . . . . . . . . . 64

2.9.2 L-moments for Exponential Distribution . . . . . . . . . . . . . . . 67

2.9.3 L-moments for Logistic Distribution . . . . . . . . . . . . . . . . . . 70

2.9.4 L-moments for Generalized Pareto . . . . . . . . . . . . . . . . . . . 71

3 ESTIMATION OF L-MOMENTS 75

3.1 The rth Sample L-moments . . . . . . . . . . . . . . . . . . . . . . . . . . 75

3.2 The Sample Probability Weighted Moments . . . . . . . . . . . . . . . . . 78

3.3 The rth Sample L-moment Ratios . . . . . . . . . . . . . . . . . . . . . . . 81

3.4 Parameter Estimation Using L-moments . . . . . . . . . . . . . . . . . . . 84

4 Estimation of the Generalized Lambda Distribution from Censored Data 88

4.1 The Family of Generalized Lambda Distribution . . . . . . . . . . . . . . . 89

4.2 PWMs and L-moments for GLD . . . . . . . . . . . . . . . . . . . . . . . . 89

4.3 PWMs and L-moments for Type I and II Singly Censored Data . . . . . . 95

4.3.1 Case I-Right Censoring . . . . . . . . . . . . . . . . . . . . . . . . . 95

4.3.2 Case 2 - Left Censoring . . . . . . . . . . . . . . . . . . . . . . . . . 102

4.4 L-moments for Censored Distributions Using GLD . . . . . . . . . . . . . . 105

4.5 Fitting of the Distributions to Censored Data Using GLD . . . . . . . . . . 118

List of Tables

Table 1.1 The Skewness For Some of Common Distributions . . . . . . . . . . 18

Table 1.2 The Kurtosis For Some of Common Distributions . . . . . . . . . . . 20

Table 2.1 L-skewness of Some Common Distributions . . . . . . . . . . . . . . 53

Table 2.2 L-kurtosis of Some Common Distributions . . . . . . . . . . . . . . . 53

Table 2.3 Matrix B with Numerical Evaluations of βk =∫ 1

0(Φ−1(u))mukdu . . . 55

Table 2.4 Matrix B with Numerical Evaluation of βk =∫ 1

0(ξ−α log(1−u))mukdu 56

Table 2.5 L-moments of Some Common Distributions . . . . . . . . . . . . . . 64

III

Page 6: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Table 3.1 Annual Maximum Windspeed Data, in Miles per Hour . . . . . . . . 82

Table 3.2 L-moments of The Annual Maximum Windspeed Data in Table(3.1) 83

Table 3.3 Bais of Sample L-CV . . . . . . . . . . . . . . . . . . . . . . . . . . 83

Table 3.4 Parameter Estimation via L-moments for Some Common Distributions 85

Table 4.1 Comparison of L-moments . . . . . . . . . . . . . . . . . . . . . . . . 94

Table 4.2 L-moment of Pareto Distribution for Censoring Fraction c . . . . . . 117

IV

Page 7: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Acknowledgments

I would like to express my sincere thanks and gratitude to Almighty Allah for

his blessings.

I am extremely and sincerely thankful to my parents whose love, care and

sacrifice enabled me to reach this level of learning.

I would like to express my sincere appreciation and thanks to my supervi-

sor Prof. Mohamed I Riffi for his ceaseless help and supervision during the

preparation of this project.

I would like also to express my great and sincere thanks to Prof. Eissa D.

Habil for his great help and sincere guidance and advice all the time. At the

same time, I would like to thank Dr. Raid Salha for his great efforts with me.

I would like to express my sincere thanks to all the staff members of the

Mathematics Department and all my teachers who taught me to come to this

stage of learning.

V

Page 8: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Abstract

In this thesis, we survey the concept of L-moments. We introduce the definition of

L-moments and the probability weighted moments (PWMs) and then we expressed the

L-moments by the use of the probability weighted moments. Also, we established the re-

lation between the L-moments and the order statistic. Moreover, we introduced some of

the properties the L-moments especially the property that, if the mean of the distribution

exists, then all of the L-moments exist and uniquely define the distribution. That is, no

two distinct distributions have the same L-moments. This property is not always valid

in the conventional moments. Moreover, we find the L-moments for some distributions.

Later, we introduce estimation for the L-moments and probability weighted moments and

then we used them in estimating the parameters of some distributions as the Uniform dis-

tribution, the Exponential distribution, Generalized Logistic distribution and Generalized

Pareto Distribution. Moreover, we introduce the generalized lambda distribution (GLD)

and we find the (PWMs) and L-moments for (GLD). Also, we defined the Censored Data

which is divided into two cases: I-Right censoring and II-Left censoring and then we find

the partial property weighted moments (PPWMs) for both cases. Finally, we find the

type B PPWMs for GLD.

Key words: Order Statistics, Probability Weighted Moments, L-moments, Censored

Data, Generalized Lambda Distribution Family, Partial Probability Weighted Moments.

VI

Page 9: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Introduction

It is standard statistical practice to summarize a probability distribution or an observed

data set by its moments or cumulant. It is also common, when fitting a parametric dis-

tribution to a data set, to estimate the parameters by equating the sample moments to

those of the fitted distribution. Yet moment-based methods, although long established

in statistics, are not always satisfactory. It is sometimes difficult to assess exactly what

information about the shape of a distribution is conveyed by its moments of third and

higher order; the numerical values of sample moments, particularly when the sample is

small, can be very different from those of the probability distribution from which the

sample was drawn; and the estimated parameters of distributions fitted by the method

of moments are often markedly less accurate than those obtainable by other estimation

procedures such as the method of maximum likelihood.

The alternative approach described here is based on quantities which we call L-moments.

These are analogous to the conventional moments but can be estimated by linear com-

binations of order statistics. L-moments have theoretical advantages over conventional

moments of being able to characterize a wider range of distributions and, when estimated

from a sample, of being more robust to the presence of outliers in the data. Experience

also shows that, compared with conventional moments, L-moments are less subject to bias

in estimation and approximate their asymptotic normal distribution more closely in finite

samples. Parameter estimates obtained from L-moments are sometimes more accurate in

small samples than even the maximum likelihood estimates[17].

The origins of our work can be traced to the early 1970, when there was a growing

awareness among hydrologists that annual maximum streamflow data, although commonly

1

Page 10: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

modeled by the Gumbel distribution, often had higher skewness than was consistent with

that distribution. Moment statistics were widely used as the basis for identifying and

fitting frequency distributions, but to use them effectively required knowledge of their

sampling properties in small samples. A massive (for the time) computational effort us-

ing simulated data was performed by Wallis, Matalas, and Slack in 1974. It revealed some

unpleasant properties of moment statistics-high bias and algebraic boundedness. Wallis

and others went on to establish the phenomenon of “separation of skewness,” which is

that for annual maximum streamflow data “the relationship between the mean and the

standard deviation of regional estimates of skewness for historical flood sequences is not

compatible with the relations derived from several well-known distribution” (Matalas,

Slack, and Wallis in 1975). Separation can be explained by “mixed distribution” (Wal-

lis, Matalas, and Slack in 1977)- regional heterogeneity in our present terminology- or if

the frequency distribution of stremflow has a longer tail than those of the distribution

commonly used in the 1970s. In particular, the Wakeby distribution dose not exhibit

the phenomenon of separation (Landwehr, Matalas, and Wallis in 1978). The Wakaby

distribution was devised by H.A Thomas Jr. (personal communication to J.R. Wallis, in

1976). It is hard to estimate by conventional methods such as maximum likelihood or the

method of moments, and the desirability of obtaining closed-from estimates of Wakeby

parameters led Greenwood et al. (1979) to devise probability weighted moments. Prob-

ability weighted moments were found to perform well for other distributions (Landwehr,

Matalas, and Wallis in 1979; Hosking, Wallis, and Wood in 1985; Hosking and Wallis in

1987) but were hard to interpret. In 1990 Hosking found that certain linear combinations

of probability weighted moments, which he called “L-moments,” could be interpreted as

measures of the location, scale, and shape of probability distribution and formed the basis

for a comprehensive theory of the description, identification, and estimation of distribu-

tions ([15], Pages xi, xii).

This thesis consists of four chapters. In the first chapter, we introduce general concepts

and definitions that are related to the L-moments. The definition of the cumulative distri-

bution function, quantile function and the probability density function are very important

2

Page 11: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

in chapter two. The definition of the random sample is essential in the definition of the

order statistic. The concept of the estimator is useful in chapter three in the estimation of

L-moment. The concepts of the nth moment, rth central moment and moment generated

functions are introduced to be used in comparing between the conventional moments and

L-moments. The concept of order statistics is the base for defining the L-moments. In

fact, the first chapter consists of seven sections: distribution functions and probability

density or mass functions, random samples, estimators, moment and moment generating

functions, skewness and kurtosis, the shifted Legendre polynomials and order statistics.

Charter 2, which is the main chapter in this research, consists of nine sections. In this

chapter, we define L-moments and L-moments ratios in the first section. In the second

section, we define probability weight moments and we find the relationship between L-

moments and probability weight moments and it will make it easier to find L-moments

for some distributions. In the third section, we find the relation between L-moments and

order statistic. In the fourth section, we establish some properties of L-moments. After

that, we talk about L-skewness and L-kurtosis (which are considered as a special case

of the L-moments ) in section 2.5. In the sixth section, we write about the L-moments

of a polynomial function of a random variable. In the seventh section, we write about

an inversion theorem, expressing the quantile function in terms of L-moments. In the

eighth section, we write about L-moments as a measure of distribution shape. Finally,

in the ninth section, we find L-moments for some distributions. This section is divided

into four subsections: L-moments for uniform distribution, L-moments for exponential

distribution, L-moments for logistic distribution and L-moments for generalized pareto

distribution. This last section is used in chapter three in estimating the parameters of

some of the previous distributions.

Chapter 3, which is titled by estimation of L-moments, consists of four sections: the

rth sample L-moments (which is used in estimating the parameters of some distributions),

the sample probability weighted moments (which is used in chapter four in finding PP-

WMs estimators for Right and Left Censoring), the rth sample L-moment ratios, and

finally the parameter estimation using L-moments.

3

Page 12: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

In chapter 4, we deal with the “Estimation of the Generalized Lambda Distribution

from Censored Data”. In the first section, we find the PWMs and L-moments for GLD.

In the second section, we discus the PWMs and L-moments for Censored Data (type B

for Right Censoring and Left Censoring ). In the third section, we find L-moments for

Censored Distributions using GLD. In the last section, we discuss the fitting of the distri-

butions to Censored Data using GLD. In fact, chapter 4 is considered as an application

of the previous chapters.

4

Page 13: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Chapter 1

Preliminaries

In this chapter, we give the basic definitions, that we think they are very important for

our thesis.

In the first section, we define the cumulative distribution functions, quantile functions

and the probability density functions, and these definitions are needed in chapters 2, 3

and 4.

In the second section, we define the random sample and give related examples. The

importance of section two will appear in section (1.7).

In the third section, we wrote about estimators and define bias estimators. This section

is necessary in chapter three.

In section four, we define the nth moment and the nth central moment and find the nth

center moment for normal distribution. After that, we define skewness and kurtosis in

section five. In the sixth section we define the shifted Legendre polynomials. Finally, we

introduce the order statistic and its distributions in section seven.

5

Page 14: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

1.1 Distribution Functions and Probability Density

or Mass Functions

In this section we define the cumulative distribution functions, quantile functions and the

probability density functions. These definitions are essential in defining the L-moments,

the main definition in this research.

Definition 1.1.1. ([26], Page 112) Let X be random variable defined on a sample space S

with probability function P . For any real number x, the cumulative distribution function

of X [abbreviated ( cdf ) and written F (x)] is the probability associated with the set of

sample points in S that get mapped by X into values on the real line less than or equal

to x. Formally, F (x) := P ({s ∈ S | X(s) ≤ x}).

We shall normally be concerned with continuous random variables, F (x) is an increas-

ing function of x, and 0 ≤ F (x) ≤ 1 for all x, for which P (X = t) = 0 for all t. That is;

no single value has nonzero probability. In this case, F (x) is a continuous function and

has an inverse function.

Definition 1.1.2. ([15], Page 14) If F (x) is the cumulative distribution function of X,

then the inverse function of F (x) is called the quantile function of X and is denoted by

x(F ).

Notice that, given any u, 0 < u < 1, x(u) is the unique value that satisfies

F (x(u)) = u.

Definition 1.1.3. ([10], Page 35) The probability density function (pdf) of a continuous

random variable X is the function f satisfying

F (x) :=

∫ x

−∞f(t)dt for all x.

Remark 1.1.1. We deduce from the above two definitions the following:

1. If X is a discrete random variable, then F (x) =∑

y≤x P (X = y) =∑

y≤x f(y), and

in this case, f(x) is said to be probability mass function (pmf) of X.

6

Page 15: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

2. If X is a continuous random variable, and f is a continuous function, then by the

Fundamental Theorem of Calculus, f(x) = ddx

F (x).

Definition 1.1.4. ([26], Page 131) Two random variables X and Y are said to be inde-

pendent, if and only if fXY (x, y) = fX(x)fY (y), for all x and y where f(x, y) is the joint

(pdf) or (pmf) of X and Y , and f(x)X , f(y)Y are the (pdf) of X and Y , respectively.

Definition 1.1.5. ([10], Page 174) Let X1, X2, ..., Xn be random variables with the joint

(pdf) or (pmf) f(x1, x2, ..., xn). Let fi(x) denote the marginal (pdf) or (pmf) of Xi Then

X1, X2, ..., Xn are called mutually independent random variables if for every (x1, x2, ..., xn)

within their range

f(x1, x2, ..., xn) =n∏

i=1

fi(xi).

Definition 1.1.6. ([26], Page 154) Let X be any random variable with the marginal (pdf)

or (pmf) f(x). The expected value denoted by E(X) and is given by:

(1) E(X) =

∫ ∞

−∞xf(x) dx; if X is a continuous random variable, provided that

∫ ∞

−∞|x|f(x) < ∞ .

(1.1.1)

We may also write, via the transformation u = F (x),

E(X) =

∫ 1

0

x(u)du .

(2) E(X) =∑

x xf(x) if X is a discrete random variable, provided that∑

x |x|f(x) < ∞ .

Example 1.1.1. Let X be a random variable from the exponential distribution with pa-

rameter β. Then the expectation of X is given by:

E(X) =

∫ ∞

−∞xf(x)dx

=

∫ ∞

0

x( 1

β

)e−xβ dx

= β.

7

Page 16: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

1.2 Random Samples

In this section, we define the random sample which is used to define the order statistics

in section 1.7. Then, we give related examples.

Definition 1.2.1. ([10], Page 201) The collection of random variables X1, X2, ..., Xn is

called a random sample of size n from the population with (pdf) f(x) if X1, X2, ..., Xn

are mutually independent and marginal probability density function (pdf) or probability

mass function (pmf) of each Xi is the sample function f(x).

Alternatively, X1, X2, ..., Xn are called independent and identically distributed random

variables with (pdf) or (pmf) f(x). This is commonly abbreviated to iid random vari-

ables. From the above definition of a random sample, the joint (pdf) or (pmf) of the

random sample X1, X2, ..., Xn is given by

f(x1, x2, ..., xn) = f(x1)f(x2)...f(xn) =n∏

i=1

f(xi).

Example 1.2.1. Let X1, X2, ..., Xn be a random sample of size n from the exponential

distribution with parameter (β), corresponding to the time until failure for identical circuit

that one puts on the test and used until they fail. Then the joint (pdf) of the sample is:

f(x1, x2, ..., xn|β) = f(x1)f(x2)...f(xn)

=n∏

i=1

f(xi|β)

=n∏

i=1

(1/β)e−xiβ

= (1/β)ne−1β

Pni=1 xi .

8

Page 17: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Now, to compute the probability of the all boards last more than 2 time units, we do

the following

P (X1 > 2, X2 > 2, ..., Xn > 2) =n∏

i=1

P (Xi > 2)

=n∏

i=1

∫ ∞

2

1

βe−xi/βdxi

=( ∫ ∞

2

1

βe−x/βdx

)n

= (e−2/β)n = e−2n/β .

1.3 Estimators

In practice, it is often assumed that the distribution of some physical quantities is exactly

known apart from a finite set of parameters θ1, ...., θp. When needed for clarity, we write

the quantile function of a distribution with p unknown parameters as x(u; θ1, ...., θp).

In most applications the unknown parameters include a location parameter and a scale

parameter [15].

Definition 1.3.1. ([15], Page 15) A parameter ξ of a distribution is a location parameter

if the quantile function of the distribution satisfies

x(u; ξ, θ1, ...., θp) = ξ + x(u; 0, θ1, ...., θp).

Definition 1.3.2. ([15], Page 16) A parameter α of a distribution is a scale parameter if

the quantile function of the distribution satisfies

x(u; α, θ1, ...., θp) = α× x(u; 1, θ1, ...., θp).

or, if the distribution also has a location parameter ξ,

x(u; ξ, α, θ1, ...., θp) = ξ + α× x(u; 0, 1, θ1, ...., θp).

Example 1.3.1. The gamble distribution has the quantile function[15]:

x(u) = ξ − α log(− log u).

9

Page 18: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Since x(u; ξ, α) = (ξ) + [−α log(− log u)] = ξ + x(u; 0, α), then ξ is a location parameter.

Now, ξ is a location parameter and x(u; ξ, α) = ξ−α log(− log u) = (ξ)+(α)[− log(− log u)] =

ξ + α× x(u; 0, 1), hence α is a scale parameter.

The unknown parameters are estimated from the observed data. Given a set of data,

a function θ of the data values may be chosen as an estimator of θ. The estimator θ is a

random variable and has a probability distribution. The goodness of θ as an estimator of

θ depends on how close θ typically is to θ. The deviation of θ from θ may be decomposed

into bias - a tendency to give estimates that are consistently higher or lower than the true

value - and variability - the random deviation of the estimate from the true value that

occurs even for estimators that have no bias [15].

Definition 1.3.3. ([15], Page 16) bias(θ) = E(θ − θ)

Definition 1.3.4. ([15], Page 16) We say that θ is unbiased if bias(θ) = 0, that is if

E(θ) = θ.

1.4 Moment and Moment Generating Functions

In this section, we define the nth moment, nth central moment and also define the moment

generating function. Also, we introduce a theorem that generates the moment from

moment generating function and find the nth center moment for normal distribution.

After that, we define skewness and kurtosis. The shape of a probability distribution has

traditionally been described by the moments of the distribution.

Definition 1.4.1. ([10], Page 58) For each integer n, the nth moment of X, µ′n, is

µ′n = E(Xn).

The nth central moment of X, µn, is

µn = E(X − µ)n,

where µ = µ′1 = E(X).

10

Page 19: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

The mean is the center of location of the distribution. The dispersion of the distribu-

tion about its center is measured by the standard deviation,

σ = µ1/22 = {E(X − µ)2}1/2 ,

or the variance, σ2 = var(X). The coefficient of variation (CV), Cv = σ/µ,

Definition 1.4.2. ([15], Page 17) Analogous quantities can be computed from a data

sample x1, x2, ..., xn. The sample mean

x = n−1

n∑i=1

xi

is the natural estimator of µ.

Definition 1.4.3. ([15], Page 17) The higher sample moments

mr = n−1

n∑i=1

(xi − x)r

are reasonable estimators of the µr, but are not unbiased.

Unbiased estimators are often used. In particular, σ2, µ3 and the fourth cumulant

κ4 = µ4 − 3µ22 are unbiasedly estimated by

s2 = (n− 1)−1

n∑i=1

(xi − x)2 ,

m3 =n2

(n− 1)(n− 2)m3

k4 =n2

(n− 2)(n− 3)

{(n + 1

n− 1

)m4 − 3m2

2

},

respectively. The sample standard deviation, s =√

s2, is an estimator of σ but is not

unbiased. The sample estimator of CV, is,

Cv = s/x

We now introduce a new function that is associated with a probability distribution, the

moment generating function mgf. As its name suggests, the mgf can be used to generate

moments.

11

Page 20: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Definition 1.4.4. ([15], Page 61) Let X be a random variable with cdf F (X). The

moment generating function (mgf ) of X, denoted by MX(t), is

MX(t) = E(etX) ,

provided that the expectation exists for t in some neighborhood of 0.

More explicitly, we can write the mgf of X as

MX(t) =

∫ ∞

−∞etxf(x)dx if X is continuous

or

MX(t) =∑

x

etxP (X = x) if X is discrete.

It is very easy to see how the mgf generates moments. We summarize the result in

the following theorem.

Theorem 1.4.1. [15] If X has mgf MX(t), then E(Xn) = M(n)X (0),

where we define

M(n)X (0) =

dn

dtnMX(t)

∣∣∣t=0

.

That is, the nth moment is equal to the nth derivative of MX(t) evaluated at t = 0.

Proof. Assuming that X has (pdf) fX(x). If we can differential under the integral sign

we have

d

dtMX(t) =

d

dtMX(t) =

d

dt

∫ ∞

−∞etxfX(x)dx

=

∫ ∞

−∞(d

dtetx)fX(x)dx

=

∫ ∞

−∞(xetx)fX(x)dx

= E(XetX).

12

Page 21: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Thus,d

dtMX(t)|t=0 = E(XetX) |t=0= E(X).

Proceeding in an analogous manner, we can establish that

dn

dtnMX(t)|t=0 = E(XnetX) |t=0= E(Xn).

Definition 1.4.5. ([10], Page 100) For any real number r > 0, the gamma function (of

r) is given by:

Γ(r) =

∫ ∞

0

xr−1e−xdx.

Note 1.4.2. ([10], Page 100) If r is a positive real number, then Γ(r + 1) = rΓ(r).

Note 1.4.3. ([10], Page 100) For any positive integer n, Γ(n) = (n− 1)! ·

Example 1.4.1. The full gamma(α, β) family, is,

f(x) =1

Γ(α)βαxα−1e−x/β, 0 < x < ∞, α > 0, β > 0,

where Γ(α) denotes the gamma function,

MX(t) =1

Γ(α)βα

∫ ∞

0

etxxα−1e−x/βdx

=1

Γ(α)βα

∫ ∞

0

xα−1e−( 1β−t)xdx (1.4.1)

=1

Γ(α)βα

∫ ∞

0

xα−1e−x/( β1−βt

)dx.

Using the fact that, for any positive constants a and b,

f(x) =1

Γ(a)baxa−1e−x/b

13

Page 22: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

is a pdf, we have that ∫ ∞

0

1

Γ(a)baxa−1e−x/bdx = 1

and hence, ∫ ∞

0

xa−1e−x/bdx = Γ(a)ba. (1.4.2)

Applying (1.4.2) to (1.4.1), we have

MX(t) =1

Γ(α)βαΓ(α)

( β

1− βt

=( 1

1− βt

if t <1

β.

If t ≥ 1β, then the quantity (1/β) − t, in the integrand of (1.4.1), is nonpositive and

the integral in (1.4.2) is infinite. Thus, the mgf of the gamma distribution exists only if

t < 1/β

The mean of the gamma distribution is given by

EX =d

dtMX(t)

∣∣t=0

=αβ

(1− βt)α+1

∣∣∣t=0

= αβ.

Other moments can be calculated in similar manner.

Example 1.4.2. Central moments of the normal distribution N(0,σ2). The

moment generating function for the normal distribution N(0,σ2) is as follows:

MX(t) = et2σ2

2 .

The moments are then as follows. The first central moments is

E(X − µ) = ddt

(e

t2σ2

2

)|t=0

= tσ2(e

t2σ2

2

)|t=0

= 0.

14

Page 23: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

The second central moment is

E(X − µ)2 = d2

dt2

(e

t2σ2

2

)|t=0

= ddt

(tσ2

(e

t2σ2

2

))|t=0

=(t2σ4

(e

t2σ2

2

)+ σ2

(e

t2σ2

2

))|t=0

= σ2.

The third central moment is

E(X − µ)3 = d3

dt3

(e

t2σ2

2

)|t=0

= ddt

(t2σ4

(e

t2σ2

2

)+ σ2

(e

t2σ2

2

))|t=0

=(t3σ6

(e

t2σ2

2

)+ 2tσ4

(e

t2σ2

2

)+ tσ4

(e

t2σ2

2

))|t=0

=(t3σ6

(e

t2σ2

2

)+ 3tσ4

(e

t2σ2

2

))|t=0

= 0.

The fourth central moment is

E(X − µ)4 = d4

dt4

(e

t2σ2

2

)|t=0

= ddt

(t3σ6

(e

t2σ2

2

)+ 3tσ4

(e

t2σ2

2

))|t=0

=(t4σ8

(e

t2σ2

2

)+ 3t2σ6

(e

t2σ2

2

)+ 3t2σ6

(e

t2σ2

2

)+ 3σ4

(e

t2σ2

2

))|t=0

=(t4σ8

(e

t2σ2

2

)+ 6t2σ6

(e

t2σ2

2

)+ 3σ4

(e

t2σ2

2

))|t=0 = 3σ4.

15

Page 24: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Now, we write this Theorem because it is used in the proof of Theorem 2.4.1.

Theorem 1.4.4. ([10], Page 65) Let FX(x) and FY (y) be two cdfs all whose moments

exist. If FX(x) and FY (y) have bounded support, then FX = FY for all u if and only if

EXr = EY r for all integers r = 0, 1, 2, . . .

Proof. Assume that FX(u) = FY (u) for all u, hence dFX(u) = dFY (u).

Now, for all integers r = 0, 1, 2, . . . ,

E(Xr) =

∫ ∞

−∞urdFX(u) =

∫ ∞

−∞urdFY (u) = E(Y r).

Conversely, assume that EXr = EY r for all integers r = 0, 1, 2, . . . , then in special case

EX0 = EY 0.

Conceder,

EX0 =

∫ ∞

−∞u0dFX(u) =

∫ ∞

−∞dFX = FX .

Similarly,

EY 0 =

∫ ∞

−∞u0dFY (u) =

∫ ∞

−∞dFY = FY .

Since EX0 = EY 0, then FX = FY . That means, FX(u) = FY (u), for all u.

1.5 Skewness and Kurtosis

Skewness measures the lak of symmetry in the probability density function f(x) of a

distribution [10].

Definition 1.5.1. ([15], Page 17) The skewness is :

γ = µ3/µ3/22 .

A distribution that’s symmetric about its mean has 0 skewness. But if it has a long

tail to the right and a short one to the left, then it has a positive skewness, and a negative

skewness in the opposite situation.

The sample estimator of skewness is,

g = m3/s3 [15],

16

Page 25: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

where

s2 = (n− 1)−1

n∑i=1

(xi − x)2 ,

m3 =n2

(n− 1)(n− 2)m3.

The estimator g is biased estimators of γ. Indeed, g has algebraic bounds that depend on

the sample size; for a sample of size n the bound is

|g| ≤ n1/2 [15].

Example 1.5.1. The skewness of the normal distribution N(0,σ2):

From example 1.4.2, we have the second and the third central moments of the normal dis-

tribution N(0,σ2) are: µ2 = σ2 and µ3 = 0. Then, the skewness of the normal distribution

N(0,σ2) is:

γ = µ3/µ3/22 =

0

(σ2)3/2=

0

σ3= 0 .

17

Page 26: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Table 1.1: The following table gives the skewness for a number of common distributions.

Distribution pdf, f(x) Skewness

Bernoulli pxq1−x 1−2p√p(1−p)

Beta Γ(α+β)Γ(α)Γ(β)

(1− x)β−1xα 2(β−α)(2+α+β)

√1+α+β

αβ

Binomial(

Nx

)pxqN−x q−p√

Npq

Chi-squared xr/2−1 e−x/2

Γ( 12r) 2r/2 2

√2r

Exponential 1βe−(x−α)/β 2

Gamma xα−1e−x/θ

Γ(α) θα2√α

Geometric distribution p qx 2−p√1−p

Half-normal 2θπ

e−x2θ2/π√

2(4−n)

(π−2)3/2

Laplace 12b

e−|x−µ|/b 0

Log normal 1S√

2π xe−(ln x−M)2/(2S2)

√eS2 − 1(2 + eS2

)

Maxwell√

x2e−x2/(2a2)

a3

2√

2(5n−16)

(3n−8)3/2

Negative binomial(

x+r−1r−1

)prqx 2−p√

rq

Normal 1σ√

2πe−(x−µ)2/(2σ2) 0

Poisson νn e−ν

n!ν−1/2

Rayleigh x e−x2/(2s2)

s2 (π − 3)√

π2(2− 1

2π)3

Student’s t

(r

r+x2

)(1+r)/2

√r B( 1

2r, 1

2)

0

Continuous uniform 1β−α

0

Discrete uniform 1N

0

18

Page 27: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Kurtosis

kurtosis is the degree of peakedness of a distribution, defined as a normalized from the

fourth central moment µ4.

Definition 1.5.2. ([15], Page 17) The kurtosis is

κ = µ4/µ22.

A fairly flat distribution with long tails has a high kurtosis, while a short tailed

distribution has a low kurtosis. A normal distribution has a kurtosis of 3.

The sample estimators of kurtosis,

k = k4/s4 + 3 [15],

where

s2 = (n− 1)−1

n∑i=1

(xi − x)2 ,

k4 =n2

(n− 2)(n− 3)

{(n + 1

n− 1

)m4 − 3m2

2

}.

The estimator k is biased estimators of κ. Indeed k has algebraic bounds that depend on

the sample size; for a sample of size n the bound is

k ≤ n + 3 [15].

Example 1.5.2. The kurtosis of the normal distribution N(0,σ2):

Since the second and the fourth central moments of the normal distribution N(0,σ2) are:

µ2 = σ2 and µ4 = 3σ4 (see example 1.4.2). Hence, the kurtosis of the normal distribution

N(0,σ2) is:

κ = µ4/µ22 =

3σ4

(σ2)2=

3σ4

σ4= 3 .

19

Page 28: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Table 1.2: The following table gives the Kurtosis for a number of common distributions.

Distribution pdf, f(x) Kurtosis

Bernoulli pxq1−x 11−p

+ 1p− 6

Beta Γ(α+β)Γ(α)Γ(β)

(1− x)β−1xα 6[a3+a2(1−2b)+b2(1+b)−2ab(2+b)]ab(2+a+b)(3+a+b)

Binomial(

Nx

)pxqN−x 1−6pq

Npq

Chi-squared xr/2−1 e−x/2

Γ( 12r) 2r/2

12r

Exponential 1βe−(x−α)/β 6

Gamma xα−1e−x/θ

Γ(α) θα6α

Geometric distribution p qx 5− p + 11+p

Half-normal 2θπ

e−x2θ2/π 8(π−3)(π−2)2

Laplace 12b

e−|x−µ|/b 3

Log normal 1S√

2π xe−(ln x−M)2/(2S2) e4S2+2e3S2

+3e2S2−6

Maxwell√

x2e−x2/(2a2)

a3 −4(96−40π+3π2)(3π−8)2

Negative binomial(

x+r−1r−1

)prqx 6−p(6−p)

r(1−p)

Normal 1σ√

2πe−(x−µ)2/(2σ2) 3

Poisson νn e−ν

n!1v

Rayleigh x e−x2/(2s2)

s2

6π(4−π)−16(π−4)2

Student’s t

(r

r+x2

)(1+r)/2

√r B( 1

2r, 1

2)

6r−4

Continuous uniform 1β−α

−65

Discrete uniform 1N

−6(N2+1)5(N2−1)

20

Page 29: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

1.6 The Shifted Legendre Polynomials

The base of our thesis is to define the L-moments λr which depends on the rth shifted

Legendre polynomial which is related to the usual Legendre polynomials Pr−1(F ). So, we

defined the Legendre polynomials and the shifted Legendre polynomials and we extract

some relations that we use in this thesis. In addition, we show that Legendre polynomials

and shifted Legendre polynomials are eigenfunctions.

Furthermore, we serve the Corollary that will be used to prove Theorem 2.7.1 in section

(2.7).

Definition 1.6.1. ([5], Page 60) A self-adjoint differential equation of the form

[p(x) y′]′ + [q(x) + λr(x)] y = 0, (1.6.1)

on the interval 0 < x < 1, together with the boundary conditions

a1y(0) + a2y′(0) = 0, b1y(1) + b2y

′(1) = 0, (1.6.2)

is called a Sturm-Liouville eigenvalue problem. Those values of λ for which non-trivial

solutions for such problems exits, are called eigenvalues and the corresponding solutions

are called eigenfunctions.

The following theorem expresses the property of orthogonality of the eigenfunctions

with respect to the weight function r.

Theorem 1.6.1. ([31], Page 636) If y1 and y2 are two eigenfunctions of a Sturm-Liouville

problem (1.6.1), (1.6.2) corresponding to eigenvalues λ1and λ2, respectively, and λ1 6= λ2,

then ∫ 1

0

r(x) y1(x) y2(x) dx = 0, where r(x) is weight function. (1.6.3)

21

Page 30: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Corollary 1.6.2. ([5], Page 61) (Eigenfunction expansion). If {yi(x)} is the set of eigen-

functions of the Sturm-Liouville eigenvalue problem:

[p(x) y′]′ + [q(x) + λr(x)] y = 0,

a1y(a) + a2y′(a) = 0, b1y(b) + b2y

′(b) = 0,

and f(x) is a function on [a,b] such that f(a) = f(b) = 0, then

f(x) =∞∑i=0

ci yi(x) (1.6.4)

where ci =1

µi

∫ b

a

r(x) f(x) yi(x) dx, µi =

∫ b

a

r(x) y2i (x) dx.

Definition 1.6.2. ([5], Page 83) The Legendre’s equation is

(1− x2) y′′ − 2xy′ + n(n + 1) y = 0 (1.6.5)

where n is a positive integer.

One of the solutions of equation (1.6.5) is the polynomial

Pn(x) = F[− n, n + 1; 1;

1− x

2

],

where

F[a, b; c; x

]=

Γ(c)

Γ(b)Γ(c− b)

∫ 1

0

tb−1(1− t)c−b−1(1− xt)−a dt

and Γ(.) is gamma function.

Pn(x) is called the nth Legendre’s polynomial.

The Legendre’s equation can be written in the self-adjoint form

[(1− x2) y′]′ + n(n + 1) y = 0 (1.6.6)

Comparing equation (1.6.6) with the form (1.6.1), p(x) = 1−x2, q(x) = 0, r(x) = 1, λ =

n(n + 1). Since p(x) = 0 for x = −1, 1, represents a Sturm-Liouville problem without

explicit boundary conditions, its eigenfunctions are Pn(x) with the related eigenvalues

22

Page 31: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

n(n + 1) (n = 0, 1, 2, . . .). Hence {Pn(x)} is an orthogonal set of polynomials over the

interval −1 6 x 6 1 with weight function equal to 1, i.e.,

∫ 1

−1

Pm(x)Pn(x) dx = 0, m 6= n.

There are other approaches for establishing orthogonality of the Legendre sequence. The

following is the complete statement [5]

∫ 1

−1

Pm(x)Pn(x) dx =

0, m 6= n;

22n+1

, m = n.

Definition 1.6.3. ([15], Page 19) We define polynomials P′r(u), r = 0, 1, 2, . . . as follows:

(i) P′r(u) is a polynomial of degree r in u.

(ii) P′r(1) = 1.

(iii)∫ 1

0P′r(u)P

′s(u) du = 0 if r 6= s.

Condition(iii) is the orthogonality condition. These conditions define the shifted Legendre

polynomials Condition(“ shifted”, because the ordinary Legendre polynomials Pr(u) are

defined to be orthogonal on the interval −1 ≤ u ≤ +1, not 0 ≤ u ≤ 1).

The P′r(F ) is the rth shifted Legendre polynomial related to the usual Legendre poly-

nomials P′r(u) = Pr(2u− 1). Shifted Legendre polynomials are orthogonal on the interval

(0,1) with constant weight function r(u) = 1[15].

Note 1.6.3. [18] The P ∗r (F ) is the rth shifted Legendre polynomials, where

P ∗r (F ) =

r∑m=0

p∗r,m Fm,

and

p∗r,m = (−1)r−m

r

m

r + m

m

.

Note 1.6.4.∫ 1

0{P ∗

r (u)}2du = 12r+1

·

Proof. Since, ∫ 1

0

{P ∗r (u)}2du =

∫ 1

0

{Pr(2u− 1)}2du. (1.6.7)

23

Page 32: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Let z = 2u− 1, then, dz = 2du and substituting in eqn (1.6.7) we have:

∫ 1

0

{P ∗r (u)}2du =

1

2

∫ 1

−1

{Pr(z)}2dz =1

2

( 2

2r + 1

)=

1

2r + 1· (1.6.8)

Note 1.6.5.∫ 1

0P ∗

r (u)du = 0 for r > 0.

Proof. From definition of P ∗r (u), we have

P ∗0 (u) =

0∑m=0

p∗0,m um = p∗0,0 = (−1)0−0

0

0

0

0

= 1.

Then from orthogonality condition,

∫ 1

0

P ∗r (u)du =

∫ 1

0

1× P ∗r (u)du =

∫ 1

0

P ∗0 (u) P ∗

r (u)du = 0 becase r > 0 · (1.6.9)

We introduce (Chebyshev’s Other Inequality) since it is used in the proof of Theorem

2.8.1.

Theorem 1.6.6. [9] (Chebyshev’s Other Inequality). Let f and g be real-valued functions

that are either both increasing or both decreasing on the interval (a,b) (a and b can be

infinite), and let w be a function that is positive on (a,b). Then

∫ b

a

f(x)g(x)w(x)dx

∫ b

a

w(x)dx ≥∫ b

a

f(x)w(x)dx

∫ b

a

g(x)w(x)dx.

Proof. We have

{f(y)− f(x)}{g(y)− g(x)} ≥ 0 for any x and y in (a, b),

so,

0 ≤∫ b

a

∫ b

a

{f(y)− f(x)}{g(y)− g(x)}w(x)w(y)dx dy

=

∫ b

a

∫ b

a

f(y)g(y)w(x)w(y)dx dy −∫ b

a

∫ b

a

f(y)g(x)w(x)w(y)dx dy

24

Page 33: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

−∫ b

a

∫ b

a

f(x)g(y)w(x)w(y)dx dy +

∫ b

a

∫ b

a

f(x)g(x)w(x)w(y)dx dy

=

∫ b

a

f(y)g(y)w(y)dy

∫ b

a

w(x)dx−∫ b

a

f(y)w(y)dy

∫ b

a

g(x)w(x)dx

−∫ b

a

f(x)w(x)dx

∫ b

a

g(y)w(y)dy +

∫ b

a

f(x)g(x)w(x)dx

∫ b

a

w(y)dy

= 2

∫ b

a

f(x)g(x)w(x)dx

∫ b

a

w(x)dx− 2

∫ b

a

f(x)w(x)dx

∫ b

a

g(x)w(x)dx.

The result follows.

1.7 Order Statistics

In this section, we deal with order statistics and related subjects. At first, we define order

statistics and their distribution functions. Next, we give examples for order statistics .

Then, we present some significant propositions. After that, we define the probability

density function and the cumulative distribution function for an order statistic. We then

present some related theorems.

Definition 1.7.1. ([10], Page 229) The order statistics of a random sample X1, X2, ..., Xn

are the sample values placed in ascending order. They are denoted by X(1), X(2), ..., X(n).

In other words, the order statistics are random variables that satisfy X(1) ≤ X(2) ≤ ... ≤X(n), where

X(1) := mini

Xi

X(2) := 2nd smallest Xi

.

.

X(n) := max1≤i≤n

Xi.

Example 1.7.1. The values x1 = 0.62, x2 = 0.98, x3 = 0.31, x4 = 0.81 and x5 = 0.53

are the n = 5 observed values of five independent trials of an experiment with ( pdf)

25

Page 34: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

f(x) = 2x, 0 < x < 1. The observed values of the order statistics are

x1 = 0.31 < x2 = 0.53 < x3 = 0.62 < x4 = 0.81 < x5 = 0.98.

Now, the next theorem gives the cdf of the jth order statistic.

Theorem 1.7.1. ([10], Page 231) Let X1, X2, ..., Xn be a random sample of size n from

a distribution with pdf f(x) and (cdf) F (x). Then the cdf of the jth order statistic, is

given by

Fj(x) =n∑

k=j

n

k

[F (x)]k[1− F (x)]n−k. (1.7.1)

Example 1.7.2. Let X1, X2, ..., Xn be a random sample of size n from the uniform dis-

tribution with parameter θ. Then

f(x) =

1θ, 0 < x < θ;

0, otherwise.

and

F (x) =

0, x ≤ 0;

xθ, 0 < x < θ;

1, x ≥ θ.

Fj(x) =n∑

k=j

n

k

[F (x)]k[1− F (x)]n−k

=n∑

k=j

n

k

[x

θ

]k[1−

(x

θ

)]n−k

.

Example 1.7.3. Let X1, X2, ..., Xn be the random sample of size n from an exponential

distribution with parameter β. Then

f(x) =

1βe−

xβ , x ≥ 0;

0, otherwise.

So,

26

Page 35: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Fj(x) =n∑

k=j

n

k

[F (x)]k[1− F (x)]n−k

=n∑

k=j

n

k

[1−

(e−

)]k[e−

]n−k

.

Now, we introduce the probability density function of any order statistic through the

following theorem.

Theorem 1.7.2. ([10], Page 232) Let X1, X2, ..., Xn be a random sample of size n from

a distribution of continuous population with (pdf)f(x) and cdf F (x).

Then the (pdf) of the jth order statistic is given by

fj(x) = j

n

j

f(x)[F (x)]j−1[1− F (x)]n−j. (1.7.2)

Example 1.7.4. Let X1, X2, ..., Xn be a random sample of size n from the uniform dis-

tribution with parameter θ = 1. Then by Example 1.7.2, the cdf is defined by:

F (x) =

0, x ≤ 0,

x, 0 < x < 1,

1, x ≥ 1.

Now, for 0 < x < 1 , Theorem 1.7.2 yields

fj(x) = j

n

j

f(x)[F (x)]j−1[1− F (x)]n−j

= j

n

j

xj−1(1− x)n−j

=Γ(n + 1)

Γ(j)Γ(n− j + 1)xj−1(1− x)(n−j+1)−1.

Thus, the jth order statistic has a Beta distribution with parameters j and n− j + 1 .

27

Page 36: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Chapter 2

L-MOMENTS OF PROBABILITY

DISTRIBUTIONS

L-moments are expectations of certain linear combinations of order statistics. They can be

defined for any random variable whose mean exists and from the basis of a general theory

which covers the summarization and description of theoretical probability distributions,

the summarization and description of observed data samples, estimation of parameters

and quantile of probability distributions, and hypothesis tests for probability distributions

[17].

In the first section of this chapter, we define L-moments and L-moment ratios.

In the second section, we define probability weight moments and we find the relationship

between L-moments and probability weight moments and it will make it easier to find

L-moments for some distributions.

In the third section, we find the relation between L-moments and order statistic.

In the fourth section, we established some properties of L-moments. After that, we talk

about L-skewness and L-kurtosis.

In the sixth section, we write about the L-moments of a polynomial function of a random

variable.

28

Page 37: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

In the seventh section, we write about an inversion theorem, expressing the quantile

function in terms of L-moments.

In the eighth section, we write about L-moments as measure of distribution shape.

Finally, in the ninth section, we find L-moments for some distribution.

2.1 Definitions and Basic Properties

Here we introduce some basic and related definitions and properties.

Definition 2.1.1. [17] Let X be a real-valued random variable with cumulative distri-

bution F (x) and quantile function x(F ), and let X1:n ≤ X2:n ≤ ... ≤ Xn:n be the order

statistics of a random sample of size n drawn from the distribution of X. Define the

L-moments of X to be the quantities

λr ≡ r−1

r−1∑

k=0

(−1)k

r − 1

k

EXr−k:r r = 1, 2, .... (2.1.1)

The L in “L-moments” emphasizes that λr is a linear function of the expected order

statistics. Furthermore, as noted in [17], the natural estimator of λr based on an observed

sample of data is a linear combination of the ordered data values. From Theorem 1.7.2,

the (pdf) of the jth order statistic is given by:

fj(x) = j

r

j

f(x)[F (x)]j−1[1− F (x)]r−j

=r!

(j − 1)!(r − j)![F (x)]j−1[1− F (x)]r−jf(x).

The expectation of an order statistic from eqn.(1.1.1) may be written as:

EXj:r =

∫ ∞

−∞xfj(x) dx

=

∫ ∞

−∞x

r!

(j − 1)!(r − j)![F (x)]j−1[1− F (x)]r−jf(x) dx.

29

Page 38: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Hence,

EXj:r =r!

(j − 1)!(r − j)!

∫ 1

0

x[F (x)]j−1[1− F (x)]r−j dF (x). (2.1.2)

Lemma 2.1.1. [11] A finite mean implies finite expectation of all order statistics.

Proof. Assume that the mean µ =∫ 1

0x(u)du is finite. So, x(u) is integrable in the interval

(0,1). Since from eqsn.(2.3.2) and (2.3.3) we have:

∫ 1

0

uj−1[1− u]r−jdu = B(j, r − j + 1) =(j − 1)! (r − j)!

(r!)is finite,

then uj−1[1−u]r−j is integrable in the interval (0,1). Hence, x(u) uj−1[1−u]r−j is integrable

in the interval (0,1) (because the product of two integrable functions on any interval is

an integrable function on this interval) and so

∫ 1

0

x(u) uj−1[1− u]r−jdu is finite.

From eqn.(2.1.2),

EXj:r =r!

(j − 1)!(r − j)!

∫ 1

0

x(u) uj−1[1− u]r−jdu is finite·

Therefore, a finite mean implies finite expectation of all order statistics.

Let’s rewrite the definition of the L-moment given in eqn.(2.1.1) to a simpler form

that is easy in use.

Change variable u = F (x). Let Q be the inverse of function F ; i.e., Q(F (x)) = x or

F (Q(u)) = u:

EXr−k:r =r!

(j − 1)!(r − j)!

∫ 1

0

Q(u) ur−k−1(1− u)k du. (2.1.3)

Substitute from eqn.(2.1.3) into eqn.(2.1.1) :

λr ≡ r−1

r−1∑

k=0

(−1)k

r − 1

k

r!

(r − 1− k)!k!

∫ 1

0

Q(u) ur−k−1(1− u)k du.

For convenience, consider λr+1 instead of λr:

30

Page 39: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

λr+1 ≡ (r + 1)−1

r∑

k=0

(−1)k

r

k

(r + 1)!

(r − k)!k!

∫ 1

0

Q(u) ur−k(1− u)k du.

Note that (r + 1)−1 (r + 1)! = r! and rearrange terms:

λr+1 =

∫ 1

0

r∑

k=0

(−1)k

r

k

2

ur−k(1− u)k Q(u) du. (2.1.4)

Expand (1− u)k in powers of u :

λr+1 =

∫ 1

0

r∑

k=0

(−1)k

r

k

2

ur−k

k∑j=0

(−1)k−j

k

j

uk−j Q(u) du

=

∫ 1

0

r∑

k=0

k∑j=0

(−1)j

r

k

2 k

j

ur−j Q(u) du.

Interchange order of summation over j and k:

λr+1 =

∫ 1

0

r∑j=0

r∑

k=j

(−1)j

r

k

2 k

j

ur−j Q(u) du.

Reverse order of summation: set m = r − j, n = r − k:

λr+1 =

∫ 1

0

r∑m=0

m∑n=0

(−1)r−m

r

r − n

2 r − n

r −m

um Q(u) du

λr+1 =

∫ 1

0

r∑m=0

(−1)r−m{ m∑

n=0

r

r − n

2 r − n

r −m

}um Q(u) du. (2.1.5)

Note that r

r − n

2 r − n

r −m

=

r

n

r

m

m

n

(2.1.6)

(expand the binomial coefficients in terms of factorials) and that

31

Page 40: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

m∑n=0

r

n

m

n

=

m∑n=0

r

r − n

m

n

=

r + m

r

=

r + m

m

(2.1.7)

(second equality follows because to choose r items from r +m we can choose from the

first m items and r− n from the remaining r items, for any n in 0, 1, ..., m). From (2.2.5)

and (2.2.6), we have:

m∑n=0

r

r − n

2 r − n

r −m

=

r

m

r + m

m

, (2.1.8)

and substituting into (2.1.5) gives

λr+1 =

∫ 1

0

r∑m=0

(−1)r−m

r

m

r + m

m

um Q(u) du

λr+1 =

∫ 1

0

r∑m=0

(−1)r−m

r

m

r + m

m

x(F ) Fm dF. (2.1.9)

Let

p∗r,m = (−1)r−m

r

m

r + m

m

, (2.1.10)

and

P ∗r (F ) =

r∑m=0

p∗r,m Fm. (2.1.11)

Substituting (2.1.11) into (2.1.9) we have [11]:

λr =

∫ 1

0

x(F ) P ∗r−1(F ) dF, r = 1, 2, . . . . (2.1.12)

Example 2.1.1. To fined λ2, substitute r = 2 in eqn.(2.1.1),

λ2 =1

2

1∑

k=0

(−1)k

1

k

EX2−k:2

=1

2

[(−1)0

1

0

EX2:2 + (−1)1

1

1

EX1:2

]

=1

2

[EX2:2 − EX1:2

]=

1

2E(X2:2 −X1:2).

32

Page 41: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

And we can substitute r = 2 in eqn.(2.1.12),

λ2 =

∫ 1

0

x(F ) P ∗1 (F ) dF

=

∫ 1

0

x(F )[ 1∑

m=0

p∗1,m Fm]

dF from eq.n.(2.1.11)

=

∫ 1

0

x(F )[p∗1,0F

0 + p∗1,1F1]

dF

=

∫ 1

0

x(F )[(−1)1

1

2

1

0

+ (−1)0

1

1

2

1

F

]dF from (2.1.10)

=

∫ 1

0

x(F )(2F − 1) dF.

Hence,

λ2 =1

2E(X2:2 −X1:2) =

∫ 1

0

x.(2F − 1) dF.

The first few L-moments are:

λ1 = EX =

∫ 1

0

x. dF,

λ2 =1

2E(X2:2 −X1:2) =

∫ 1

0

x.(2F − 1) dF,

λ3 =1

3E(X3:3 −X2:3 + X1:3) =

∫ 1

0

x.(6F 2 − 6F + 1) dF,

λ4 =1

4E(X4:4 − 3X3:4 + 3X2:4 −X1:4) =

∫ 1

0

x.(20F 3 − 30F 2 + 12F − 1) dF.

The use of L-moments to describe probability distributions is justified by the next

theorem. As shown in [17], λ2 is a measure of the scale or dispersion of the random

variable X. It is often convenient to standardize the higher moments λr, r ≥ 3, so that

they are independent of the units of measurement of X.

Definition 2.1.2. [18] Define the L-moment ratios of X to be the quantities

τr ≡ λr/λ2, r = 3, 4, ....

33

Page 42: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Note that [17]:

τ3 = λ3/λ2 is called L-skewness,

τ4 = λ4/λ2 is called L-kurtosis.

It is also possible to define a function of L-moments which is analogous to the coefficient

of variation: this is the L − CV, τ ≡ λ2/λ1. Bounds on the numerical values of the

L-moment ratios and L− CV is given by the following theorem.

Theorem 2.1.2. [18] Let X be a nondegenerate random variable with finite mean. Then

the L-moment ratios of X satisfy | τr |< 1, r ≥ 3. If in addition X ≥ 0 almost surely,

then τ , the L− CV of X, satisfies 0 < τ < 1.

Proof. Define Qr(t) by

t(1− t)Qr(t) =(−1)r

r!

dr

dtr[t(1− t)]r+1,

where Qr(t) is the Jacobi polynomial P(1,1)r (2t− 1).

Then,

d

dt[t(1− t)Qr(t)] =

(−1)r

r!

dr+1

dtr+1[t(1− t)]r+1

=(−1)r

r!

dr+1

dtr+1

r+1∑

k=0

(−1)k

r + 1

k

tr+1+k

=(−1)r

r!

r+1∑

k=0

(−1)k

r + 1

k

dr+1

dtr+1[tr+1+k]

=(−1)r

r!

r+1∑

k=0

(−1)k

r + 1

k

(

r + 1 + k)(

r + k).....

(k + 1

)tk

= −(r + 1)r+1∑

k=0

(−1)r−k+1 (r + 1)!(r + 1 + k)!

(r + 1)!k!(r + 1− k)!k!tk

= −(r + 1)r+1∑

k=0

(−1)r−k+1

r + 1

k

r + 1 + k

k

tk

= −(r + 1)r+1∑

k=0

(−1)r−k+1p∗r+1,ktk

= −(r + 1)P ∗r+1,k

(t).

34

Page 43: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Hence,d

dt[t(1− t)Qr(t)] = −(r + 1)P ∗

r+1(t).

Then,

P ∗r+1

(t)

=−1

r + 1

d

dt[t(1− t)Qr(t)].

Therefore,

P ∗r−1

(F

)=

−1

r − 1

d

dF[F (1− F )Qr−2(F )].

So, from eq.n.(2.1.12),

λr =−1

r − 1

∫x(F )

d

dF

[F (1− F )Qr−2(F )

]dF.

Now, integrating by parts:

λr =−1

r − 1

[x(F )F (1− F )Qr−2(F )−

∫F (1− F )Qr−2(F )dx

]

=[− xF (x)

[1− F (x)

](r − 1)−1Qr−2(F (x))

]+

∫F (x)

[1− F (x)

](r − 1)−1Qr−2(F (x))dx.

Since xF (x)[1− F (x)

]→ 0 as x approaches the endpoint of the distribution, then

λr =

∫F (x)

[1− F (x)

](r − 1)−1Qr−2(F (x))dx. (2.1.13)

Since

Qr(t) =(−1)r

r!

1

t(1− t)

dr

dtr[t(1− t)]r+1,

then Qt(0) = 1. In the case r = 2,

λ2 =

∫F (x)

[1− F (x)

]dx. (2.1.14)

Now, 0 ≤ F (x) ≤ 1 for all x. So,

|λr| ≤ (r − 1)−1

∫|F (1− F )Qr−2(F )|dx

= (r − 1)−1

∫|Qr−2|F (1− F )dx

≤ (r − 1)−1

∫sup

0≤t≤1|Qr−2(t)|F (1− F )dx

= (r − 1)−1 sup0≤t≤1

|Qr−2(t)|λ2.

35

Page 44: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

We have (see [30])

sup0≤t≤1

|Qr(t)| = r + 1

with the supremume being attained only at t = 0 or t = 1 . Thus, (see [18]), |λr| ≤ λ2,

with equality only if F (x) can take only the values 0 and 1; i.e., only if X is degenerate.

Thus, a nondegenerate distribution has |λr| ≤ λ2, which together with λ2 > 0 implies

|τr| < 1.

If X ≥ 0 almost surely, then λ1 = EX > 0 and λ2 > 0. So,

τ =λ2

λ1

> 0.

Furthermore, EX1:2 > 0. So,

τ − 1 = (λ2 − λ1)/λ1 = −EX1:2/λ1 < 0.

36

Page 45: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

2.2 Probability Weighted Moments

Here we are about to have a tool by which we can easily find the L-moments for any

distribution.

Definition 2.2.1. [14] The probability weighted moments (PWMs) of a random variable

X with a cumulative distribution function u = F (X) is the quantities

Mp,r,s = E{XpF (X)r(1− F (X))s

}=

∫ 1

0

XpF (X)r(1− F (X))sdF r = 0, 1, . . . .

If we write a cumulative distribution function F (X) = u, then the quantile function

is x(u) and

Mp,r,s = E{x(u)pur(1− u)s

}=

∫ 1

0

x(u)pur(1− u)sdu r = 0, 1, . . . .

A particular useful special cases are the probability weighted moments αr = M1,0,r and

βr = M1,r,0. For a distribution that has a quantile function x(u),

αr =

∫ 1

0

x(u)(1− u)rdu,

βr =

∫ 1

0

x(u)urdu. (2.2.1)

These equations may be contrasted with the definition of the ordinary moments, which

may be written as

E(Xr) =

∫ 1

0

{x(u)}r du.

Conventional moments involve successively higher powers of the quantile functions x(u),

whereas probability weighted moments involve successively higher powers of u or 1 − u

and may be regarded as integrals of x(u) weighted by the polynomials ur or (1− u)r [15].

The probability weighted moments αr and βr have been used as the basis of methods

for estimating parameters of probability distributions. However, they are difficult to

interpret directly as measures of the scale and shape of a probability distribution. This

37

Page 46: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

information is carried in certain linear combinations of the probability weighted moments.

For example, estimates of scale parameters of distributions are multiples of α0 − 2α1 or

2β1 − β0. The skewness of a distribution can be measured by 6β2 − 6β1 + β0 ([15]).

L-moments are linear combination of probability-weighed moments [28], since

λr+1 =

∫ 1

0

xP ∗r (F )dF =

∫ 1

0

r∑m=0

x(F )p∗r,mFmdF.

=r∑

m=0

p∗r,m

∫ 1

0

x(F )FmdF =r∑

m=0

p∗r,mβm. (2.2.2)

From e.qn. (2.1.4), we have

λr+1 =

∫ 1

0

r∑

k=0

(−1)k

r

k

2

ur−k(1− u)k Q(u) du. (2.2.3)

Expand ur−k in powers of (1− u) :

λr+1 =

∫ 1

0

r∑

k=0

(−1)k

r

k

2

(1− u)k

r−k∑j=0

(−1)r−k−j

r − k

j

(1− u)r−k−j Q(u) du

=

∫ 1

0

r∑

k=0

r−k∑j=0

(−1)r−j

r

k

2 r − k

j

(1− u)r−j Q(u) du·

= (−1)r

∫ 1

0

r∑

k=0

r−k∑j=0

(−1)j

r

r − k

2 r − k

j

(1− u)r−j Q(u) du·

= (−1)r

∫ 1

0

r∑

k=0

k∑j=0

(−1)j

r

k

2 k

j

(1− u)r−j Q(u) du·

Interchange order of summation over j and k:

λr+1 = (−1)r

∫ 1

0

r∑j=0

r∑

k=j

(−1)j

r

k

2 k

j

(1− u)r−j Q(u) du·

38

Page 47: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Reverse order of summation, set m = r − j, n = r − k:

λr+1 = (−1)r

∫ 1

0

r∑m=0

m∑n=0

(−1)r−m

r

r − n

2 r − n

r −m

(1− u)m Q(u) du

λr+1 = (−1)r

∫ 1

0

r∑m=0

(−1)r−m{ m∑

n=0

r

r − n

2 r − n

r −m

}(1− u)m Q(u) du. (2.2.4)

Note that r

r − n

2 r − n

r −m

=

r

n

r

m

m

n

(2.2.5)

(expand the binomial coefficients in terms of factorials) and that

m∑n=0

r

n

m

n

=

m∑n=0

r

r − n

m

n

=

r + m

r

=

r + m

m

(2.2.6)

(second equality follows because to choose r items from r + m we can choose from

the first m items and r − n from the remaining r items, for any n in 0, 1, ..., m). From

eq.n.(2.2.5) and eq.n.(2.2.6), we have:

m∑n=0

r

r − n

2 r − n

r −m

=

r

m

r + m

m

, (2.2.7)

and substituting into 2.4.1 gives

λr+1 = (−1)r

∫ 1

0

r∑m=0

(−1)r−m

r

m

r + m

m

(1− u)m Q(u) du

λr+1 = (−1)r

∫ 1

0

r∑m=0

(−1)r−m

r

m

r + m

m

x(F ) (1− F )m dF. (2.2.8)

λr+1 = (−1)r

r∑m=0

p∗r,m

∫ 1

0

x(F ) (1− F )m dF (2.2.9)

39

Page 48: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

λr+1 = (−1)r

r∑m=0

p∗r,mαm.

Hence,

λr+1 =r∑

m=0

p∗r,m βm = (−1)r

r∑m=0

p∗r,m αm. (2.2.10)

For example, the first four L-moments are related to the PWMs as follows [25]:

λ1 = β0 = α0,

λ2 = 2β1 − β0 = α0 − 2α1,

λ3 = 6β2 − 6β1 + β0 = α0 − 6α1 + 6α2,

λ4 = 20β3 − 30β2 + 12β1 + β0 = α0 − 12α1 + 30α2 − 20α3.

(2.2.11)

2.3 Relation of L-moments with Order Statistic

From (1.7.1), the cdf of rth order statistic is given by:

Fr(x) =n∑

k=r

n

k

F (x)k

[1− F (x)

]n−k. (2.3.1)

Definition 2.3.1. ([10], Page 107) We define the Beta function B(a, b) as follows:

B(a, b) =

∫ 1

0

ta−1(1− t)b−1dt =Γ(a)Γ(b)

Γ(a + b)· (2.3.2)

Note 2.3.1. If a, b are positive integers, then from Note 1.4.3 we can write

B(a, b) =(a− 1)!(b− 1)!

(a + b− 1)!· (2.3.3)

Definition 2.3.2. [25] The incomplete Beta function Ix(a, b) is defined via the Beta

function B(a,b) as follows:

Ix(a, b) =1

B(a, b)

∫ x

0

ta−1(1− t)b−1dt. (2.3.4)

Theorem 2.3.2. The expression

Fr(x) =n∑

k=r

n

k

F (x)k

[1− F (x)

]n−k.

40

Page 49: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

can be written in terms of an incomplete Beta function as:

Fr(x) = r

n

r

∫ F (x)

0

ur−1(1− u)n−rdu = IF (x)(r, n− r + 1).

Proof. Claim:

n∑

k=a

n

k

xk(1− x)n−k =

Γ(a + b)

Γ(a)Γ(b)

∫ x

0

ta−1(1− t)b−1dt,

where n = a + b− 1 , Γ is the gamma function and 0 < x < 1.

Proof of the claim: First, we want to find a formula for∫ x

0

ta−1(1− t)b−1dt.

Integrating by partes, let’s put u = (1− t)b−1, dv = ta−1dt, then

du = −(b− 1)(1− t)b−2dt, v =ta

So, ∫ x

0

ta−1(1− t)b−1dt =ta(1− t)b−1

a

∣∣∣x

0+

∫ x

0

ta

a(b− 1)(1− t)b−2dt.

Hence,∫ x

0

ta−1(1− t)b−1dt =xa(1− x)b−1

a+

(b− 1)

a

∫ x

0

ta(1− t)b−2dt. (2.3.5)

Now, by formula (2.3.5), we have:∫ x

0

ta−1(1− t)b−1dt =xa(1− x)b−1

a+

(b− 1)

a

∫ x

0

ta(1− t)b−2dt

=xa(1− x)b−1

a+

(b− 1)

a

[xa+1(1− x)b−2

a + 1+

(b− 2)

a + 1

∫ x

0

ta+1(1− t)b−3dt]

=xa(1− x)b−1

a+

(b− 1)xa+1(1− x)b−2

a(a + 1)+

(b− 1)(b− 2)

a(a + 1)

∫ x

0

ta+1(1− t)b−3dt

=xa(1− x)b−1

a+

(b− 1)xa+1(1− x)b−2

a(a + 1)

+(b− 1)(b− 2)

a(a + 1)

[xa+2(1− x)b−3

a + 2+

(b− 3)

a + 2

∫ x

0

ta+2(1− t)b−4dt]

41

Page 50: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

=xa(1− x)b−1

a+

(b− 1)xa+1(1− x)b−2

a(a + 1)+

(b− 1)(b− 2)xa+2(1− x)b−3

a(a + 1)(a + 2)

+(b− 1)(b− 2)(b− 3)

a(a + 1)(a + 2)

∫ x

0

ta+2(1− t)b−4dt

=xa(1− x)b−1

a+

(b− 1)xa+1(1− x)b−2

a(a + 1)+

(b− 1)(b− 2)xa+2(1− x)b−3

a(a + 1)(a + 2)

+ ... +(b− 1)(b− 2)(b− 3)

a(a + 1)(a + 2)

∫ x

0

ta+2(1− t)b−4dt.

Therefore,

Γ(a + b)

Γ(a)Γ(b)

∫ x

0

ta−1(1− t)b−1dt =(a + b− 1)!

(a− 1)!(b− 1)!

∫ x

0

ta−1(1− t)b−1dt (from Note 1.4.3)

=(a + b− 1)!

(a− 1)!(b− 1)!

[xa(1− x)b−1

a+

(b− 1)xa+1(1− x)b−2

a(a + 1)+

(b− 1)(b− 2)xa+2(1− x)b−3

a(a + 1)(a + 2)

+ ... +(b− 1)(b− 2)(b− 3)

a(a + 1)(a + 2)

∫ x

0

ta+2(1− t)b−4dt]

=(a + b− 1)!

(a− 1)!(b− 1)!× xa(1− x)b−1

a+

(a + b− 1)!

(a− 1)!(b− 1)!× (b− 1)xa+1(1− x)b−2

a(a + 1)

+(a + b− 1)!

(a− 1)!(b− 1)!× (b− 1)(b− 2)xa+2(1− x)b−3

a(a + 1)(a + 2)

+ ... +(a + b− 1)!

(a− 1)!(b− 1)!× (b− 1)(b− 2)(b− 3)

a(a + 1)(a + 2)

∫ x

0

ta+2(1− t)b−4dt

=(a + b− 1)! xa (1− x)b−1

a! (b− 1)!+

(a + b− 1)! xa+1 (1− x)b−2

(a + 1)! (b− 2)!

+(a + b− 1)! xa+2 (1− x)b−3

(a + 2)! (b− 3)!+

(a + b− 1)!

(b− 4)! (a + 2)!

∫ x

0

ta+2(1− t)b−4dt

42

Page 51: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

=(a + b− 1)! xa (1− x)b−1

a! (b− 1)!+

(a + b− 1)! xa+1 (1− x)b−2

(a + 1)! (b− 2)!

+(a + b− 1)! xa+2 (1− x)b−3

(a + 2)! (b− 3)!+ ... +

(a + b− 1)!

(a + b− 2)! (b− b)!

∫ x

0

ta+b−2(1− t)b−bdt

=(a + b− 1)! xa (1− x)b−1

a! (b− 1)!+

(a + b− 1)! xa+1 (1− x)b−2

(a + 1)! (b− 2)!

+(a + b− 1)! xa+2 (1− x)b−3

(a + 2)! (b− 3)!+ ... +

(a + b− 1)! xa+b−1 (1− x)0

(a + b− 1)! 0!

=

a + b− 1

a

xa(1− x)b−1 +

a + b− 1

a + 1

xa+1(1− x)b−2

+

a + b− 1

a + 2

xa+2(1− x)b−3 + ... +

a + b− 1

a + b− 1

xa+b−1(1− x)0

=a+b−1∑

k=a

a + b− 1

k

xk (1− x)a+b−1−k

=n∑

k=a

n

k

xk (1− x)n−k, where n = a + b− 1.

This completes the proof of the claim.

Now, we want to show that

Fr(x) = r

n

r

∫ F (x)

0

ur−1(1− u)n−rdu = IF (x)(r, n− r + 1).

From eqn.(2.3.4), we have

IF (x)(r, n− r + 1) =1

B(r, n− r + 1)

∫ F (x)

0

ur−1(1− u)n−rdu. (2.3.6)

Indeed; note that:

1

B(r, n− r + 1)=

Γ(n + 1)

Γ(r)Γ(n− r + 1)=

Γ(r + n− r + 1)

Γ(r)Γ(n− r + 1).

43

Page 52: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Substitute in eqn.(2.3.6),

IF (x)(r, n− r + 1) =Γ(r + n− r + 1)

Γ(r)Γ(n− r + 1)

∫ F (x)

0

ur−1(1− u)n−rdu.

By the Claim we have:

IF (x)(r, n− r + 1) =n∑

k=r

n

k

F (x)k

[1− F (x)

]n−k.

From eq.n.(2.3.1), we have:

IF (x)(r, n− r + 1) = Fr(x).

We want to connect the cdf of the jth order statistic with the probability wight mo-

ments.

The probability density function of Xr:n is given by Theorem 1.7.2 as follows:

fr(x) = r

n

r

F r−1(x)

[1− F (x)

]n−rf(x). (2.3.7)

Now, the expected value of rth order statistics can be obtained as

E[Xr:n] =

∫ ∞

−∞xfr(x)dx. (2.3.8)

Substituting from e.qn.(2.3.7) into (2.3.8) and introducing a transformation, u = F (x)

or x = F−1(u), 0 ≤ u ≤ 1, leads to:

E[Xr:n] = r

n

r

∫ 1

0

x(u)ur−1(1− u)n−rdu· (2.3.9)

Note that, x(u) denotes the quantile function of a random variable. The expectation of

the maximum and minimum of a sample of size n can be easily obtained from eq.n.(2.3.9)

by setting r = n and r = 1, respectively as follows:

44

Page 53: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

E[Xn,n] = n

∫ 1

0

x(u)un−1du, (2.3.10)

and

E[X1:n] = n

∫ 1

0

x(u)(1− u)n−1du. (2.3.11)

The probability weighted moments (PWMs)of a random variable was formally defined

by :

Mi,j,k = E[x(u)iuj(1− u)k] =

∫ 1

0

x(u)iuj(1− u)kdu.

The following two forms of PWMs are particularly simple and useful:

αk = M1,0,k =

∫ 1

0

x(u)(1− u)kdu (k = 0, 1, ...n) (2.3.12)

and

βk = M1,k,0 =

∫ 1

0

x(u)ukdu (k = 0, 1, ....n). (2.3.13)

Comparing eq.ns (2.3.12) and (2.3.13), with e.qns (2.3.10) and (2.3.11), it can be seen

that αk and βk, respectively, are related to the expectation of the minimum and maximum

in a sample of size k as follows:

αk =1

k + 1E[X1:k+1],

βk =1

k + 1E[Xk+1:k+1] (k ≥ 1). (2.3.14)

In fact, PWMs are the normalized expectations of maximum/minimum of k random

observations. The normalization is done by the sample of size k itself. From eq.n.(2.3.10),

we notice that:

E[Xn:n] = nβn−1.

From e.qn.(2.3.13), we have:

βn−1 =

∫ ∞

−∞xF n−1(x)f(x)dx.

So,

E[Xn:n] =

∫ ∞

−∞xnf(x)F n−1(x)dx.

45

Page 54: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

2.4 Properties of L-moments

The L-moments λ1 and λ2, the L−CV, τ, and L-moment ratios τ3 and τ4 are most useful

quantities for summarizing probability distributions. Their most important properties are

the following (proofs are given in [17], [18]):

1. Existence. If the mean of the distribution exists, then all of the L-moments exist.

2. Uniqueness. If the mean of the distribution exists, then the L-moments uniquely

define the distribution. That is; no two distinct distributions have the same L-

moment. Properties 1 and 2 are proved in the next theorem.

Theorem 2.4.1. [1] (i) The L-moments λr, r = 1, 2, . . . of a real-valued random

variable X exists if and only if X has a finite mean.

(ii) A distribution whose mean exists is characterized by its L-moments λr : r = 1, 2, . . ..

Proof. We know that a finite mean implies a finite expectation of all order statistics

(see Lemma 2.1.1). Since the L-moments λr, r = 1, 2, . . . are a linear functions of

the expected order statistics, then the L-moments λr, r = 1, 2, . . . exist.

Conversely, if the L-moments λr, r = 1, 2, . . . of a real-valued random variable X

exist, then the mean= λ1 exists.

For part (ii), we first show that a distribution is characterized by the set

{EXr:r, r = 1, 2, . . .}.

Let X and Y be random variables with cumulative distribution functions F and G

and quantile functions x(u) and y(u), respectively. Let

ξ(X)r ≡ EXr:r = r

∫ 1

0x F (x)r−1 dF (x), ξ

(Y )r ≡ EYr:r = r

∫ 1

0x G(x)r−1 dG(x).

Then,

ξ(X)r+2 − ξ

(X)r+1 =

∫ 1

0

x(r + 2)ur+1 − (r + 1)ur du

46

Page 55: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

=

∫ 1

0

ur.u(1− u) dx(u) integrating by parts,

=

∫ 1

0

ur. dzX(u),

where zX(u), defined by dzX(u) = u(1−u) dx(u), is an increasing function on (0,1).

If ξ(X)r = ξ

(Y )r , r = 1, 2, . . ., then

∫ 1

0

ur. dzX(u) =

∫ 1

0

ur. dzY (u).

Thus, zX and zY are distributions which have the same moments on the finite interval

(0,1). Consequently, by Theorem 1.4.4, zX(u) = zY (u). Hence, dzX = dzY . That

means, u(1 − u) dx(u) = u(1 − u) dy(u). Since u(1 − u) 6= 0, then dx(u) = dy(u).

This implies that x(u) = y(u), and so F = G.

Conversely, if F = G, then x(u) = y(u) and

ξ(X)r = EXr:r = r

∫ 1

0

xF (x)r−1 dF (x) = r

∫ 1

0

xG(x)r−1 dG(x) = EYr:r = ξ(Y )r .

We have shown that a distribution with finite mean is characterized by the set

{ξr : r = 1, 2, ...}.Now, we want to show that a distribution with finite mean is characterized by its

L-moments λr : r = 1, 2, . . ..

Recall eq.n. (2.1.12),

λr =

∫ 1

0

x(F )P ∗r−1(F )dF, r = 1, 2, ...,

P ∗r (F ) =

r∑

k=0

p∗r,kFk, p∗r,k = (−1)r−k

r

k

r + k

k

.

Since

P ∗r−1(F ) =

r−1∑

k=0

p∗r−1,kFk,

then,

47

Page 56: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

λr =

∫ 1

0

x(F )[ r−1∑

k=0

p∗r−1,k F k]

dF

=

∫ 1

0

r−1∑

k=0

p∗r−1,k x(F ) F k dF =r−1∑

k=0

∫ 1

0

p∗r−1,k x(F ) {F (x)}k dF

=r−1∑

k=0

p∗r−1,k

∫ 1

0

x(F ) {F (x)}k dF =r∑

k=1

p∗r−1,k−1

∫ 1

0

x(F ) {F (x)}k−1 dF

=r∑

k=1

p∗r−1,k−1k−1 k

∫ 1

0

x(F ) {F (x)}k−1 dF

︸ ︷︷ ︸ξk

=r∑

k=1

p∗r−1,k−1 k−1ξk·

From [18], we have:

ξr =r∑

k=1

(2k − 1) r! (r − 1)!

(r − k)! (r − 1 + k)!λk ·

Thus, a given set of λr determines a unique set of {ξr : r = 1, 2, ...}, since a

distribution with finite mean is characterized by the set {ξr : r = 1, 2, ...}. Therefor,

a distribution whose mean exists is characterized by its L-moments λr : r = 1, 2, . . ..

Thus, a distribution may be specified by its L-moments even if some of its conven-

tional moments do not exist([18]).

3. Terminology([15], Page 24)

• λ1 is the L-location or mean of the distribution.

• λ2 is the L-scale.

• τ is the L-CV

• τ3 is the L-skewness.

• τ4 is the L-kurtosis.

4. Numerical values

• λ1 can take any value, because λ1 = E(X) and X may be positive or negative.

48

Page 57: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

• λ2 ≥ 0, because λ2 = E(X2:2 −X2:1) and X2:2 ≥ X2:1.

• For any distribution that takes only positive values, 0 ≤ τ < 1, this is proved

in Theorem 2.1.2.

• L-moment ratios satisfy |τ | < 1 for all r ≥ 3. This is proved in Theorem 2.1.2.

• Tighter bounds can be found for individual τr quantities. For example, bounds

for τ4 given τ3 are1

4(5τ 2

3 − 1) ≤ τ4 < 1 ([15])·

• For a distribution that takes only positive values, bounds for τ3 given τ are

2τ − 1 ≤ τ3 < 1 ([18])·

5. Linear transformation. Let X and Y be random variables with L-moments λr and

λ∗r, respectively, and suppose that Y = aX + b, a > 0. Then,

(I) λ∗1 = aλ1 + b ;

(II) λ∗2 = aλ2 ;

(III) τ ∗r = τr , r ≥ 3.

Proof. (I) Assume that X and Y are random variables with cumulative distribution

functions F and G and quantile functions x(u) and y(u).

Let u = GY (y). Then,

y = G−1Y (u) = y(u). (2.4.1)

Since

u = GY (y) = P (Y ≤ y) = P (aX + b ≤ y)

= P(aX ≤ y − b

)= P

(X ≤ y − b

a

)(because a > 0)

= FX

(y − b

a

),

then F−1X (u) = y−b

a· So, x(u) = y−b

a· Hence,

y = ax(u) + b. (2.4.2)

49

Page 58: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

From eq.n.(2.4.1) and eq.n(2.4.2) we have:

y(u) = ax(u) + b. (2.4.3)

Then, from eq.n.(2.4.3) we have:

λ1(Y ) =

∫ 1

0

y(u)du =

∫ 1

0

[ax(u) + b]du

= a

∫ 1

0

x(u)du + b = aλ1(X) + b.

(II) λ2(Y ) =

∫ 1

0

y(u)(2u− 1)du

=

∫ 1

0

[ax(u) + b](2u− 1)du

= a

∫ 1

0

x(u)(2u− 1)du + b

∫ 1

0

(2u− 1)du

= aλ2(X).

(III) From eq.n.(2.1.12),

λr(Y ) =

∫ 1

0

y(F )P ∗r−1(F )d F, r = 3, 4 . . .

=

∫ 1

0

(ax(F ) + b)P ∗r−1(F )dF

= a

∫ 1

0

x(F )P ∗r−1(F )dF + b

∫ 1

0

P ∗r−1(F ) dF, by eq.n(1.6.9)

= aλr(X).

Hence, for all r ≥ 3,

τr(Y ) = λr(Y )/λ2(Y )

= aλr(X)/aλ2(X)

= τr(X).

50

Page 59: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

6. Symmetry. Let X be a symmetric random variable with mean µ. That is; P (X ≥µ + x) = P (X ≤ µ− x) for all x. Then, all of the odd-order L-moment ratios of X

are zero. That is; τr = 0, r = 3, 5, ....([15], Page 24).

Proof. Assume X has the cumulative distribution function FX(x) and the quantile

function x(u).

Claim: If X is a symmetric random variable with mean µ then,

x(u) = −x(1− u).

Proof of the claim: Conceder, X is a symmetric random variable with mean µ,

that means, P (X ≥ µ + x) = P (X ≤ µ− x), then P (X ≥ x) = P (X ≤ −x).

Now, FX(−x) = P (X ≤ −x) = P (X ≥ x) = 1− P (X ≤ x) = 1− FX(x).

Hence, −x(u) = F−1X [FX(−x)] = F−1

X [1− FX(x)] = F−1X (1− u) = x(1− u).

Therefor, x(u) = −x(1− u). This completes the proof of the claim.

Now we want to calculate λ2r+1, r = 1, 2, 3 . . . for a symmetric random variable X,

then we want to fined it’s τ2r+1, r = 1, 2, 3 . . .

Replace 2r + 1 with r in eqn.(2.1.12) we have

λ2r+1 =

∫ 1

0

x(u) P ∗2r(u) du =

∫ 1

0

2r∑m=0

p∗2r,m x(u) umdu. (2.4.4)

And replace 2r + 1 with r + 1 in eqn.(2.2.9) we have

λ2r+1 = (−1)2r+1

2r∑m=0

p∗2r,m

∫ 1

0

x(u) (1− u)m du

= −∫ 1

0

2r∑m=0

p∗2r,m x(u) (1− u)m du

= −∫ 1

0

2r∑m=0

p∗2r,m − x(1− u) (1− u)m du, by the claim

= −∫ 1

0

2r∑m=0

p∗2r,m x(1− u) (1− u)m d(1− u)

= −∫ 1

0

2r∑m=0

p∗2r,m x(z) zm dz, where z = 1− u. (2.4.5)

51

Page 60: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

From eqn’s (2.4.4) and (2.4.5) we have λ2r+1 = −λ2r+1, that means, λ2r+1 = 0 for

all r = 1, 2, 3, . . . .

Then,

τ2r+1 =λ2r+1

λ2

=0

λ2

= 0.

2.5 L-skewness and L-kurtosis

The main features of a probability distribution should be well-summarized by the following

four measures: the mean or L-location (λ1), the L-scale λ2, the L-skewness τ3 and the

L-kurtosis τ4. We now consider these measures, particulary τ3 and τ4 in more details.

The L-moment measure of location is the mean, λ1. This is a well-established and familiar

quantity which needs no further description or justification here [17].

The L-scale λ2 is also long established in statistic, for it is, apart from a scalar multiple,

the expectation of Gini,s mean difference statistic. To compare λ2 with the more familiar

scale measure σ, the standard deviation, write

λ2 =1

2E(X2:2 −X1:2), σ2 =

1

2E(X2:2 −X1:2)

2

Both quantities measure the difference between two randomly drawn elements of a distri-

bution, but σ2 gives relatively more weight to the largest difference [17].

λ2 is used to obtain scale-free higher-order descriptive measure, τk = λk

λ2, k ≥ 3 called

L-moment ratios, very conveniently for practical use and interpretation.

Table 2.1 shows the L-skewness for some common distributions. The L-skewness τ3 is a

dimensionless analogue of λ3. By theorem 2.4.1, τ3 takes values between −1 and +1.

τ3 =EX3:3 − 2EX2:3 + EX1:3

EX3:3 − EX1:3

shows that τ3 is similar in form to a measure of skewness.

52

Page 61: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Table 2.1: L-skewness of some common distribution

Distribution L-skewness

Uniform 0

Exponential 13

Gumble 0.1699

Logistic 0

Normal 0

Generalized Pareto τ3 = (1− k)/(3 + k)

Generalized extreme value 2(1− 3−k)/(1− 2−k)− 3

Generalized logistic −k

Table 2.2: L-kurtosis of some common distributions

Distribution L-kurtosis

Uniform 0

Exponintial 16

Gumble 0.1504

Logistic 16

Normal 0.1226

Generalized Pareto (1− k)(2− k)/(3 + k)(4 + k)

Generalized extreme value (1− 6.2−k + 10.3−k − 5.4−k)/(1− 2−k)

Generalized logistic (1 + 5k2)/6

53

Page 62: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

L-kurtosis, τ4, is equally difficult to interpret uniquely and is best thought of as a

measure similar to κ but giving less weight to the extreme tails of the distribution [17].

Table 2.2 shows the L-kurtosis for some common distributions:

2.6 L-moments of a Polynomial Function of Random

Variables

In this section, we find the kth PWMs of a random variable Y = Xm and we apply this

relation to the standard normal distribution and to the exponential distribution.

The kth PWMs of a random variable X with quantile function x(u) is given from eq.n.(2.2.1)

by:

βk =

∫ 1

0

x(u)ukdu.

The quantile function of the random variable Y = Xm follows from a transformation

y(u) = xm(u): Since

FY (y) = P (Y ≤ y) = P (Xm ≤ y) = P (X ≤ y1m ) = FX(y

1m )

F−1Y (u) = y, F−1

X (u) = y1m .

Then,

y(u) = F−1Y (u) = y = (F−1

X (u))m = xm(u).

Therefore, the kth PWMs of Xm is given by:

βk =

∫ 1

0

[F−1X (u)]mukdu.

In particular, if X is a standard normally distributed variable, then the following PWM,s

is:

βk =

∫ 1

0

[Φ−1(u)]mukdu

and can be calculated numerically as shown in Table 2.3.

54

Page 63: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Table 2.3: [25] Matrix B with numerical evaluations of βk =∫ 1

0(Φ−1(u))mukdu

X0 X1 X2 X3 X4 X5

β0 1 0 1 0 3 0

β1 1/2 0.282 0.5 0.705 1.5 3.032

β2 1/3 0.282 0.425 0.705 1.400 3.032

β3 1/4 0.257 0.388 0.675 1.350 2.969

β4 1/5 0.233 0.360 0.650 1.305 2.907

β5 1/6 0.211 0.337 0.618 1.266 2.848

In particular, if X is exponentially distributed, then the following PWM,s can be

written as:

βk =

∫ 1

0

[ξ − α ln(1− u)]mukdu

and can be calculated numerically as shown in Table 2.4.

L-moments are linear combinations of the PWMs, from eq.n.s(2.2.11)

λ1 = β0,

λ2 = −β0 + 2β1,

λ3 = β0 − 6β1 + 6β2,

λ4 = −β0 + 12β1 − 30β2 + 20β3.

Then, L-moments are given by the matrix multiplication λ = AB, in which

λ =

λ1

λ2

λ3

λ4

, A =

1 0 0 0

−1 2 0 0

1 −6 6 0

−1 12 −30 20

, B =

β0

β1

β2

β3

.

Furthermore, L-moments are linear combinations of observations and therefore the L-

moments of the summation of two random variables is given by the summation of the

L-moments of the random variables separately[25].

55

Page 64: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Table 2.4: [25] Matrix B with numerical evaluation of βk =∫ 1

0(ξ − α log(1− u))mukdu

X0 X1 X2 X3 X4

β0 1 ξ + α ξ2 + 2α2 + 2ξα ξ3 + 6α3 + 6ξα2 + 3ξ2 + 3ξ2α 4ξ3α + 12ξ2α2+

24ξα3 + ξ4 + 24α4

β1 1/2 1/2ξ + 3/4α 3/2ξα+ 21/4ξα2 + 1/2ξ3 1/2ξ4 + 93/4α4 + 3ξ3α

7/4ξ2 + 1/2ξ2 +45/8α3 + 9/4ξ2α +21/2ξ2α2 + 45/2ξα3

β2 1/3 1/3ξ + 11/18α 11/9ξα + 85/54α2 11/6ξ2α + 575/108α3+ 575/27ξα3 + 3661/162α4+

+1/3ξ2 1/3ξ3 + 85/18ξα2 22/9ξ3α + 85/9ξ2α2 + 1/3ξ4

β3 1/4 1/4ξ + 25/48α 25/24ξα + 415/288α2 1/4ξ3 + 25/16ξ2α + 5845/ 415/48ξ2α2 + 5845/288ξα3+

+1/4ξ2 1152α3 + 415/96ξα2 76111/3456α4 + 25/12ξ3α+

1/4ξ4

β4 1/5 1/2ξ + 137/300α 1/5ξ2 + 137/ 1/5ξ3 + 137/100ξ2α + 12019/ 137/75ξ3α + 12019/1500ξ2α2

150ξα + 12019/ 3000ξα2 + 874853/180000α3 +874853/45000ξα3 + 1/5ξ4+

9000α2 58067611/2700000α4 18000ξ2α3 + 3673451957/

β5 1/6 1/2ξ + 49/120α 49/60ξα + 13489/ 49/40ξ2α + 1/6ξ3 + 13489/ 1/6ξ4 + 68165041/3240000α4+

10800α2 + 1/6ξ2 3600ξα2 + 336581/72000α3 49/30ξ3α + 13489/1800ξ2α2

+336581/18000ξα3

X5

β0 120ξα4 + 5ξ4 + 20ξ3α2+

60ξ2α3 + 120α5 + ξ5

β1 465/4ξα4 + 15/4ξ4α+

2ξ3α2 + 225/4ξ2α3+

945/8α5 + 1/2ξ5

β2 18305/162ξα4α+

425/27ξ3α2 + 2875/54ξ2α3

+113155/972ξ5 + 1/3ξ5

β3 3805555/3456ξα4 + 125/48ξ4α+

2075/144ξ3α2 + 29225/576ξ2α3+

4762625/41472α5 + 1/4ξ5

β4 58067611/540000ξα4 + 137/

60ξ4α + 12019/900ξ3α2 + 874853/

18000ξ2α3 + 3673451957/

32400000α5 + 1/5ξ5

β5 68165041/648000ξα4 + 49/

24ξ4α + 13489/1080ξ3α2 + 336581/

7200ξ2α3 + 483900263/

432000α5 + 1/6ξ5

56

Page 65: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

2.7 Approximating a Quantile Function

In this section we introduce a theorem of a special importance. From this theorem that

approximates a quantile function x(F ), we can find any distribution when we know it’s

L-moments and this is by finding its quantile function x(F ). After that, we can find

the cumulative distribution function F (x) to this distribution and then, we can get its

probability distribution function f(x).

Theorem 2.7.1. [27]. Let X be a real-valued continuous random variable with finite

variance, quantile function x(F ) and L-moment λr, r ≥ 1. Then the representation

x(F ) =∞∑

r=1

(2r − 1)λrP∗r−1(F ), 0 < F < 1,

is convergent in mean square, i.e.,

Rs(F ) ≡ x(F )−s∑

r=1

(2r − 1)λrP∗r−1(F ),

the remainder after stopping the infinite sum after s terms, satisfies

∫1

0

{Rs(F )}2dF → 0 as s → ∞ .

Proof. The shifted Legendre polynomials P ∗r−1(F ) are a natural choice as the basis of the

approximation because they are orthogonal on 0 < F < 1 with constant weight function

r(F ) = 1. We can say that {P ∗r−1(F ) : r = 1, 2, 3 . . .} is the set of eigenfunctions, and

x(F ) is a function on [0,1], (see section 1.6).

Now, we can apply e.qn. (1.6.4) in Corollary 1.6.2 to fined x(F ) as follows:

x(F ) =∞∑

r=0

cr P ∗r−1(F ),

where cr =1

µr

∫ 1

0

r(F ) u(F ) P ∗r−1(F ) dF,

µr =

∫ 1

0

r(F ) {P ∗r−1(F )}2 dF =

∫ 1

0

{P ∗r−1(F )}2 dF.

57

Page 66: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Since r(F ) = 1 and by eq.n.(1.6.8),

∫ 1

0

{P ∗r (F )}2 dF =

1

2r + 1,

then,

µr =

∫ 1

0

{P ∗r−1(F )}2 dF =

1

2(r − 1) + 1=

1

2r − 1·

So,

cr =( 1

2r − 1

)−1∫ 1

0

u(F ) P ∗r−1(F ) dF = (2r − 1)λr.

Hence,

x(F ) =∞∑

r=0

(2r − 1)λr P ∗r−1(F ). (2.7.1)

Now,

∫ 1

0

{Rs(F )}2dF =

∫ 1

0

{x(F )−

s∑r=1

(2r − 1)λrP∗r−1(F )

}2

dF.

By e.qn.(2.7.1) and as s →∞,

∫ 1

0

{Rs(F )}2dF =

∫ 1

0

{x(F )−

∞∑r=1

(2r − 1)λrP∗r−1(F )

}2

dF = 0·

Example 2.7.1. We can apply Theorem 2.7.1 to find the quantile function x(F ) of the

uniform distribution from it’s L-moments. Since, from subsection 3.9.1, the L-moments

for the uniform distribution are: λ1 = 12(α+β), λ2 = 1

6(β−α) and λr = 0, r = 3, 4, 5 . . . ,

then,

x(F ) =∞∑

r=1

(2r − 1)λrP∗r−1(F )

=2∑

r=1

(2r − 1)λrP∗r−1(F ) (because λr = 0, for all r > 2)

= λ1P∗0 (F ) + 3λ2P

∗1 (F )

58

Page 67: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

=1

2(α + β) + 3× 1

6(β − α)[2F − 1]

=1

2(α + β)− 1

2(β − α) + (β − α)F

=1

2(α + β − β + α) + (β − α)F

= α + (β − α)F ·

Since the cumulative distribution function F (x) is the inverse function of quantile function

x(F ), then we can find the cumulative distribution function of the uniform distribution

F (x) by

F (x) =

0, x < α;

(x− α)/(β − α), α ≤ x < β;

1, x ≥ β.

and we can get the probability distribution function of the uniform distribution f(x)

by

f(x) = F ′(x) = 1/(β − α).

2.8 L-moments as Measures of Distributional Shape

In [12], Oja has defined intuitively reasonable criteria for one probability distribution on

the real line to be located further to the right (more dispersed, more skew, kurtotic)

than another. Areal-valued function of a distribution that preserves the partial ordering

of distributions implied by these criteria may then reasonably be called a “measure of

location” (dispersion, skewness, kurtosis). The following theorem shows that τ3 and τ4

are, by Oja’s criteria, measures of skewness and kurtosis respectively.

Definition 2.8.1. [24] Let S ⊂ Rn be a nonempty convex set. Function f : S → R is

said to be convex on S if for any x1, x2 εS and all 0 ≤ α ≤ 1, we have

f(αx1 + (1− α)x2) ≤ αf(x1) + (1− α)f(x2).

Theorem 2.8.1. [12] Let X and Y be continues real-valued random variables with cu-

mulative distribution functions F and G respectively, and L-moment λr(X) and λr(Y )

59

Page 68: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

respectively.

(i) If Y = aX + b, then λ1(Y ) = aλ1(X) + b, λ2(Y ) = |a|λ2(X) , τ3(Y ) = τ3(X),

τ4(Y ) = τ4(X).

(ii) Let M (x) = G−1(F (x))− x. If M (x) ≥ 0 for all x, then λ1(Y ) ≥ λ1(X). If M (x) is

convex, then τ3(Y ) ≥ τ3(X).

Proof. (i) Since λ1(Y ) = E(Y ) = E(aX + b) = aE(X) + b = aλ1(X) + b

and since Y = (aX + b), then

FY (y) = P (Y ≤ y) = P (aX + b ≤ y) = P (aX ≤ y − b), we have two cases:

case(1): a > 0, then a = |a| and FY (y) = P (X ≤ y−b|a| ) = FX(y−b

|a| ),

case(2): a < 0, then a = −|a| and FY (y) = P (−X ≤ y−b|a| ) = P (X ≥ −y−b

|a| )

= P (X ≤ y−b|a| ) = FX(y−b

|a| ).

Let u = FY (y) = FX(y−b|a| ). Then,

y = F−1Y (u) (2.8.1)

and y−b|a| = F−1

X (u). Now,

y = |a|F−1X (u) + b. (2.8.2)

From eq.n.(2.8.1) and eq.n.(2.8.2), we have: F−1Y (u) = |a|F−1

X (u) + b.

So,

y(u) = |a|x(u) + b. (2.8.3)

Therefore,

λ2(Y ) =

∫ 1

0

y(u)(2u− 1)du

=

∫ 1

0

[|a|x(u) + b](2u− 1)du from eq.n.(2.8.3)

= |a|∫ 1

0

x(u)(2u− 1)du + b

∫ 1

0

(2u− 1)du

= |a|λ(X)2 + b(u2 − u)

∣∣∣1

0= |a|λ2(X) ·

60

Page 69: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Claim:

λr(Y ) = |a|λr(X) + b

r−1∑

k=0

p∗r−1,k

k + 1·

Proof of the claim: From eq.n.(2.1.12),

λr(Y ) =

∫ 1

0

y(u)P ∗r−1(u)du

=

∫ 1

0

[|a|x(u) + b]P ∗r−1(u)du from eq.n.(2.8.3)

= |a|∫ 1

0

x(u)P ∗r−1(u)du + b

∫ 1

0

P ∗r−1(u)du

= |a|λr(X) + b

∫ 1

0

[ r−1∑

k=0

p∗r−1,kuk]du

= |a|λr(X) + b

r−1∑

k=0

p∗r−1,k

[ ∫ 1

0

ukdu]

= |a|λr(X) + b

r−1∑

k=0

p∗r−1,k

k + 1·

So, from the claim, we have:

λ3(Y ) = |a|λ3(X) + b

2∑

k=0

p∗2,k

k + 1

= |a|λ3(X) + b[p∗2,0

1+

p∗2,1

2+

p∗2,2

3

]

= |a|λ3(X) + b[(− 1

)2

2

0

2

0

+

1

2

(− 1

)1

2

1

3

1

+1

3

(− 1

)0

2

2

4

2

]

= |a|λ3(X) + b[1− 1

2× 2× 3 +

1

3× 1× 6

]

= |a|λ3(X) + b[1− 3 + 2

]= |a|λ3(X).

61

Page 70: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Therefore,

τ3(Y ) = λ3(Y )/λ2(Y ) = |a|λ3(X)/|a|λ2(X)

= λ3(X)/λ2(X) = τ3(X),

and

λ4(Y ) = |a|λ4(X) + b

3∑

k=0

p∗3,k

k + 1

= |a|λ4(X) + b[p∗3,0

1+

p∗3,1

2+

p∗3,2

3+

p∗3,3

4

]

= |a|λ4(X) + b[(− 1

)3

3

0

3

0

+

1

2

(− 1

)2

3

1

4

1

+1

3

(− 1

)1

3

2

5

2

+

1

4

(− 1

)0

3

3

6

3

]

= |a|λ4(X) + b[− 1 +

1

2× 3× 4− 1

3× 3× 10 +

1

4× 1× 20

]

= |a|λ4(X) + b[− 1 + 6− 10 + 5

]= |a|λ4(X)·

Now,

τ4(Y ) = λ4(Y )/λ2(Y ) = |a|λ4(X)/|a|λ2(X)

= λ4(X)/λ2(X) = τ4(X)·

To show that λ1(Y ) ≥ λ1(X), let y = G−1(F (x)). Since M (x) ≥ 0 for all x, then

G−1(F ) ≥ x(F ) for all F .

Hence, y(u) ≥ x(u) for all u. Therefore,

∫ 1

0

y(u)du ≥∫ 1

0

x(u)du.

From eq.n.(2.1.12), λ1(Y ) ≥ λ1(X)·

For τ3, we want to show that τ3(Y ) ≥ τ3(X). Assume that the probability density func-

tions of X and Y are respectively, f and g and let r(x) = f(x)/g{G−1(F (x))}. Because

62

Page 71: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

M (x) is convex, r(x) = d M (x)/dx+1 is increasing. Since y = G−1(F (x)), G(y) = F (x).

This implies thatdG(y)

dx=

dF (x)

dx, and so, g(y)

dy

dx= f(x).

So,

dy =[f(x)/g(y)

]dx =

[f(x)/g{G−1(F (x))}

]dx = r(x) dx.

Now, by eq.n.(2.1.14), and from F (x) = G(y), dy = r(x) dx we have:

λ2(Y ) =

∫ ∞

−∞G(y){1−G(y)} dy =

∫ ∞

−∞F (x){1− F (x)}r(x)dx.

Similarly,

λ3(Y ) =

∫ ∞

−∞G(y){1−G(y)}{2G(y)− 1} dy =

∫ ∞

−∞F (x){1− F (x)}{2F (x)− 1}r(x) dx.

Thus, λ2(X)λ2(Y )τ3(Y )− τ3(X) = λ3(Y )λ2(X)− λ3(X)λ2(Y ) which can be written as:∫ ∞

−∞F (x){1− F (x)}{2F (x)− 1}r(x)dx.

∫ ∞

−∞F (x){1− F (x)}dx

−∫ ∞

−∞F (x){1− F (x)}{2F (x)− 1}.

∫ ∞

−∞F (x){1− F (x)}r(x) (2.8.4)

wherein F (x){1−F (x)} is a positive function of x and 2F (x)−1 and r(x) are increas-

ing. Chebyshev’s Other Inequality for integrals (see Theorem 1.6.6) implies that (2.8.4)

is positive. Because λ2(X)λ2(Y ) > 0, it follows that τ3(Y ) ≥ τ3(X).

2.9 L-moments for some Distributions

In this section, we find the first four L-moments for some distributions and this will be

used in chapter three in estimating the parameters of some distributions.

This section is divided into four subsections: L-moments for uniform distribution, L-

moments for exponential distribution, L-moments for logistic distribution and L-moments

for generalized pareto distribution. In Table 2.5, we introduce the first four L-moments

for some distributions.

63

Page 72: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Table 2.5: [17] L-moments of some common distributionsDistribution F (x) or x(F ) L-moments

Uniform x = α + (β − α)F λ1 = 12(β + α), λ2 = 1

6(β − α), τ3 = 0, τ4 = 0

Exponential x = ξ − α log(1− F ) λ1 = ξ + α, λ2 = 12α, τ3 = 1

3, τ4 = 1

6

Gumble x = ξ − α log(−logF ) λ1 = ξ + γα, λ2 = α log 2, τ3 = 0.1699, τ4 = 0.1504

Logistic x = ξ − α log{F/(1− F )} λ1 = ξ, λ2 = α, τ3 = 0, τ4 = 16

Normal F = Φ�

x−µσ

�λ1 = µ, λ2 = π−

12 σ, τ3 = 0, τ4 = 0.1226

Generalized x = ξ + α{1− (1− F )k}/k λ1 = ξ + α{1− Γ(1 + k)}/k, λ2 = α/(1 + k)(2k + 1),

Pareto τ3 = (1− k)/(3 + k), τ4 = (1− k)(2− k)/(3 + k)(4 + k)

Generalized x = ξ + α{1− (− log F )k}/k λ1 = ξ + α{1− Γ(1 + k)}/k, λ2 = α(1− 2−k)Γ(1 + k)/k,

extreme value τ3 = 2(1− 3−k)/(1− 2−k)− 3,

τ4 = (1− 6.2−k + 10.3−k − 5.4−k)/(1− 2−k)

Generalized x = ξ + α[1− {(1− F )/F}k]/k λ1 = ξ + α{1− Γ(1 + k)Γ(1− k)}/k, λ2 = αΓ(1 + k)(1− k),

logistic τ3 = −k, τ4 = (1 + 5k2)/6

Long-normal F = Φ�

log(x−ξ)−µσ

�λ1 = ξ + exp(η + σ2/2), λ2 = exp(η + σ2/2)erf(σ/2),

τ3 = 6π−1/2R σ/20 erf(x/

√3)exp(−x2)dx/erf(σ/2)

Gamma F = β−αR x0 tα−1exp(−t/β) dt/Γ(α) λ1 = αβ, λ2 = π−1/2βΓ(α + 1

2)/Γ(α), τ3 = 6I1/3(α, 2α)− 3

2.9.1 L-moments for Uniform Distribution

In this subsection, we find the L-moments for the uniform distribution.

The uniform distribution has the probability density function([15], Page 191):

f(x) = 1/(β − α),

and has the quantile function[17]:

x(F ) = α + (β − α)F.

We are about to find the first four L-moments of the uniform distribution. Before doing

so, we have to determine the first for PWMs of the the uniform distribution.

βr =

∫ 1

0

x(F )F rdF, r = 0, 1, 2, . . .

=

∫ 1

0

[α + (β − α)F

]F rdF =

∫ 1

0

αF rdF +

∫ 1

0

(β − α)F r+1dF

= αF r+1

r + 1

∣∣∣1

0+

(β − α)

r + 2F r+2

∣∣∣1

0=

α

r + 1+

β − α

r + 2·

Then,

βr =α

r + 1+

β − α

r + 2(2.9.1)

64

Page 73: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

and,

λ1 = β0 = α +β − α

2=

1

2(β − α)

λ2 = 2β1 − β0 = 2[α

2+

β − α

3

]− α + β

2=

1

6(β − α)

λ3 = 6β2 − 6β1 + β0 = 6[α

3+

β − α

4

]− 6

2+

β − α

3

]+

α + β

2= 0

λ4 = 20β3 − 30β2 + 12β1 − β0

= 20[α

4+

β − α

5

]− 30

3+

β − α

4

]+ 12

2+

β − α

3

]−

[α + β

2

]= 0 ·

Hence,

τ3 = λ3/λ2 = 0

τ4 = λ4/λ2 = 0 ·

Now, we write Note 2.9.1 and Note 2.9.2 because it is used in find the others L-moments

of the uniform distribution.

Proposition 2.9.1.∑r

m=0

p∗r,m

m+1= 0, for all r ≥ 1.

Proof. From eq.n.(1.6.9) we have:∫ 1

0P ∗

r (F )dF = 0, for all r ≥ 1.

Since

∫ 1

0

P ∗r (F )dF =

∫ 1

0

r∑m=0

p∗r,mFmdF, from eq.n.(2.1.11)

=r∑

m=0

p∗r,m

∫ 1

0

FmdF

=r∑

m=0

p∗r,mFm+1

m + 1

∣∣∣1

0

=r∑

m=0

p∗r,mm + 1

·

Therefor,r∑

m=0

p∗r,mm + 1

= 0, for all r ≥ 1. (2.9.2)

65

Page 74: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Proposition 2.9.2.∑r

m=0

p∗r,m

m+2= 0, for all r ≥ 2.

Proof. Since P ∗1 (F ) is orthogonal with P ∗

r (F ) for all r ≥ 2 on the interval (0.1), then, for

all r ≥ 2 we have:∫ 1

0P ∗

1 (F )P ∗r (F )dF = 0. Now,

∫ 1

0

P ∗1 (F )P ∗

r (F )dF =

∫ 1

0

[ 1∑m=0

p∗r,mFm]P ∗

r (F )dF, from eq.n.(2.1.11)

=

∫ 1

0

[p∗1,0 + p∗1,1F

]P ∗

r (F )dF

=

∫ 1

0

[2F − 1

]P ∗

r (F )dF, from eq.n.(2.1.10)

= 2

∫ 1

0

FP ∗r (F )dF −

∫ 1

0

P ∗r (F )dF

= 2

∫ 1

0

FP ∗r (F )dF

= 2

∫ 1

0

F( r∑

m=0

p∗r,mFm)dF, from eq.n.(2.1.11)

= 2r∑

m=0

p∗r,m

∫ 1

0

Fm+1dF

= 2r∑

m=0

p∗r,mFm+2

m + 2

∣∣∣1

0

= 2r∑

m=0

p∗r,mm + 2

·

Hence,r∑

m=0

p∗r,mm + 2

= 0 for all r ≥ 2. (2.9.3)

We are about to find the others L-moments for the uniform distribution.

66

Page 75: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

From eq.n.(2.2.2) and for all r ≥ 2 we have:

λr+1 =r∑

m=0

p∗r,mβm

=r∑

m=0

p∗r,m[ α

m + 1+

β − α

m + 2

], from eq.n.(2.9.1)

= α

r∑m=0

p∗r,mm + 1

+ (β − α)r∑

m=0

p∗r,mm + 2

= 0, from eqs.n.(2.9.2), (2.9.3).

That means, the L-moments for the uniform distribution, λr = 0 for all r ≥ 3 .

2.9.2 L-moments for Exponential Distribution

In this subsection, we find the first four L-moments for the exponential distribution.

The exponential distribution has the cumulative distribution function([15], Page 192):

F (x) = 1− exp{−(x− ξ)/α}, where ξ ≤ x < ∞.

Firstly we want to find the quantile function of the exponential distribution. So, replace

x(F ) with x, and F with F (x) we have:

F = 1− exp{−(x(F )− ξ)/α}, then 1− F = exp{−(x(F )− ξ)/α},hence, ln(1− F ) = −(x(F )− ξ)/α. Therefor, x(F ) = ξ − α ln(1− F ).

secondly, we want to find the rth PWM for the exponential distribution:

βr =

∫ 1

0

x(F ) F rd F r = 0, 1, 2, .......

=

∫ 1

0

[ξ − α ln(1− F )

]F rdF =

ξ

r + 1− α

∫ 1

0

F r ln(1− F )dF ·

Now, we will find ∫ 1

0

F r ln(1− F )dF.

Integrating by parts, we get:

∫ 1

0

F r ln(1− F )dF =F r+1

r + 1ln(1− F )

∣∣∣1

0+

1

r + 1

∫ 1

0

F r+1

1− Fd F

67

Page 76: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

=1

r + 1

∫ 1

0

F r+1

1− Fd F · (2.9.4)

Let z = 1− F . Then, dz = −dF , F = 1− z.

So,

F r+1 = (1− z)r+1 =r+1∑

k=0

(−1)k

r + 1

k

zk.

Therefore,

F r+1

1− F=

r+1∑

k=0

(−1)k

r + 1

k

zk−1 =

1

z+

r+1∑

k=1

r + 1

k

zk−1.

From eq.n (2.9.4),

∫ 1

0

F r ln(1− F )dF =−1

r + 1

∫ 1

0

[1

z+

r+1∑

k=1

(−1)k

r + 1

k

zk−1

]dz

=−1

r + 1

[ln z +

r+1∑

k=1

(−1)k 1

k

r + 1

k

zk

]∣∣∣0

1

=1

r + 1

[ r+1∑

k=1

(−1)k 1

k

r + 1

k

]

=1

r + 1

r+1∑

k=1

(−1)k 1

k

r + 1

k

. (2.9.5)

Hence,

βr =ξ

r + 1− α

r + 1

r+1∑

k=1

(−1)k 1

k

r + 1

k

β0 = ξ − α(−1) = ξ + α.

68

Page 77: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

So,

λ1 = β0 = ξ + α

β1 =ξ

2− α

2

2∑

k=1

(−1)k 1

k

2

k

=

ξ

2− α

2

[−

2

1

+

1

2

2

2

]

2+

Therefore,

λ2 = 2β1 − β0 = 2(ξ

2+

4

)−

(ξ + α

)=

α

2

β2 =ξ

3− α

3

2∑

k=1

(−1)k 1

k

3

k

=

ξ

3− α

3

[−

3

1

+

1

2

3

2

− 1

3

3

3

]

3+

11α

18·

Thus,

λ3 = 6β2 − 6β1 + β0

= 6(ξ

3+

11α

18

)− 6

2+

4

)+ ξ + α =

α

Then,

τ3 = λ3/λ2 =1

3

β3 =ξ

4− α

4

4∑

k=1

(−1)k 1

k

4

k

=

ξ

4− α

4

[−

4

1

+

1

2

4

2

− 1

3

4

3

+

1

4

4

4

]

4+

25α

48·

Therefore,

λ4 = 20β3 − 30β2 + 12β1 − β0

= 20(ξ

4+

25α

48

)− 30

3+

11α

18

)+ 12

2+

4

)(ξ + α

)

= 5ξ +125

12α− 10ξ − 55

3α + 6ξ + 9α− ξ − α =

α

12

τ4 = λ4/λ2 =1

69

Page 78: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

2.9.3 L-moments for Logistic Distribution

In this subsection, we find the first four L-moments for the logistic distribution.

The logistic distribution has the probability density function([15], Page 196):

f(x) =α−1e−(1−k)y

(1 + e−y)2, where y = −k−1 log{1− k(x− ξ)/α},

and has the quantile function[17]:

x(F ) = ξ + α ln{F/(1− F )

}= ξ + α ln F − α ln(1− F ).

Now,

βr =

∫ 1

0

x(F )F rdF =

∫ 1

0

[ξ + α ln F − α ln(1− F )

]F rdF

r + 1+ α

∫ 1

0

F r ln FdF − α

∫ 1

0

F r ln(1− F )dF. (2.9.6)

Now, we will find ∫ 1

0

F r ln FdF.

Integrating by parts, we get:

∫ 1

0

F r ln FdF =F r+1 ln F

r + 1

∣∣∣1

0− 1

r + 1

∫ 1

0

F rdF =−1

(r + 1)· (2.9.7)

Substituting eq.n.(2.9.5) and eq.n.(2.9.7) in eq.n.(2.9.6), we get:

βr =ξ

r + 1− α

(r + 1)2− α

r + 1

r+1∑

k=1

(−1)k 1

k

r + 1

k

.

Then,

β0 = ξ − α− α(−1) = ξ.

70

Page 79: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Therefor,

λ1 = β0 = ξ

β1 =ξ

2− α

4− α

2(−3

2) =

ξ

2+

α

2

λ2 = 2β1 − β0 = 2(ξ

2+

α

2

)− ξ = α

β2 =ξ

3− α

9+

11α

18=

ξ

3+

α

2.

λ3 = 6β2 − 6β1 + β0 = 6(ξ

3+

α

2

)− 6

2+

α

2

)+ ξ

= 2ξ + 3α− 3ξ − 3α + ξ = 0

τ3 = λ3/λ2 =0

α= 0

β3 =ξ

4− α

16=

25α

48=

ξ

4+

11α

24

λ4 = 20β3 − 30β2 + 12β1 − β0

= 20(ξ

4+

11α

24

)− 30

3+

α

2

)+ 12

2+

α

2

)− ξ

= 5ξ +55

6α− 10ξ − 15α + 6ξ + 6α− ξ =

1

τ4 = λ4/λ2 =1

2.9.4 L-moments for Generalized Pareto

We are about to find - as in the previous sections - the first four L-moments for the

generalized pareto distribution.

The generalized pareto distribution has the probability density function([15], Page 194):

f(x) = α−1e−(1−k)[−k−1 log{1−k(x−ξ)/α}] ,

and has the quantile function[17]:

x(F ) = ξ + α{1− (1− F )k

}/k = ξ +

α

k− α

k(1− F )k.

71

Page 80: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Now, we will find βr for the generalized pareto distribution:

βr =

∫ 1

0

x(F )F r =

∫ 1

0

(ξ +

α

k

)F rdF − α

k

∫ 1

0

(1− F

)k

F rdF

=1

r + 1

(ξ +

α

k

)− α

k

∫ 1

0

(1− F )kF rdF. (2.9.8)

Let u = 1− F =⇒ du = −dF , F = 1− u. Then,

∫ 1

0

(1− F )kF rdF = −∫ 0

1

uk(1− u)rdu = −∫ 0

1

uk

r∑j=0

(−1)j

r

j

ujdu

= −r∑

j=0

(−1)j

r

j

∫ 0

1

uk+jdu =r∑

j=0

(−1)j 1

k + j + 1

r

j

. (2.9.9)

Substituting from eq.n.(2.9.9) in e.qn.(2.9.8) we get :

βr =1

r + 1

(ξ +

α

k

)− α

k

r∑j=0

(−1)j 1

k + j + 1

r

j

Now,

β0 = ξ +α

k− α

k

( 1

k + 1

)= ξ +

α

k− α

k(k + 1)

= ξ +α

k + 1·

Thus,

λ1 = β0 = ξ +α

k + 1·

Furthermore,

β1 =1

2

(ξ +

α

k

)− α

k

[ 1

k + 1

1

0

− 1

k + 2

1

1

]

=1

2ξ +

α

2k− α

k

[ 1

k + 1− 1

k + 21

]=

1

2ξ +

α(k + 3)

2(k + 1)(k + 2)·

72

Page 81: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

So,

λ2 = 2β1 − β0 = 2[1

2ξ +

α(k + 3)

2(k + 1)(k + 2)

]

(k + 1)(k + 2)·

Moreover,

β2 =1

3

(ξ +

α

k

)− α

k

2∑j=0

(−1)j 1

k + j + 1

2

j

=1

3ξ +

1

3

α

k− α

k

[ 1

k + 1

2

0

− 1

k + 1

2

1

+

1

k + 3

2

2

]

=1

3+

1

3

α

k− α

k

[ 1

k + 1− 2

k + 2+

1

k + 3

]

=1

3ξ +

1

3

α

k− 2α

k(k + 1)(k + 2)(k + 3)

1

3ξ +

k2 + 6k + 11

3(k + 1)(k + 2)(k + 3)·

Then,

λ3 = 6β2 − 6β1 + β0

= 6[1

3ξ +

k2 + 6k + 11

3(k + 1)(k + 2)(k + 3)

]− 6

[1

2ξ +

α(k + 3)

2(k + 1)(k + 2)

]+ ξ +

α

k + 1

= 2ξ +2k2 + 12k + 22

(k + 1)(k + 2)(k + 3)− 3ξ − 3α(k + 3)

(k + 1)(k + 2)+ ξ +

α

k + 1

=2k2 + 12k + 22− 3(k + 3)2 + (k + 2)(k + 3)

(k + 1)(k + 2)(k + 3)α

=1− k

(k + 1)(k + 2)(k + 3)α·

Also,

τ3 = λ3/λ2 =1− k

(k + 1)(k + 2)(k + 3)α/ α

(k + 1)(k + 2)=

1− k

k + 3·

73

Page 82: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Finally,

β3 =1

4

(ξ +

α

k

)− α

k

3∑j=0

(−1)j 1

k + 1 + j

3

j

=1

4ξ +

α

4k− α

k

[ 1

k + 1

3

0

− 1

k + 2

3

1

+

1

k + 3

3

2

− 1

k + 4

3

3

]

=1

4ξ +

α

4k− α

k

[ 1

k + 1− 3

k + 2+

3

k + 3− 1

k + 4

]

=1

4ξ +

1

4

α

k− α

k

[ 6

(k + 1)(k + 2)(k + 3)(k + 4)

]

=1

4ξ +

k3 + 10k2 + 35k + 50

4(k + 1)(k + 2)(k + 3)(k + 4)α ·

So,

λ4 = 20β3 − 30β2 + 12β1 − β0

= 20[1

4ξ +

k3 + 10k2 + 35k + 50

4(k + 1)(k + 2)(k + 3)(k + 4)α]− 30

[1

3ξ +

k2 + 6k + 11

3(k + 1)(k + 2)(k + 3)

]

+ 12[1

2ξ +

α(k + 3)

2(k + 1)(k + 2)

]−

[ξ +

α

k + 1

]

= 5ξ +5k3 + 50k2 + 175k + 250

(k + 1)(k + 2)(k + 3)(k + 4)α− 10ξ − 10k2 + 60k + 110

(k + 1)(k + 2)(k + 3)(k + 4)α

+ 6ξ +6(k + 3)α

(k + 1)(k + 2)− ξ − α

k + 1

=k2 − 3k + 2

(k + 1)(k + 2)(k + 3)(k + 4)α =

(1− k)(2− k)

(k + 1)(k + 2)(k + 3)(k + 4)α ·

Therefor,

τ4 = λ4/λ2 =(1− k)(2− k)

(k + 1)(k + 2)(k + 3)(k + 4)α/ α

(k + 1)(k + 2)=

(1− k)(2− k)

(k + 3)(k + 4)·

74

Page 83: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Chapter 3

ESTIMATION OF L-MOMENTS

In this chapter, we introduce estimation for L-moments, probability weighted moments

and L-moment ratios. At the end of this chapter, we introduce the estimation of parame-

ters using L-moments for any distribution with finite means and we find estimations for

parameters for some distributions as the Uniform distribution, the Exponential Distribu-

tion, Generalized Logistic distribution and Generalized Pareto Distribution.

3.1 The rth Sample L-moments

L-moments have been defined for a probability distributions, but in practice must often

be estimated from a finite sample. Estimation is based on a sample of size n, arranged

in ascending order [13]. A sample of size 2 contains two observations in ascending order

x1:2 and x2:2. The difference between the two observations (x1:2 − x2:2) is a measure of

the scale of the distribution. A sample of size 3 contains three observations in ascending

order x1:3, x2:3 and x3:3. The difference between the two observation (x2:3 − x1:3) and the

difference between the two observation (x3:3 − x2:3) can be subtracted from each other to

have a measure of the skewness of the distribution. This leads to: (x3:3 − x2:3)− (x2:3 −x1:3) = x3:3 − 2x2:3 + x1:3. A sample of size 4 contains four observations in ascending

order x1:4, x2:4, x3:4 and x4:4. A measure for the kurtosis of the distribution given by:

(x4:4 − x1:4) − 3(x3:4 − x2:4). In short: the above linear combinations of the elements of

75

Page 84: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

the order sample contain information about the location, scale, skewness and kurtosis of

the distribution from which the sample was drawn [25].

A naturale way to generalize the above approach to sample of size n, is to take all possible

sub-samples of size 2 and then take the average of the differences, i.e.; (x1:2 − x2:2)/2:

`2 =1

2

n

2

−1 ∑∑

i>j

(xi:n − xj:n).

Furthermore, the skewness and kurtosis are similarly obtained as:

`3 =1

3

n

3

−1 ∑∑ ∑

i>j>k

(xi:n − 2xj:n + xk:n),

`4 =1

4

n

4

−1 ∑∑ ∑ ∑

i>j>k>l

(xi:n − 3xj:n + 3xk:n − xi:n).

Definition 3.1.1. ([17]) Let x1, x2, ..., xn be the sample and x1:n ≤ x2:n ≤ ... ≤ xn:n the

order sample, and define the rth sample L-moments to be

`r =

n

r

−1 ∑∑

...∑

1≤i1<i2<...<ir≤n

r−1

r−1∑

k=0

(−1)k

r − 1

k

xir−k:n, r = 1, 2, ..., n.

In particular,

`1 = n−1∑

i

xi

`2 =1

2

n

2

−1 ∑∑

i>j

(xi:n − xj:n),

`3 =1

3

n

3

−1 ∑∑ ∑

i>j>k

(xi:n − 2xj:n + xk:n),

`4 =1

4

n

4

−1 ∑∑ ∑ ∑

i>j>k>l

(xi:n − 3xj:n + 3xk:n − xi:n).

76

Page 85: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Sample L-moments have been used to find the estimation of parameters using L-moments

for any distribution with finite means. The statistic `1 = n−1∑

i xi is the sample mean.

The sample L-scale, `2, is a scalar multiple of Gini,s mean difference

G =

n

2

−1 ∑∑

i>j

(xi:n − xj:n).

Direct estimators

In [21] wang provides direct estimators of L-moment which eliminate the need for intro-

ducing PWMs. The estimation procedure follows closely the definition of L-moments by

covering all possible combinations in more efficient way. For the sample value xi:n there

are (i− 1) values ≤ xi:n and (n− 1) values ≥ x(i:n), and for each subsample of size r, the

number of values drawn from each of these categories are considered. The first four direct

estimators are given by:

`1 =

n

1

−1

n∑i=1

x(i:n)

`2 =1

2

n

2

−1

n∑i=1

[ i− 1

1

n− i

1

]x(i:n)

`3 =1

3

n

3

−1

n∑i=1

[ i− 1

2

− 2

i− 1

1

n− i

1

+

n− i

2

]x(i:n)

`4 =

n

4

−1

n∑i=1

[ i− 1

3

− 3

i− 1

2

n− i

1

+ 3

i− 1

1

n− i

2

n− i

3

]x(i:n).

77

Page 86: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

3.2 The Sample Probability Weighted Moments

In this section, we introduce estimation probability weighted moments and its relation

with the estimation of L-moments.

Definition 3.2.1. [4] The Sample probability weighted moments or probability weighted

moments estimators (PWMs estimators), computed for data values x1:n, x2:n, ..., xn:n,

arranged in increasing order, are given by:

br = n−1

n− 1

r

−1

n∑j=r+1

j − 1

r

xj:n, r = 0, 1, 2 · · · . (3.2.1)

This may alternatively be written as

b0 = n−1

n∑j=1

xj:n,

b1 = n−1

n∑j=1

(j − 1)

(n− 1)xj:n,

b2 = n−1

n∑j=1

(j − 1)(j − 2)

(n− 1)(n− 2)xj:n,

and in general [6] :

br = n−1

n∑j=r+1

(j − 1)(j − 2)...(j − r)

(n− 1)(n− 2)...(n− r)xj:n·

Remark 3.2.1. [17] The Sample probability weighted moments br is an unbiased estimator

of the probability weighted moment βr.

Proof. Since,

br = n−1

n∑j=r+1

(j − 1)(j − 2)...(j − r)

(n− 1)(n− 2)...(n− r)xj:n

=n∑

j=r+1

(j − 1)(j − 2)...(j − r)

n(n− 1)(n− 2)...(n− r)xj:n,

then,

E(br) =n∑

j=r+1

(j − 1)(j − 2)...(j − r)

n(n− 1)(n− 2)...(n− r)E(Xj:n). (3.2.2)

78

Page 87: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Forme eqn.(2.1.2), we have

EXj:n =n!

(j − 1)!(n− j)!

∫x[F (x)]j−1[1− F (x)]n−j dF (x).

Hence, substituting EXj:n in eq.n.(3.2.2), we have

E(br) =n∑

j=r+1

(j − 1)(j − 2)...(j − r)

n(n− 1)(n− 2)...(n− r)× n!

(j − 1)!(n− j)!

∫ 1

0

x[F (x)]j−1[1− F (x)]n−j dF (x)

=

∫ 1

0

x[ n∑

j=r+1

(n− (r + 1))!

((j − (r + 1))! (n− j)![F (x)]j−1[1− F (x)]n−j

]dF (x)

=

∫ 1

0

x[ n∑

j=r+1

n− r − 1

j − r − 1

[F (x)]j−1[1− F (x)]n−j

]dF (x)

=

∫ 1

0

x[ n∑

j=r+1

n− (r + 1)

j − (r + 1)

[F (x)]j−1[1− F (x)]n−j

]dF (x).

Let k = r + 1. So,

E(br) =

∫ 1

0

x[ n∑

j=k

n− k

j − k

[F (x)]j−1[1− F (x)]n−j

]dF (x)

=

∫ 1

0

x[ n∑

j−k=0

n− k

j − k

[F (x)](j−k)+k−1[1− F (x)]n−(j−k)−k

]dF (x)

=

∫ 1

0

x[ n∑

m=0

n− k

m

[F (x)]m+k−1[1− F (x)]n−m−k

]dF (x), where m = j − k

=

∫ 1

0

xF k−1[ n−k∑

m=0

n− k

m

[F (x)]m[1− F (x)]n−k−m

]dF (x)

=

∫ 1

0

xF k−1[F (x) + 1− F (x)

]n−k

dF (x)

=

∫ 1

0

xF k−1dF (x).

Since k = r + 1, then from eq.n.(2.2.1) we have

E(br) =

∫ 1

0

x(F ) F rdF (x) = βr. (3.2.3)

That means, br is an unbiased estimator of the probability weighted moment βr.

79

Page 88: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Note 3.2.1. [17] The sample L-moments `r are linear combination of PWMs estimators,

br.

To see this,

`r =r−1∑

k=0

p∗r−1,k bk, r = 1, 2, ..., n; [3] (3.2.4)

where,

p∗r,k = (−1)r−k

r

k

r + k

k

.

The coefficients p∗r,k are those of the shifted Legendre polynomials.

Remark 3.2.2. [17]The sample L-moments `r is an unbiased estimator of L-moments λr.

Proof. From eqn.(3.2.4), we have

E(`r) =r−1∑

k=0

p∗r−1,k E(bk), r = 1, 2, ..., n

=r−1∑

k=0

p∗r−1,k βr, from eq.n.(3.2.3)

= λr, from eq.n.(2.2.10)·

That means, `r is an unbiased estimator of L-moments λr.

The first four rth sample L-moments follow from PWMs estimator are [3]:

`1 = b0

`2 = 2b1 − b0

`3 = 6b2 − 6b1 + b0, and

`4 = 20b3 − 30b2 + 12b1 − b0.

Sample L-moments may be used similarly to (conventional) sample moments: they

summarize the basic properties-location, scale, skewness, kurtosis-of a data set, they

estimate the corresponding properties of the probability distribution from which the data

were sampled and they may be used to estimate the parameters of the data were sampled

and they may be used to estimate the parameters of the underlying distribution[17].

80

Page 89: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

3.3 The rth Sample L-moment Ratios

By dividing the higher-order rth sample L-moments by the dispersion measure, we obtain

the rth sample L-moment ratios:

Definition 3.3.1. [16] Define the rth sample L-moment ratios to be the quantities

tr = `r/`2, r = 3, 4, 5, ..., (3.3.1)

tr is a natural estimator of τr ([15], Page 28).

These are dimensionless quantities, independent of the units of measurement of the data;

t3 = `3/`2 is a measure of skewness, t4 = `3/`2 is a measure of kurtosis these are respec-

tively the L-skewness and L-kurtosis. They take values between −1 and +1 (exception:

some evenorder L-moment ratios computed from very small samples can be less than -1).

The L-moments analogue of the coefficient of variation (standard deviation divided by

the mean), is the sample L-CV, defined by:

t = `2/`1 (3.3.2)

t is natural estimators of τ . The estimators tr and t are not unbiased ([15], Page 28).

The quantities `1, `2 (or t), t3, and t4 are useful summary statistics of a sample of data.

They can be used to identify the distribution from which a sample was drawn. They can

also be used to estimate parameters when fitting a distribution to a sample, by equating

the sample and population L-moments [19].

As an example we calculate them for six sets of annual maximum windspeed data taken

from simiu, Changery and Filliben (1979). The data are tabled in Table 3.1.

The sample L-moments can be calculated using eqn.(3.2.1), eq.n.(3.3.2), eq.n.(3.2.4) and

the sample L-moment ratios can be calculated using eq.n.(3.3.2). The results are given in

Table 3.2 ([15], Page 30).

81

Page 90: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Table 3.1: Annual maximum windspeed data, in miles per hour, for six sites in the eastern

United States.

Macon, Ga., 1950-1977.

32 32 34 37 37 38 40 40 40 42

42 42 43 44 45 45 46 48 49 50

51 51 51 53 53 58 58 60

Brownsville, Tex., 1943-1977

32 33 34 34 35 36 37 37 38 38

39 39 40 40 41 41 42 42 43 43

43 44 44 46 46 48 48 49 51 53

53 53 56 63 66

Port Arthur. Tex., 1953-1977

39 43 44 44 45 45 45 46 47 49

51 51 51 51 54 55 55 57 57 60

61 63 66 67 81

Montgomery, Ala., 1950-1977.

34 36 36 37 38 40 40 40 40 40

43 43 43 43 46 46 46 46 47 47

48 49 51 51 51 52 60 77

Key West, Fla., 1958-1976.

35 35 36 36 36 38 42 43 43 46

48 48 52 55 58 64 78 86 90

Corpus Chisti, Tex., 1943-1976.

44 44 44 44 45 45 45 45 46 46

46 47 48 48 48 48 48 49 50 50

50 51 52 55 57 58 60 60 66 67

70 71 77 128

82

Page 91: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Table 3.2: L-moments of the annual maximum windspeed data in Table(3.1)

Site n `1 `2 t t3 t4

Macon 28 45.04 4.46 0.0990 0.0406 0.0838

Brownsvill 35 43.63 4.49 0.1030 0.1937 0.1509

Port Arthur 25 53.08 5.25 0.0989 0.2086 0.1414

Montgomery 28 45.36 4.34 0.0958 0.2316 0.2490

Key West 19 51.00 9.29 0.1821 0.3472 0.1245

Corpus Christi 34 54.47 6.70 0.1229 0.5107 0.3150

Table 3.3: Bais of sample L-CV

τ

τ3 0.1 0.2 0.3 0.4 0.5

0.0 -0.001 0.000 0.003 0.009 0.020

0.1 -0.001 -0.001 0.001 0.005 0.014

0.2 -0.001 -0.002 -0.001 0.001 0.008

0.3 -0.001 -0.003 -0.005 -0.004 0.000

0.4 -0.002 -0.006 -0.010 -0.012 -0.011

0.5 -0.003 -0.011 -0.018 -0.025 -0.027

Note: Results are for samples of size 20 from a generalized extreme value distribution

with L-CV τ and L-skewness τ3

83

Page 92: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

The bias of the sample L-CV, t, is negligible in sample of size 20 or more. For

example, Table 3.3 gives the bias of t for samples of size 20 from a generalized extreme

value distribution ([15], Page 28).

3.4 Parameter Estimation Using L-moments

A common problem in statistics is the estimation, from a random sample of size n, of a

probability distribution whose specification involves a finite number, p, of unknown pa-

rameters. Analogously the usual method of moments, the method of L-moments obtains

parameter estimates by equating the first p sample L-moments to the corresponding pop-

ulation quantities. Examples of parameter estimators derived using this method are given

in Table 3.4 [17]

Method of L-moments [7]:

Let F (x) be a distribution function associated with a random variable X and let

x(F ) : (0, 1) → R be its quantile function. The rth L-moment of X is given by

eq.n.(2.1.12),

λr =

∫ 1

0

x(F ) P ∗r−1(F ) dF, r = 1, 2, . . . .

where

p∗r,m = (−1)r−m

r

m

r + m

m

,

and

P ∗r (F ) =

r∑m=0

p∗r,m Fm.

Theorem 2.4.1 gives the following justification for using L-moments:

a) µ1 (mean) is finite if and only if λr exists for all r = 1, 2, . . . ;

b) a distribution F (x) with finite mean µ1 is uniquely characterized by λr for all r =

1, 2, . . ..

L-moments can be used to estimate a finite number of parameters θ ∈ Θ that identify

a member of a family of distributions. Suppose {F (x, θ) : θ ∈ Θ ⊂ RP}, P a natural

number, is a family of distributions which is known up to θ. A sample {xi}ni=1 is available

84

Page 93: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Table 3.4: [17]Parameter estimation via L-moments for some common distributions

Distribution Estimators

Exponential (ξ known) α = l1

Gumble α = l2/ log 2, ξ = l1 − γα

Logistic α = l2, ξ = l1

Normal σ = π1/2l2, µ = l1

Generalized Pareto (ξ known) k = l1/l2 − 2, α = (1 + k)l1

Generalized extreme value z = 2/(3 + t3)− log 2 log 3, k ≈ 7.8590z + 2.9554z2

α = l2k/(1− 2−k)Γ(1 + k), ξ = l1 + α {Γ(1 + k)− 1}/kGeneralized logistic k = −t3, α = l2/Γ(1 + k)Γ(1− k), ξ = l1 + (l2 − α)/k

Log-normal z =√

(8/3)Φ−1(

1+t32

),

σ ≈ 0.999281z − 0.006118z3 + 0.000127z5 ,

µ = log {l2/erf(σ/2)} − σ2/2, ξ = l1 − exp(µ + σ2/2)

Gamma (ξ known) t = l2/l1; if 0 < t < 12

then z = πt2

and α ≈ (1− 0.3080z)/(z − 0.05812z2 + 0.01765z3);

if 12≤ t < 1 then z = 1− t and

α ≈ (0.7213z − 0.5947z2)/(1− 2.1817z + 1.2113z2);

β = l1/α

γ is Euler,s constant; Φ−1 is the inverse standard normal distribution function.

85

Page 94: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

and the objective is to estimate θ. Since, λr, r = 1, 2, 3, . . . uniquely characterizes F , θ

may be expressed as a function of λr. Hence, if estimators λr = `r are available, we may

obtain θ(λ1, λ2, . . .). From eq.n.(2.2.10), λr =∑r

m=0 p∗r−1,m βm where βm =∫ 1

0x(u)umdu.

Given the sample, we define xk,n to be the kth smallest element of the sample, such that

x1,n ≤ x2,n ≤ . . . ≤ xn,n. An unbiased estimator of βr is

βr = br = n−1

n∑j=r+1

(j − 1)(j − 2)...(j − r)

(n− 1)(n− 2)...(n− r)xj:n

and so λr =∑r

m=0 p∗r−1,m βm [7].

Here are some examples for parameter estimation using method of L-moments:

Example 3.4.1. Uniform Distribution:

From Table 2.5, we have the first and the second L-moments for the Uniform distribution

are λ1 = 12(α + β) and λ2 = 1

6(−α + β), then we have two equations

2λ1 = α + β, (3.4.1)

6λ6 = −α + β. (3.4.2)

By solving eq.n.(3.4.1) and (3.4.2) we have:

β = λ1 + 3λ2, α = λ1 − 3λ2.

Hence, β = λ1 + 3λ2 = `1 + 3`2, α = λ1 − 3λ2 = `1 − 3`2.

Example 3.4.2. Exponential Distribution:

From Table 2.5, we have the first L-moments for exponential distribution is: λ1 = ξ + α.

If ξ = 0, then λ1 = α and hence α = λ1 = `1.

Example 3.4.3. Generalized Logistic Distribution

From Table 2.5, we have the first and the second L-moments and the third ratio L-

moments for the Generalized Logistic distribution (respectively) are: λ1 = ξ + α{1 −

86

Page 95: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Γ(1 + k)Γ(1 − k)}/k, λ2 = αΓ(1 + k)(1 − k), τ3 = −k. Then, k = −τ3 = −λ3

λ2.

So k = − λ2

λ3= − `3

`2· Since α = λ2Γ(1 + k)(1 − k), then α = λ2Γ(1 + k)(1 − k). Now,

ξ = λ1−α{1−Γ(1+k)Γ(1−k)}/k. Since, Γ(1+k)(1−k) = λ2

α, then ξ = λ1−α{1− λ2

α}/k =

λ1 − αk

+ λ2

k= λ1 + (λ2 − α)/k · Therefor, ξ = λ1 + (λ2 − α)/k = `1 + (`2 − α)/k ·

Example 3.4.4. Generalized Pareto Distribution

From Table 2.5, we have the first and the second L-moments for the Generalized pareto

distribution are: λ1 = ξ+α/(1+k), λ2 = α/(1+k)(2+k). If ξ = 0, then λ1 = α/(1+k).

So, α = (1 + k)λ1. Hence, α = (1 + k)λ1 = (1 + k)`1.

Since, λ2 = α/(1 + k)(2 + k) = α(1+k)

× 1(2+k)

= λ1/(k + 2), then (k + 2)λ2 = λ1.

So, k = λ1

λ2− 2. Therefor, k = λ1

λ2− 2 = `1

`2− 2.

87

Page 96: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Chapter 4

Estimation of the Generalized

Lambda Distribution from Censored

Data

The Generalized Lambda Distribution GLD is a four parameter family of distributions,

consisting of a wide variety of curve shapes. The expressions for the PWMs and L-

moments of it help us to find out the same for any univariate continuous (both complete

and censored) distribution. Another advantage of the use of GLD is that the expressions

for the PWMs and L-moments both for complete and censored data do not change, with

respect to changes in the form of the distribution, except for the values of the parameters.

This makes both analysis and decision making much simpler [23].

In this chapter, we deal with the “Estimation of the Generalized Lambda Distribution

from Censored Data”. In the first section, we find the PWMs and L-moments for GLD.

In the second section, we discus the PWMs and L-moments for Censored Data (type

B for Right Censoring and Left Censoring ). In the third section, we find L-moments

for Censored Distributions using GLD. In the last section, we discuss the fitting of the

distributions to Censored Data using GLD.

88

Page 97: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

4.1 The Family of Generalized Lambda Distribution

The Generalized Lambda Distribution, GLD, is a family of distributions that can take

on a very wide range of shapes within one distributional form. The GLD has a number

of different applications. Its main use has been in fitting distributions to empirical data,

and in the computer generation of different distributions[23].

In this section we introduced the definitions of the quantile function and the probability

density function of the Generalized Lambda Distribution, GLD.

Definition 4.1.1. [2] Distributions belonging to the Generalized Lambda Distribution

GLD family are specified in terms of their quantile function given by

x(u) = λ1 +uλ3 − (1− u)λ4

λ2

, (4.1.1)

where 0 ≤ u ≤ 1 and u = P (X ≤ x) = F (x).

λ1, λ2 are respectively the location and scale parameters and λ3, λ4 are the shape

parameters which jointly determines skewness and kurtosis [23].

Definition 4.1.2. [2] The probability density function of the Generalized Lambda Dis-

tribution GLD is given by

f(x) =λ2

λ3u(λ3−1) + λ4(1− u)(λ4−1),

where λ1, λ2, λ3, λ4 as given above.

4.2 PWMs and L-moments for GLD

In this section, we find -in general- that the probability weighted moments (PWMs) is

the quantities Mk,r,s for GLD, and in special case we find that (PWMs) is βr = M1,r,0 for

GLD which enabled us to calculate the L-moments for GLD.

Recalling Definition(2.2.1), we have the probability weighted moments (PWMs) of a ran-

dom variable X with a cumulative distribution function F (X) and quantile function x(F )

89

Page 98: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

is the quantities

Mk,r,s = E{Xk[F (X)]r[1− F (X)]s

}=

∫ 1

0

Xk[F (X)]r[1− F (X)]sdF,

where k, r, s are real numbers.

A particular useful special cases are the probability weighted moments αr = M1,0,r

and βr = M1,r,0. For a distribution that has a quantile function x(u),

αr =

∫ 1

0

x(u)(1− u)rdu,

βr =

∫ 1

0

x(u)urdu. (4.2.1)

Lemma 4.2.1.

B(n + 1, a) =n!∏n

j=0(a + j), where n is nonnegative integer. (4.2.2)

Proof. From eq.n.(2.3.2) we have:

B(n + 1, a) =Γ(n + 1)Γ(a)

Γ(a + n + 1)

=n! Γ(a)

Γ(a + n + 1), from eq.n.(1.4.3)

=n! Γ(a)

(a + n)(a + n− 1) · · · (a + 1)aΓ(a), from eq.n.(1.4.2)

=n!

(a + 0)(a + 1) · · · (a + (n− 1))(a + n)

=n!∏n

j=0(a + j)·

In the next proposition, we find the quantities Mk,r,s of GLD.

Proposition 4.2.2. [23] The PWM Mk,r,s of a GLD(λ1, λ2, λ3, λ4) family with quantile

function x(u) is given by

Mk,r,s =k∑

i=0

k

i

λk−i

1 λ−i2

i∑j=0

(−1)j

i

j

B(λ3(i− j) + r + 1, λ4j + s + 1),

where B(p, q) = Γ(p)Γ(q)Γ(p+q)

, (Beta function).

90

Page 99: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Proof.

Mk,r,s = E{XK [F (x)]r[1− F (x)]s}=

∫ 1

0

[x(u)]kur[1− u]s du

=

∫ 1

0

[λ1 +

uλ3 − (1− u)λ4

λ2

]k

ur[1− u]s du

=

∫ 1

0

[ k∑i=0

k

i

(uλ3 − (1− u)λ4

λ2

)i

λk−i1

]ur[1− u]s du

=k∑

i=0

k

i

λk−i

1 λ−i2

∫ 1

0

(uλ3 − (1− u)λ4

)i

ur[1− u]s du

=k∑

i=0

k

i

λk−i

1 λ−i2

∫ 1

0

[ i∑j=0

i

j

(− (1− u)λ4

)j

(uλ3)i−j]ur[1− u]s du

=k∑

i=0

k

i

λk−i

1 λ−i2

i∑j=0

(−1)j

i

j

∫ 1

0

(uλ3)i−j((1− u)λ4)jur[1− u]s du

=k∑

i=0

k

i

λk−i

1 λ−i2

i∑j=0

(−1)j

i

j

∫ 1

0

uλ3(i−j)+r(1− u)λ4j+s du, from eq.n.(2.3.2)

=k∑

i=0

k

i

λk−i

1 λ−i2

i∑j=0

(−1)j

i

j

B(λ3(i− j) + r + 1, λ4j + s + 1)·

M0,r,0, M0,0,s and M0,r,s do not involve any parameters of the distribution and hence are

of no practical use. From Definition (2.2.1), the quantities Mk,0,0 = E(Xk), (k = 1, 2, ...)

are the usual noncentral moments of X. For GLD it is given as

Mk,0,0 =k∑

i=0

k

i

λk−i

1 λ−i2

i∑j=0

(−1)j

i

j

B(λ3(i− j) + 1, λ4j + 1).

Similarly, Mk,r,0 =k∑

i=0

k

i

λk−i

1 λ−i2

i∑j=0

(−1)j

i

j

B(λ3(i− j) + r + 1, λ4j + 1).

Mk,0,s =k∑

i=0

k

i

λk−i

1 λ−i2

i∑j=0

(−1)j

i

j

B(λ3(i− j) + 1, λ4j + s + 1).

91

Page 100: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

It is to be noted that

M1,0,r =1∑

i=0

1

i

λ1−i

1 λ−i2

i∑j=0

(−1)j

i

j

B(λ3(i− j) + 1, λ4j + s + 1)

= λ1B(1, r + 1) +1

λ2

i∑j=0

(−1)j

i

j

B(λ3(i− j) + 1, λ4j + s + 1)

= λ1B(1, r + 1) +1

λ2

[B(λ3 + 1, r + 1)−B(1, λ4 + r + 1)

](by Lemma (4.2.1))

=λ1

r + 1+

1

λ2

[B(λ3 + 1, r + 1)− 1

λ4 + r + 1

M1,r,0 =1∑

i=0

1

i

λ1−i

1 λ−i2

1∑j=0

(−1)j

i

j

B(λ3(i− j) + r + 1, λ4j + 1)

= λ1B(r + 1, 1) +1

λ2

1∑j=0

(−1)j

i

j

B(λ3(i− j) + r + 1, λ4j + 1)

= λ1B(r + 1, 1) +1

λ2

[B(λ3 + r + 1, 1)−B(r + 1, λ4 + 1)

]

=λ1

r + 1+

1

λ2

[ 1

λ3 + r + 1−B(r + 1, λ4 + 1)

Hence

M1,r,0 =λ1

r + 1+

1

λ2

[ 1

λ3 + r + 1−B(r + 1, λ4 + 1)

](4.2.3)

=λ1

r + 1+

1

λ2

[ 1

λ3 + r + 1− r!∏r

j=0(λ4 + j + 1)

](by Lemma (4.2.1))·

Here we consider M1,r,0 only and denote it as βr. From eq.n.(4.2.3) we get the rth

PWM βr of a GLD(λ1, λ2, λ3, λ4) family as

βr =λ1

r + 1+

1

λ2

[ 1

λ3 + r + 1−B(r + 1, λ4 + 1)

]· (4.2.4)

Now, we are going to find β0, β1, β2, β3 of GLD so that we can get the first four L-

moments for the GLD.

92

Page 101: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Putting r = 0, 1, 2, 3 in eq.n.(4.2.4), we get

β0 = λ1 +1

λ2

[ 1

λ3 + 1−B(1, λ4 + 1)

](4.2.5)

β1 =λ1

2+

1

λ2

[ 1

λ3 + 2−B(2, λ4 + 1)

](4.2.6)

β2 =λ1

3+

1

λ2

[ 1

λ3 + 3−B(3, λ4 + 1)

](4.2.7)

β3 =λ1

4+

1

λ2

[ 1

λ3 + 4−B(4, λ4 + 1)

]· (4.2.8)

Recalling Definition 2.1.1, we have the L-moments of X to be the quantities

Lr ≡ r−1

r−1∑

k=0

(−1)k

r − 1

k

EXr−k:r r = 1, 2, ....

(Here we used the symbol L instead of λ to distinguish between λ’s of the GLD and that

of the L-moments).

We can write L-moments from eq.n.(2.2.2) as :

Lr+1 =r∑

m=0

p∗r,mβm, where p∗r,m = (−1)r−m

r

m

r + m

m

. (4.2.9)

For example the first four L-moments are related to the PWMs as:

L1 = β0,

L2 = 2β1 − β0,

L3 = 6β2 − 6β1 + β0,

L4 = 30β3 − 30β2 + 12β1 − β0.

By giving appropriate values of L1, L2, L3, and L4 corresponding to various distribu-

tions, in eq.n.(4.2.4), we can approximate the values of their PWMs and hence L-moments

from eq.n. (4.2.9). The expressions for L1, L2, L3, and L4 of some distributions are given

in [17] and the numerical values of them obtained by direct calculation are compared

with the values obtained from GLD and are given in Table 4.1. Uniform(0,1), Expo-

nential(3), Normal(0,1), Pareto(1,5), Logistic(0,1) and Gumbel(0,1) are approximated

93

Page 102: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Table 4.1: [23] Comparison of L-moments

Distri x(u) L-moments

bution Theoretical Numerical value

Direct using GLD

12(α + β) 0.5 0.5

Uniform x = α+ 16(β − α) 0.1667 0.1667

(α, β) (β − α)u 0 0 0

0 0 0

α 3 2.9993

Exp(α) x = −α log(1− u) α/2 1.5 1.5013

1/3 0.3333 0.3313

1/6 0.1667 0.1670

µ 0 0

Normal x = µ + σφ−1(u) π−1/2σ 0.5642 0.5638

(µ, σ) 0 0 0

30π−1 tan−1√

2− 9 0.1226 0.1245

α/(1 + k) 0.25 0.25

Pareto x = α[1−(1−u)k]k

α/(1 + k)(2 + k) 0.1389 0.1389

(α, k) (1− k)/(3 + k) 0.4286 0.4286

(1− k)(2− k)/(3 + k)(4 + k) 0.2481 0.2481

ξ 0 0

Logistic x = ξ+ α 1 0.9989

(ξ, α) α log(

u1−u

)0 0 0

1/6 0.1667 0.1668

ξ + γα 0.5772 0.5775

Gumbel x = ξ− α log 2 0.6931 0.6905

(ξ, α) α log(− log u) 0.1699 0.1699 0.1742

0.1504 0.1504 0.16

(γ is Euler’s constant)

94

Page 103: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

respectively by GLD[0.5, 2, 1, 1], GLD[0.02100,−0 : 0003603;−0.4072 ∗ 10−5,−0.001076],

GLD[0, 0.1975, 0.1349, 0.1349], GLD[0,−1, 7.34512 ∗ 10−12,−0.2],

GLD[0,−0.0003637,−0.0003630,−0.0003637] and

GLD[−0.1857, 0.02107, 0.006696, 0.02326]. In column 4 the values in 1st, 2nd, 3rd and 4th

rows against each distribution give the numerical values of L1, L2, L3, and L4 respectively

of that distribution. The tabled values clearly justify the use of GLD for computing the

PWMs and L-moments of unimodal continuous distributions [23].

4.3 PWMs and L-moments for Type I and II Singly

Censored Data

This section consists of two subsections. In the first subsection, we introduce the definition

of type B right censoring, and then we find the type B PPWMs - which will be defined

later in this section - of a right-censoring for GLD. In the other hand, we give the definition

of the type B′ left censoring, and then we find the type B′ PPWMs of a left-censoring for

GLD. This will be used later in section 4.5 to estimate the parameters of GLD.

Definition 4.3.1. [23] Observed data sets containing values above or below the analytical

threshold of measuring equipment are referred to as censored data.

Such data are frequently encountered in quality and quantity monitoring applications

of water, soil, and air samples [28].

In right censoring, the censored observations are greater than the measurement threshold

4.3.1 Case I-Right Censoring

The order statistics of a complete sample of n observations are denoted by the following:

X1:n ≤ X2:n ≤ ... ≤ Xn:n.

Type B right censoring occurs when m of these values are observed (m ≤ n) and the

95

Page 104: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

remaining n−m are censored above a known threshold T :

X1:n ≤ X2:n ≤ ... ≤ Xm:n︸ ︷︷ ︸m observed

≤ T ≤ Xm+1:n ≤ Xm+2:n ≤ ... ≤ Xn:n︸ ︷︷ ︸n−m censored

.

The censoring threshold T is the random variable in type B censoring and m is fixed [28].

Example 4.3.1. During the T hours of test we observe r failures (where r can be any

number from 0 to n). The (exact) failure times are t1, t2, ..., tr and there are (n− r) units

that survived the entire T -hour test without failing. Note that T is fixed in advance and r

is random, since we don’t know how many failures will occur until the test is run. Note

also that we assume the exact times of failure are recorded when there are failures.

Type B PPWM, bBr , is equal to the PWM of the “completed sample,” where the

censored observations above the censoring threshold T are set equal to the censoring

threshold. It is a well established fact that replacing the censored observations with a

fixed value such as the measurement threshold leads to a significant bias in the resulting

statistics such as the mean, the median, or a quantile [28].

Definition 4.3.2. [23] The type B PPWM of a right-censored distribution is the ordinary

PWM of a (complete) distribution with quantile function

yB(u) =

x(u), 0 < u < c;

x(c), c ≤ u < 1.(4.3.1)

where T = x(c) is the censoring threshold satisfying P (X ≤ T ) = c.

Note 4.3.1. [20] The type B PPWMs, of a right-censored distribution is given by the

relation:

βBr =

∫ c

0

urx(u)du +1− cr+1

r + 1x(c)· (4.3.2)

Proof. The type B PPWMs is obtained from substitution of eq.n.(4.3.1) into eq.n.(4.2.1)

leading to

βBr =

∫ 1

0

x(u)urdu

96

Page 105: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

=

∫ 1

0

uryB(u) du

=

∫ c

0

uryB(u) du +

∫ 1

c

uryB(u) du

=

∫ c

0

urx(u) du +

∫ 1

c

urx(c) du

=

∫ c

0

urx(u) du + x(c)

∫ 1

c

ur du

=

∫ c

0

urx(u) du + x(c)[ ur+1

r + 1

]1

c

=

∫ c

0

urx(u) du +1− cr+1

r + 1x(c).

Definition 4.3.3. [23] Define the incomplete beta function βc(m, n) as:

βc(m,n) =

u≤c

um−1(1− u)n−1du, for 0 < c < 1; u > 0.

Note 4.3.2. We can write the incomplete beta function βc(m,n) as:

βc(m,n) =

∫ c

0

um−1(1− u)n−1du. (4.3.3)

Note 4.3.3. The incomplete beta function βc(m,n) = B(m,n) Ic(m,n).

Proof. From eq.n.(2.3.4) we have:

Ic(m,n) =1

B(m,n)

∫ c

0

um−1(1− u)n−1du

=1

B(m,n)βc(m,n), from eq.n.(4.3.3).

Hence, βc(m,n) = B(m,n) Ic(m,n).

Lemma 4.3.4.

βc(r + 1, a) =r!∏r

j=0(a + j)−

r∑j=0

r!

(r − j)!

c(r−j) (1− c)(a+j)

∏ji=0(a + i)

(4.3.4)

97

Page 106: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Proof.

βc(r + 1, a) =

∫ c

0

ur(1− u)a−1du

=

∫ 1

0

ur(1− u)a−1du−∫ 1

c

ur(1− u)a−1du

= B(r + 1, a)−∫ 1

c

ur(1− u)a−1du

=r!∏r

j=0(a + j)−

∫ 1

c

ur(1− u)a−1du, from eq.n.(4.2.2) (4.3.5)

Now, we want to find∫ 1

cur(1− u)a−1du, using integrating by parts:

Let z = ur, dv = (1− u)a−1du.

Then, dz = rur−1du, v = − (1−u)a

a.

So,

∫ 1

c

ur(1− u)a−1du = −ur(1− u)a

a

∣∣∣u=1

u=c−

∫ 1

c

rur−1[− (1− u)a

a

]du.

Hence, ∫ 1

c

ur(1− u)a−1du =cr(1− c)a

a+

r

a

∫ 1

c

ur−1(1− u)adu. (4.3.6)

By formula (4.3.6) we have:

∫ 1

c

ur−1(1− u)adu =cr−1(1− c)a+1

a + 1+

r − 1

a + 1

∫ 1

c

ur−2(1− u)a+1du. (4.3.7)

98

Page 107: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Then, substituting eq.n.(4.3.7) int eq.n.(4.3.6) we get:

∫ 1

c

ur(1− u)a−1du =cr(1− c)a

a+

r

a

[cr−1(1− c)a+1

a + 1+

r − 1

a + 1

∫ 1

c

ur−2(1− u)a+1du]

=cr(1− c)a

a+

r[cr−1(1− c)a+1]

a(a + 1)+

r(r − 1)

a(a + 1)

∫ 1

c

ur−2(1− u)a+1du

=cr(1− c)a

a+

r[cr−1(1− c)a+1]

a(a + 1)+

r(r − 1)[cr−2(1− c)a+2]

a(a + 1)(a + 2)

+ . . . . . . . . . +r(r − 1) . . . (r − (r − 1))

a(a + 1) . . . (a + r − 1)

∫ 1

c

ur−r(1− u)a+r−1du

=cr(1− c)a

a+

r[cr−1(1− c)a+1]

a(a + 1)+

r(r − 1)[cr−2(1− c)a+2]

a(a + 1)(a + 2)

+ . . . . . . . . . +r(r − 1) . . . (r − (r − 1))

a(a + 1) . . . (a + r − 1)×

[− (1− u)a+r

a + r

∣∣∣u=1

u=c

]

=cr(1− c)a

a+

r[cr−1(1− c)a+1]

a(a + 1)+

r(r − 1)[cr−2(1− c)a+2]

a(a + 1)(a + 2)

+ . . . . . . . . . +r(r − 1) . . . 3× 2× 1(1− c)a+r

a(a + 1) . . . (a + r)

=r∑

j=0

r!

(r − j)!

c(r−j)(1− c)(a+j)

∏ji=0(a + i)

· (4.3.8)

Substitute (4.3.8) into (4.3.5) we have:

βc(r + 1, a) =r!∏r

j=0(a + j)−

r∑j=0

r!

(r − j)!

c(r−j)(1− c)(a+j)

∏ji=0(a + i)

·

In the following proposition, we find the type B PPWMs of a GLD which we use in

determining the L-moments of a right-censored distribution.

99

Page 108: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Proposition 4.3.5. [23] The type B PPWMs of a GLD(λ1, λ2, λ3, λ4) family for singly

right censoring are given by

βBr =

λ1cr+1

r + 1+

cλ3+r+1

λ2(λ3 + r + 1)− 1

λ2

βc(r + 1, λ4 + 1) +cr+1

r + 1x(c), (4.3.9)

Proof.

βBr =

∫ c

0

urx(u)du +1− cr+1

r + 1x(c)

=

∫ c

0

ur[λ1 +

uλ3 − (1− u)λ4

λ2

]du +

1− cr+1

r + 1x(c)

= λ1

∫ c

0

urdu +1

λ2

∫ c

0

uλ3+rdu− 1

λ2

∫ c

0

(1− u)λ4urdu +1− cr+1

r + 1x(c)

= λ1ur+1

r + 1

∣∣∣c

0+

1

λ2

× uλ3+r+1

λ3 + r + 1

∣∣∣c

0− 1

λ2

βc(r + 1, λ4 + 1) +1− cr+1

r + 1x(c)

=λ1c

r+1

r + 1+

cλ3+r+1

λ2(λ3 + r + 1)+

1

λ2

{ r∑j=0

r!

(r − j)!

c(r−j)(1− c)(λ4+j+1)

∏ji=0(λ4 + i + 1)

− r!∏rj=0(λ4 + j + 1)

}+

1− cr+1

r + 1x(c), from eq.n.(4.3.4).

Now, we are about to find the first four L-moments of a right-censored distribution of

the GLD. Before doing so, we have to determine the first four B PPWMs of the GLD.

Putting r = 0, 1, 2, 3 in the expression (4.3.9) and use eq.n.(4.3.4) we get:

βB0 = λ1c +

cλ3+1

λ2(λ3 + 1)− 1

λ2

βc(1, λ4 + 1) + (1− c)x(c)

= λ1c +cλ3+1

λ2(λ3 + 1)+

(1− c)λ4+1

λ2(λ4 + 1)+ (1− c)x(c)

βB1 =

λ1c2

2+

cλ3+2

λ2(λ3 + 2)− 1

λ2

βc(2, λ4 + 1) +1− c2

2x(c)

=λ1c

2

2+

cλ3+2

λ2(λ3 + 2)− 1

λ2

{c(1− c)λ4+1

λ4 + 1+

(1− c)λ4+2 − 1

(λ4 + 1)(λ4 + 2)

}

+1− c2

2x(c)

100

Page 109: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

βB2 =

λ1c3

3+

cλ3+3

λ2(λ3 + 3)− 1

λ2

βc(3, λ4 + 1) +1− c3

3x(c)

=λ1c

3

3+

cλ3+3

λ2(λ3 + 3)

+1

λ2

{c2(1− c)λ4+1

λ4 + 1+

2c(1− c)λ4+2

(λ4 + 1)(λ4 + 2)+

2(1− c)λ4+3 − 2

(λ4 + 1)(λ4 + 2)(λ4 + 3)

}

+1− c3

3x(c)

βB3 =

λ1c4

4+

cλ3+4

λ2(λ3 + 4)− 1

λ2

βc(4, λ4 + 1) +1− c4

4x(c)

=λ1c

4

4+

cλ3+4

λ2(λ3 + 4)

+1

λ2

{c3(1− c)λ4+1

λ4 + 1+

3c2(1− c)λ4+2

(λ4 + 1)(λ4 + 2)+

6c(1− c)λ4+3

(λ4 + 1)(λ4 + 2)(λ4 + 3)

+6((1− c)λ4+4 − 1)

(λ4 + 1)(λ4 + 2)(λ4 + 3)(λ4 + 4)

}

+1− c4

4x(c)·

We can write the L-moments of a right-censored distribution from eq.n.(2.2.2) as follows:

LBr+1 =

r∑m=0

p∗r,mβBm, where p∗r,m = (−1)r−m

r

m

r + m

m

. (4.3.10)

In particular, the first four L-moments of the right-censored distribution of the GLD that

are related to the type B PPWM of the GLD are:

LB1 = βB

0

LB2 = 2βB

1 − βB0

LB3 = 6βB

2 − 6βB1 + βB

0

LB4 = 30βB

3 − 30βB2 + 12βB

1 − βB0 .

101

Page 110: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

4.3.2 Case 2 - Left Censoring

The B′ left censoring results when the observations below a random variable threshold T

are censored:

X1:n ≤ X2:n ≤ ... ≤ Xm−1:n︸ ︷︷ ︸n−k censored

≤ T ≤ Xm:n ≤ Xm+2:n ≤ ... ≤ Xm:n︸ ︷︷ ︸k observed

,

where the number of the censored values (m− 1 = n− k) is fixed [28].

For left censoring, type B′ PPWMs may be derived by replacing the censored observations

with the fixed threshold x(c), below which measurements are unavailable [23].

Example 4.3.2. In the field of hydrology, left censored data sets arise because river

discharges below some measurement threshold are often reported as zero. Such river dis-

charges may have actually been zero or they may have been between zero and the mea-

surement threshold, yet reported as zero [8]. Sometimes it is actually advantageous to in-

tentionally censor (or eliminate) observations in order to better understand the frequency

and magnitude of flood and drought events [29].

Definition 4.3.4. [23] The type B′ PPWM of a left-censored distribution is the ordinary

PWM of a (complete) distribution with quantile function

yB′(u) =

x(c), 0 < u < c;

x(u), c ≤ u < 1.(4.3.11)

where T = x(c) is the censoring threshold satisfying P (X ≤ T ) = c.

Note 4.3.6. [28] The type B′ PPWMs, of a left-censored distribution is given by the

relation:

βB′r =

cr+1

r + 1x(c) +

∫ 1

c

urx(u) du. (4.3.12)

Proof. The type B′ PPWMs is obtained from substitution of eq.n.(4.3.11) into eq.n.(4.2.1)

leading to

βB′r =

∫ 1

0

x(u)urdu

102

Page 111: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

=

∫ 1

0

uryB′(u) du

=

∫ c

0

uryB′(u) du +

∫ 1

c

uryB′(u) du

=

∫ c

0

urx(c) du +

∫ 1

c

urx(u) du

= x(c)

∫ c

0

ur du +

∫ 1

c

urx(u) du

= x(c)[ ur+1

r + 1

]c

0+

∫ 1

c

urx(u) du

=

∫ 1

c

urx(u)du +cr+1

r + 1x(c)·

In the next proposition, we find the type B′ PPWMs of a GLD by which we deter-

mining the L-moments of a left-censored distribution.

Proposition 4.3.7. [23] The type B′ PPWMs of a GLD(λ1, λ2, λ3, λ4) family for singly

left censoring are given by

βB′r =

λ1(1− cr+1)

r + 1+

(1− cλ3+r+1)

λ2(λ3 + r + 1)− 1

λ2

{B(r+1, λ4+1)−βc(r+1, λ4+1)}+cr+1

r + 1x(c).

(4.3.13)

=λ1(1− cr+1)

r + 1+

(1− cλ3+r+1)

λ2(λ3 + r + 1)− 1

λ2

{ r∑j=0

r!

(r − j)!

c(r−j)(1− c)(λ4+j+1)

∏ji=0(λ4 + i + 1)

}+

cr+1

r + 1x(c).

Proof.

βB′r =

∫ 1

c

urx(u)du +cr+1

r + 1x(c)

=

∫ 1

c

ur[λ1 +

uλ3 − (1− u)λ4

λ2

]du +

cr+1

r + 1x(c)

= λ1

∫ 1

c

urdu +1

λ2

∫ 1

c

uλ3+rdu− 1

λ2

∫ 1

c

(1− u)λ4urdu +cr+1

r + 1x(c)

= λ1ur+1

r + 1

∣∣∣1

c+

1

λ2

× uλ3+r+1

λ3 + r + 1

∣∣∣1

c− 1

λ2

{ ∫ 1

0

(1− u)λ4urdu−∫ c

0

(1− u)λ4urdu}

+cr+1

r + 1x(c)

103

Page 112: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

=λ1(1− cr+1)

r + 1+

(1− cλ3+r+1)

λ2(λ3 + r + 1)− 1

λ2

{B(r + 1, λ4 + 1)− βc(r + 1, λ4 + 1)

}+

cr+1

r + 1x(c)

=λ1(1− cr+1)

r + 1+

(1− cλ3+r+1)

λ2(λ3 + r + 1)− 1

λ2

{ r∑j=0

r!

(r − j)!

c(r−j)(1− c)(λ4+j+1)

∏ji=0(λ4 + i + 1)

}

+cr+1

r + 1x(c), from eq.n.(4.3.4).

Now, we will determine the first four B′ PPWMs of the GLD to determine the first

four L-moments of a left-censored distribution of the GLD.

Putting r = 0, 1, 2, 3 in the expression (4.3.13) we get

βB′0 = λ1(1− c) +

(1− cλ3+1)

λ2(λ3 + 1)− 1

λ2

{B(r + 1, λ4 + 1)− βc(1, λ4 + 1)}c.x(c)

βB′1 =

λ1(1− c2)

2+

(1− cλ3+2)

λ2(λ3 + 2)− 1

λ2

{B(2, λ4 + 1)− βc(2, λ4 + 1)}+c2

2x(c)

βB′2 =

λ1(1− c3)

3+

(1− cλ3+3)

λ2(λ3 + 3)− 1

λ2

{B(3, λ4 + 1)− βc(3, λ4 + 1)}+c3

3x(c)

βB′3 =

λ1(1− c4)

4+

(1− cλ3+4)

λ2(λ3 + 4)− 1

λ2

{B(4, λ4 + 1)− βc(4, λ4 + 1)}+c4

4x(c)

We can write L-moments of a left-censored distribution from eqn.(2.2.2) as :

LB′r+1 =

r∑m=0

p∗r,mβB′m , where p∗r,m = (−1)r−m

r

m

r + m

m

. (4.3.14)

In particular, the first four L-moments of the left-censored distribution of the GLD that

are related to the type B′ PPWM of the GLD are:

LB′1 = βB′

0

LB′2 = 2βB′

1 − βB′0

LB′3 = 6βB′

2 − 6βB′1 + βB′

0

LB′4 = 30βB′

3 − 30βB′2 + 12βB′

1 − βB′0 .

104

Page 113: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

4.4 L-moments for Censored Distributions Using GLD

In section 4.3, we find the type B PPWMs for GLD. This will be used to find the B

PPWMs for Pareto distribution, which is considered to be a special case of GLD and its

quantile function will be given soon. The L-moments for Pareto distribution is deduced

later.

Definition 4.4.1. [23] The Pareto distribution has the quantile function:

x(u) = α[1− (1− u)k]/k.

Assume that mr = α[

1−(1−c)r+k

r+k

]. We will use this assumption to express the L-

moments of Pareto distribution.

Now, we are going to calculate the first four L-moments for Pareto distribution.

First, we calculate βB0 for Pareto distribution:

βB0 = λ1c +

cλ3+1

λ2(λ3 + 1)+

(1− c)λ4+1

λ2(λ4 + 1)+ (1− c)x(c)

=ckα

+(1− c)k+1

k(k + 1)− 1

kα(k + 1)

+ (1− c)[1− (1− c)k]α

k

k

[c +

(1− c)k+1

k + 1− 1

k + 1+ (1− c)− (1− c)k+1

]

k

[(1− c)k+1 − 1

k + 1+ 1− (1− c)k+1

]

k

[1− (1− c)k+1

]( −1

k + 1+ 1

)

k

[1− (1− c)k+1

](−1 + k + 1

k + 1

)

k

[1− (1− c)k+1

]( k

k + 1

)

= α[1− (1− c)k+1

k + 1

]= αm1.

105

Page 114: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Thus, the 1st L-moment for Pareto distribution is given by:

L1B = βB

0 = αm1.

Second, we calculate βB1 for Pareto distribution:

βB1 =

λ1c2

2+

cλ3+2

λ2(λ3 + 2)− 1

λ2

{c(1− c)λ4+1

λ4 + 1+

(1− c)λ4+2 − 1

(λ4 + 1)(λ4 + 2)

}

+1− c2

2x(c)

=c2

2( kα)

+1

k/α

{c(1− c)k+1

k + 1+

(1− c)k+2 − 1

(k + 1)(k + 2)

}+

1− c2

2

[1− (1− c)k

k

k

[c2

2+

c(1− c)k+1

k + 1+

(1− c)k+2 − 1

(k + 1)(k + 2)+

1− c2

2− 1− c2

2(1− c)k

]

k

[c2

2+

c(1− c)k+1

k + 1+

(1− c)k+2 − 1

(k + 1)(k + 2)+

1

2− c2

2− 1 + c

2(1− c)k+1

]

k

[c(1− c)k+1

k + 1+

(1− c)k+2 − 1

(k + 1)(k + 2)+

1

2− 1 + c

2(1− c)k+1

]

k

[c(1− c)k+1

k + 1+

(1− c)k+2

(k + 1)(k + 2)− 1

(k + 1)(k + 2)+

1

2− 1 + c

2(1− c)k+1

]

k

[2(k + 2)c(1− c)k+1 + 2(1− c)k+2 − 2 + (k + 1)(k + 2)

2(k + 1)(k + 2)

+−(k + 1)(k + 2)(1 + c)(1− c)k+1

2(k + 1)(k + 2)

]

k

[2(k + 2)c(1− c)k+1 + 2(1− c)k+2 − 2 + k2 + 3k + 2

2(k + 1)(k + 2)

+−(k + 1)(k + 2)(1 + c)(1− c)k+1

2(k + 1)(k + 2)

]

106

Page 115: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

k

[(1− c)k+1[2(k + 2)c− (k + 1)(k + 2)(1 + c)

]+ 2(1− c)k+2 + k2 + 3k

2(k + 1)(k + 2)

]

k

[(1− c)k+1[2(k + 2)c− (k + 1)(k + 2)− (k + 1)(k + 2)c

]+ 2(1− c)k+2 + k2 + 3k

2(k + 1)(k + 2)

]

k

[(1− c)k+1[c{2(k + 2)− (k + 1)(k + 2)

}− (k + 1)(k + 2)]+ 2(1− c)k+2 + k2 + 3k

2(k + 1)(k + 2)

]

k

[(1− c)k+1[c(k + 2)

{2− (k + 1)

}− (k + 1)(k + 2)]+ 2(1− c)k+2 + k2 + 3k

2(k + 1)(k + 2)

]

k

[(k + 2)(1− c)k+1[c(−k + 1)− (k + 1)

]+ 2(1− c)k+2 + k2 + 3k

2(k + 1)(k + 2)

]

k

[(k + 2)(1− c)k+1[c(−k + 1)− (−k + 1) + (−k + 1)− (k + 1)

]

2(k + 1)(k + 2)

+2(1− c)k+2 + k2 + 3k

2(k + 1)(k + 2)

]

k

[(k + 2)(1− c)k+1[(−k + 1)(c− 1)− 2k

]+ 2(1− c)k+2 + k2 + 3k

2(k + 1)(k + 2)

]

k

[−(k + 2)(−k + 1)(1− c)k+2 − 2k(k + 2)(1− c)k+1 + 2(1− c)k+2 + k2 + 3k

2(k + 1)(k + 2)

]

k

[(1− c)k+2[− (k + 2)(−k + 1) + 2

]− 2k(k + 2)(1− c)k+1 + k2 + 3k

2(k + 1)(k + 2)

]

k

[(1− c)k+2(k2 + k)− 2k(k + 2)(1− c)k+1 + k2 + 3k

2(k + 1)(k + 2)

].

k

[(1− c)k+2(k2 + k)− (k2 + k) + (k2 + k)

2(k + 1)(k + 2)

+−2k(k + 2)(1− c)k+1 + 2k(k + 2)− 2k(k + 2) + k2 + 3k

2(k + 1)(k + 2)

]

107

Page 116: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

k

[(k2 + k)[(1− c)k+2 − 1]− 2k(k + 2)[(1− c)k+1 − 1]

2(k + 1)(k + 2)

+k2 + k − 2k2 − 4k + k2 + 3k

2(k + 1)(k + 2)

]+ α

[− 1− (1− c)k+2

2(k + 2)+

1− (1− c)k+1

(k + 1)

].

Thus, the 2nd L-moment for Pareto distribution is given by:

LB2 = 2βB

1 − βB0

= α[− 1− (1− c)k+2

(k + 2)+

2[1− (1− c)k+1]

(k + 1)− 1− (1− c)k+1

(k + 1)

]

= α[1− (1− c)k+1

(k + 1)− 1− (1− c)k+2

(k + 2)

]

= α(m1 −m2)·

Third, we calculate βB2 for Pareto distribution:

βB2 =

λ1c3

3+

cλ3+3

λ2(λ3 + 3)+

1

λ2

{c2(1− c)λ4+1

λ4 + 1+

2c(1− c)λ4+2

(λ4 + 1)(λ4 + 2)

+2(1− c)λ4+3 − 2

(λ4 + 1)(λ4 + 2)(λ4 + 3)

}+

1− c3

3x(c)

=c3

3( kα)

+1

k/α

{c2(1− c)k+1

k + 1+

2c(1− c)k+2

(k + 1)(k + 2)+

2(1− c)k+3 − 2

(k + 1)(k + 2)(k + 3)

}

+1− c3

3

[1− (1− c)k

k

k

[c3

3+

c2(1− c)k+1

k + 1+

2c(1− c)k+2

(k + 1)(k + 2)+

2(1− c)k+3 − 2

(k + 1)(k + 2)(k + 3)

+1− c3

3− 1− c3

3(1− c)k

]

108

Page 117: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

k

[1

3+{(1− c)2 − 2(1− c) + 1}(1− c)k+1

k + 1+

2{−(1− c) + 1}(1− c)k+2

(k + 1)(k + 2)

+2(1− c)k+3 − 2

(k + 1)(k + 2)(k + 3)− {(1− c)3 − 3(1− c)2 + 3(1− c)}

3(1− c)k

]

k

[1

3+

(1− c)k+3 − 2(1− c)k+2 + (1− c)k+1

k + 1+−2(1− c)k+3 + 2(1− c)k+2

(k + 1)(k + 2)

+2(1− c)k+3 − 2

(k + 1)(k + 2)(k + 3)+−(1− c)k+3 + 3(1− c)k+2 − 3(1− c)k+1

3

]

k

[ (k + 1)(k + 2)(k + 3)

3(k + 1)(k + 2)(k + 3)+

3(k + 2)(k + 3)(1− c)k+3 − 6(k + 2)(k + 3)(1− c)k+2

3(k + 1)(k + 2)(k + 3)

+3(k + 2)(k + 3)(1− c)k+1

3(k + 1)(k + 2)(k + 3)

+−6(k + 3)(1− c)k+3 + 6(k + 3)(1− c)k+2

3(k + 1)(k + 2)(k + 3)+

6(1− c)k+3 − 6

3(k + 1)(k + 2)(k + 3)

+−(k + 1)(k + 2)(k + 3)(1− c)k+3 + 3(k + 1)(k + 2)(k + 3)(1− c)k+2

3(k + 1)(k + 2)(k + 3)

+−3(k + 1)(k + 2)(k + 3)(1− c)k+1

3(k + 1)(k + 2)(k + 3)

]

k

[(k + 1)(k + 2)(k + 3)− 6

3(k + 1)(k + 2)(k + 3)+

(1− c)k+1[3(k + 2)(k + 3)− 3(k + 1)(k + 2)(k + 3)

]

3(k + 1)(k + 2)(k + 3)

+(1− c)k+2

[− 6(k + 2)(k + 3) + 6(k + 3) + 3(k + 1)(k + 2)(k + 3)]

3(k + 1)(k + 2)(k + 3)

+(1− c)k+3

[3(k + 2)(k + 3)− 6(k + 3) + 6− (k + 1)(k + 2)(k + 3)

]

3(k + 1)(k + 2)(k + 3)

]

109

Page 118: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

k

[ k3 + 6k2 + 11k

3(k + 1)(k + 2)(k + 3)+

3(k + 2)(k + 3)(1− c)k+1(1− k − 1)

3(k + 1)(k + 2)(k + 3)

+3(k + 3)(1− c)k+2

[− 2(k + 2) + 2 + (k + 1)(k + 2)]

3(k + 1)(k + 2)(k + 3)

+(1− c)k+3

[3k2 + 15k + 18− 6k − 18 + 6− k3 − 6k2 − 11k − 6

]

3(k + 1)(k + 2)(k + 3)

]

k

[ k3 + 6k2 + 11k

3(k + 1)(k + 2)(k + 3)+−3k(k + 2)(k + 3)(1− c)k+1

3(k + 1)(k + 2)(k + 3)

+3(k + 3)(1− c)k+2(−2k − 4 + 2 + k2 + 3k + 2)

3(k + 1)(k + 2)(k + 3)+

(1− c)k+3(−k3 − 3k2 − 2k)

3(k + 1)(k + 2)(k + 3)

]

k

[ k3 + 6k2 + 11k

3(k + 1)(k + 2)(k + 3)+−3k(k + 2)(k + 3)(1− c)k+1

3(k + 1)(k + 2)(k + 3)

+3k(k + 1)(k + 3)(1− c)k+2

3(k + 1)(k + 2)(k + 3)+−k(k + 1)(k + 2)(1− c)k+3

3(k + 1)(k + 2)(k + 3)

]

k

[ k3 + 6k2 + 11k

3(k + 1)(k + 2)(k + 3)

+−3k(k + 2)(k + 3)(1− c)k+1 + 3k(k + 2)(k + 3)− 3k(k + 2)(k + 3)

3(k + 1)(k + 2)(k + 3)

+3k(k + 1)(k + 3)(1− c)k+2 − 3k(k + 1)(k + 3) + 3k(k + 1)(k + 3)

3(k + 1)(k + 2)(k + 3)

+−k(k + 1)(k + 2)(1− c)k+3 + k(k + 1)(k + 2)− k(k + 1)(k + 2)

3(k + 1)(k + 2)(k + 3)

]

k

[ k3 + 6k2 + 11k

3(k + 1)(k + 2)(k + 3)

+3k(k + 2)(k + 3)[1− (1− c)k+1]− 3k(k + 2)(k + 3)

3(k + 1)(k + 2)(k + 3)

110

Page 119: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

+−3k(k + 1)(k + 3)[1− (1− c)k+2] + 3k(k + 1)(k + 3)

3(k + 1)(k + 2)(k + 3)

+k(k + 1)(k + 2)[1− (1− c)k+3]− k(k + 1)(k + 2)

3(k + 1)(k + 2)(k + 3)

]

k

[k3 + 6k2 + 11k − 3k(k + 2)(k + 3) + 3k(k + 1)(k + 3)− k(k + 1)(k + 2)

3(k + 1)(k + 2)(k + 3)

+k[1− (1− c)k+1]

(k + 1)+−k[1− (1− c)k+2]

(k + 2)+

k[1− (1− c)k+3]

3(k + 3)

]

= α[1− (1− c)k+1

(k + 1)− 1− (1− c)k+2

(k + 2)+

1− (1− c)k+3

3(k + 3)

].

Thus, the 3ed L-moment for Pareto distribution is given by:

LB3 = 6βB

2 − 6βB1 + βB

0

= α[61− (1− c)k+1

(k + 1)− 6

1− (1− c)k+2

(k + 2)+ 2

1− (1− c)k+3

(k + 3)+ 3

1− (1− c)k+2

(k + 2)

− 61− (1− c)k+1

(k + 1)+

1− (1− c)k+1

(k + 1)

]

= α[1− (1− c)k+1

(k + 1)− 3

1− (1− c)k+2

(k + 2)+

1− (1− c)k+3

(k + 3)

]

= α(m1 − 3m2 + 2m3).

111

Page 120: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Finally, we calculate βB3 for Pareto distribution:

βB3 =

λ1c4

4+

cλ3+4

λ2(λ3 + 4)

+1

λ2

{c3(1− c)λ4+1

λ4 + 1+

3c2(1− c)λ4+2

(λ4 + 1)(λ4 + 2)+

6c(1− c)λ4+3

(λ4 + 1)(λ4 + 2)(λ4 + 3)

+6((1− c)λ4+4 − 1)

(λ4 + 1)(λ4 + 2)(λ4 + 3)(λ4 + 4)

}+

1− c4

4x(c)

=c4

4( kα)

+1

k/α

{c3(1− c)k+1

k + 1+

3c2(1− c)k+2

(k + 1)(k + 2)+

6c(1− c)k+3

(k + 1)(k + 2)(k + 3)

+6(1− c)k+4 − 6

(k + 1)(k + 2)(k + 3)(k + 4)

}+

1− c4

4

[1− (1− c)k

k

k

[c4

4+

c3(1− c)k+1

k + 1+

3c2(1− c)k+2

(k + 1)(k + 2)+

6c(1− c)k+3

(k + 1)(k + 2)(k + 3)

+6(1− c)k+4 − 6

(k + 1)(k + 2)(k + 3)(k + 4)+

1− c4

4

[1− (1− c)k

]]

k

[c4

4+

c3(1− c)k+1

k + 1+

3c2(1− c)k+2

(k + 1)(k + 2)+

6c(1− c)k+3

(k + 1)(k + 2)(k + 3)

+6(1− c)k+4 − 6

(k + 1)(k + 2)(k + 3)(k + 4)+

1− c4

4− 1− c4

4(1− c)k

]

k

[1

4+

c3(1− c)k+1

k + 1+

3c2(1− c)k+2

(k + 1)(k + 2)+

6c(1− c)k+3

(k + 1)(k + 2)(k + 3)

+6(1− c)k+4 − 6

(k + 1)(k + 2)(k + 3)(k + 4)− 1− c4

4(1− c)k

]

112

Page 121: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

k

[1

4+{−(1− c)3 + 3(1− c)2 − 3(1− c) + 1}(1− c)k+1

k + 1

+3{(1− c)2 − 2(1− c) + 1}(1− c)k+2

(k + 1)(k + 2)

+6{−(1− c) + 1}(1− c)k+3

(k + 1)(k + 2)(k + 3)+

6(1− c)k+4 − 6

(k + 1)(k + 2)(k + 3)(k + 4)

− −(1− c)4 + 4(1− c)3 − 6(1− c)2 + 4(1− c)

4(1− c)k

]

k

[1

4+−(1− c)k+4 + 3(1− c)k+3 − 3(1− c)k+2 + (1− c)k+1

k + 1

+3(1− c)k+4 − 6(1− c)k+3 + 3(1− c)k+2

(k + 1)(k + 2)

+−6(1− c)k+4 + 6(1− c)k+3

(k + 1)(k + 2)(k + 3)+

6(1− c)k+4 − 6

(k + 1)(k + 2)(k + 3)(k + 4)

+(1− c)k+4 − 4(1− c)k+3 + 6(1− c)k+2 − 4(1− c)k+1

4

]

k

[ (k + 1)(k + 2)(k + 3)(k + 4)

4(k + 1)(k + 2)(k + 3)(k + 4)

+4(k + 2)(k + 3)(k + 4){−(1− c)k+4 + 3(1− c)k+3 − 3(1− c)k+2 + (1− c)k+1}

4(k + 1)(k + 2)(k + 3)(k + 4)

+4(k + 3)(k + 4){3(1− c)k+4 − 6(1− c)k+3 + 3(1− c)k+2}

4(k + 1)(k + 2)(k + 3)(k + 4)

+−24(k + 4)(1− c)k+4 + 24(k + 4)(1− c)k+3

4(k + 1)(k + 2)(k + 3)(k + 4)+

24(1− c)k+4 − 24}4(k + 1)(k + 2)(k + 3)(k + 4)

+(k + 1)(k + 2)(k + 3)(k + 4){(1− c)k+4 − 4(1− c)k+3 + 6(1− c)k+2 − 4(1− c)k+1}

4(k + 1)(k + 2)(k + 3)(k + 4)

]

113

Page 122: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

k

[(k + 1)(k + 2)(k + 3)(k + 4)− 24

4(k + 1)(k + 2)(k + 3)(k + 4)

+(1− c)k+1

[4(k + 2)(k + 3)(k + 4)− 4(k + 1)(k + 2)(k + 3)(k + 4)

]

4(k + 1)(k + 2)(k + 3)(k + 4)

+(1− c)k+2

[− 12(k + 2)(k + 3)(k + 4) + 12(k + 3)(k + 4)

4(k + 1)(k + 2)(k + 3)(k + 4)

+6(k + 1)(k + 2)(k + 3)(k + 4)

]

4(k + 1)(k + 2)(k + 3)(k + 4)

+(1− c)k+3

[12(k + 2)(k + 3)(k + 4)− 24(k + 3)(k + 4) + 24(k + 4)

4(k + 1)(k + 2)(k + 3)(k + 4)

+−4(k + 1)(k + 2)(k + 3)(k + 4)

]

4(k + 1)(k + 2)(k + 3)(k + 4)

+(1− c)k+4

[− 4(k + 2)(k + 3)(k + 4) + 12(k + 3)(k + 4)− 24(k + 4) + 24

4(k + 1)(k + 2)(k + 3)(k + 4)

+(k + 1)(k + 2)(k + 3)(k + 4)

]

4(k + 1)(k + 2)(k + 3)(k + 4)

]

k

[(k + 1)(k + 2)(k + 3)(k + 4)− 24

4(k + 1)(k + 2)(k + 3)(k + 4)+−4k(k + 2)(k + 3)(k + 4)(1− c)k+1

4(k + 1)(k + 2)(k + 3)(k + 4)

+6k(k + 1)(k + 3)(k + 4)(1− c)k+2

4(k + 1)(k + 2)(k + 3)(k + 4)+−4k(k + 1)(k + 2)(k + 4)(1− c)k+3

4(k + 1)(k + 2)(k + 3)(k + 4)

+k(k + 1)(k + 2)(k + 3)(1− c)k+4

4(k + 1)(k + 2)(k + 3)(k + 4)

]

114

Page 123: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

k

[ k4 + 10k3 + 35k2 + 50k

4(k + 1)(k + 2)(k + 3)(k + 4)

+4k(k + 2)(k + 3)(k + 4)

[1− (1− c)k+1

]− 4k(k + 2)(k + 3)(k + 4)

4(k + 1)(k + 2)(k + 3)(k + 4)

+−6k(k + 1)(k + 3)(k + 4)

[1− (1− c)k+2

]+ 6k(k + 1)(k + 3)(k + 4)

4(k + 1)(k + 2)(k + 3)(k + 4)

+4k(k + 1)(k + 2)(k + 4)

[1− (1− c)k+3

]− 4k(k + 1)(k + 2)(k + 4)

4(k + 1)(k + 2)(k + 3)(k + 4)

+−k(k + 1)(k + 2)(k + 3)

[1− (1− c)k+4

]+ k(k + 1)(k + 2)(k + 3)

4(k + 1)(k + 2)(k + 3)(k + 4)

]

= α[k4 + 10k3 + 35k2 + 50k − 4k(k + 2)(k + 3)(k + 4) + 6k(k + 1)(k + 3)(k + 4)

4k(k + 1)(k + 2)(k + 3)(k + 4)k(k + 1)(k + 2)(k + 3)

+−4k(k + 1)(k + 2)(k + 4) + k(k + 1)(k + 2)(k + 3)

4k(k + 1)(k + 2)(k + 3)(k + 4)k(k + 1)(k + 2)(k + 3)

+1− (1− c)k+1

(k + 1)− 3

[1− (1− c)k+2

]

2(k + 2)+

1− (1− c)k+3

(k + 3)− 1− (1− c)k+4

4(k + 4)

]

= α[1− (1− c)k+1

(k + 1)− 3

[1− (1− c)k+2

]

2(k + 2)+

1− (1− c)k+3

(k + 3)− 1− (1− c)k+4

4(k + 4)

].

Thus, the 4th L-moment for Pareto distribution is given by:

LB4 = 20β3 − 30β2 + 12β1 − β0

= α[20

1− (1− c)k+1

(k + 1)− 30

1− (1− c)k+2

(k + 2)+ 20

1− (1− c)k+3

(k + 3)− 5

1− (1− c)k+4

4(k + 4)

− 301− (1− c)k+1

(k + 1)+ 30

1− (1− c)k+2

(k + 2)− 10

1− (1− c)k+3

(k + 3)− 6

1− (1− c)k+2

(k + 2)

+ 121− (1− c)k+1

(k + 1)− 1− (1− c)k+1

(k + 1)

]

115

Page 124: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

= α[1− (1− c)k+1

(k + 1)− 6

1− (1− c)k+2

(k + 2)+ 10

1− (1− c)k+3

(k + 3)− 5

1− (1− c)k+4

4(k + 4)

]

= α[m1 − 6m2 + 10m3 − 5m4

].

In Table 4.2 the numerical values of the first four L-moments of Pareto distribution for

different censoring values are compared with the values obtained by the corresponding

GLD approximation [23].

116

Page 125: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Table 4.2: :[23] L-moment of Pareto distribution for censoring fraction c

Distribution c method LB1 LB

2 LB3 LB

4

0.99 direct 0.2437 0.1326 0.0533 0.0283

gld 0.2437 0.1326 0.0533 0.0283

0.9 direct 0.2104 0.1010 0.0250 0.0043

gld 0.2104 0.1010 0.0250 0.0043

0.8 direct 0.1810 0.0760 0.0074 -0.0050

gld 0.1810 0.0760 0.0074 -0.0050

Pareto 0.7 direct 0.1546 0.0562 -0.0026 -0.0064

α = 1/5, gld 0.1546 0.0562 -0.0026 -0.0064

k = −1/5

0.6 direct 0.1299 0.0401 -0.0075 -0.0043

gld 0.1299 0.0401 -0.0075 -0.0043

0.5 direct 0.1064 0.02772 -0.0089 -0.0013

gld 0.1064 0.0272 -0.0089 -0.0013

Table (4.2) strongly recommends the use of GLD for modeling univariate continuous

distributions using their PWMs and L-moments even for censored observations [23].

117

Page 126: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

4.5 Fitting of the Distributions to Censored Data Us-

ing GLD

In this section, we estimate type B PPWMs for right censoring distribution and type

B′ PPWMs for left censoring distribution. Using this estimations, we can estimate the

parameters of the right and the left censoring GLD.

PPWM Estimators for Right Censoring

Type B PPWM is computed from the completed sample, where the n−m censored values

in

X1:n ≤ X2:n ≤ ... ≤ Xm:n︸ ︷︷ ︸m−1 observed

≤ T ≤ Xm+1:n ≤ Xm+2:n ≤ ... ≤ Xn−1:n ≤ Xn:n︸ ︷︷ ︸n−m censored

are replaced by the censoring threshold T [28].

Definition 4.5.1. [28] Let x1:n ≤ x2:n ≤ ... ≤ xm:n︸ ︷︷ ︸m−1 observed

≤ T ≤ xm+1:n ≤ xm+2:n ≤ ... ≤ xn−1:n ≤ xn:n︸ ︷︷ ︸n−m censored

be an order sample, and define the sample type B PPWM for right censoring distribution,

bBr as:

bBr =

1

n

{ m∑j=1

(j − 1)(j − 2)...(j − r)

(n− 1)(n− 2)...(n− r)xj:n+

( n∑j=m+1

(j − 1)(j − 2)...(j − r)

(n− 1)(n− 2)...(n− r)

)T

}. (4.5.1)

Note 4.5.1. [28] The samples type B PPWMs, bBr are unbiased estimators of the type B

PPWM βBr for r = 1, 2, 3, . . .

To estimate the parameters of the right censored GLD in the case of type one single

censoring, we can equate the sample and population PPWMs. As for estimation usually

B type PPWMs are preferred by comparing the first four theoretical and sample moments

obtained from expressions (4.3.2) and (4.5.1), we can obtain the appropriate values of the

parameters λ1, λ2, λ3 and λ4 [20].

118

Page 127: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

PPWM Estimators for Left Censoring

Type B′ PPWM is computed from the completed sample, where the n−k censored values

in

X1:n ≤ X2:n ≤ ... ≤ Xm−1:n︸ ︷︷ ︸n−k censored

≤ T ≤ Xm:n ≤ Xm+2:n ≤ ... ≤ Xn:n︸ ︷︷ ︸k observed

, (m−1=n−k)

are replaced by the censoring threshold T [28].

Definition 4.5.2. [28] Let x1:n ≤ x2:n ≤ ... ≤ xm−1:n︸ ︷︷ ︸n−k censored

≤ T ≤ xm:n ≤ xm+2:n ≤ ... ≤ xn:n︸ ︷︷ ︸k observed

,

(m− 1 = n− k) ba an order sample and define the sample type B′ PPWM for lift cen-

soring distribution, bB′r as:

bB′r =

1

n

{ n−k∑j=1

(j − 1)(j − 2)...(j − r)

(n− 1)(n− 2)...(n− r)T +

n∑

j=n−k+1

(j − 1)(j − 2)...(j − r)

(n− 1)(n− 2)...(n− r)xj:n

}. (4.5.2)

Note 4.5.2. [23] The sampls type bB′r are unbiased estimators of the type B′, βB′

r for

r = 1, 2, 3, . . .

In eq.n.(4.5.2), k = n −m + 1. In the case of type B′ censoring T is to be replaced

by Xm:n in the above expressions. So, by comparing the First 4 theoretical and sample

PPWMs using expressions (4.3.13) and (4.5.2), we can fit a GLD for a left censored data

[23].

119

Page 128: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

Bibliography

[1] A.G. Konheim, A note on order statistics, American mathematical Monthly, 78,

524, 1971.

[2] A. Tarsitano, Fitting the Generalized Lambda Distribution to Income Data, Diparti-

mento di Economia e Statistica, Universita della Calabria, Italy, 2004.

[3] A.Viglione, Homogeneity Tests for Regional Frequencey Analysis, the Homest

Package, Version 1.0-2, October 3, 2007.

[4] B. M. Upadhyay and E. G. Smith, Modeling Crop Yield Distributions from Small

Samples Selected Paper CAES annual meeting, San Francisco, California July 6-8,

2005.

[5] B. P. Parashar, Differential and Integral Equations, second edition, Rani Durgawati

Vishwa, Vidyalaya, 1992.

[6] C. Marcella, Utilizzo Degli L-moments Perl,Analisisi Regionale Delle Portate Dipena

in Sicilia, Universita degli studi di Palermo, 2006.

120

Page 129: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

[7] C. M. Filho, F. Yao, Estimation of Value-at-risk and Expected Shortfall Based on

Nonlinear Models of Return Dynamics and Extreme Value Theory, Oregon State

University, 2002.

[8] C. N. Kroll and J. R. Stedinger, Estimation of moments and quantiles using censored

data, Water Resour. Res., 32(4), 1005 -1012, 1996.

[9] D.S Mitrinovic, Analytic Inequalities, Berlin: Springer, p.40, 1970.

[10] G. Casella, R.L. Beger, Statistical Inference, Duxbury Press. California, 1990.

[11] H.A. David, Order statistics, 2nd ed. New York:Wiely, (1981).

[12] H. Oja, On location, scale, skewness and kurtosis of univariate distributions,

Scandinavian Journal of Statistics, 8, 154-168, 1981.

[13] J. C. Fliney, B.A.Dakota, Optimizaion of Skewed Logitic Distribution with recpect to

the Kolmogrove-smirnov Test, Wesleyan university, 1985, M.S. South Dakota State

university, 1991.

[14] J.M., Landwehr, Probability weighted moments compared with some traditional tech-

niques in estimating Gumbel parameters and quantitles,Water Resour. Res.,15(5),

1055-1064, 1979.

121

Page 130: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

[15] J.R.M. Hosking, and J.R.Wallis, Regional Frequency Analysis, Cambrideg University.

1997.

[16] J.R.M. Hosking, Fortran Routines for Use with The Method of L-moments, IBM

Research Division, T. J Watson Research Center, Yorkton Heights, NY 10598, RC

2025 (90933), 1996.

[17] J.R.M. Hosking: L-moments, Analysis and estimation of distributions using linear

combinations of order statistic, Journal of the Royal Statistical Society, Series B, 52,

105-104. 1990.

[18] J.R.M. Hosking, Some Theorical Results concering L-moments, IBM Research

Division. RC 14492 (64907), 1989.

[19] J.R.M. Hosking, The Four-Parameter Kappa Distribution, IBM. Journal, RES.

EVEOLP.Vol. 38 No. 3, May 1994.

[20] J. R. M. Hosking, The use of L-moments in the analysis of censored data, in Recent

Advances in Life-Testing and Reliability, edited by N. Balakrishnan, chap. 29, pp.

546-564, CRC Press, Boca Raton, Fla., N.Y, 1995.

[21] L. M. Tallaksen & H. Hisdal, Methods for Regional Classification of Streamflow

Drought Series: The EOF Method and L-moments, Technical Report to the ARIDE

project No.2, Department of Geophysics, University of Oslo, Norway, October 1999.

122

Page 131: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

[22] M. ES and S. JR, Genrralized Maximum-Likelihood Generlized Extrem-value Quan-

tile Estimators for Hydrologic Data, Water Resource Research 37(10):2551-2557.

October 2001.

[23] M. Joseph, M. Kumaran, Estimation of the Generalized Lambda Distribution from

Censored Data, Govt.College, Kasaragod-671123, Kerala, India, 2007.

[24] N. Andrei, Convex functions, Research Institute for Informatics, Center for Advanced

Modeling and Optimization, 8-10, Averescu Avenue, Bucharest 1, Romania, 2005.

[25] P.H.A.J.M. Van Gelder, An Analysis of Drag forces based on L-moments, Delft

University of Technology, Advances in Safity and Relibility-Kolowrocki(ed.), 2005.

[26] R. I. Larson, M. L. Marx, An Introduction to Mathematical Statistics and its

Applications, Prentice-Hall, Englewood Cliffs, New Jeresy, 1986.

[27] Sillitto, G. P. Derivation of approximants to the inverse distribution function of a

continuous univariate population from the order statistics of a sample, Biometrika,

56, 641-650, 1969.

[28] S.M.Craig. Metcalf & Eddy Inc, L moment diagrams for censord observations, Wake-

field, Massachuestts, Water Resources Research, Vol. 34, No. 5, Pages 12411249,

May 1998.

[29] S. R. Durrans, Low-flow analysis with a conditional Weibull tail model, Water Resour.

Res., 32(6), 1749 -1760, 1996.

123

Page 132: The Properties of L-moments Compared to Conventional Moments · L-moment. The concepts of the nth moment, rth central moment and moment generated functions are introduced to be used

[30] Szego, G. Orthogonal polynomials, 2nd ed. New York: American Mathematical Soci-

ety, 1959.

[31] W. E. Boyce, Elementary Differential Equations and Boundary Value Problems, sixth

edition. Canada, 1997.

124