Using Non-Linear Mixed Models for Agricultural...

34
Introduction Barley N response Statistical Models Application to Meta-analysis Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy Biosciences Institute Crop Sciences University of Illinois, Urbana-Champaign [email protected] Oct 8 th , 2008

Transcript of Using Non-Linear Mixed Models for Agricultural...

Page 1: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Using Non-Linear Mixed Models for AgriculturalData

Fernando E. Miguez

Energy Biosciences InstituteCrop Sciences

University of Illinois, [email protected]

Oct 8th, 2008

Page 2: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Outline

1 Introduction

2 Barley N response

3 Statistical Models

4 Application to Meta-analysis

Page 3: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Objectives of Statistical Modeling

Objectives

1 Develop the simplest model which still captures the structureof the data

2 Interpret the model (give meaning to the parameters)

3 Generate predictions (validation)

Page 4: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Objectives of Statistical Modeling

Objectives

1 Develop the simplest model which still captures the structureof the data

2 Interpret the model (give meaning to the parameters)

3 Generate predictions (validation)

Page 5: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Objectives of Statistical Modeling

Objectives

1 Develop the simplest model which still captures the structureof the data

2 Interpret the model (give meaning to the parameters)

3 Generate predictions (validation)

Page 6: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Non-Linear and Mixed Models

Non-Linear Models

1 Parsimony

2 Interpretability

3 Model the mean structure

Mixed Models

1 Flexibility

2 Hierarchy

3 Model the error structure

Page 7: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Non-Linear and Mixed Models

Non-Linear Models

1 Parsimony

2 Interpretability

3 Model the mean structure

Mixed Models

1 Flexibility

2 Hierarchy

3 Model the error structure

Page 8: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Non-Linear and Mixed Models

Non-Linear Models

1 Parsimony

2 Interpretability

3 Model the mean structure

Mixed Models

1 Flexibility

2 Hierarchy

3 Model the error structure

Page 9: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Non-Linear and Mixed Models

Non-Linear Models

1 Parsimony

2 Interpretability

3 Model the mean structure

Mixed Models

1 Flexibility

2 Hierarchy

3 Model the error structure

Page 10: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Non-Linear and Mixed Models

Non-Linear Models

1 Parsimony

2 Interpretability

3 Model the mean structure

Mixed Models

1 Flexibility

2 Hierarchy

3 Model the error structure

Page 11: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Non-Linear and Mixed Models

Non-Linear Models

1 Parsimony

2 Interpretability

3 Model the mean structure

Mixed Models

1 Flexibility

2 Hierarchy

3 Model the error structure

Page 12: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Outline

1 Introduction

2 Barley N response

3 Statistical Models

4 Application to Meta-analysis

Page 13: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Barley N response trialsAril Vold (1998). A generalization of ordinary yield response functions. EcologicalApplications. 108:227-236.

Details

19 years of data, Norway

N rates (0, 3.38, 7.76 and11.69 g N m−2) raised by20% in 1978

Agronomic Questions

1 How does it respond to N?

2 How does it vary amongyears?

Page 14: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

N fertilizer (g/m2)

Yie

ld (

g/m

2)100200300400500

●●

1970

0 5 10

● ●

1971

●●

1972

0 5 10

● ●

1973

1974

1975

●●

● ●

1976

●●

1977

●●

1978

100200300400500

● ●

1979

100200300400500

● ●

1980

● ●

1981

●●

1982

1983

●●

1984

0 5 10

● ●

1985

●●

● ●

1986

0 5 10

●●

1987

100200300400500

●●

1988

Page 15: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Outline

1 Introduction

2 Barley N response

3 Statistical Models

4 Application to Meta-analysis

Page 16: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Basics of Statistical Models

y = f(x, θ) + ε

where,y = observedf = mean structurex = inputθ = parametersε = error

Page 17: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Basics of Statistical Models

y = f(x, θ) + ε

D =M+ Ewhere,y = observedf = mean structurex = inputθ = parametersε = error

Page 18: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Choosing the Mean Structure

Asymptotic RegressionModel

y = θ1 + (θ2 − θ1)×exp(− exp(θ3)× x)

where,θ1 is the maximum value of yθ2 is the value of y for x = 0.θ3 is the growth rate of y

N fertilizer (g/m2)

Yie

ld (

g/m

2)100

200

300

0 5 10

Page 19: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Barley N response trialsNon-linear regression with years combined

N fertilizer (g/m2)

Yie

ld (

g/m

2)

100

200

300

400

500

0 5 10

●●

●●

●●

●●

●●●

● ●

●●●

●●

●●

●●

●●

●●

Page 20: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Barley N response trialsBox-plots of residuals for each year

Residuals

year

1986

1976

1979

1987

1985

1972

1988

1980

1970

1971

1977

1981

1983

1973

1984

1982

1975

1978

1974

−100 0 100 200

Page 21: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Barley N response trials

N fertilizer (g/m2)

Yie

ld (

g/m

2)

100

200

300

400

500

0 5 10

●●

●●

●●

●●

●●●

● ●

●●●

●●

●●

●●

●●

●●

N fertilizer (g/m2)

Yie

ld (

g/m

2)

100200300400500

●●

1970

0 5 10

● ●

1971

●●

1972

0 5 10

● ●

1973

1974

1975

●●

● ●

1976

●●

1977

●●

1978

100200300400500

● ●

1979

100200300400500

● ●

1980

● ●

1981

●●

1982

1983

●●

1984

0 5 10

● ●

1985

●●

● ●

1986

0 5 10

●●

1987

100200300400500

●●

1988

One single regression to all the data

Wide confidence intervalsIgnores the structure of the data

Fitting one function for each separate year

Over-parameterized model3 parms × 19 y = 57 parms

Page 22: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Barley N response trialsConfidence Intervals for Non-linear regressions for each year

year

1986

1976

1979

1987

1985

1972

1988

1980

1970

1971

1977

1981

1983

1973

1984

1982

1975

1978

1974

−1000 0 1000 2000

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

th1

0 50 100 150 200 250 300

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

th2

−6 −4 −2 0

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

|

lrc

Page 23: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

N fertilizer (g/m2)

Yie

ld (

g/m

2)

100200300400500

●●

1970

0 5 10

● ●

1971

●●

1972

0 5 10

● ●

1973

1974

1975

●●

● ●

1976

●●

1977

●●

1978

100200300400500

● ●

1979

100200300400500

● ●

1980

● ●

1981

●●

1982

1983

●●

1984

0 5 10

● ●

1985

●●

● ●

1986

0 5 10

●●

1987

100200300400500

●●

1988

Page 24: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Non-Linear Mixed Model

Asymptotic regression with random effects

yij = (θ1+b1i)+((θ2+b2i)−(θ1+b1i))×exp(− exp(θ3+b3i)×xij)+εij

i = the year (or experimental unit)j = the N rate

bi ∼ N (0, Ψ), εij ∼ N (0, σ2)

Ψ =

σ11 σ12 σ13

σ21 σ22 σ23

σ31 σ32 σ33

Page 25: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Random EffectsDot plot for the random effects

Random effects

year

1970

1971

1972

1973

1974

1975

1976

1977

1978

1979

1980

1981

1982

1983

1984

1985

1986

1987

1988

−200 −100 0 100 200

th1

−100 −50 0 50 100

th2

−0.4 −0.2 0.0 0.2 0.4

lrc

Page 26: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Random EffectsScatter plot matrix for the random effects

Scatter Plot Matrix

th10

100

2000 100 200

−200

−100

0

−200 −100 0●

●●

●●●

●●

●●

●●

●●

●●●●

●●

●●●

●●

●●

● ●

th20

50

100 0 50 100

−100

−50

0

−100 −50 0

●●

●●

●●

●●

●●

●●●

●●

●●

lrc0.0

0.2

0.4 0.0 0.2 0.4

−0.4

−0.2

0.0

−0.4 −0.2 0.0

Page 27: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Non-Linear Mixed ModelFixed and BLUP

N fertilizer (g/m2)

Yie

ld (

g/m

2)

100200300400500

0 5 10

●●

● ●

1986

●●

● ●

1976

0 5 10

● ●

1979

●●

1987

0 5 10

● ●

1985

●●

1972

●●

1988

●● ●

1980

●●

1970

100200300400500

● ●

1971

100200300400500

●●

1977

● ●

1981

1983

● ●

1973

●●

1984

●●

1982

0 5 10

1975

●●

1978

0 5 10

100200300400500

1974

fixedBLUP

Page 28: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Comparison of NLS and NLME

Estimate, and 95% confidence intervals for the three parameters ofthe asymptotic regression model (NLS) and the mixed-effectsmodel (NLME).

Fixed term Estimate Lower Upperθ1 NLS 381 335 507θ1 NLME 390 337 443

θ2 NLS 133 101 166θ2 NLME 132 107 157

lrc NLS -1.7 -2.7 -1.1lrc NLME -1.7 -1.9 -1.4

σ̂ NLS 71.2σ̂ NLME 18.8 13.8 25.6

Page 29: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Summary: Using NLME

NLME are able to accomodate the mean anderror structure

NLME produce a parsimonious and easy tointerpret model

The NLME estimates are more accurate and theconfidence intervals are narrower

Page 30: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Summary: Using NLME

NLME are able to accomodate the mean anderror structure

NLME produce a parsimonious and easy tointerpret model

The NLME estimates are more accurate and theconfidence intervals are narrower

Page 31: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Summary: Using NLME

NLME are able to accomodate the mean anderror structure

NLME produce a parsimonious and easy tointerpret model

The NLME estimates are more accurate and theconfidence intervals are narrower

Page 32: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Outline

1 Introduction

2 Barley N response

3 Statistical Models

4 Application to Meta-analysis

Page 33: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Application to Meta-analysisMeta-analysis of the effects of management factors on Miscanthus x giganteus growthand biomass production. Miguez et al (2008) Agricultural and Forest Meteorology.148:1280-1292.

R Code and DataE-mail: [email protected]

Website: https://netfiles.uiuc.edu/miguez/www

Page 34: Using Non-Linear Mixed Models for Agricultural Datamiguezlab.agron.iastate.edu/OldWebsite/Research/Talks/...Using Non-Linear Mixed Models for Agricultural Data Fernando E. Miguez Energy

Introduction Barley N response Statistical Models Application to Meta-analysis

Questions?