CEA Report Fall 2008

7/31/2019 CEA Report Fall 2008

1/10

Universityof

atLafayetteLouisiana[CourseembeddedAssessment:Written

Communication]Ninetyfour ENGL 102 papers were selected from 6 randomly identified

sections in Fall 2008. At the end of the semester, a team of one coordinator

(Dr. Clancy Ratliff, Director of the FirstYear Writing Program) and sevenexpert evaluators assembled to assess each of the studentsubmitted

manuscripts on a 4dimensional rubric utilizing three levels of performance

(1=poor, 2=satisfactory, 3=outstanding). Each paper was evaluated by two

independent assessors. Reliabilities between these raters on each dimension

and on the overall score are: Content = .58, Organization = .61, Research

= .72, Language Issues = .41, Overall (mathematical mean of four dimensions

equally weighted) = .70.

2009

OfficeofLearningEffectiveness

AssessmentofStudentLearningReport

1/23/2009


2/10

Expectedof 2 (satisfact

esults|Only on the Language Issues dimension was the expected performance attained.

Performance|At least 70% of the assessed student products would attain an overall ratinory) or greater.

R

Overall Results (n=94)Poor Satisfactory Outstanding

Content

Mean=2.05Med

Mod

ian=2 0.e=2.5

33% 67%

Organization

Mean=1.93Median=2 0.Mode=2.0

39% 61%

Research

Mean=1.84Median

Mode= =1 5.1.052% 48%

Language Issues

Mean=2.07Median=2 0.Mode=2.0

21% 79%

OverallMean=1.97Median=1.875Mode=1.875

51% 49%nterpretation| After reviewing the results, Dr. Ratliff, on behalf of the CEA team, offered the followinI

contextual caveats that may have skewed the data. These issues should be considered when interpreting the results

1. The s were taking the second semester of the firstyear writing cours

out of s

ample was comprised of students who

equence. Students who take ENGL 102 in the fall semester often fall into one of the following groups:

students who retake 102 after failing it

students who originally started out in developmental writing (for example, took English 90 in fall 2

in spring 2008, then 102 in fall 2008)

007, 10

students who participated in the high school dual enrollment program for their English 101 credit

2. Hurr

instruct

icanes Gustav and Ike had a disruptive influence on courses in the fall 2008 semester. According t

or feedback received:

there seemed to be a much higher than usual rate of attrition in classes. We had to gather papers from si

esections of ENGL 102 in order to compile a sampl of 92 papers. Since the enrollment cap in ENGL 102 is 27

we were surprised. Each section lost about 12 students.

even for the students who remained, there was a higher than usual rate of absenteeism in fall 2008 and

ion from class work. Teachers speculated that students and thei

anes that had a spillover effect on their academic work.

according to teachers, a general distract

families suffered setbacks from the hurric

Recommended Interventions(1) Clarify the Language Issues dimension of the rubric to augment interrater reliability.

(2) Repeat

(3)Ask e the results, with particular emphasis on:the CEA in a Spring semester.th firstyear writing team for insight/recommendations into. Assisting students with evolving their research skills.. Assisting students with organizational issues in writing.ab

Attac hments to Follow

SPSS Da ta Resul

Rub r

Exce l File with Raw Dat


3/10

7 +,%%/0++.+*#!*!.("+.,,!.+"%0/(!*#0$

7 +(!.)%*%!+./1/0%*!,+/%0%+*%*0$!,,!.+..#1)!*0%/%*.!%(!0+*!)%1%!*!

7 .!0)!*0+"0$!/1&!0%/

/1,!."%%(*"%(!7 ,!.%/

+2!.(5.!(%*0+*(%$!/+.1(01.((5+*%0%+*!!0$*+!*0.%//1),0%+*/*%/

7 .#1)!*0%",.!/!*0%/1*/1,,+.0!

5!2%!*!+.!2%!*!%/%*/1""%%!*0

7 +,%%/

)*#!(!"+.,,!.+"%0/(!*#0$

7 )+1*0+"!2%!*!%//1""%%!*0

7 !)+*/0.0!/.%0%(0$%*'%*#%(%050+.!+#*%6!+),(!4%05%/!/*/0!.!+05,%(

.!,.!/!*00%+*/%/0%*#1%/$%*#"0".+)+,%*%+*

7 !0/"+.0$(!.0$!/%/,+/%0%+*+*0$!%//1!

7 +*0%*//+)!'*+3(!#)!*0+"+,,+/%*#%2!.#!*02%!3/

7 +,%%/*..+3!*+1#$0+((+3"+..%#+.+1/*1*!0.!0)!*0+"0$!/1&!0

7 2%!*!%/),(!0+/1,,+.0,+/%0%+*0'!*

7 2%!*!%/!2(10!*(56!*+0/%),(5

,.!/!*0!7 ,,+/%*#%2!.#!*02%!3/.!.!"1((5+*/%!.!*0$+1#$0"1((5.!"10!

7 .#1)!*0%/".!/$*+005,%(+.,.!%0(!"+.

"%./05!./01!*0

7 *0.+10%+*+!/*+0+.%!*00$!.!!.0+0$!+*!.*/+"0$!,,!.+.+*0!401(%6!0$!/1&!0+"0$!,,!.

7 ..*#!)!*0+"0$!,,!.%/$,$6.*.*+)

7 .#.,$/+*+0$2!0.*/%0%+*/0$0#1%!0$!.!!.

7 ,!.+*0%*/(!.%*0.+10%+*!2!(+,)!*0+*(1/%+*

7 %2%!%*0+%/.!0!/!0%+*/!$/1,,+.0%*#0$!

0$!/%/7 +#%(/)++0$0.*/%0%+*/!03!!*/!0%+*/

7 (*+"!2!(+,)!*0/00!"+.!/0%*#

7 ,!.%/*+0+*(53!((+.#*%6!10/$+3/*1*1/1((5'!!*+*/%!.0%+*+"0$!1%!*!

-1!/0%+*/.!*0%%,0!**/3!.!.#1)!*0//!!)..*#!.0"1((5"+.0$!)+/0


4/10

".+)+*!%!0+0$!*!40

7 +*(1/%+*%//!*0+..1,0

/00!)!*0/!("**+1*%*#/0.101.!0+.#1)!*0

,!./1/%2!!""!0

7 *"+.)0%+*0$0(!.(5+)!/".+)/+1.!/%/*+0%0!

7 +.!-1+0!)0!.%(%/,.!/!*00$*,.+/!3.%00!*50$!/01!*0

7 *"+.)0%+*+)!/".+)

/+1.!/0$0.!*+0!,0(!"+.*!)%,,!.

7 +.'/%0!(%/0*+0,.!/!*0

7 +1.!/.!%*0!#.0!%*0+/01!*0/.#1)!*0/01!*0%/%*+*0.+(+"0$!/+1.!)0!.%(*+01),

7 +1.!/.!.!%(!+.%*#0+

!)%/0*./7 +.'/%0!(%/0

%/,.!/!*0!2!*%"+1)!*00%+*"+.)0%/%*+..!0

7 +1.!)0!.%(%/%*0!#.0!/!)(!//(5%*0+0$!/01!*0/.#1)!*0

7 %(%+#.,$5%/!2!*$*!/+1.!/+0$%*/1,,+.0+"*+*0.

/01!*0/.#1)!*07 ,!.+*0%*/

3+.'/%0!,#!%*+..!0+1)!*00%+*"+.)0

7 .!-1!*5+"

!..+.+"*505,!!0.0/".+)0$!+*0!*0+"0$!,,!.

7 ,!.+*0%*/"1(053+.$+%!/+.)(,.+,%/)/

7 .)).*

,1*010%+*.!)+/0(5+..!0

7 5*04%/(!.7 01!*0/$+3/

+))*+"(*#1#!3+.$+%!2+1(.5

7 .%!/!*0!*!/0.101.!

7 +..!0/,!((%*#

7 ,!.%/2%.01((5".!!+"!..+.

7 .%0!./$+3/

*1*1/1("!(%%053%0$.!#.0+3+.$+%!01.*/+",$./!!41/!/+/1.!3+./+*)+0/

7 !*0!*!/0.101.!%/+),(!410*+0

1)!./+)!


5/10

per Content1 Organization1 R es earc h1 L an gu ag eIssues1 O ve ra ll1 Content2 Organization2 R es earc h2 L an gu ag eIssues2 Over al l2 ContentAvg O rg an iz atio nAvg R es earc hAvg LanguageIssuesA vg Ov er allAvg1 1 2 1 3 1.75 2 2 1 2 1.75 1.5 2 1 2.5 1.75

2 1 1 1 1 1 1 1 2 2 1.5 1 1 1.5 1.5 1.25

3 3 2 3 3 2.75 3 3 3 3 3 3 2.5 3 3 2.875

4 2 2 1 1 1.5 2 1 1 1 1.25 2 1.5 1 1 1.375

5 1 1 2 2 1.5. 1 1 1 3 1.5. 1 1 1.5. 2.5. 1.5.

6 2 1 2 2 1.75 3 2 3 3 2.75 2.5 1.5 2.5 2.5 2.25

7 1 2 1 3 1.75 2 1 1 2 1.5 1.5 1.5 1 2.5 1.625

8 3 2 2 2 2.25 2 1 1 2 1.5 2.5 1.5 1.5 2 1.875

9 2 1 3 2 2 2 1 3 2 2 2 1 3 2 2

0 3 2 2 2 2.25 2 1 2 2 1.75 2.5 1.5 2 2 2

1 2 1 1 1 1.25 2 2 1 2 1.75 2 1.5 1 1.5 1.5

2 3 3 2 2 2.5 3 3 2 2 2.5 3 3 2 2 2.5

3 3 2 2 3 2.5 2 2 1 2 1.75 2.5 2 1.5 2.5 2.125

4 3 3 3 2 2.75 1 2 2 2 1.75 2 2.5 2.5 2 2.25

5 3 3 3 3 3 3 2 3 3 2.75 3 2.5 3 3 2.875

6 3 3 3 3 3 3 2 3 3 2.75 3 2.5 3 3 2.875

7 2 1 3 1 1.75 1 1 2 2 1.5 1.5 1 2.5 1.5 1.625

8 3 2 2 2 2.25 3 2 2 3 2.5 3 2 2 2.5 2.375

9 2 2 3 2 2.25 2 2 2 2 2 2 2 2.5 2 2.125

0 3 2 2 1 2 3 3 2 2 2.5 3 2.5 2 1.5 2.25

1 3 2 1 2 2 3 3 1 3 2.5 3 2.5 1 2.5 2.25

2 1 1 2 2 1.5 2 2 3 3 2.5 1.5 1.5 2.5 2.5 2

3 3 2 3 3 2.75 2 3 2 2 2.25 2.5 2.5 2.5 2.5 2.5

4 2 3 3 2 2.5. 2 3 3 2 2.5. 2 3 3 2 2.5.

5 2 2 2 1 1.75 2 2 1 2 1.75 2 2 1.5 1.5 1.75

6 3 3 2 3 2.75 2 2 2 2 2 2.5 2.5 2 2.5 2.375

7 3 3 3 3 3 2 2 2 2 2 2.5 2.5 2.5 2.5 2.5

8 3 3 3 2 2.75 3 3 3 3 3 3 3 3 2.5 2.875

9 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

0 3 2 3 3 2.75 3 2 3 2 2.5 3 2 3 2.5 2.625

1 2 3 1 2 2 2 2 1 2 1.75 2 2.5 1 2 1.875

2 1 2 1 1 1.25 1 2 1 1 1.25 1 2 1 1 1.25

3 1 2 1 2 1.5 2 2 1 2 1.75 1 .5 2 1 2 1.625

4 3 3 3 3 3 3 3 3 2 2.75 3 3 3 2.5 2.875

5 1 2 2 1 1.5 2 2 2 3 2.25 1 .5 2 2 2 1.875

6 1 1 2 2 1.5 1 1 1 2 1.25 1 1 1.5 2 1.375

7 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2

8 1 1 1 1 1 1 2 1 2 1.5 1 1.5 1 1.5 1.25

9 3 3 2 2 2.5 1 2 1 1 1.25 2 2.5 1.5 1.5 1.875

40 2 3 2 1 2 3 2 1 1 1.75 2.5 2.5 1.5 1 1.875

41 3 2 3 3 2.75 2 2 3 2 2.25 2.5 2 3 2.5 2.5

42 1 2 1 2 1.5 2 2 2 2 2 1.5 2 1.5 2 1.75

43 3 2 2 3 2.5. 2 2 2 2 2 2.5. 2 2 2.5. 2.25.

44 2 1 1 1 1.25 3 2 2 2 2.25 2.5 1.5 1.5 1.5 1.75

45 3 3 3 3 3 3 3 2 3 2.75 3 3 2.5 3 2.875

46 2 3 3 3 2.75 2 2 1 2 1.75 2 2.5 2 2.5 2.25

47 1 2 1 2 1.5 1 1 3 2 1.75 1 1.5 2 2 1.625

48 3 3 3 3 3 2 2 2 2 2 2.5 2.5 2.5 2.5 2.5

49 2 2 3 1 2 3 3 2 3 2.75 2.5 2.5 2.5 2 2.375

0 3 2 2 2 2.25 1 1 1 2 1.25 2 1.5 1.5 2 1.75

1 2 2 3 2 2.25 3 3 3 2 2.75 2.5 2.5 3 2 2.5

2 2 2 3 2 2.25 3 3 2 2 2.5 2.5 2.5 2.5 2 2.375

3 3 2 2 2 2.25 3 2 1 2 2 3 2 1.5 2 2.125

4 3 3 2 2 2.5 2 2 3 2 2.25 2.5 2.5 2.5 2 2.375

5 1 1 2 2 1.5 1 1 2 2 1.5 1 1 2 2 1.5

6 2 1 1 2 1.5 1 2 2 2 1.75 1.5 1.5 1.5 2 1.625

7 2 3 3 3 2.75 3 3 2 3 2.75 2.5 3 2.5 3 2.75

8 1 1 1 1 1 1 2 2 2 1.75 1 1.5 1.5 1.5 1.375

9 1 1 2 2 1.5 2 2 1 1 1.5 1.5 1.5 1.5 1.5 1.5

0 2 1 2 2 1.75 3 3 3 3 3 2.5 2 2.5 2.5 2.375

1 2 1 1 2 1.5 2 1 1 2 1.5 2 1 1 2 1.5

2 1 2 2 2 1.75. 2 2 2 2 2 1.5. 2 2 2 1.875.

3 1 2 1 1 1.25 1 1 1 1 1 1 1.5 1 1 1.125

4 2 1 1 2 1.5 1 1 1 2 1.25 1 .5 1 1 2 1.375

5 3 2 1 2 2 1 2 2 2 1.75 2 2 1.5 2 1.875

6 2 2 1 2 1.75 3 3 1 3 2.5 2.5 2.5 1 2.5 2.125

7 2 2 2 2 2 3 2 2 2 2.25 2.5 2 2 2 2.125

8 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3

9 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

0 2 3 3 2 2.5 2 2 3 2 2.25 2 2.5 3 2 2.375

1 3 3 3 2 2.75 2 3 3 2 2.5 2.5 3 3 2 2.625

2 2 2 2 2 2 3 2 3 3 2.75 2.5 2 2.5 2.5 2.375

3 2 2 1 3 2 2 2 1 2 1.75 2 2 1 2.5 1.875

4 2 3 3 3 2.75 2 2 1 2 1.75 2 2.5 2 2.5 2.25

5 2 1 1 2 1.5 1 1 1 2 1.25 1 .5 1 1 2 1.375

6 3 2 1 3 2.25 2 2 1 2 1.75 2.5 2 1 2.5 2

7 2 2 1 1 1.5 2 2 2 2 2 2 2 1.5 1.5 1.75

8 3 3 3 3 3 3 2 2 2 2.25 3 2.5 2.5 2.5 2.625

9 2 1 2 2 1.75 2 2 1 3 2 2 1.5 1.5 2.5 1.875

0 1 1 1 2 1.25 1 2 2 3 2 1 1.5 1.5 2.5 1.625

1 2 2 1 2 1 75. 3 1 2 2 2 2 5. 1 5. 1 5. 2 1 875.

2 1 1 1 2 1.25 3 1 1 2 1.75 2 1 1 2 1.5

3 2 1 1 2 1.5 3 3 1 1 2 2.5 2 1 1.5 1.75

4 2 2 1 1 1.5 1 1 1 1 1 1.5 1.5 1 1 1.25

5 1 1 1 1 1 1 1 2 2 1.5 1 1 1.5 1.5 1.25

6 1 1 2 2 1.5 1 2 1 2 1.5 1 1.5 1.5 2 1.5

7 2 2 2 3 2.25 2 2 1 2 1.75 2 2 1.5 2.5 2

8 2 2 1 2 1.75 2 2 1 3 2 2 2 1 2.5 1.875

9 2 2 1 2 1.75 1 2 1 2 1.5 1.5 2 1 2 1.625

0 1 1 1 2 1.25 2 1 1 2 1.5 1.5 1 1 2 1.375

1 1 1 1 2 1.25 1 1 1 2 1.25 1 1 1 2 1.25

2 2 2 2 2 2 1 1 1 2 1.25 1.5 1.5 1.5 2 1.625

3 3 2 3 3 2.75 1 1 2 1 1.25 2 1.5 2.5 2 2

4 3 2 2 2 2.25 2 3 2 2 2.25 2.5 2.5 2 2 2.25

1.99 1.95 2.04 1.93 1.84 2.07 1.97


6/10

GET DATA /TYPE=XLSX

/FILE='C:\MyFiles\MyFiles\UL SACS Gen Ed Assessment\Fall 2008 English 102 CEA Excel.xls

x'

/SHEET=name 'Sheet1'

/CELLRANGE=full

/READNAMES=on

/ASSUMEDSTRWIDTH=32767.

DATASET NAME DataSet1 WINDOW=FRONT.

SAVE OUTFILE='C:\MyFiles\MyFiles\UL SACS Gen Ed Assessment\Fall 2008 English 102 CEA Data

.sav'

/COMPRESSED.

FREQUENCIES VARIABLES=Content1 Organization1 Research1 Language1 Overall1 Content2 Organi

zation2 Research2 Language2 Overall2 Conten

tx Organizationx Researchx Languagex Overallx

/STATISTICS=MEAN MEDIAN MODE

/ORDER=ANALYSIS.

Frequencies

[DataSet1] C:\MyFiles\MyFiles\UL SACS Gen Ed Assessment\Fall 2008 English 102 CEA Data.sa

v

Organization2Content2Overall1Language1Research1Organization1Content1

Valid

Missing

Mean

MedianMode

N

221.50002122

2.002.002.0000002.002.002.002.00

1.932.011.9920212.051.901.942.07

0000000

94949494949494

Statistics

ResearchxOrganizationxContentxOverall2Language2Research2

Valid

Missing

Mean

Median

Mode

N

1.00002.00002.50001.750021

1.5000002.0000002.0000002.0000002.002.00

1.8351061.9308512.0425531.9494682.101.77

000000

949494949494

Statistics

OverallxLanguagex

Valid

Missing

Mean

Median

Mode

N

1.87502.0000

1.8750002.000000

1.9707452.074468

00

9494

Statistics

Page 1


7/10

Frequency Table

CumulativePercentValid PercentPercentFrequency

1

2

3

Total

Valid

100.0100.094

100.034.034.032

66.039.439.437

26.626.626.625

Content1


12

3

Total

Valid

100.0100.094

100.023.423.422

76.646.846.844

29.829.829.828

Organization1


1

2

3

Total

Valid

100.0100.094

100.028.728.727

71.333.033.031

38.338.338.336

Research1


1

2

3

Total

Valid

100.0100.094

100.025.525.524

74.554.354.351

20.220.220.219

Language1

Cumulative

PercentValid PercentPercentFrequency1

1.25

1.5

Valid

34.019.119.118

14.98.58.58

6.46.46.46

Overall1

Page 2


8/10


1.75

2

2.25

2.5

2.75

3

Total

Valid

100.0100.094

100.08.58.58

91.512.812.812

78.77.47.47

71.311.711.711

59.612.812.812

46.812.812.812

Overall1


1

2

3Total

Valid

100.0100.094

100.029.829.828

70.241.541.539

28.728.728.727

Content2


1

2

3

Total

Valid

100.0100.094

100.020.220.219

79.852.152.149

27.727.727.726

Organization2


1

2

3

Total

Valid

100.0100.094

100.020.220.219

79.836.236.234

43.643.643.641

Research2


1

23

Total

Valid

100.0100.094

100.021.321.320

78.767.067.063

11.711.711.711

Language2

Page 3


9/10


1

1.25

1.5

1.75

2

2.25

2.5

2.75

3

Total

Valid

100.0100.094

100.04.34.34

95.79.69.69

86.210.610.610

75.59.69.69

66.017.017.016

48.920.220.219

28.713.813.813

14.910.610.610

4.34.34.34

Overall2

Cumulative

PercentValid PercentPercentFrequency1

1.5

2

2.5

3

Total

Valid

100.0100.094

100.014.914.914

85.127.727.726

57.424.524.523

33.017.017.016

16.016.016.015

Contentx


11.5

2

2.5

3

Total

Valid

100.0100.094

100.08.58.58

91.524.524.523

67.027.727.726

39.423.423.42216.016.016.015

Organizationx


1

1.5

2

2.5

3

Total

Valid

100.0100.094

100.013.813.813

86.218.118.117

68.116.016.015

52.125.525.524

26.626.626.625

Researchx

Page 4


10/10


1

1.5

2

2.5

3

Total

Valid

100.0100.094

100.06.46.46

93.630.930.929

62.841.541.539

21.313.813.813

7.47.47.47

Languagex


1

1.125

1.25

1.3751.5

1.625

1.75

1.875

2

2.125

2.25

2.375

2.5

2.625

2.75

2.875

3

Total

Valid

100.0100.094

100.01.11.11

98.96.46.46

92.61.11.11

91.53.23.23

88.37.47.47

80.98.58.58

72.38.58.58

63.85.35.35

58.57.47.47

51.111.711.711

39.47.47.47

31.98.58.58

23.47.47.47

16.06.46.46

9.66.46.46

3.21.11.11

2.12.12.12

Overallx

Page 5

CEA Report Fall 2008

Documents

Transcript of CEA Report Fall 2008