Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking...

64
Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention Presentation Cheryl Thompson-Stacy, Ed.D. President Lord Fairfax Community College John Milam, Ph.D. Director, Planning & Institutional Effectiveness Lord Fairfax Community College

Transcript of Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking...

Page 1: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs

AACC 2014 Convention Presentation

Cheryl Thompson-Stacy, Ed.D.PresidentLord Fairfax Community College

John Milam, Ph.D.Director, Planning & Institutional EffectivenessLord Fairfax Community College

Page 2: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Some Questions about Online Courses

• Can we serve more students by offering online courses? (enrollment)

• How do you ensure academic quality with an adequate number of full-time faculty with adjuncts teaching online? (quality, staffing)

• How does an increase in online course offerings impact our physical space requirements? (space)

• What is the impact on the institution if distance programs continue to grow? (change)

• How do we monitor changes in program offerings online? (programs)

• How do success rates in online courses compare to those in courses with other delivery modes? (success)

• Does taking courses online affect program completion? (success)

• What do we know about the cost of DL and how do we use the results? (cost)

Page 3: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Context - Enrollment

• In 2013, the number of students taking online courses rose 411K to 7.1 million (Grade Change, 2014).

• The online growth rate of 6.1% is the lowest reported since the report series has been tracking the data (Grade Change, 2014).

• The proportion of students taking at least one online course is at its highest at 33.5% (Grade Change, 2014).

• Approximately half of community college students take classes online (Not Yet Sold, 2013).

• The demand for distance learning courses in community colleges is growing “at a rate that is much greater than the demand for on-campus, face-to-face courses” (ITC Trends in eLearning, 2013)

• The typical online program “does not offer enough courses to meet student demand” (ITC Trends in eLearning 2013).

Page 4: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Allen, I.E. and Seaman, J. (2014). “Grade Change: Tracking Online Education in the United States.” Babson Survey Research Group and Quahog Research Group, LLC.

Page 5: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Context - Quality

• Large institutions are most likely to offer online courses and have the most positive views on their relative quality. BA schools have the most negative attitudes (Grade Change, 2014).

• Associate’s degree institutions have the “most favorable view towards online” and were among the earliest adopters (Grade Change, 2014).

• Over 85% of schools have implemented some form of standards or best practices in online courses (WCET Managing Online Education 2013).

• Online administration “has shifted so that more academic administrators… are responsible for distance education, rather than library services or the IT department” (ITC Trends in eLearning, 2013).

• Colleges are developing “strategies to improve overall course quality, consistency, retention and assessment” (ITC Trends in eLearning, 2013).

• In 2012, full-time faculty taught 60% of online sections (ITC Trends in eLearning, 2013).

Page 6: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Context - Assessment

• 74% of chief academic officers say learning outcomes in online courses are the same or superior to face-to-face (Grade Change, 2014).

• Few faculty strongly agree that online courses can achieve student learning outcomes equivalent to in-person (2013 Higher Ed Survey of Faculty Attitudes on Technology).

• “The gap between DL and face-to-face student completion rates has significantly narrowed” (ITC Trends in eLearning, 2013).

• Completion rates average 4.6% higher for on-campus than online courses (WCET Managing Online Education 2013).

• “The principal barriers [to the future of online education] are the lack of hard evidence about both learning outcomes and potential cost savings” (William G. Bowen, Chronicle, 3/25/13).

Page 7: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Context – Trends affecting online education

1. Declining unemployment

2. Declining number of high school students

3. Tuition increasing faster than financial aid and inflation

4. Many more people still don’t have degrees

5. Many degree programs don’t have online options (The Online Learning Curve, 2014).

6. According to Bill Gates’s at ACCT, MOOCs could help two-year colleges and their students (Chronicle, 10/3/13).

7. For some community colleges, however, MOOCs may be better suited for orientation and becoming college ready. For others, “The flipped classroom can work here” (Community College Times, 10/28/13).

Page 8: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

• Student enrollment trends

• Course trends

• Instructor type

• Course success

• Course obstacles to completion

• Course/space utilization

• Credit hour production by program, general education competency, location, & type of faculty

• Costs

Online Course Data Points of Interest

Page 9: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Student enrollment trends

Page 10: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Fall Student headcount enrollment trends by type

2008 2009 2010 2011 2012 2013

Total Enrollment 5,867 6,644 7,005 7,270 7,288 7,238

Dual enrollment 1,475 1,628 1,843 1,781 2,054 2,099

Non-DE 4,392 5,016 5,162 5,489 5,234 5,139

Total in DL 1,498 2,023 2,352 2,882 2,738 2,913

Total only in DL 403 514 659 849 811 891

0

500

1,000

1,500

2,000

2,500

3,000

3,500

4,000

4,500

5,000

5,500

6,000

6,500

7,000

7,500

Page 11: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Student characteristics by DL Enrollment Type

891 639 252

49

737

105

93

798 861 3067 222

669 594297

418125 137 30

762129

4,325 3,214 1,111 1,6122,580

133

883

3,442

4,196

129

671

1,855 2,4702,242

2,083

1,339309

312

1073,491

834

2,022 1,498 524

309

1,579134

987

1,0351,930

92 478

6671,355 1,393

629

1,232261

354

421,641 381

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Distance only No distance Mixed delivery

___________________________________________________________________

Fall 2013 End-of-term headcount enrollment

___________________________________________________________________

Page 12: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Course trends

Page 13: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Course Trends by Subject, Delivery Mode, & Course

Page 14: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Sections by Delivery Mode

Compressed video Hybrid Face-to-face Online

FA09 54 33 677 83

FA10 64 43 700 107

FA11 48 85 700 131

FA12 47 94 691 136

FA13 46 83 633 156

SP14 47 69 498 170

0

100

200

300

400

500

600

700

800

FA09 FA10 FA11 FA12 FA13 SP14

Excludes DE, MTE, and labs. Source: LF_CLASSES_BY_ACAD_ORG SIS query

Page 15: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Enrollment Seats by Delivery Mode

Compressed video Hybrid Face-to-face Online

FA09 549 640 12,626 1,841

FA10 656 730 12,458 2,291

FA11 435 1,327 11,933 2,892

FA12 402 1,242 10,954 2,796

FA13 400 1,129 10,274 3,407

SP14 367 929 8,286 3,613

0

2,000

4,000

6,000

8,000

10,000

12,000

14,000

FA09 FA10 FA11 FA12 FA13 SP14

Excludes DE, MTE, and labs. Source: LF_CLASSES_BY_ACAD_ORG SIS query

Page 16: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Sections by Delivery Mode - %

FA09 SP10 FA10 SP11 FA11 SP12 FA12 SP13 FA13 SP14

Online 9.8% 12.5% 11.7% 14.5% 13.6% 16.0% 14.0% 17.1% 17.0% 21.7%

Face-to-face 79.9% 75.8% 76.6% 71.3% 72.6% 68.0% 71.4% 67.3% 69.0% 63.5%

Hybrid 3.9% 5.0% 4.7% 5.8% 8.8% 9.8% 9.7% 8.9% 9.0% 8.8%

Compressed video 6.4% 6.7% 7.0% 8.4% 5.0% 6.3% 4.9% 6.8% 5.0% 6.0%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Compressed video Hybrid Face-to-face Online

Excludes DE, MTE, and labs. Source: LF_CLASSES_BY_ACAD_ORG SIS query

Page 17: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Enrollment Seats by Delivery Mode - %

FA09 SP10 FA10 SP11 FA11 SP12 FA12 SP13 FA13 SP14

Online 11.8% 16.5% 14.2% 18.7% 17.4% 21.2% 18.2% 22.5% 22.4% 27.4%

Face-to-face 80.6% 75.3% 77.2% 71.5% 71.9% 67.0% 71.2% 65.6% 67.5% 62.8%

Hybrid 4.1% 4.3% 4.5% 5.3% 8.0% 8.6% 8.1% 8.4% 7.4% 7.0%

Compressed video 3.5% 3.8% 4.1% 4.5% 2.6% 3.2% 2.6% 3.4% 2.6% 2.8%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Compressed video Hybrid Face-to-face Online

Excludes DE, MTE, and labs. Source: LF_CLASSES_BY_ACAD_ORG SIS query

Page 18: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Face-to-Face Sections by Campus

172

505

155

457

174

526

162

485

169

531

148

450

186

505

171

456

165

468

119

379

0

100

200

300

400

500

600

Fauquier Middletown

FA09 SP10 FA10 SP11 FA11 SP12 FA12 SP13 FA13 SP14

Excludes DE, MTE, and labs. Source: LF_CLASSES_BY_ACAD_ORG SIS query

Page 19: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Face-to-Face Enrollment Seats by Campus

3,287

9,339

2,835

8,043

2,986

9,472

2,692

7,747

2,886

9,047

2,254

7,579

2,688

8,266

2,154

6,826

2,449

7,825

1,913

6,373

0

1,000

2,000

3,000

4,000

5,000

6,000

7,000

8,000

9,000

10,000

Fauquier Middletown

FA09 SP10 FA10 SP11 FA11 SP12 FA12 SP13 FA13 SP14

Excludes DE, MTE, and labs. Source: LF_CLASSES_BY_ACAD_ORG SIS query

Page 20: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Sections by Distance Delivery Mode & Campus

FC Video MC Video FC Hybrid MC Hybrid FC Online MC Online

FA09 19 35 24 9 30 53

FA10 24 40 19 24 48 59

FA11 21 27 28 57 54 77

FA12 20 27 25 69 53 83

FA13 19 27 26 57 65 91

SP14 21 26 25 44 69 101

0

20

40

60

80

100

120

FA09 FA10 FA11 FA12 FA13 SP14

Excludes DE, MTE, and labs. Source: LF_CLASSES_BY_ACAD_ORG SIS query

Page 21: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Enrollment Seats by Delivery Mode & Campus

FC Video MC Video FC Hybrid MC Hybrid FC Online MC Online

FA09 97 452 452 188 641 1,200

FA10 155 501 358 372 1,021 1,270

FA11 104 331 432 895 1,238 1,654

FA12 82 320 235 1,007 1,141 1,655

FA13 90 310 296 833 1,511 1,896

SP14 107 260 309 620 1,450 2,163

0

500

1,000

1,500

2,000

2,500

FA09 FA10 FA11 FA12 FA13 SP14

Excludes DE, MTE, and labs. Source: LF_CLASSES_BY_ACAD_ORG SIS query

Page 22: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Online Enrollment by Subject

0 500 1,000 1,500 2,000 2,500 3,000 3,500

SPA

SOC

SDV

REL

PSY

PLS

PHY

PHI

NUR

NAS

MUS

MTH

MTE

MKT

LGL

ITP

ITN

ITE

ITD

INT

HUM

HLT

HIS

HIM

GOL

GEO

ENG

EDU

ECO

CST

CIV

CHM

CHD

BUS

BSK

BIO

AST

ASL

ART

ARC

ACC

FA09

SP10

FA10

SP11

FA11

SP12

FA12

SP13

FA13

SP14

Page 23: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Online Enrollment by Subject at Middletown Campus

0 200 400 600 800 1,000 1,200 1,400 1,600 1,800

SPA

SOC

SDV

REL

PSY

PLS

PHY

PHI

NUR

NAS

MTH

MKT

LGL

ITP

ITN

ITE

ITD

INT

HUM

HLT

HIS

HIM

GOL

ENG

EDU

ECO

CST

CIV

CHM

CHD

BUS

FA09

SP10

FA10

SP11

FA11

SP12

FA12

SP13

FA13

SP14

Page 24: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Online Enrollment by Subject at Fauquier Campus

0 200 400 600 800 1,000 1,200 1,400 1,600 1,800

SOC

REL

PSY

PLS

PHI

NUR

MUS

MTH

MTE

MKT

ITP

ITN

ITE

ITD

HUM

HLT

HIS

HIM

GOL

GEO

ENG

EDU

ECO

CST

CHM

CHD

BUS

BSK

BIO

ASL

ART

FA09

SP10

FA10

SP11

FA11

SP12

FA12

SP13

FA13

SP14

Page 25: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Top Online Course Enrollments

0 200 400 600 800 1,000 1,200 1,400 1,600 1,800 2,000

SOC 200

SDV 101

PSY 230

PSY 200

PHI 220

ITE 115

HLT 215

HLT 160

HLT 130

HIS 122

HIS 121

HIS 112

HIS 111

GOL 106

GOL 105

ENG 242

ENG 241

ENG 112

ENG 111

ECO 202

ECO 201

CST 100

BUS 100

BIO 102

BIO 101

ART 283

ART 102

ART 101

FA05

FA06

FA07

FA08

FA09

FA10

FA11

FA12

Page 26: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Instructor type

Page 27: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Face-to-Face Sections by Instructor Type

407

270

360

252

425

275

409

238

462

238

384

214

435

256

376

251

375

258263

235

0

50

100

150

200

250

300

350

400

450

500

Adjunct Full-time faculty

FA09 SP10 FA10 SP11 FA11 SP12 FA12 SP13 FA13 SP14

Excludes DE, MTE, and labs. Source: LF_CLASSES_BY_ACAD_ORG SIS query

Page 28: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Face-to-Face Enrollment by Instructor Type

7,295

5,331

5,758

5,120

6,941

5,517

5,986

4,453

7,391

4,542

5,920

3,913

6,537

4,417

5,070

3,910

5,640

4,634

4,151 4,135

0

1000

2000

3000

4000

5000

6000

7000

8000

Adjunct Full-time faculty

FA09 SP10 FA10 SP11 FA11 SP12 FA12 SP13 FA13 SP14

Excludes DE and MTE, and labs. Source: LF_CLASSES_BY_ACAD_ORG SIS query

Page 29: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Sections by Distance Mode & Instructor Type

Video-Adj Video-FT Hybrid-Adj Hybrid-FT Online-Adj Online-FT

FA09 24 30 9 24 50 33

FA10 33 31 21 22 68 39

FA11 30 18 43 42 82 49

FA12 30 17 54 40 79 57

FA13 30 16 47 36 87 69

SP14 28 19 38 31 96 74

0

10

20

30

40

50

60

70

80

90

100

FA09 FA10 FA11 FA12 FA13 SP14

Excludes DE, MTE, and labs. Source: LF_CLASSES_BY_ACAD_ORG SIS query

Page 30: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Enrollment by Distance Mode & Instructor Type

Video - Adj Video-FT Hybrid-Adj Hybrid-FT Online-Adj Online-FT

FA09 248 301 209 431 1,111 730

FA10 324 332 333 397 1,511 780

FA11 278 157 635 692 1,802 1,090

FA12 237 165 733 509 1,685 1,111

FA13 248 152 602 527 1,925 1,482

SP14 201 166 453 476 2,100 1,513

-300

200

700

1,200

1,700

2,200

FA09 FA10 FA11 FA12 FA13 SP14

Excludes DE, MTE, and labs. Source: LF_CLASSES_BY_ACAD_ORG SIS query

Page 31: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Sections by Distance Mode & Instructor Type - %

FA09 SP10 FA10 SP11 FA11 SP12 FA12 SP13 FA13 SP14

Online-FT 39.8% 40.6% 36.4% 40.9% 37.4% 37.6% 41.9% 42.1% 44.2% 43.5%

Online-Adj 60.2% 59.4% 63.6% 59.1% 62.6% 62.4% 58.1% 57.9% 55.8% 56.5%

Hybrid-FT 72.7% 55.0% 51.2% 58.5% 49.4% 41.9% 42.6% 41.0% 43.4% 44.9%

Hybrid-Adj 27.3% 45.0% 48.8% 41.5% 50.6% 58.1% 57.4% 59.0% 56.6% 55.1%

Video-FT 55.6% 51.9% 48.4% 44.7% 37.5% 43.6% 36.2% 41.3% 34.8% 40.4%

Video - Adj 44.4% 48.1% 51.6% 55.3% 62.5% 56.4% 63.8% 58.7% 65.2% 59.6%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Video - Adj Video-FT Hybrid-Adj Hybrid-FT Online-Adj Online-FT

Excludes DE, MTE, and labs. Source: LF_CLASSES_BY_ACAD_ORG SIS query

Page 32: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Enrollment by Distance Mode & Instructor Type %

FA09 SP10 FA10 SP11 FA11 SP12 FA12 SP13 FA13 SP14

Online-FT 39.7% 38.1% 34.0% 35.2% 37.7% 35.0% 39.7% 39.4% 43.5% 41.9%

Online-Adj 60.3% 61.9% 66.0% 64.8% 62.3% 65.0% 60.3% 60.6% 56.5% 58.1%

Hybrid-FT 67.3% 55.0% 54.4% 61.6% 52.1% 42.0% 41.0% 43.5% 46.7% 51.2%

Hybrid-Adj 32.7% 45.0% 45.6% 38.4% 47.9% 58.0% 59.0% 56.5% 53.3% 48.8%

Video-FT 54.8% 47.9% 50.6% 41.5% 36.1% 42.0% 41.0% 42.8% 38.0% 45.2%

Video - Adj 45.2% 52.1% 49.4% 58.5% 63.9% 58.0% 59.0% 57.2% 62.0% 54.8%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Video - Adj Video-FT Hybrid-Adj Hybrid-FT Online-Adj Online-FT

Excludes DE, MTE, and labs. Source: LF_CLASSES_BY_ACAD_ORG SIS query

Page 33: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Online Sections by Subject & Instructor Type % – AY 2013-14

0

9

12

7

0

4

1

4

0

1

2

14

49

0

1

0

0

7

2

0

21

17

7

6

4

16

0

9

0

5

4

3

4

4

1

1

11

6

6

4

3

0

15

0

1

3

3

0

0

9

0

5

0

2

4

10

0

3

10

4

4

0

0

19

3

0

12

5

4

6

0

8

0

0

0

0

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

SPA

SOC

SDV

REL

PSY

PLS

PHY

PHI

NUR

NAS

MUS

MTH

MTE

MKT

LGL

ITP

ITN

ITE

ITD

HUM

HLT

HIS

HIM

GOL

GEO

ENG

EDU

ECO

CST

CHM

CHD

BUS

BSK

BIO

AST

ASL

ART

ACC

Adjunct Full-time

Page 34: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Online Enrollment by Subject & Instructor Type % - AY13-14

0

214

306

119

0

83

9

116

0

14

41

272

129

0

11

0

0

133

32

0

548

417

197

122

99

384

0

212

0

95

67

74

2

53

9

9

265

122

112

107

58

0

352

0

15

70

31

0

0

111

0

100

0

36

51

265

0

54

223

115

92

0

0

406

43

0

315

78

61

145

0

155

0

0

0

0

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

SPA

SOC

SDV

REL

PSY

PLS

PHY

PHI

NUR

NAS

MUS

MTH

MTE

MKT

LGL

ITP

ITN

ITE

ITD

HUM

HLT

HIS

HIM

GOL

GEO

ENG

EDU

ECO

CST

CHM

CHD

BUS

BSK

BIO

AST

ASL

ART

ACC

Adjunct Full-time

Page 35: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Course Success

Page 36: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Course Success Rates by Delivery Mode

71.3%74.1%

72.3%

78.1%

71.3%

77.4%

72.7%

77.3%

72.6%

78.3%

72.1%

76.9%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Online Face-to-Face

2009-10 2010-11 2011-12 2012-13 2013-14 5 Year Average

Excludes DE & MTE. Source: LF_IR_GRADE_DISTRIBUTION SIS query

Page 37: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Online Course Success Rates by Campus

68.9%

72.8%70.8%

73.3%69.7%

72.4%70.0%

74.5%

70.1%

74.2%

70.0%73.5%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Fauquier campus Middletown campus

2009-10 2010-11 2011-12 2012-13 2013-14 5 Year Average

Excludes DE & MTE. Source: LF_IR_GRADE_DISTRIBUTION SIS query

Page 38: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

5 Year Average Online Course Success Rates by Subject

70%

79%

75%

72%

69%

78%

88%

76%

99%

63%

66%

65%

69%

75%

74%

60%

82%

70%

65%

68%

68%

73%

71%

77%

76%

84%

67%

67%

83%

69%

71%

70%

66%

74%

77%

100%

69%

83%

67%

83%

72%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

SPA

SOC

SDV

REL

PSY

PLS

PHY

PHI

NUR

NAS

MUS

MTH

MKT

MEC

LGL

ITP

ITN

ITE

ITD

INT

HUM

HLT

HIS

HIM

GOL

GEO

ENG

EGR

EDU

ECO

CST

CIV

CHM

CHD

BUS

BSK

BIO

AST

ASL

ART

ARC

Page 39: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Course Success by Instructor Type & Delivery Mode

Excludes DE & MTE. Source: LF_IR_GRADE_DISTRIBUTION SIS query for spring & fall 2013

81.5%

72.0% 73.3%

78.6%82.6%

68.2%

79.0%75.0%

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

100.0%

Compressed Video Online Hybrid Face-to-Face

Adjunct Full-time

Page 40: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Withdrawals by Instructor Type & Delivery Mode

Excludes DE & MTE. Source: LF_IR_GRADE_DISTRIBUTION SIS query for spring & fall 2013

4.1%6.5% 7.1%

4.1%5.4%9.3%

5.7% 6.2%

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

100.0%

Compressed Video Online Hybrid Face-to-Face

Adjunct Full-time

Page 41: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Course Obstacles to Completion

Page 42: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Course Obstacles Study – Overall ResultsCourse Success by Completers vs. Non-Completers by Degree/Plan 12/3/13

Subtotal Success W Subtotal Success W

AA&S 36,157 87.7% 3.3% 41,787 59.1% 7.8% 77,944 -28.5% 4.5% 46.4%

AAS 7,336 91.6% 1.9% 9,423 64.5% 7.2% 16,759 -27.1% 5.3% 43.8%

CERT 3,954 89.4% 2.5% 9,984 63.7% 6.9% 13,938 -25.7% 4.4% 28.4%

CSC 1,411 84.0% 3.2% 2,645 59.5% 6.1% 4,056 -24.4% 2.9% 34.8%

Nondegree 8,150 91.2% 2.5% 8,975 74.6% 4.9% 17,125 -16.6% 2.5% 47.6%

Grand Total 57,008 88.7% 2.9% 72,814 62.4% 7.2% 129,822 -26.3% 4.2% 43.9%

Difference

in Success

Difference

in W Rate

% Grades

to GradsDegree/Plan

Completers Non-Completers Total

Grades

Based on the work of Zeidenberg, Mathew et al. (2013). “Not Just Math and English: Courses That Pose Obstacles to Community College Completion.” CCRC Working Paper No. 52. Community College Research Center, Teachers College, Columbia University.

Source: SIS Queries LF_SR_SEARCH_GRADES and LF_GRADUATES, VCCS A Record Census files for terms 2053 through 2133.

Notes: Includes courses taken over these terms by all new students who entered from summer 2053 through summer 2011, tracking their coursework over time through summer 2013. Excludes blank grades, such as for the lab component.Cells marked with conditional formatting where difference between non-completers and completers is > 25.0%. Completers include all award levels. Degree and program are listed for the most recent semester. Excludes ICDUAL courses.

Page 43: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Course Obstacles Study – Courses taken w/in program

Course Success by Completers vs. Non-Completers by Degree/Plan for Top Obstacle Courses with >50 Grades 12/3/13

Subtotal Success W Subtotal Success W

AA&S 18,755 87.5% 3.3% 23,180 58.5% 8.0% 41,935 -29.0% 4.7% 44.7%

Business Administration 2,636 89.6% 2.8% 3,200 56.0% 9.5% 5,836 -33.6% 6.7% 45.2%

ACC 211 206 90.3% 1.9% 245 56.3% 12.7% 451 -34.0% 10.7% 45.7%

BIO 101 122 91.0% 2.5% 137 49.6% 11.7% 259 -41.3% 9.2% 47.1%

BIO 102 111 91.0% 1.8% 57 61.4% 5.3% 168 -29.6% 3.5% 66.1%

ECO 201 216 79.6% 3.7% 156 45.5% 13.5% 372 -34.1% 9.8% 58.1%

ENG 111 186 96.8% 0.0% 424 57.8% 7.5% 610 -39.0% 7.5% 30.5%

ENG 112 200 91.0% 1.0% 259 53.7% 15.4% 459 -37.3% 14.4% 43.6%

ENG 241 184 82.1% 9.2% 62 46.8% 11.3% 246 -35.3% 2.1% 74.8%

ENG 242 164 86.6% 5.5% 35 42.9% 31.4% 199 -43.7% 25.9% 82.4%

HIS 111 121 93.4% 1.7% 201 63.2% 6.0% 322 -30.2% 4.3% 37.6%

HIS 112 108 93.5% 1.9% 118 53.4% 14.4% 226 -40.1% 12.6% 47.8%

HIS 121 98 79.6% 6.1% 172 51.7% 8.1% 270 -27.8% 2.0% 36.3%

HIS 122 87 87.4% 3.4% 118 56.8% 7.6% 205 -30.6% 4.2% 42.4%

ITE 115 154 97.4% 1.3% 267 57.3% 8.2% 421 -40.1% 6.9% 36.6%

MTH 151 34 97.1% 0.0% 42 54.8% 0.0% 76 -42.3% 0.0% 44.7%

MTH 163 171 85.4% 4.7% 179 50.3% 14.5% 350 -35.1% 9.8% 48.9%

MTH 240 87 87.4% 3.4% 49 53.1% 10.2% 136 -34.3% 6.8% 64.0%

PSY 200 59 91.5% 0.0% 85 49.4% 12.9% 144 -42.1% 12.9% 41.0%

SDV 100 196 95.4% 0.5% 458 64.2% 3.5% 654 -31.2% 3.0% 30.0%

SPD 100 80 97.5% 1.3% 80 63.8% 7.5% 160 -33.8% 6.3% 50.0%

Difference

in Success

Difference

in W Rate

% Grades

to GradsSubject/ Course

Completers Non-Completers

Total Grades

Page 44: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Course Success by Completers & Delivery Mode

91.3%

83.6%

91.3% 89.7% 88.7%

65.5%

57.5%

63.1% 63.1% 62.4%

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

100.0%

Compressed Video Online Hybrid Face-to-Face Overall

Completers Non-completers

Page 45: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Course Withdrawal Rate by Delivery Mode

1.6%5.0%

2.6% 2.5% 2.9%6.7%

9.8% 8.1% 6.7% 7.2%

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

100.0%

Compressed Video Online Hybrid Face-to-Face Overall

Completers Non-completers

Page 46: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Online Course Success by Completers & Award Level

82.7%85.8%

78.3% 80.0%

87.4%83.6%

51.9%

61.6%

56.7%

47.6%

77.7%

57.5%

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

100.0%

AA&S AAS CERT CSC Non-degree Overall

Completers Non-completers

Page 47: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Online Course Withdrawal Rate by Award Level

5.4% 3.8%6.5% 7.6%

3.8% 5.0%

11.7%8.8% 8.2% 8.3%

5.4%9.8%

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

100.0%

AA&S AAS CERT CSC Non-degree Overall

Completers Non-completers

Page 48: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Course/Space Utilization

Page 49: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Average Enrollment per Online Course

Page 50: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Capacity Utilization per Online Course

Page 51: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Credits generated by program, general education competency,

location, & type of faculty

Page 52: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Program Courses Offered by Requirement & Location

Page 53: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Program Courses Offered by Requirement & High School

Page 54: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

DL SCH Taught by Program, Course, Term, & Instructor Type

Page 55: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

DL SCH Taught by Program, Term, & Instructor Type

Page 56: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

DL SCH by Competency, Term, & Instructor Type

Page 57: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Costs

Page 58: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

VCCS Distance Learning Cost Model

• Analyze cost per section and cost per student FTE for online vs. traditional, classroom delivery across the VCCS system

• Assemble relatively accessible data, using estimates where needed of workload, salaries, & space utilization

• Utilize course data extracted from SIS with instructor of record

• Report institutional differences overall

• Report disciplinary differences

• Report differences for individual courses w/ large enrollments

• Results provide insight into the variation that exists within a college in different disciplines and between colleges in the same discipline

• Results provide benchmarks for specific courses

Page 59: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

% Sections & Student FTE Taught Online

14.7% 16.3%

18.6% 18.4%

0.0%

5.0%

10.0%

15.0%

20.0%

25.0%

30.0%

35.0%

Online sections Online FTEBR291 CV292 DC279 ES284 GC297 JT290 LF298 ME299 NR275 NV280

PC277 PH285 PV282 RC278 SR283 SV276 SW294 TC295 TN293 Total

VCCS Data for Academic Year 2010-11

Page 60: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Weighted Cost per FTE – Online vs. Face-to-face

$1,025

$859

$984

$910

$0

$100

$200

$300

$400

$500

$600

$700

$800

$900

$1,000

$1,100

$1,200

$1,300

Face-to-face OnlineBR291 CV292 DC279 ES284 GC297 JT290 LF298 ME299 NR275 NV280

PC277 PH285 PV282 RC278 SR283 SV276 SW294 TC295 TN293 Average

VCCS Data for Academic Year 2010-11

Page 61: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Cost per Online FTE by Selected Disciplines

$722 $951

$647

$906 $993 $1,043

$713

$938

$-

$500

$1,000

$1,500

$2,000

$2,500

$3,000

BUS ENG HLT ITEBR291 CV292 DC279 ES284 GC297 JT290 LF298 ME299 NR275 NV280

PC277 PH285 PV282 RC278 SR283 SV276 SW294 TC295 TN293 Average

VCCS Data for Academic Year 2010-11

Page 62: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Difference in Cost per FTE between Full-time & Adjunct Faculty by Delivery Mode

$425

$630

$443

$537

$0

$200

$400

$600

$800

$1,000

$1,200

Face-to-face OnlineBR291 CV292 DC279 ES284 GC297 JT290 LF298 ME299 NR275 NV280

PC277 PH285 PV282 RC278 SR283 SV276 SW294 TC295 TN293 Average

VCCS Data for Academic Year 2010-11

Page 63: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Presenters:

Lord Fairfax Community College

Dr. Cheryl [email protected](540) 868-7101

Dr. John MilamDirector of Planning & Institutional [email protected](540) 868-7249

Page 64: Tracking Online Courses to Ensure Quality, Monitor Change, and … · 2019. 9. 13. · Tracking Online Courses to Ensure Quality, Monitor Change, and Reduce Costs AACC 2014 Convention

Questions?