Christopher Cyphers 2006 NSSE and Accreditation Self-Study Christopher Cyphers, Ph.D. Provost...

ChristopherCyphers2006

NSSE and Accreditation Self-Study

Christopher Cyphers, Ph.D.Provost

School of Visual ArtsNew York, New York


SVA at a glance

Location: ManhattanCarnegie: SpecializedDegrees: BFA, MFA, MTA, MPSPhysical plant: 675,000 ft2

Beds: 1,100

Location: ManhattanCarnegie: SpecializedDegrees: BFA, MFA, MTA, MPSPhysical plant: 675,000 ft2

Beds: 1,100

First-time, full-time freshmen: 661% female: 56.6% full-time: 100% in-state: 34.8% on campus: 65.4% international: 10.6States represented: 36Countries represented: 14

First-time persistence rate(2005 cohort): 86.4%First-time graduation rate (2000 cohort): 65%

UG enrollment: 3,100GR enrollment: 407% female: 52.6% full-time: 93.4% on campus: 32.8% international: 13.4States represented: 45Countries represented: 47


Demand for greater accountability


. . . but not just from official bodies


Greater emphasis on assessment

Learning in the majorLearning in the major

Written, oral, critical thinking, analytical skills

Written, oral, critical thinking, analytical skills

Academic advisementAcademic advisement Student support servicesStudent support services

Foundation for lifelong learningFoundation for lifelong learning

Co- and extracurricular learningCo- and extracurricular learning


The assessment universe


Let’s do it

You commit to administering NSSEYou commit to administering NSSE

You achieve a healthy response rateYou achieve a healthy response rate

You receive your results in a smart and tidy packageYou receive your results in a smart and tidy package

You proudly take your results binder to your president, and he says:You proudly take your results binder to your president, and he says:


Okay. . . . Now what?

“This is great. . . what do we do with it”?


Why NSSE?

Focused on students’ academic and student life experience, better than comparable instruments.Focused on students’ academic and student life experience, better than comparable instruments.

NSSE embraced by Middle States Commission on Higher education.NSSE embraced by Middle States Commission on Higher education.

Numerous opportunities to benchmark institution’s data against peer groups. Numerous opportunities to benchmark institution’s data against peer groups.

NSSE generated benchmark scores, “standardized” so as to Comparisons over time.NSSE generated benchmark scores, “standardized” so as to Comparisons over time.


Comparative value of NSSE data

Institutional Scores Across TimeInstitutional Scores Across Time

Institutional Scores Against Peer GroupsInstitutional Scores Against Peer Groups

First-Year versus SeniorsFirst-Year versus Seniors


How does SVA compare to. . .

SVASVA Independent Art Schools(AICAD)

Independent Art Schools(AICAD)

NSSE-Selected Carnegie PeersNSSE-Selected Carnegie Peers

All NSSE RespondentsAll NSSE Respondents


Linking NSSE data to other data sources

Institutional DateInstitutional Date NSSE DataNSSE Data Other AssessmentData

Other AssessmentData

Multidimensional Dataset

Multidimensional Dataset


Use of NSSE for Middle States accreditation

Standard 7: Institutional Assessment

Standard 12: GeneralEducation

Standard 14: LearningOutcomes Assessment

Standard 9: Student SupportServices

Standard 10: Faculty

Standard 11: Educational Offerings


Institutional assessment

Using mean scores to make

comparisons across peer groups


What to consider

Effect sizeEffect size

StatisticalsignificanceStatistical

significance Class yearClass year


Student support services

NSSE Items: Students’ perception of institutional emphasis (1=very little, 2=some, 3=quite a bit, 4=very much)

Class Year

SVA AICAD Carnegie Peers

All NSSE

Providing support to help you succeed academically.

FYSR

2.822.75

3.01*2.81

3.02**2.99***

2.99*2.87

Encouraging contact among students from different backgrounds.

FYSR

2.552.48

2.622.31

2.522.44

2.572.40

Helping cope with non-academic responsibilities.

FYSR

1.941.77

2.021.80

2.15**2.03**

2.13*1.91

Providing support needed to thrive socially. FYSR

2.121.96

2.261.93

2.34**2.21**

2.37**2.14**

Attending campus events and activities. FYSR

2.632.47

2.90**2.81***

2.752.59

2.752.57

Using computers in academic work. FYSR

3.163.41

3.203.38

3.263.44

3.32*3.47

*p < .05, **p < .01, ***p < .001


Student life

NSSE Items: Frequency with which student did the following (1=never, 2=sometimes, 3=often, 4=very often)

Class Year


All NSSE

Attended an art exhibit, gallery, play, dance, or other theatre performance.

FYSR

3.213.12

3.063.16

2.03***1.95***

2.10***2.00***

Exercised or participated in physical fitness activities.

FYSR

2.042.22

2.33**2.42*

2.69***2.60***

2.77***2.70***

Participated in activities to enhance your spirituality (worship, meditation, prayer).

FYSR

1.691.77

1.801.86

2.17***2.32***

2.09***2.18***

Examined the strengths and weaknesses of your own views on a topic or issue.

FYSR

2.772.91

2.883.09*

2.53**2.66***

2.57*2.69**

Tried to better understand someone else’s views by imagining how an issue looks from his or her perspective.

FYSR

2.892.98

3.063.14*

2.70*2.78**

2.742.83*

Learned something that changed the way you understand an issue or concept.

FYSR

3.023.10

3.143.11

2.76***2.82***

2.80**2.87***

*p < .05, **p < .01, ***p < .001


Personal development

NSSE Items: Experience at institution contributed to the following areas (1=very little, 2=some, 3=quite a bit, 4=very much)

Class Year


All NSSE

Acquiring a broad general education. FYSR

2.692.74

2.772.68

3.05***3.26***

3.12***3.24***

Learning effectively on your own. FYSR

2.873.25

3.013.15

2.833.01**

2.853.00***

Understanding yourself. FYSR

2.873.12

3.033.09

2.68*2.80***

2.712.78***

Contributing to the welfare of your community. FYSR

1.891.87

2.18**2.02

2.33***2.45***

2.34***2.42***

Developing a deepened sense of spirituality. FYSR

1.861.92

1.841.68

2.13**2.07

2.051.92

Voting in local, state, or national elections. FYSR

1.412.18

1.471.85***

1.85***2.06

1.92***2.10

*p < .05, **p < .01, ***p < .001


Faculty

NSSE Items: Frequency with which students did the following (1=never, 2=sometimes, 3=often, 4=very often)

Class Year


All NSSE

Discussed grades or assignments with an instructor.

FYSR

2.502.67

2.73**2.89**

2.642.87**

2.562.79

Talked about career plans with a faculty member orAdvisor.

FYSR

1.972.71

2.112.63

2.18*2.55

2.112.40***

Discussed ideas from readings or classes with faculty member outside of class.

FYSR

1.952.34

2.042.29

1.872.16*

1.812.08**

Received prompt feedback on academic performance (written or oral).

FYSR

2.692.91

2.832.79

2.612.85

2.582.76*

Worked harder than you thought to meet an instructor’s standards or expectations.

FYSR

2.742.99

3.04**3.04

2.622.76**

2.58*2.69**

(Positive) relationship with faculty members. FYSR

5.405.44

5.515.46

5.365.70*

5.195.42

Worked with faculty members on activities other than coursework.

FYSR

1.381.81

1.55*1.79

1.66**1.91

1.56*1.81


General Education

NSSE Items: Degree to which institution has contributed to the following (1=very little, 2=some, 3=quite a bit, 4=very much)

Class Year


All NSSE

Writing clearly and effectively. FYSR

2.432.47

2.542.40

2.99***3.14***

2.95***3.07***

Speaking clearly and effectively. FYSR

2.402.54

2.502.71

2.84***3.07***

2.75***2.96***

Thinking critically and analytically. FYSR

3.043.30

3.34***3.37

3.143.34

3.163.33

Analyzing quantitative problems. FYSR

2.352.57

2.552.45

2.84***3.05***

2.86***3.02***

Using computing and information technology. FYSR

3.073.15

2.923.12

2.953.19***

2.923.14***

*p < .05, **p < .01, ***p < .001


General education, II

NSSE Items: Time during the school year spent reading and writing (1=none, 2=1-4, 3=5-10, 4=11-20, 5=20+)

Class Year


All NSSE

Number of assigned textbooks, books, or book-length packs of course readings.

FYSR

3.112.82

3.002.73

3.143.13***

3.26*3.18***

Number of books read on your own (not assigned) for personal enjoyment or academic enrichment.

FYSR

2.342.73

2.312.59

2.09**2.21***

2.06**2.21***

Number of written papers or reports 20 or more pages.

FYSR

1.231.38

1.221.32

1.281.67***

1.251.64***

Number of written papers or reports between 5 and 20 pages.

FYSR

2.032.08

2.162.09

2.21*2.57***

2.29***2.59***

Number of written papers or reports fewer than 5 pages.

FYSR

3.022.34

2.962.65***

3.032.90***

3.052.98***

To what extent have your examinations during the current school year challenged you to do your best work?

FYSR

4.965.22

5.51***5.32

5.41***5.51**

5.42***5.41

*p < .05, **p < .01, ***p < .001


Assessment in the major or general education

NSSE Items: Degree to which coursework has emphasized the following ((1=very little, 2=some, 3=quite a bit, 4=very much)

Class Year


All NSSE

Memorizing facts, ideas, or methods for courses and readings so you can repeat them in pretty much the same form.

FYSR

2.382.16

2.332.08

2.87***2.78***

2.87***2.74***

Analyzing the basic elements of an idea, experience, or theory, such as examining a particular case or situation in depth and considering its components.

FYSR

3.033.19

3.31***3.27

2.993.19

3.063.22

Synthesizing and organizing ideas, information, or experiences into new, more complex interpretations and relationships.

FYSR

2.883.18

3.17***3.29

2.763.00**

2.833.01*

Making judgments about the value of information, arguments, or methods, such as examining how others gathered and interpreted data and assessing the soundness of their conclusions.

FYSR

2.903.14

3.063.08

2.782.95**

2.822.94**

Applying theories or concepts to practical problems or in new situations.

FYSR

3.033.39

3.27**3.29

2.943.19**

2.983.17**

*p < .05, **p < .01, ***p < .001


Overall satisfaction/quality of relationships

NSSE Items: (1=poor, 2=fair, 3=good, 4=excellent)

Class Year


All NSSE

Overall, how would you evaluate the quality of academic advising you received at your institution?

FYSR

2.862.91

2.932.76

3.012.99

2.942.82

How would you evaluate your entire educational experience at this institution?

FYSR

3.223.25

3.39*3.23

3.103.19

3.163.19

If you could start over again, would you go to the same institution you are now attending (1=definitely no, 2=probably no, 3=probably yes, 4=definitely yes)?

FYSR

3.373.32

3.393.21

3.10**3.13*

3.20*3.17*

Relationships with other students (1=unfriendly, 7=friendly, supportive, sense of belonging).

FYSR

5.135.39

5.395.21

5.51*5.78**

5.485.60

Relationships with faculty members (1=unfriendly, 7=friendly, supportive, sense of belonging).

FYSR

5.405.44

5.515.46

5.365.70*

5.195.42

Relationships with administrative personnel and offices (1=unfriendly, 7=friendly, supportive, sense of belonging).

FYSR

4.464.41

4.664.32

4.79*4.79*

4.604.50

*p < .05, **p < .01, ***p < .001


NSSE benchmark scores

Concise summaries of data along fivemeasurement scales


Level of Academic Challenge

50.7

57.6

50.851.8

54.6

57.2

55.755.8

46

48

50

52

54

56

58

First-Year Seniors

SVA AICAD Carnegie Peers NSSE 2006


Active & Collaborative Learning

43.349.2

42.741.346.1

51.4 52 50.4

0

10

20

30

40

50

60

First-Year Seniors



Student-Faculty Interaction

31.235.834.3

32.1

44.144.343.7 41.3

05

1015202530354045

First-Year Seniors



Enriching Educational Experience

27.126.625.126.7

39 41 39.3 39.9

05

1015202530354045

First-Year Seniors



Supportive Campus Environment

54.8

58.8

60.359.1

53.4 53

60.4

56.6

48

50

52

54

56

58

60

62

First-Year Seniors



Benchmark scores over time

Benchmark Class 2003 2004 2005 2006

Level of Academic Challenge

FY

SR

52.0

49.9

59.8

54.5

54.5

53.6

50.7

54.6

Active & Collaborative Learning

FY

SR

41.4

41.0

40.7

42.0

44.6

42.3

43.4

46.1

Student-FacultyInteraction

FY

SR

35.0

47.0

35.7

44.3

39.2

48.2

36.7

49.3


FY

SR

54.3

51.5

56.4

54.6

54.7

57.2

54.8

53.4


Dissecting benchmark scales

Level of Academic Challenge(SVA)

Item 1

Item 4

Item 1

Item 3

Item 5 Item 6

Item 2

Major Field

Gender

Residence

GPA

First-Year Prgm


Differences based on major

NSSE Benchmark Class

Advert

Anim ComputerArt

Film/Video

Cartoon Fine Arts GraphicDesign

Illustration

Photo

Academic Challenge*

FYSR

53.9962.13

53.2954.47

52.4349.98

51.4850.50

48.4342.43

43.3960.60

52.4658.91

46.5055.06

46.3952.29

Active and Collaborate Learning***

FYSR

44.4451.58

45.2349.20

42.8540.47

51.8353.12

39.9134.88

30.7845.73

38.2650.76

38.0938.30

39.8242.64

Student-Faculty Interaction*

FYSR

32.2250.92

39.3543.43

27.7741.91

39.7048.41

26.6640.22

27.2743.79

30.0048.91

25.6936.71

28.5342.30

Enriching Educational Experience*

FYSR

27.7536.57

29.0344.48

25.7735.10

33.8942.17

25.5829.36

24.4238.97

28.1340.76

20.9833.98

24.2742.85

Supportive Campus Environment*

FYSR

60.7462.50

49.5352.27

58.3357.07

56.3348.67

52.9445.83

49.4958.15

55.1858.01

46.5246.25

51.9850.96

*p < .05, **p < .01, ***p < .001


Differences based on first-year program

NSSE Benchmark Class

Common Foundation

Departmental Foundation

Academic Challenge FYSR

47.9956.36

51.7153.01

Active and Collaborate Learning**

FYSR

37.2844.58

45.9347.63

Student-Faculty Interaction FYSR

27.3543.75

33.0744.51


FYSR

24.7637.31

28.2241.08


FYSR

51.1253.37

56.1053.56

*p < .05, **p < .01, ***p < .001


Differences based on Gender

NSSE Benchmark Class Female Male

Academic Challenge FYSR

48.4856.97

52.8351.94

Active and Collaborate Learning*

FYSR

39.3645.81

47.1846.34

Student-Faculty Interaction FYSR

29.6144.00

32.7044.24


FYSR

26.1240.57

28.0237.24


FYSR

51.4855.18

57.9951.36

*p < .05, **p < .01, ***p < .001

Persistence rates are generally higher for men than women.

However, women enjoy a higher6-year graduation rate.


Differences based on local residency

NSSE Benchmark Class Resident Commuter

Academic Challenge FY 50.37 50.18

Active and Collaborate Learning* FY 42.14 43.48

Student-Faculty Interaction*** FY 30.94 30.87

Enriching Educational Experience** FY 28.42 24.56

Supportive Campus Environment FY 52.57 56.80

*p < .05, **p < .01, ***p < .001


Christopher CyphersSchool of Visual Arts209 East 23 Street

New York, NY [email protected]

212-592-2550

Christopher Cyphers 2006 NSSE and Accreditation Self-Study Christopher Cyphers, Ph.D. Provost...

Documents

Transcript of Christopher Cyphers 2006 NSSE and Accreditation Self-Study Christopher Cyphers, Ph.D. Provost...