Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft...
Transcript of Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft...
1
Assessment in the Arts Conference
July 2013
Angie L. Miller, Ph.D.
Amber D. Lambert, Ph.D.
Center for Postsecondary Research, Indiana University
Best Practices in Using Alumni Data for Arts Program Assessment
Introduction to SNAAP
2
SNAAP Mission
We investigate the educational experiences and career paths of arts graduates nationally
Provide the findings to educators, policy makers, and philanthropic organizations
To improve arts training, inform cultural policy, and support artists
SNAAP Basics: Who is surveyed?
Participants drawn from..Arts high schoolsIndependent arts colleges, arts schools or departments in comprehensive colleges & universities
Broad definition of “arts”
All arts alumni, all years (since 2011)2008‐2010: surveyed selected cohorts
3
Increasing Numbers…
2011 Administration 36,000 respondents 66 institutions
2012 Administration 33,000 respondents 70 institutions
Combining 2011 and 2012 respondents to create
SNAAP Database with 69,000 respondents
Questionnaire Topics
1. Formal education and degrees
2. Institutional experience and satisfaction
3. Postgraduate resources for artists
4. Career
5. Arts engagement
6. Income and debt
7. Demographics
4
Participating institutions receive...
Institutional Reports: Customized, Confidential Separate reports for undergraduate and graduate alumni
Both quantitative and qualitative data
New report on “Recent Grads”
Comparative data with other schools
Complete data file of responses
Workshops/webinars on how to use data
Using the Data
5
Examples of institutions using alumni data for...
Sharing on campus
Alumni and donor outreach
Recruitment
Assessment and curricular change
Advocacy and public policy
Sharing on Campus
6
7
8
Alumni and Donor Outreach
9
10
11
12
13
Recruitment
14
15
Assessment and Curricular Change
16
Using SNAAP for Curricular Assessment and Change
Using SNAAP for Curricular Assessment (cont.) Most important skills:
1. Creative thinking and problem solving2. Listening and revising3. Interpersonal relations and working collaboratively4. Broad knowledge and education5. Critical thinking and analysis of arguments and
information
Recommend that faculty: Incorporate open‐ended projects (top skill #1) and group projects (top skill #3)
Require analysis of theories or reviews/critiques (top skill #5) and provide opportunities for feedback and revision (top skill #2)
Ensure curricula include a firm knowledge foundation in a wide variety of areas (top skill #4)
17
Using SNAAP for Curricular Assessment (cont.)
Using SNAAP for Curricular Assessment (cont.) Identify strengths:
What skills have the highest % of alumni reporting the institution helped them develop “very much” or “quite a bit”?
Identify areas for improvement:
What skills have the highest % of alumni reporting the institution helped them develop “very little” or “not at all”?
Peer group information provides context:
Do other institutions have similar strengths and weaknesses?
18
Examples From Aggregate Findings
77% 81%
71%
90%
22%26%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Artistic technique Financial and businessmanagement skills
Entrepreneurial skills
"Very" or "Somewhat Important" to profession or work life
Institution contributed "Very much" or "Some" to development of skill
Using SNAAP for Curricular Assessment (cont.) Alumni receive strong training in learning artistic techniques
Discrepancies between those who say a skill is important for their work and those who say the institution helped them develop that skill suggest some improvements that could be made, such as: Requiring business and financial classes, or incorporating these elements into existing courses
Include classes looking at the “nontraditional” career paths of arts graduates
19
20
Advocacy and Policy
21
22
23
SNAAP Data Resources
Aggregate Reports
24
Aggregate Report (detail)
Annual Reports
25
Annual Report (detail)
SNAAP Special Reports
26
SNAAP Special Reports (detail)
SNAAP DataBriefs
27
Available at: http://snaap.indiana.edu/snaapshot
Questions or Comments?
Contact Information: Angie L. Miller [email protected] Amber D. Lambert [email protected]
Strategic National Arts Alumni Project (SNAAP)
www.snaap.indiana.edu
(812) 856‐5824