Lessons Learned with Institutional Data Analytics• Analytics History: Started over three years ago...
Transcript of Lessons Learned with Institutional Data Analytics• Analytics History: Started over three years ago...
wcet.wiche.edu
Lessons Learned with Institutional Data Analytics
October 9, 2014
• The webcast will begin at the top of the hour. • There is no audio being broadcast at this
time. • If you need assistance, contact Blackboard
Collaborate: 866-388-8674. • An archive of this webcast will be available on
the WCET website next week.
1
Lessons Learned with Institutional Data Analytics
October 9, 2014
wcet.wiche.edu
Lessons Learned with Institutional Data Analytics
• Welcome.
• Thank you Blackboard Collaborate!
• If you have technical issues:
• Call 866-388-8674
• Use the chat box for questions.
• Archive, PowerPoint, and Resources available next week.
Megan Raymond, WCET
3
wcet.wiche.edu
Questions from the Audience
If you have a question during the presentation, please add your questions to the chat box. We will monitor the chat box and have time for Q&A at the end of each section.
4
wcet.wiche.edu
Moderator
Matthew Milliron Senior Director, Client Success
Civitas Learning
5
wcet.wiche.edu
Presenters
Jennifer McGrath Freed Vice President, Academic
Affairs Rio Salado College
6
Karen Vignare Vice Provost, University of Maryland
University College
wcet.wiche.edu
OCCURING WITHOUT AN INFRASTRUCTURE TO UNDERSTAND WHAT WORKS, WHEN AND FOR WHICH STUDENTS. SILOED SYSTEMS NOT SHARING OR COMBINING THE POWER OF ALL DATA COLLECTED.
NUMEROUS STUDENT SUCCESS INITIATIVES
wcet.wiche.edu
THAT CONNECTS TO SYSTEMS ALREADY IN PLACE AND ANALYZES THE DATA FROM EACH OF THEM TO GAIN NEW AND POWERFUL INSIGHTS IN WAYS NO SINGLE SYSTEM OR POINT SOLUTIONS ALONG CAN DO.
IMAGINE A DATA AND ANALYTICS PLATFORM
wcet.wiche.edu
BETTER DECISION-MAKING MODEL
Blunt decisions
Comprehensive data
Precise decisions
Point data
ACROSS THE STUDENT LIFECYCLE
wcet.wiche.edu
Broad
Deep
Practical
Specific
Diverse
Sustainable
Intuitive
Accessible
Humanizing
Cross-System
Insightful features
Real-world quality, consistency
To the college and each student
Fluent in many modeling approaches
Model re-fresh & rapid feedback/testing
Intuitive UI to drive adoption
Meet users where they are
Personal, empowering, dynamic
Data
Science
People
KEYS TO STUDENT SUCCESS SCIENCE
wcet.wiche.edu
Jennifer McGrath Freed
Vice President, Academic Affairs Rio Salado College
11
wcet.wiche.edu
About Rio Salado College
12
One of 10 Maricopa Community Colleges
Locations throughout Maricopa County
Serves nearly 60,000 students, more than half online
wcet.wiche.edu
Analytics at Rio Salado College
Predictive Analytics- RioPACE
PAR Civitas
13
wcet.wiche.edu
Why Analytics?
Predictive- student success and interventions
Comparative- learning from like institutions
Decisions and Directions- Proactive decisions about the future
14
wcet.wiche.edu
RioPACE
Which factors are effective as early/point-in-time predictors of course outcome in an online environment?
Can we predict course outcomes using data retrieved from our SIS and LMS? If so, can we generate early and/or rolling (i.e. weekly) predictions?
How do we respond to students flagged as at-risk?
15
wcet.wiche.edu
Predictive Analytics Reporting
Predictive Collaborative Comparative Intervention
16
wcet.wiche.edu
Civitas
Predictive Collaborative Proactive Decisions Student-Focused
17
wcet.wiche.edu
What We Have Learned
Predictive analytics- a moving target
The importance of community
Interventions are essential
Challenges of data mining
18
wcet.wiche.edu
Future Directions
Beyond course data Student data Intervention tracking Success, persistence,
and completion
19
wcet.wiche.edu
Questions from the Audience
20
wcet.wiche.edu
Karen Vignare
21
Vice Provost, University of Maryland University College
wcet.wiche.edu
• Pioneer in adult and distance education since 1947 • One of 11 accredited, degree-granting institutions in the
University System of Maryland • Focus on the unique educational and professional
development needs of adult students • Almost 90,000 students enrolled worldwide
University of Maryland University College
wcet.wiche.edu
• Analytics History: Started over three years ago by current president (formerly IR SVP)
• Set up an Office of Analytics which helps optimize all internal data—marketing, enrollment, financial, and learner
• Have created a culture of evidence-based/data-driven decision making within administration
History of Analytics at UMUC
23
wcet.wiche.edu
• Partner with Civitas Learning • Create a cross-functional steering committee &
academic intervention team • Joined PAR second wave • Through grant funding, built a transfer student
data mart with two community colleges
Building our Analytics Toolset
wcet.wiche.edu
Putting Civitas PA to work
Four term pilot academic/advising pilot with mixed results based on risk score Marketing segmentation—very effective
based on likely persistence Continuing development of new tools—Ilume,
Insight, Faculty apps & Degree Maps
25
wcet.wiche.edu
CC Predictors of First Term GPA Positive Predictors
Older
Married
Successful Course Completion at CC
Successful Math Completion at CC
Successful English Completion at CC
CC GPA
CC Cumulative Credits
Negative Predictors
Minority
Received PELL Grant
Withdrawals
Non-Significant
Female
Taken Honors
Taken Dev Ed
Taken Online
wcet.wiche.edu
Turning Insights into Action to Improve Student Success Spend time on building a cross-institutional
team Don’t expect every intervention to work or be
significant Keep asking questions Develop a retention model
27
wcet.wiche.edu
Questions from the Audience
28
wcet.wiche.edu
Learn More and Stay Connected
Visit the WCET’s Connect, Learn, Advance services on our website: http://wcet.wiche.edu/ Attend WCET’s 26th Annual Meeting in
Portland, OR, November 19-21. http://wcetconference2014.wiche.edu/
29
wcet.wiche.edu
Learn More and Stay Connected
Join WCET today! http://wcet.wiche.edu/contact-us/join-wcet
Become a WCET member: benefits extend to your entire institution: News digests- academic, technology, and policy. Discounted access to events including Leadership Summits and
Boot Camps. Listservs. Free webcasts. Exclusive member only resources.
30
wcet.wiche.edu
Additional Information and Resources
Access to the resources discussed during this webcast, including the archive, will be available next week. http://wcet.wiche.edu/connect/webcasts
31
wcet.wiche.edu
Thank You to our Technology Provider
32
wcet.wiche.edu
Thank you Supporting Members for your commitment to WCET and e-Learning Boise State University Colorado State University Cooley LLP Lone Star College System Michigan State University University of Missouri/Mizzou Online University of North Texas University of West Georgia
wcet.wiche.edu
Thank you WCET Annual Sponsors
Blackboard CourseSmart/Vital Source Pearson Learning Solutions
Learn about Sponsorship Opportunities:
http://www.wcet.wiche.edu/sponsorship