Beyond Logic Models: Evaluating Complex Programs
-
Upload
sarah-baughman -
Category
Education
-
view
471 -
download
0
description
Transcript of Beyond Logic Models: Evaluating Complex Programs
Beyond Logic Models:Beyond Logic Models:Evaluating Complex Evaluating Complex Emerging ProgramsEmerging Programs
Sarah Baughman
John Dorner
Karen Jeannette
eXtension
http://www.extension.org/militaryfamilies
http://blogs.extension.org/militaryfamilies
• Anne Adrian
• Sarah Baughman, Evaluation Specialist
• Bob Bertsch
• Peg Boyles
• Kyleen Burgess
• Chris Canjar
• Thomas G. Coon, Administrative advisor
• John Dorner, Vice-Chair
• Brent Elrod, National Program Leader
• Kevin Gamble
• Diana Hagan
NetLit Steering CommitteeNetLit Steering Committee
• Connie Hancock
• Amy Hays
• Karen Jeannette
• Stephen Judd, Chair
• Jim Langcuster
• Kristen Mastel
• Rich Phelps
• Jerry Thomas
• Terrence Wolfork
• Barbara Woods
Image Credit: http://www.flickr.com/photos/info_grrl/6862478946/in/set-72157629286123040/
Image credit: http://www.flickr.com/photos/kelvin255/3518359517/
How do we plan to measure outcomes when we aren't sure where we are going?
Developmental Evaluation adapts to Developmental Evaluation adapts to the realities of complex nonlinear the realities of complex nonlinear dynamics rather than trying to impose dynamics rather than trying to impose order and certainty on a disorderly and order and certainty on a disorderly and uncertain world. uncertain world. – Michael Quinn Patton– Michael Quinn Patton
Evaluation ProgressEvaluation Progress
Steps along the way
internal evaluator with eval committee
establishing the framework
developing initial evaluation questions
surveying steering committee for sensitizing concepts
reflective practice
Reflections to Reflections to move us forwardmove us forward
Participating in online networks is an essential skill for our increasingly inter-connected world. Network Literacy is the ability to leverage technology to create connections with other people and/or organizations in a virtual space.
http://www.flickr.com/photos/foxypar4/
• Networks are powerful• Participating in networks has opened opportunities for
creating stronger relationships resulting in professional collaborations
• Learning, co-learning, and active learning all happen with participation in networks
• Comfort level increases through active participation in networks
• Need for recognizing barriers to participating in networks
Image credit: http://www.flickr.com/photos/mag3737/
What role can we play? What role can we play? • Role model good online teaching• Leveraging individual CoP member networks to
create impact within the system• Leader in defining, creating best practices for online
learning and extension education• Serve as “technology stewards” for CES by showing
how tools and approaches can address challenges.• Strategic efforts to leverage our networks around
specific events
Roles we can playRoles we can play
• Hold national level online conversations about cooperative extension that are open to the public to raise awareness of cooperative extension programs.
• Support the efforts of others within Extension working to build network literacy.
Next StepsNext Steps
• Discussion results of reflective practice with the steering committee
• Engage entire CoP in more specific plans to more forward
• Continue to document our work
What we’ve learnedWhat we’ve learned
• Time consuming, challenging approach
• Stakeholder involvement has been difficult to get
• We are making progress in individual learning networks
• Increasing engagement and interaction outside of CoP membership
What we’ve learnedWhat we’ve learned
• Time consuming, challenging approach
• Stakeholder involvement has been difficult to get
• We are making progress in individual learning networks
• Increasing engagement and interaction outside of CoP membership
Harold Jarche: www.jarche.com
Listening SessionListening Session
• Offer a chance to invest
• Opportunity to identify themes (sensitizing concepts to work from)
• Create opportunity to request specific contributors/contributions
• Provide tighter direction for future educational offerings (webinars, blog posts, etc)
Themes can help identify contributors Themes can help identify contributors and “community indicators” and “community indicators”
• Can we provide programming that responds to themes and increase:– #new contributors– # contributors from state systems– # contributors from external learning
networks– Repeat visitors, contributors
Contact Information Contact Information SarahBaughman
@programeval
John Dorner
@jdorner
Karen Jeannette
@kjeannette