D2 d evaluation overview 2013 4 30-13

1

© 2011 Regents of the University of Minnesota. All rights reserved.

11

Enabling Youth Inquiry through Citizen Science

EVALUATION/RESEARCH OVERVIEW

May 2013University of Minnesota, Cedar Creek Ecosystem Science Reserve

Evaluation Team: Kim Kies, Nathan Meyer, Pam Larson Nippolt, Siri Scott, Andrea Lorek Strauss, Katie Smiley

AcknowledgmentsThe Driven to Discover project is supported, in part, by a grant from the National Science Foundation.

3


AGENDA

►Research purpose/evaluation approach►Snapshot of evaluation results to date ►Discuss instruments/procedures

4


OVERARCHING GOALSTo engage individuals working with youth in Informal Science Education settings in Citizen Science, AND to encourage authentic inquiry in this engagement.

Oberhauser 2010

5


2 PHASES1. Youth leader/youth/scientist research

teams engage in youth-initiated research based on involvement in CS programs focused on monarch butterflies or birds.

2. Disseminate model to broader audiences of youth leaders and citizen science practitioners.

Oberhauser 2010

6


3 PREMISES1. Engagement in authentic inquiry leads to

important science education outcomes.

2. Citizen Science is an engaging, effective setting for learning science content & methods (~40% of Monarch Larvae Monitoring Program volunteers monitor with youth).

3. Integrating authentic inquiry into Citizen Science programs will benefit the practice of Citizen Science and Informal Science Education in general.

Oberhauser 2010

7


YOUTH CHARACTERISTICS:

8


YOUTH GENDER

29%

71%Male Female

39%

61%

Male Female

2010 2011 2012

Male 20 43 55

Female 48 67 70

• Percentage of male participants increased slightly each year

44%

56%

Male Female

9


YOUTH AGE• The largest proportion of youth are between the ages of 9 and 13.• 28% of Year 2 youth and 23% of Year 3 youth were returning

participants

5 6 7 8 9 10 11 12 13 14 15 16 170

5

10

15

20

25

30

35

201020112012

Age

Number

The Number of Youth by Age and Year

10


YOUTH ATTITUDES (2012) 73% of youth coming into the program agree

that they can contribute to a citizen science project, but only 56% say they consider themselves a citizen scientist.

78% of youth coming into the program are interested in answering their own questions about nature.

33% had participated in a citizen science project before. Of those, 26% participated through prior D2D involvement and 7% another project.

11


YOUTH ATTENDANCE AND EXPERIENCE (2012)

Youth Attendance Ratings % Youth

All of the time. I was at every meeting. 44%

More than half of the time. I missed a few meetings. 49%

About half of the time. I missed about half of the meetings. 3%

Less than half of the time. I missed more than half of the meetings.

4%

• 73% of youth would like to participate in the research club again, 26% were unsure and 1% did not want to participate again.

• 74% said they enjoyed the program a lot; 23% a moderate amount; and 3% said a little.

Sarah Shimek

I don't have the adult leader data for attendance.

12


YOUTH KNOWLEDGE (2012 PRE-POST PROGRAM COMPARISON)

0.0%20.0%40.0%60.0%80.0%

100.0%

43.0%

90.0%

59.0%80.0%

93.0%74.0%

PrePost

13


How often do you watch birds or butterflies?

Almost

neve

r

Once

in a

while

Modera

tely

often

Very o

ften

0.0%5.0%

10.0%15.0%20.0%25.0%30.0%35.0%40.0%45.0%50.0%

Prepost

How often do you try to identify the bird or butterflies you see outdoors?

Almost

neve

r

Once

in a

while

Modera

tely

often

Very o

ften

0.0%

5.0%

10.0%

15.0%

20.0%

25.0%

30.0%

35.0%

40.0%

PrePost

YOUTH 2012 PRE AND POST PROGRAM BEHAVIORS

14


YOUTH RATED SKILLS: 2012 PRE PROGRAM

Finding organisms and their habitats

Observing organisms and their habitats

Identifying organisms

Using scientific instruments

Using a field guide

Filling out data sheets

0.0% 10.0% 20.0% 30.0% 40.0% 50.0% 60.0%

Very skilled Moderately skilledA little skilled Not skilled

15


YOUTH RATED SKILLS: 2012 POST PROGRAM

Finding organisms and their habitats

Observing organisms and their habitats

Identifying organisms

Using scientific instruments

Using a field guide

Filling out data sheets

0.0% 10.0% 20.0% 30.0% 40.0% 50.0% 60.0%


16


YOUTH RATED SKILLS: 2012 PRE PROGRAM

Asking a question that can be answered by collecting data.

Developing testable hypotheses.

Designing a scientific procedure to answer a question.

Creating graphs that help me and others understand my data.

creating a display to communicate my data and observations.

Analyzing the results of a scientific investigation.

Using the results of my investigation to answer the question that I asked.

0% 10% 20% 30% 40% 50%


17


YOUTH RATED SKILLS: 2012 POST PROGRAM

Asking a question that can be answered by collecting data.

Developing testable hypotheses.

Designing a scientific procedure to answer a question.

Creating graphs that help me and others understand my data.

creating a display to communicate my data and observations.

Analyzing the results of a scientific investigation.

Using the results of my investigation to answer the question that I asked.

0% 10% 20% 30% 40% 50% 60%


18


EVALUATION PROCEDURES

19


OVERVIEW We will ask you to complete / participate in…

– Assessments / Surveys– Group phone / conference calls – Attendance forms– Observations with selected teams– Focus Groups with adult leaders

We will ask for your help…– Youth enrollment / consents– Youth assessments

20


EVALUATION STEPS OVERVIEW1. Complete and send the consent forms to Grant Bowers (D2D

Program Coordinator).

2. Complete and send youths’ completed pre-assessments and reporting sheet.

3. Have fun! Do your projects! / Complete Attendance sheet. / Participate in phone conference calls.

4. Complete and send youths’ completed post-assessments, reporting sheet, and attendance sheet.

5. Attend the D2D summit / Adult leader focus groups.

6. Complete troop leader surveys.

21


PARENT/YOUTH CONSENT1. Parents complete enrollment/consent

forms (Voluntary)

2. Inform youth about the research/evaluation process

3. Youth complete consent forms (Voluntary)

4. Youth complete code sheet

22


PARENT/YOUTH CONSENT Send the consent forms and youth code sheets in the

pre-stamped and addressed envelope to:

Grant Bowers

University of Minnesota

1980 Folwell Ave

200 Hodson Hall

St. Paul, MN 55108

P: 612.625.8304

F: 612.625.5299

[email protected]

https://exchange.exchangesource.net/owa/redir.aspx?C=W927FNfwKUK3OkTbfN9QOZOVv8YWFtAI4p0A9sa7--kKb6Rx7acOsDaJu2hZbHf0k3mu0Yqb6WI.&URL=mailto:[email protected]

23


ADULT LEADER ASSESSMENTS

Pre-program adult leader assessments: will be administered through SurveyMonkey. A link will only be sent to new leaders.

Post-training assessments: if attending, will be completed on paper directly after the training.)

Post-program adult leader assessments will be administered through SurveyMonkey. A link will be sent to your email after we receive the youth assessments or after the summit if you plan to attend.)

24


YOUTH ASSESSMENTS First and last meeting; dedicate 30 minutes Give plenty of time Provide a comfortable space for writing Let youth know that there are no correct / incorrect

answers Encourage them to fill it out completely (especially open-

ended questions) Make sure the youth complete the questions on their

own. Complete the survey at the meeting. Do not send the

surveys home with the youth to complete.

25


YOUTH PRE-ASSESSMENTS Administer prior to or at the first meeting before you

begin your activities. Put all the youth pre-assessment material into the self-

addressed stamped envelope provided in your evaluation packet. Be sure to include the following:– Reporting Sheet– Youth Pre-Assessments

Seal the envelope and put it where you will remember to send it in the mail the next day.

Send the assessment in the mail the day after your meeting.

26


YOUTH PRE PROGRAM REPORTING SHEET

27


YOUTH PRE ASSESSMENT

28


YOUTH POST-ASSESSMENTS Administer after your team activities are completed. Put all the youth post-assessment material into the self-

addressed stamped envelope provided in your evaluation packet. Be sure to include the following:– Reporting Sheet– Youth Post-Assessments– Attendance forms

Seal the envelope and put it where you will remember to send it in the mail the next day.

Send the assessment in the mail the day after your meeting.

29


YOUTH POST ASSESSMENT REPORTING SHEET

30


YOUTH POST ASSESSMENT

31


ATTENDANCE FORM

32


ADULT LEADER GROUP PHONE / CONFERENCE CALLS

The program will offer Bi-weekly conference calls for adult leaders to connect and discuss various items. Conference call information will be shared in bi-weekly E-zines. The calls offer the means: To disseminate useful information For adult leaders to ask questions For seasoned adult leaders to offer insight For adult leaders to share successes

33


ADULT FOCUS GROUPS

Adult leader focus groups will be scheduled the first evening of the D2D Summit / Insect Fair (November or December 2013 -date to be decided).

34


QUESTIONS?

D2 d evaluation overview 2013 4 30-13

Documents

Transcript of D2 d evaluation overview 2013 4 30-13