Safe Drive Stay Alive · Feb/March 2016 (3 months post) October 2016 (12 months post) Groups...
22
First performances November 2014 Annual attendance 10,000 Total attendance 20,000 Total performances 49 First performances April 2005 Annual attendance 12,000 Total attendance 126,000 Total performances 211 Safe Drive Stay Alive Greater Manchester (GM) and Surrey
Transcript of Safe Drive Stay Alive · Feb/March 2016 (3 months post) October 2016 (12 months post) Groups...
First performancesNovember 2014
Annual attendance10,000
Total attendance20,000
Total performances49
First performancesApril 2005
Annual attendance12,000
Total attendance126,000
Total performances211
Safe Drive Stay AliveGreater Manchester (GM) and Surrey
SDSA GM and Surrey
working together
background &history
page
03
November 2014 - SDSA Surrey first used new films
November 2014 - SDSA GM delivered first year of performances, using Surrey films, with SDSA Surrey support
March 2015 - SDSA GM and Surrey commissioned Road Safety Analysis (RSA) to undertake an Independent evaluation
October 2015 - First questionnaire issued.
April 2013 - GM Police and SDSA Surrey both featured in BBC3’s ‘Licence to Kill’
November 2013 - GM Police, GM FRS and NWAS attended SDSA Surrey’s VIP performance
July 2014 - SDSA GM purchased licence to use new SDSA Surrey films for 5 years
evaluation methodologyprototype willingness model
page
04
The Prototype Willingness Model (PWM) was used to create questions for the SDSA evaluation.
It incorporates questions on willingness, intentions, attitudes, subjective norms and behaviour to see if SDSA has any effect on any of these elements of the model.
Intentions are often positive in young people but willingness, vulnerability, social norms and attitude could be better indicators of likelihood to engage in risky behaviour.
evaluation methodologyquestionnaires, groups, study period, sample size
page
05
QuestionnairesJoint construction GM - Online Surrey - Paper copies,
delivered and collected by hand
Study period12 months and 3 stagesOctober 2015 (Pre performances)Feb/March 2016 (3 months post)October 2016 (12 months post)
GroupsIntervention group Comparison group Year 12 studentsMatched
respondents (individuals)
Sample sizes achievedIntervention/ComparisonPre 2166/3083 months 1909/48212 months 1096/479
evaluation resultssample sizes
page
06
1257
946
728
909963
368308
482 479
0
200
400
600
800
1000
1200
1400
Pre 3 months 12 months
Surrey Greater Manchester Comparison (Surrey)
evaluation results3 months
page
07
Examples of Key findings
Friends’ Likelihood (Unlikelihood) - Net changes*
Greater Manchester
65% drink alcohol before driving (+12%)
42% use mobiles to text or call (+15%)
77% take drugs & drive (+3%)
52% exceed town speed limit (+8%)
45% exceed motorway limit (+12%)
48% exceed rural speed limit (+10%)
56% not wear seatbelt (+11%)
Surrey
63% drink alcohol before driving (+7%)
36% use mobiles to text or call (+15%)
77% take drugs & drive (+3%)
49% exceed town speed limit (+9%)
42% exceed motorway limit (+10%)
45% exceed rural speed limit (+10%)
58% not wear seatbelt (+10%)
*Intervention group changes, over and above the Comparison Group. Statistically significant changes are shown in red.
evaluation results3 months
page
08
Friends’ Approval (Disapproval) - Net changes*
Greater Manchester
72% drink alcohol before driving (+9%)
51% use mobiles to text or call (+15%)
82% take drugs & drive (+3%)
51% exceed town speed limit (+10%)
42% exceed motorway limit (+11%)
48% exceed rural speed limit (+11%)
57% not wear seatbelt (+12%)
Surrey
60% drink alcohol before driving (+7%)
32% use mobiles to text or call (+20%)
77% take drugs & drive (+3%)
34% exceed town speed limit (+11%)
29% exceed motorway limit (+10%)
34% exceed rural speed limit (+11%)
41% not wear seatbelt (+12%)
*Intervention group changes, over and above the Comparison Group. Statistically significant changes are shown in red.
Examples of Key findings
evaluation results3 months
page
09
Summary
Based on the Prototype Willingness Model
Safe Drive Stay Alive positively affected:
Willingness
Friends’ Likelihood
Family approval
Friends’ Approval
Attitudes
Many measures for each showed statistically significant differences between the Intervention Group and Comparison Group.
Safe Drive Stay Alive did not effect:
Vulnerability
Parents’ Likelihood
Passengers
evaluation results12 months
page
010
Report Extract - Methodology and results
‘The evaluation has provided a unique insight into the efficacy of Safe Drive Stay Alive, through:
the employment of large sample sizes
consistent monitoring over time
the use of a comparison group and
utilising an adolescent-based behaviour change model to measure against.
Many evaluations of young and pre-driver education do not employ all or most of these elements’.
‘Many of the successes from the 1st report are still present …the improvements at 12 months in social norms, attitudes and willingness are all really positive’
Tanya Fosdick, Road Safety Analysis, March 2017
evaluation results12 months
page
011
‘Success’ was based on finding three conditions using ANOVA statistical tests.
13 questions met all three conditions, showing statistically significant improvements. These were:
Willingness to use mobile phones
Willingness to speed on rural roads
Willingness to speed on the motorway
Friends’ likelihood to drink and drive
Friends’ likelihood to use their mobile and drive
Friends’ likelihood to speed on the motorway
Friends’ likelihood to speed on rural roads
Friends’ likelihood to speed in town
Friends’ approval if the respondent sped on the motorway
Friends’ approval if the respondent sped on rural roads
Friends’ approval if the respondent sped in town
Attitudes towards being able to handle one drink and drive
Attitudes towards friends making fun of them driving sensibly
Key findings
evaluation & reportrecommendations
page
012
Passenger related behaviours
Did not improve to a statistically significant extent
The intervention should be adapted to include more passenger
focus.
Personal Vulnerability
Did not increase to a statistically significant extent Highlighting the alternative consequences of risky behaviour could
be effective - such as loss of freedom and mobility and the resulting social stigma
Credible coping mechanisms could be provided - either through SDSA itself or follow up lessons.
Key findings & recommendations
evaluation & reportrecommendations
page
013
Coaching Speakers - SDSA GM
Speaker Workshops - style / content / relevance
Ensure clear “take home” messages about risks and consequences
Passenger responsibility messages strengthened
Include wider range of consequences
extended learning &wider use of BCTs
page
014
Follow up Tutor ResourceSDSA GM - 2015 & 2016 - Why?
Colleges attending in 2014 and 2015 requested it
SDSA has faced some criticism as a single solution to reducing risk taking behaviours over the longer term -need to utilise more Behaviour Change Techniques
Students clearly leave SDSA with the intention of staying safe
The resource allows them to explore what this means for them as individuals
extended learning &wider use of BCTs
page
015
Follow up Tutor ResourceSDSA GM - Process
Proposal to GM Casualty Reduction Partnership
Commissioned Brainbox Research (Dr Fiona Fylan)
Literature Review
Focus Groups in GM colleges
Draft content put forward to our Project Team
Tested in 4 colleges
Approval and design
extended learning &wider use of BCTs
page
016
Follow up Tutor ResourceModules
Impulsivity - 1 hour
Pressure - 1 hour
Mobiles - 30 mins
Drugs and Alcohol - 30 mins
Compulsory
Optional
SDSA GM has now shared resource with SDSA Surrey, SDSA Lancashire, and Devon and Cornwall and is willing to share with others road safety
organisations.www.SafeDriveGM.co.uk
Possible future GM and Surrey collaboration to evaluate the
additional impact of using the Tutor Resource.
extended learning &wider use of BCTs
page
017
Young Driver’s GuideSDSA Surrey - 2015 & 2016
Following evaluation findings (SDSA Surrey):
Issue dates changed for November 2016 performances
Year 13 students received in the following January
Year 12 students to receive in the following June
Nearer to driving age of 17 with potentially increased relevance
to recipients
Continue to be delivered direct to school or college
In addition, First Car contacts each school/college before delivery
date, reminding of use and benefits.
extended learning &wider use of BCTs
page
018
Road Safety GB ConnectSDSA Surrey - 2017
SDSA Surrey purchased & aims to promote and develop the
use of the Road Safety GB Connect in 2017/18.
Aiming to:
Build an online audience
Create compelling communications
Evaluate and improve communications
sharing knowledge, resources, good practice,research and developments
page
019
Road Safety Performances Forum
SDSA GM and Surrey are members
Meets twice yearly
Share good practice; such as funding, extended learning and
evaluation
Welcomes new members
Next meeting, Hertford, 12 July 2017
Road Safety
Performances
Forum
conclusion
Tangible benefits to working across geographical
boundaries
Delivering similar live ‘performances’ with similar
aims, objectives, formats, content and outcomes
Reaching large numbers of vulnerable drivers and
passengers (22 000 pa)
Prompting a real interest amongst this large
audience group
Conclusion
SDSA Surrey & GM working together
Different regions and socio-economic groups,
but with similar evaluation results
Extending contact and learning, using a range of
BCTs, to further improve outcomes
Will continue sharing experiences, learning and
findings.
Mark TaylorSurrey Fire & Rescue [email protected]
Lesley AllenGreater Manchester Fire & Rescue [email protected]
thank you.
