slide 1

Welcome to MaxSumo training session

Pernilla Hyllenius Mattisson, Trivector Traffic, SWEDEN

EU project MAX (2006-2009)     

Work Package B: Behaviour change model and Methods for Evaluation

Partners: ILS (D), CNRS (F), NU Napier (UK), Univ. of AUTH (GR), Uni Griesen, Uni Magdeburg, Trivector (S), ESTC (USA)

slide 2

MaxSumoA tool that gives guidance on how to plan, monitor and evaluate an MM-project

slide 3

MaxSumo

• Based on MOST-MET (MOST), CAF (Tapestry), SUMO• Further developed in the EU project MAX

• Has great possibilities to become a common European standardised evaluation tool ensuring…

… that evaluations are able to be done at all

… that evaluations are done in a comparable way

slide 4

Mobility Management

System impact

MaxSumo

slide 5

System impacts

Mobility Management

services

System impacts

New mobility option

Mobility Management

slide 6

Example: Test Traveller / Job ticket project

Background Before data: 5 % PT, 95 % car (in TT group)

Mo

bility

Services

Activities: 10 posters, Intra net info, meetings, 100 E

Awareness: 48 % (480 employees)

Usage: 28 % (280 employees) particip. in info-meet.

Satisfaction: 80 % satisfied with info and test concept

Mo

bility O

ptio

n O

ffered

Acceptance: 6 % (54 people) signed a contract

Take up: : During: 85 % PT (in TT group)

Satisfaction: 90 % of TT satisfied with commuting by PT

Effects

Perm travel beh. After 12 months: 40 % PT (in TT group)

Decrease/year: Car traffic: 110.000 km, CO2: 20 tonnes

slide 7

How to use MaxSumo?

slide 8

MonitoringCollect a basic data-set

Evaluationof the data collected

Monitoring and Evaluation

Project Start

Target Groups

Services & Option offered

Uppdragsbeskrivning& målsättningar

Mission Statement and Objectives

Targets and indicators on Assessment Levels

MEP: Monitoring

and Evaluation

Plan

for the actual project

Methods

slide 9

MonitoringCollect a basic data-set

Evaluationof the data collected

Monitoring and Evaluation

Project Start

Target Groups

Services & Option offered

Uppdragsbeskrivning& målsättningar

Mission Statement and Objectives

Targets and indicators on Assessment Levels

MEP: Monitoring

and Evaluation

Plan

for the actual project

Methods

slide 10

Overall goals

Target groups

Mobility services provided

Mobility option(s) offered

MaxSumo Monitoring and Evaluation Plan

Template 1

10

slide 11

Level Targets Indicators Methods When

Servicesprovided

A Project activities and outputs

B Awareness of mobility services provided

C Usage of mobility services provided

D Satisfaction with mobility services provided

Mobilityoption offered

E Acceptance of mobility options offered

F Take up of mobility option offered

G Satisfaction with the mobility option offered

Overall effects

H Long-term attitudes and behaviour

I System impacts

MaxSumo Monitoring and Evaluation Plan

Template 2

slide 12

Level Targets Indicators Methods When

Servicesprovided

A Project activities and outputs

XXX XXX

B Awareness of mobility services provided

XXX XXX

C Usage of mobility services provided

XXX XXX

D Satisfaction with mobility services provided

XXX XXX

Mobilityoption offered

E Acceptance of mobility options offered

XXX XXX

F Take up of mobility option offered

XXX XXX

G Satisfaction with the mobility option offered

XXX XXX

Overall effects

H Long-term attitudes and behaviour

XXX XXX

I System impacts XXX XXX

MaxSUMO Evaluation Plan

Template 2MaxSumo Monitoring and Evaluation Plan

Template 2

slide 13

Level Targets Indicators Methods When

Servicesprovided

A Project activities and outputs

XXX XXX

B Awareness of mobility services provided

XXX XXX

C Usage of mobility services provided

XXX XXX

D Satisfaction with mobility services provided

XXX XXX

Mobilityoption offered

E Acceptance of mobility options offered

XXX XXX

F Take up of mobility option offered

XXX XXX

G Satisfaction with the mobility option offered

XXX XXX

Overall effects

H Long-term attitudes and behaviour

XXX XXX

I System impacts XXX XXX

MaxSUMO Evaluation Plan

Template 2MaxSumo Monitoring and Evaluation Plan

Template 2

slide 14

Level Targets Indicators Methods When

Servicesprovided

A Project activities and outputs

XXX XXX XXX

B Awareness of mobility services provided

C Usage of mobility services provided

XXX XXX XXX

D Satisfaction with mobility services provided

Mobilityoption offered

E Acceptance of mobility options offered

XXX XXX XXX XXX

F Take up of mobility option offered

XXX XXX XXX

G Satisfaction with the mobility option offered

Overall effects

H Long-term attitudes and behaviour

XXX XXX XXX XXX

I System impacts XXX XXX XXX

MaxSUMO Evaluation Plan

Template 2MaxSumo Monitoring and Evaluation Plan

Template 2

slide 15

OK, let´s practice!

• Case 1: Personalised travel planning

• Case 2: Walk and Bike to school

slide 16

Overall goals

Target groups

Mobility services provided

Mobility option(s) offered

MaxSumo Monitoring and Evaluation Plan

Template 1

16

slide 17

MaxSumo Evaluation Plan

Template 1

Overall goals To decrease the use of car and decrease the CO2 emissions.

Target groups Inhabitants living in Gros i San Sebastian.

Services - Information letter to all households (timetables, bikemaps, etc)

- An ”answering card” with possibility to:

- ask for personalised advices

- to order a free 1-week PT ticket

Mobility option offered

To travel by public transport, bike or foot instead of using the car.

slide 18

Level Targets Indicators Methods When

Servicesprovided

A Project activities and outputs

B Awareness of mobility services provided

C Usage of mobility services provided

D Satisfaction with mobility services provided

Mobilityoption offered

E Acceptance of mobility options offered

F Take up of mobility option offered

G Satisfaction with the mobility option offered

Overall effects

H Long-term attitudes and behaviour

I System impacts

MaxSumo Monitoring and Evaluation Plan

Template 2

slide 19

MaxSumo gives you

- Help to manage and pilot

- Guidance on survey design:

- control group

- comparison group

- one group

- Practical help (examples of questions)

- Help throughout the whole process: stop and go

- Early results- Comparable results

To be aware of…

- Clear objective

- Clear conceptions of services and options offered

- Best if used already in the planning stage

- You don´t have to use all levels

- Only provides a structure – still the same requirements on the competence of the evaluator

- Seems to be easier than it is…

slide 20

• Interactive database with input and output modules• Based on MaxSumo and Swedish SARA

• Accumulates results from different projects evaluated using MaxSumo

• Gives guidance on how to evaluate• Makes it possilible to benchmark with others

MaxEva web-based tool

slide 21

Thank you!

Pernilla Hyllenius Mattisson

pernilla.hyllenius@trivector.se

MaxSumo and MaxEva: www.epomm.eu / Max MM-tools