Impact evaluation in the sector of Social Entrepreneurship: Integrating GIS with inductive methods.

16
Impact evaluation in the sector of Social Entrepreneurship: Integrating GIS with inductive methods

Transcript of Impact evaluation in the sector of Social Entrepreneurship: Integrating GIS with inductive methods.

Page 1: Impact evaluation in the sector of Social Entrepreneurship: Integrating GIS with inductive methods.

Impact evaluation in the sector of Social Entrepreneurship: Integrating

GIS with inductive methods

Page 2: Impact evaluation in the sector of Social Entrepreneurship: Integrating GIS with inductive methods.

1. Introduction to the Knowledge Transfer Partnership (‘KTP’) project

2. Outline current strategies in impact evaluation

3. The KTP method and progress

4. Summary of conclusions

Aim of the session

Page 3: Impact evaluation in the sector of Social Entrepreneurship: Integrating GIS with inductive methods.

Knowledge Transfer Partnership: Designing and implementing a longitudinal impact evaluation strategy

Design and implement a strategyto evaluate the kinds of socialimpact being made by UnLtd

Award Winners

The foundation for Social Entrepreneurs

Department of Geomatic Engineering

Page 4: Impact evaluation in the sector of Social Entrepreneurship: Integrating GIS with inductive methods.

The landscape of impact evaluation

Evidence-based research

-use of both qualitative and quantitative methods

Markers of success -used to measure impact

Deductive methods -common practice in impact evaluation

Page 5: Impact evaluation in the sector of Social Entrepreneurship: Integrating GIS with inductive methods.

Current impact evaluation strategies: the deductive approach

Hypothesis

Observation

Confirmation/rejection of hypothesis

Deductive approach: An approach to developing or confirming a theory that begins with abstract concepts and theoretical relationships and works toward more empirical evidence (Neuman, 2006, pp.59)

1.

2.

3.

Page 6: Impact evaluation in the sector of Social Entrepreneurship: Integrating GIS with inductive methods.

The problem…

Hypothesis

-Reliant on what we understand about Social Entrepreneurs

-Reliant on what we understand about impact

Observation-Methods are designed to gather evidence to support of reject hypothesis

Confirmation/rejection of hypothesis

-Knowledge of social entrepreneurs is specific and limited

Page 7: Impact evaluation in the sector of Social Entrepreneurship: Integrating GIS with inductive methods.

Mapping Social Entrepreneurs: an example of deductive approaches to evaluation

Source: UnLtd research, 2005

Page 8: Impact evaluation in the sector of Social Entrepreneurship: Integrating GIS with inductive methods.

Inductive approach to impact evaluation

Observation

Pattern/Trend

Tentative hypothesis

Theory

Inductive approach: An approach to developing or confirming a theory that begins with concrete empirical evidence and works toward more abstract concepts and theoretical relationships (Neuman, 2006, pp.60)

Qualitative interviews

Questionnaires/ Surveys

Page 9: Impact evaluation in the sector of Social Entrepreneurship: Integrating GIS with inductive methods.

Combining GIS and qualitative methods

Qualitative research: To observe and gather information

about social entrepreneurs’ experience of creating

social impact

Geographic Information Systems/Science:

Provides ‘a tool for representing and visualizing environments

beyond the scope of everyday life’ (McLafferty, 2002, pp.265)

A more comprehensive and more critical view of

social impact

Inductivedirection

Page 10: Impact evaluation in the sector of Social Entrepreneurship: Integrating GIS with inductive methods.

The project stages

STAGE 1: Review of literature

STAGE 2: Research tool design

STAGE 3: Field work

STAGE 4: Data analysis

STAGE 5:Results

Pilot Study

In depth interviews, focus groups,

online surveys, mappingATLAS.ti, SPSS, GIS

Page 11: Impact evaluation in the sector of Social Entrepreneurship: Integrating GIS with inductive methods.

Introducing GIS

Geographical Information Systems and Science

-Computer systems that can capture, store, analyse and manage any data with a spatial reference-Is recognised for its ability to support qualitative research that that seeks to understand the socio-spatial contexts of individual experiences

-can teach us how to enhance social impact

Page 12: Impact evaluation in the sector of Social Entrepreneurship: Integrating GIS with inductive methods.

Data analysis and impact mapping

Coding of qualitative

data

Categories of impact

Further testingon broader population

Impact maps

Page 13: Impact evaluation in the sector of Social Entrepreneurship: Integrating GIS with inductive methods.

Impact Maps

Source: UnLtd research, 2005

No’ of jobs created through projects

>10080-9960-7940-5920-3910-19

5-90-4

Projects run by those aged 25-30

Page 14: Impact evaluation in the sector of Social Entrepreneurship: Integrating GIS with inductive methods.

Pilot study results

Award Winners identify social

impact as:

Changes to attitude

Change to behaviour

Skill provisionRemoving barriersto social inclusion

Improvingcommunitycohesion

Reducing crime

Providing support

“Impact for me is making people sit up and listen… and about creating a difference”

“think that we’ve given a lot of grooms a little boost, a bit of confidence…”

“If you’re making 50,000 pounds or if

you’re on limited income support…you

should have the benefit of being

treated as a client and not as a service user. And that’s the

whole idea behind wanting to run [this

project]”

“…the BGA can make them feel a bit more inclusive, socially inclusive in the area that they’re in”

Page 15: Impact evaluation in the sector of Social Entrepreneurship: Integrating GIS with inductive methods.

Summary of conclusions

• Deductive approaches to impact evaluation provide partial knowledge about social impact

• By adopting an inductive approach we can develop a more comprehensive understanding about social impact

• Incorporating GIS with inductive/qualitative methods encourages a more in-depth and critical approach to understanding impact

Page 16: Impact evaluation in the sector of Social Entrepreneurship: Integrating GIS with inductive methods.

Laura FryKnowledge Transfer Associate, UCL, [email protected]

Mordechai (Muki) HaklaySenior Lecturer, [email protected]

Lea EsterhuizenHead of Research, [email protected]