FCP Survey Grantee Report Final 2€¦ · Grants page on we bsite easy to navigate Grant...

12
2013 - 2014 FCP Grantee Survey Report

Transcript of FCP Survey Grantee Report Final 2€¦ · Grants page on we bsite easy to navigate Grant...

Page 1: FCP Survey Grantee Report Final 2€¦ · Grants page on we bsite easy to navigate Grant instruction and app easy to access and download Uploading/submitting grant app easy to read

2013 - 2014FCP Grantee Survey Report

Page 2: FCP Survey Grantee Report Final 2€¦ · Grants page on we bsite easy to navigate Grant instruction and app easy to access and download Uploading/submitting grant app easy to read

Executive Summary

In August 2013, Drexel University School of Public Health was hired by Foundations Community Partnership (FCP) to evaluate the foundation’s grant making after six years. The Foundations Community Partnership Survey was designed to assess 1) grantee experiences and perceptions of grantees in Buck County and 2) the impact of FCP grant(s) on grantees’ work.

MethodologyAll 180 FCP grantees and grant applicants since 2007 were invited to take the online survey via Qualtrics (www.qualtrics.com). The survey was conducted from early Septem-ber 2013 through mid-October 2013. Fifty-two grantee respondents completed the survey (28.9% response rate).

• Responses were submitted via the Web.• Response frequencies and mean ratings on a 5-point scale are shown throughout the report• All grantee survey responses were anonymous. The Drexel SPH team removed any comments that could potentially identify the respondent.• Selected grantee comments are shown at the end of the report. This selection of comments highlights the key themes in the data. • This survey report is part of a larger evaluation project that will include insights from key informant interviews that will be conducted from January to February 2014.

Background

Key FindingsFoundations Community Partnership is rated highly on many measures in the “Founda-tions Community Partnership Survey”. Mean scores of grantee responses were deter-mined for each category and are as follows:

• Grant Application/Grant Writing Assistance: The mean score for grantee requests for information or assistance from FCP was 4.78. The mean score for usefulness of FCP resources during the grant application process was 4.40. • Grant Application: The mean score for the grant application process was 4.40 (see Figure 1 for types of assistance provided by FCP).• Grant Management: The mean score for grantee reporting requirements is 4.12. Grantees also rated the frequency that FCP provided grant management support with a mean score of 3.91.• Grant Effectiveness and Sustainability: Grantee respondents agreed that FCP’s grant effectiveness and sustainability activities have impacted organizations’ work in the community with a mean score of 4.16.

Brion, T., Sax, R., Carroll-Scott, A.Drexel University School of Public Health

Page 3: FCP Survey Grantee Report Final 2€¦ · Grants page on we bsite easy to navigate Grant instruction and app easy to access and download Uploading/submitting grant app easy to read

Overall, a majority of FCP grantees strongly agree that FCP has been effective in devel-oping a comprehensive grant making system that supports potential grantees from the pre-application stage to completion of the grant funded project. Within a short span of six years, FCP has made a very significant impact (see Figures 1 & 2) in supporting organiza-tions that promote behavioral health education and research in Bucks County.

Figure 1: FCP’s Primary Types of Impact on Organizations’ Work, 2007 - 2013, n = 47

Incr

ease

d co

mm

unity

part

icip

atio

n

Evid

ence

-bas

ed c

hang

es

Incr

ease

d po

pula

tion’

skn

owle

dge

29

26

New

col

lab.

WIT

HIN

B.C

.bu

t OU

TSID

E ta

rget

pop

.

18

New

col

lab.

OU

TSID

E B.

C.

& O

UTS

IDE

targ

et p

op.

8

Purs

uing

pro

gram

of

inte

rest

furt

her

22

Oth

er

7 1

19

1

24

Very

sign

i�ca

ntim

pact

Sign

i�ca

nt im

pact

Nei

ther

r min

imal

or

signi

�can

t im

pact

Figure 2: Grantee Perceptions of FCP’s Impacton Bucks County, 2007 - 2013, n = 44

of grantees think that FCP has had a “Very Signi�cant” impact on Bucks County.

54.5%

# of respondents#

of re

spon

dent

s

Page 4: FCP Survey Grantee Report Final 2€¦ · Grants page on we bsite easy to navigate Grant instruction and app easy to access and download Uploading/submitting grant app easy to read

FCP Grantee Survey Full Report

Drexel University School of Public Health was contracted by Foundations Community Partnership (FCP) to evaluate the foundation’s grant making after six years. The Founda-tions Community Partnership Survey was designed to assess: 1) grantee experiences and perceptions of grantees in Buck County; and 2) the impact of FCP grant(s) on grant-ees’ work.

The survey was disseminated using the online survey tool, Qualtrics (http://qualtrics.com/). On September 9th, 2013, FCP emailed the Foundations Commu-nity Partnership Survey link to all of the 180 grantees and grant applicants since 2007. The survey was closed on October 18th, 2013. Two reminder emails were sent out in this period. This survey report is part of a larger evaluation project that will include key infor-mant interviews that will be conducted from January to February 2014. Key informant interviews will expand the focus to gain insights not only from grantees but from other stakeholders who have interacted with FCP through the years.

Survey Respondents Of the 180 individuals who received the Foundations Community Partnership Survey link, 52 (28.9%) grantee respondents com-pleted the survey. Most grantee respondents applied one time for an FCP grant with those applying for two grants a close second (27.5%). The largest group of FCP grantee respondents has received one grant with the majority receiving Partnership in Youth Ser-vices (PYS) grants (26) and Bucks Innova-tion and Improvement grants (25).

A majority of grantee respondents have received grants from other organizations before receiving their first grant from FCP (87%) with one third of respondents learning about FCP through direct interaction with FCP board members and/or staff. Grantee respondents agreed that they were familiar with FCP’s mission (100%) and vision (95.9%).

1

29.4%

29.4% of grantees applied onetime for an FCP grant

Introduction

39.2%

39.2% of grantees receivedone FCP grant

Brion, T., Sax, R., Carroll-Scott, A.Drexel University School of Public Health

Page 5: FCP Survey Grantee Report Final 2€¦ · Grants page on we bsite easy to navigate Grant instruction and app easy to access and download Uploading/submitting grant app easy to read

2

Organizational CharacteristicsAs evidenced by Figure 1, a majority of respondents described their organization as a not-for-profit organization. Grantees primarily served youth in Bucks County, but served other populations as well (see Figure 2). Many grantees have been providing services, implementing programs, and/or conducting educational workshops for more than 20 years (71.1%).

Figure 1: How would you categorize your organization?Fa

mile

s

Yout

h

Youn

g Ad

ults

2422

Figure 2: What community or population do you serve?

Adul

ts

19

Elde

rly

15

Min

ority

21

Low

-Inco

me

Hom

eles

s

7

40

24

Child

ren

with

Sp

ecia

l Nee

ds

23

Oth

er

1

Brion, T., Sax, R., Carroll-Scott, A.Drexel University School of Public Health

Not

-for-

pro�

t

NG

O

Serv

ice

deliv

ery

38

8

Char

ity

7

Clin

ical

pro

vide

r

4Co

aliti

on/C

olla

b/Co

mm

. Par

tner

ship

Coop

erat

ive

Oth

er

76 14

Page 6: FCP Survey Grantee Report Final 2€¦ · Grants page on we bsite easy to navigate Grant instruction and app easy to access and download Uploading/submitting grant app easy to read

Grant Application/Grant Writing Assistance More than half of grantees received assistance from FCP during the grant application process (65.3%). As evidenced by Figure 3, the largest group of grantees received assistance by speaking to FCP staff and/or attending a pre-grant meeting and contacted FCP for assistance 1-3 times (67.4%). Two respondents requested information or assis-tance 10+ times. A majority of respondents received their FCP grant the first time around (83.7%). About half of the grantees received some kind of assistance from FCP after receiving their grant (51%). Of those who received assistance after receiving their grant, the largest group received assistance in completing project changes and/or reporting requirements and applying for future FCP grants (see Figure 4). The resources that grantees cited as being most useful were staff time/responsiveness (mean score = 4.80*) and information on grant opportunities (4.68*).

* mean score based on a 5.00 scale, 1 = not at all useful, 5 = extremely useful

Figure 3: FCP Assistance During Grant Application Process2007 - 2013, n = 47

Att

ende

d pr

e-gr

ant

mee

ting

Spok

e to

FCP

Att

ende

d w

orks

hop

on g

rant

writ

ing

25

5

Pre-

gran

t due

di

ligen

ce c

heck

list

10

Crea

ting

achi

evab

legr

ant o

bjec

tives

15

Com

plet

ing

gran

t req

spr

ior t

o su

bmis

sion

9

Subm

ittin

g gr

ant

appl

icat

ion

onlin

e

Aft

er s

ubm

issi

onan

d be

fore

revi

ew

7

25

12

Te

chni

cal A

ssis

tanc

eG

rant

2

Oth

er

0

3Brion, T., Sax, R., Carroll-Scott, A.

Drexel University School of Public Health

Page 7: FCP Survey Grantee Report Final 2€¦ · Grants page on we bsite easy to navigate Grant instruction and app easy to access and download Uploading/submitting grant app easy to read

4

Figure 4: FCP Assistance After Receiving Grant2007 - 2013, n = 47

Info

rmat

ion

onpu

blic

atio

n/to

pic

expe

rts

Proj

ect c

hang

esan

d/or

repo

rtin

g

Com

mun

icat

e re

sults

to e

xter

nal a

udie

nces

4

6

5

App

lyin

g fo

r fut

ure

FCP

gran

ts

14

Oth

er

14

App

lyin

g fo

r fut

ure

gran

ts fr

om o

ther

fund

ers

03

For the most part, grantee experiences with requests for information or assistance from FCP were rated as “Very Good” or “Excellent” **. Grantees rated their overall satisfaction with assistance with a mean score of 4.82. One grantee rated adequacy of follow-up as “Poor” and one grantee rated their overall satisfaction with assistance as “Fair”.

** mean score based on 5.00 scale, 1 = poor, 5 = excellent

Grant ApplicationRespondents, in general, strongly agreed*** that the grant application was easy and accessible. One respondent disagreed that the grants page was easy to navigate, one respondent neither agreed nor disagreed that uploading or submitting the grant applica-tion instructions were easy to read and clear, and three respondents neither agreed nor disagreed that the application instructions were easy to read and clear (see Figure 5).

*** mean score based on 5.00 scale, 1 = strongly disagree, 5 = strongly agree

Brion, T., Sax, R., Carroll-Scott, A.Drexel University School of Public Health

Page 8: FCP Survey Grantee Report Final 2€¦ · Grants page on we bsite easy to navigate Grant instruction and app easy to access and download Uploading/submitting grant app easy to read

4.43 4.434.35

Gra

nts

page

on

we

bsite

ea

sy to

nav

igat

e

Gra

nt in

stru

ctio

n an

d ap

pea

sy to

acc

ess

and

dow

nloa

d

Upl

oadi

ng/s

ubm

ittin

g gr

ant

app

easy

to re

ad a

nd c

lear

4.37

App

Inst

ruct

ions

eas

yto

read

and

cle

ar

Figure 5: Mean Ratings For Grant Application Process, 2007 - 2013, n = 47

Grant ManagementResponses were more varied in terms of grant management. In Figure 6, a majority of respondents agreed that reporting requirements were streamlined. However, four respondents neither agreed nor disagreed with this statement. The largest group of grantees agreed that reporting requirements were easy to follow and complete as well as reasonable for the size of the grant received. Two respondents disagreed that reporting requirements were easy to follow and complete. Two respondents disagreed and five respondents neither agreed nor disagreed that the reporting requirements were reason-able for the size of grant received.

As evidenced by Figure 7, grantees generally rated the frequency of contact among the respondents and staff at FCP as very good**. Two respondents rated frequency of providing general information about the foundation and frequency that FCP sent an email or phone call as “Fair” and 11 rated these categories as “Good”. Three respondents rated frequency that FCP has in-person meetings as “Fair” and 13 rated this category as “Good”. One respondent rated the frequency of FCP seminars/events as “Fair” and 13 respondents rating this category as “Good”.

4.09 4.094.17

Stre

amlin

ed

Easy

to fo

llow

and

com

plet

e

Reas

onab

le fo

r siz

e of

gra

nt re

ceiv

ed

Figure 6: Mean Ratings For Grant Reporting, 2007 - 2013, n = 47

5Brion, T., Sax, R., Carroll-Scott, A.

Drexel University School of Public Health

0

1

2

3

4

5

0

1

2

3

4

5

Page 9: FCP Survey Grantee Report Final 2€¦ · Grants page on we bsite easy to navigate Grant instruction and app easy to access and download Uploading/submitting grant app easy to read

3.96 3.833.93

Prov

ided

gen

eral

info

abou

t fou

ndat

ion

Sent

an

emai

l or

phon

e ca

ll

Hav

e an

in-p

erso

nm

eetin

g

3.93

Hos

ted

FCP

sem

inar

or e

vent

Figure 7: Mean Scores for Frequency of Communication with FCP, 2007 - 2013, n = 47

Grant Effectiveness and SustainabilityThe top three types of impact reported by grantees as a result of receiving FCP grant funding were 1) increased community participation, 2) increased target population's knowledge on topics specific to the implemented program and 3) participation in the FCP grant process stimulated interest in pursuing the program area of interest further (see Figure 8).

The largest group of respondents strongly agreed*** (mean = 4.45) that the FCP grant helped their organization reach more clients and/or provide more services. Two respon-dents disagreed that the FCP grant helped them reach more clients. Grantees also agreed that the FCP grant helped improve the sustainability of their program (4.27). Five respondents neither agreed nor disagreed with this statement. In terms of leveraging more funding from other funding sources, the largest group neither agreed nor disagreed with the statement (mean = 3.75). Two respondents disagreed that the FCP grant lever-aged more funding from other sources.

The FCP grant has led to development of some products or activities based on the grant. Most prevalent activities involved development of a press release (20 of 44 respondents),

6Brion, T., Sax, R., Carroll-Scott, A.

Drexel University School of Public Health

0

1

2

3

4

5

Page 10: FCP Survey Grantee Report Final 2€¦ · Grants page on we bsite easy to navigate Grant instruction and app easy to access and download Uploading/submitting grant app easy to read

Figure 8: FCP’s Primary Types of Impact on Organizations’ Work2007 - 2013, n = 47

Incr

ease

d co

mm

unity

part

icip

atio

n

Evid

ence

-bas

ed c

hang

es

Incr

ease

d po

pula

tion’

skn

owle

dge

29

26

New

col

lab.

WIT

HIN

B.C

.bu

t OU

TSID

E ta

rget

pop

.

18

New

col

lab.

OU

TSID

E B.

C.&

OU

TSID

E ta

rget

pop

.

8

Purs

uing

pro

gram

of

inte

rest

furt

her

22

Oth

er

7 1

a print story (18 of 44 respondents), and an invitation to collaborate with others (16 of 44 respondents).

Many grantees have recommended other colleagues to contact FCP for information or to apply for a grant (69.6%). Of the 46 respondents, 76.1% have applied to other grant making entities for additional funding to support their work.

Overall, respondents rated (mean = 4.49) FCP “Excellent” with its ability to meet its mis-sion and vision, to foster an image of integrity and trustworthiness in the community (4.71), on its quality of staff (4.71), knowledge on working with non-profits (4.62) and experience with working with non-profits (4.64). Respondents also generally rated FCP “Excellent” on its grant making strategy and performance (4.62), leadership in the com-munity (4.60), ability to make an impact on the community (4.71), and transparency of grant making (4.56).

7Brion, T., Sax, R., Carroll-Scott, A.

Drexel University School of Public Health

Page 11: FCP Survey Grantee Report Final 2€¦ · Grants page on we bsite easy to navigate Grant instruction and app easy to access and download Uploading/submitting grant app easy to read

The largest group of respondents rated FCP’s impact on the Bucks County community as having a “Very Significant Impact”. The second largest group rated FCP as having a “Sig-nificant Impact” with a mean impact score of 4.52. One respondent rated FCP as having “Neither minimal or significant impact”.

Selected Grantee CommentsThe following are verbatim comments by grantee survey respondents reflecting the key themes found in the responses: How can FCP improve services in the future?

• Greater dissemination of information regarding summer internship program; bring non-profits together for discussion and/or collaborations

• Continue to have the annual luncheon and providing leadership for the non-profit com-munity.

• Bring the non-profit community together for community needs assessment activities

• Keep reaching out. As our small organizations are squeezed by reduced staff numbers, it is easy to forget deadlines and opportunities while putting out our local fires.

• Not sure there is an answer for improving something that works great already!

• A mentor group for smaller not for profits, a roundtable type of initiative would be very helpful. Maybe once every 6 weeks we meet to share resources, learn, network, collabo-rate, etc.

General comments and/or suggestions?

• FCP's staff always make us feel like they are committed to seeing this organization suc-ceed! They are invested and we feel it. The personal calls and visits make a big differ-ence.

• Explore option of some general operating funds. Continue the variety of types of grants that are available. Great to have a foundation that cares about the non-profits and sees the value of small grants that are available through the Partnership Grants. Have always found the foundation staff to be responsive and helpful through the years.

• Enjoy your great reputation for making a difference for so many non-profits!

8Brion, T., Sax, R., Carroll-Scott, A.

Drexel University School of Public Health

Page 12: FCP Survey Grantee Report Final 2€¦ · Grants page on we bsite easy to navigate Grant instruction and app easy to access and download Uploading/submitting grant app easy to read

• FCP is clearly a first-class grant-making organization. We have been deeply apprecia-tive of the support and assistance they have provided to our nonprofit organization over the past several years.

• Please keep doing what you do. You are a great and much needed community resource.

• This survey is too long and/or cannot be saved, give amount of time it takes prior to start-ing, I am thankful for the grant and want to give feedback but I need to know ahead of time to set aside 30 minutes.

• You are doing extremely helpful work as more and more government sources of grants are restricted.

ConclusionSurvey results suggest Foundations Community Partnership has accomplished a lot within a short span of six years. Data from the survey suggests that a majority of grantee respondents strongly agree that FCP has been effective in developing a comprehensive grant making system and guidelines that support potential grantees from the pre-application stage to completion of the grant funded project. FCP has also made an impact supporting organizations that promote behavioral health in Bucks County, and enabled these organizations to achieve significant impacts of their work in the populations they serve.

9

Suggested Citation: Brion, T., Sax, R., & Carroll-Scott, A. (2013). 2013-2014 Grantee Survey Report. Drexel University School of Public Health.

Brion, T., Sax, R., Carroll-Scott, A.Drexel University School of Public Health