Chapter FiveChapter Five

Survey DesignsSurvey Designs

Survey Design

• Cross-sectional studies that collect data on a topic at 1 point in time

• Measures many variables at once

• Uses statistical techniques to make inferences about relationships among variables

Rationale of the SurveyRationale of the Survey

• used for large sample studies intending to use a sample to represent a larger population

• collects information on many variables typically

• may be altered for interviews to allow probing

• relatively easy, cheap

Steps in Survey Design• Formulate the research question

• Select the type of survey (interview, phone,etc)

• Translate the objectives of the survey into items or questions

• Identify the population or setting

• Develop sampling procedures

• Design data collection procedures

• Pilot test data collection & analysis procedures

• Modify procedures as necessary

• Collect & analyze data & write report

General Rules: AdministrationGeneral Rules: Administration

• establish legitimacy

• keep it simple

• report to respondent

• pay respondents, reciprocal relation

• no pressure to participate

• quality control

Individually-Delivered Individually-Delivered QuestionnairesQuestionnaires

• Personal contact

• avoid mail backs or drop-box return method

• use slotted return box

• record time/place information

• provide envelope for privacy

Group Administered Group Administered QuestionnairesQuestionnaires

• voluntary nature of survey

• arrange in advance

• explain survey to respondents

• administer at end of session

• identify bad questionnaires

Mailed QuestionnairesMailed Questionnaires

• Response rate concern: key elements include:

– salience of topic– number of contacts– incentives– government sponsored

Tips for Mailed QuestionnairesTips for Mailed Questionnaires

• legitimacy through sponsoring agency

• name in full, no initials, personal touch (hand written good)

• first-class mail, stamps, not metered

• stamped envelope for return

• codes on questionnaire

• incentive, use new coinage

• post-card follow up

• phone call follow up

Phone Survey TipsPhone Survey Tips

• begin with salient & interesting• establish rules for determining who gets

interviewed• monitor quality• simplify response categories

Advantages & LimitationsAdvantages & Limitations

Research Design Category General ValidityCausalInference

Multi-variate Probing

EXPERIMENTAL DESIGNS

Pre-experimental Experimental Quasi-Experimental

- -

- - -

- + +

- - -

- - -

SURVEY DESIGNS

Individual Questionnaire Group Administered Phone Survey Interview Comparative Analysis Secondary Data Meta Analysis

+ - + + + + +

- - - - - - -

- - - - - - -

+ + + + + + -

- - - + - - -

Comparative Studies

• Comparative surveys involve comparing two or more samples on one or more variables, at one point in time

• Comparative studies are those whose very purpose is to compare

• May include quantitative, qualitative, or a combination of each method

• Cross-cultural & historical studies are examples

Examples of Comparative Nursing Studies

• Coming of Age in the New Metropolis (Palteil et al., 1998)

• Adaptation to Pregnancy in Three different Ethnic Groups (Lederman & Miller, 1998)

Challenges in Comparative Research

• Equivalence of concepts

• Equivalence of indicators

• Equivalence of language

• The problem of selecting evidence

Secondary Data Analysis

• The analysis of an existing data source, or set of documents, for some research purpose other than the one originally intended

• Involves re-analysis of data by another researcher to answer the same research question or another question or to apply a different method of analysis

• Most resembles survey designs in terms of the analytical procedures used

Secondary Data Analysis

• Purpose

• Sources of data

• Challenges in conducting secondary data analysis