PHILIPPINE NORMAL UNIVERSITYNATIONAL CENTER FOR TEACHER EDUCATION

TAFT AVENUE, MANILA

SURVEY METHODGROUP 1

III-15 BEED

AGRAMON, DANICA ANNE V.MONTE, CLARISSA R.

PETALCORIN, QUIN MARIRAMOS, KRYSTEL CAMILLE L.

REBESE, GLAYSA A.VELOSO, REGINE S.

SURVEY

WHAT IS A

SURVEY? TYPES

OF A SURVEY

WHY ARE SURVEY

CONDUCTED?

STEPS IN SURVEY

RESEARCH

WHAT IS A SURVEY?Information is collected from a group of people in

order to describe some aspects or characteristics of the population of which that group is a part.

The main way in which the information is collected is through asking questions by the members of the group constitute the data of the study.Information is collected from a sample rather that from every member of the population.

WHY ARE SURVEY CONDUCTED?

Describe the characteristics of a population

Major purpose:

In essence, what researches want to find out is how the members of a population distribute themselves on one or more variables.

• AGE

•ETHNICITY

• RELIGIOUS PREFERENCE

• ATTITUDES TOWARD SCHOOL

Longitudinal surveys

TYPES OF SURVEY

Cross-sectional surveys

Trend study

Cohort study

Panel study

Cross-sectional surveys

Collects information from a sample that has been drawn from a predetermined population The information is collected at just one point in time

EXAMPLE

Longitudinal surveys

Information is collected at different points in time in order to study changes over time

Trend study

Cohort study

Panel study

Different samples from a population whose members may change are surveyed at different points in time

A particular population whose members do not change over the course of the survey

The researcher surveys the same samples of individuals at different times during the course of the survey

EXAMPLE

EXAMPLE

EXAMPLE

Examples

A professor of mathematics might collect data from a

sample of all the high school Mathematics teachers in a

particular state about their interests in earning a master’s

degree in Mathematics from his university, or

Another researcher might take a survey of the kinds of

personal problems experienced by students at 10,, 13

and 16 years of age.

A researcher might be interested in the attitudes

of high school principals toward the use of flexible

scheduling. He would select a sample each year

from a current listing of high school principals

throughout the state.

Example

A researcher might want to study growth in

teaching effectiveness of all the first year

teachers who had graduated in the past year from

San Francisco State University. The names of all

of these teachers would be listed, and then a

different sample would be selected from this

listing at different times.

Example

The researcher in the previous example might

select a sample of last year’s graduates from

San Francisco State University who are first year

teachers and survey the same individuals

several times during the teaching year.

Example

Steps in Survey Method

STEP 1: DEFINING THE PROBLEMThe problem to be investigated by means of Survey should be:

- Sufficiently interesting- Important

Strategy for defining survey question:- Hierarchical Approach

STEP 2: IDENTIFYING THE TARGET POPULATION

Unit of Analysis- Is the major entity that is being analyzed

in a study- It is the “what” or “who” that is being

studied- It include individuals, groups, social

organizations and social artifacts.Target Population

- The group of persons (objects, institutions and so on) that is being studied.

STEP 3: CHOOSING THE MODE OF THECOLLECTION

Direct Administration to a GroupADVANTAGES- High rate of response- often close to 100 percent (usually in single setting).- Low cost factor-Researcher has an opportunity to explain the study and answer any questions that the respondents may have before they complete the questionnaire.DISADVANTAGES-The chief disadvantage is that there are not many types of survey that can use sample of individuals that are collected together as a group.

Mail SurveysADVANTAGES- Relatively inexpensive- Can be accomplished by the researcher alone (or with

only a few assistants)- Allows the researcher to have access to sample that

might be hard to reach in person or by telephone.- It permits the respondents to take sufficient time to give

thoughtful answers to the questions asked.DISADVANTAGES- Less opportunity to encourage the cooperation of the

respondents- Less opportunity to provide assistance- Have a tendency to produce low response rates

Telephone SurveysADVANTAGES- Cheaper than personal interview- Can be conduct fairly quickly- Can easily lend themselves to standardized questioning procedures- Allows the researcher to assist the respondent (by clarifying

questions, asking follow- up questions, encouraging hesitant respondents, and so on)

- Allows the researcher to permit a greater amount of follow- up (through several call backs)

- Provide better coverage in certain areas where personal interviewers are reluctant to go

DISADVANTAGES- Access to some sample (obviously, those without telephones and

those whose phone numbers are unlisted) is not possible.- Telephone Interviews also prevent visual observation of

respondents - Less effective in obtaining information about sensitive issues or

personal questions.

Personal InterviewsADVANTAGES- It is probably the most effective survey method for enlisting

the cooperation of the respondents.- Rapport can be established- Question can be clarified - Unclear or incomplete answers can be followed up.- The places of the interview is less of a burden on reading and

writing skills of the respondents- Permits spending more time with respondents. DISADVANTAGES- More costly than direct, mail, or telephone surveys.- It require a trained staff of interviewers- The total data collection time required is likely to be quite a bit

longer than in any of the other three methods.

STEP 4: SELECTING THE SAMPLE- The subject of the survey should be

selected from the population.- the subjects they intend to question

possess the desired information - Individuals who possess the necessary

information but who are uninterested in the topic of the survey (or who do not see as important) are unlikely to respondents.

- conduct a preliminary inquiry among potential respondents

SLOVIN’S FORMULA FOR COMPUTING SAMPLEis used to calculate the sample size (n) given the population size (N) and a margin of error (e)

 it's a random sampling technique formula to estimate sampling size 

  It is computed as n = N / (1+Ne2).whereas: n = no. of samplesN = total populatione = error margin / margin of error

How to use slovin's formula? (Examples)

A researcher plans to conduct a survey. If the

population on High City  is 1,000,000 , find the

sample size if the margin of error is 25%      

             

Given:N = 1,000,000e = 25% = 0.025

First : Convert the Margin Error 25% by dividing it to 100   

n = 1,000,000/(1 + 1,000,000 ·0.025² )

n = 1,000,000/(1 + 1,000,000 · 0.000625 )

n = 1,000,000/(1 + 625 )

n = 1,000,000/626

n = 1597.44 or approx. 1597  

Suppose that you have a group of 1,000 city government employees and you want to survey them to find out which tools are best suited to their jobs. You decide that you are happy with a margin of error of 0.05. Using Slovin's formula, you would be required to survey n = N / (1 + Ne^2) people:

How to use slovin's formula? (Examples)

SAMPLING

Is the process of selecting participants from the population..

Process of choosing representative portion of the entire population .

Involves selecting a group of people ,events, behavior s or elements with which to conduct a study .

Is developed to determine mathematically the most effective way to acquire a sample that would accurately reflect the population under study .

SAMPLING THEORY

KEY CONCEPTS OF SAMPLING SAMPLING UNIT

refers to specific place or location which can be used during sampling process

SAMPLING FRAME

describes the complete list of sampling units from which the sample is drawn.

SAMPLING CRITERIA

refers to the essential characteristics of a subject or respondents such as the ability to read and write responses on the data collection instruments.

STEPS INVOLVED IN SAMPLING

Identify the target population Identify the subject or respondent population

Specify the criteria for subject or respondent selection

Specify the sampling designRecruit the subjects.

Number of individual pieces of data collected in a survey.

Generally represented by “n”.Prior to selection of sampling technique the researcher must first determine the size of the sample.

SAMPLE SIZE

Factors to consider in determining the sample size

1. The total size of the population being studied 2. Margin of error-the reliability that the data

collected is generally accurate .3. Confidence level-the probability that your

margin of error is accurate.4. Standard deviation-measures how much

pieces of data vary from the average data measured.

The sample size can be determined using the Slovins’ (1960 ) formula which is as follows:

n= N/1+Ne2 n is the sample size N is the population size e is the margin of error 1 is the constant value

Example

From the population of 10 000 clients with tuberculosis ,a nurse researcher selected a sample size with a margin of error of 50%

Desired sample is 385.

TWO GENERAL TYPES OF SAMPLING TECHNIQUES

RANDOM

(PROBABILITY ) NON RANDOM(NON-

PROBABILTY )

CONVENIENCEQOUTAPURPOSIVE

SYSTEMATICSTRATEFIEDCLUSTERMULTI-STAGE

RANDOM( NON-

PROBABILITY )

RANDOM(PROBABILTY )

PROBABILITY /RANDOM SAMPLING

Involves the selection of elements from the population using random in which each element of the population has equal and independent changes of being chosen.

Advantages : 1.Easy to conduct . 2.high probability of achieving a representative

sample 3.Meets assumptions of many statistical

procedures.

Disadvantages: 1.Identification of all members of the population can be difficult.

2.contactting all members of the sample can be difficult.

FOUR CLASSIFICATION SYSTEMATIC STRATEFIEDCLUSTERMULTI –STAGE

SYSTEMATIC SAMPLING Draw a sample from a population. Selects samples by following some rules set by the

researcher which involves selecting the kth member where the random start is determine.

A system is a plan for selecting members after a starting point or random start has been determined.

Then every nth member of the population will be determined by the system in drawing or selecting the members of the sample

Example

To select sample of 25 dorm rooms in your college dorm , make a list of all the room numbers in the dorm. For example there are 100 rooms ,divide the total number of rooms (100) by the number of rooms you want I the sample (25).the answer is 4.this means that you are going to select every fourth dorm room from the list.

Example

First of all we have to determine the random starting point. This step can be done by picking any point on the table of random numbers ,and read across or down until you come to a number between 1 and 4 .his is your random starting point for instance your random starting point is 3 .This means you select dorm room 3as your first room and then every fourth room down the list(3,7,11,15,19,etc) until you have 25 rooms selected.

STRATEFIED RAMDOM SAMPLING

Selects members of the sample proportionally from each subpopulation or stratum.

Used when the population is too large to handle and is divided into subgroups(called strata)

Samples per stratum are then randomly selected but considerations must be given to the sizes of the random samples to be drawn from the subgroups.

Example of stratum-females ,males or managers ,non managers.

CLUSTER SAMPLINGUsed when population is divided into groups or clusters.

Sample are selected in groups rather than individuals which is employed into a largely –scale survey.

The process of randomly selecting intact groups, not individuals ,within the defined population sharing similar characteristics.

Clusters are locations within which intact groups are found .example(neighborhoods ,school districts, schools, classroom)

Cluster sampling POPULATION

SAMPLE 1

CLUSTER 3CLUSTER 2CLUSTER 1

SAMPLE 2 SAMPLE 3

MULTI-STAGE SAMPLINGSelects samples using more than two sampling technique s

Rarely used because of the complexity of its application

Requires a lot of effort ,time , and cost

NON-PROBALITY/NON RANDOM SAMPLINGAllows a procedure governed by chance to select the sample controls for sampling bias.

Does not involve random selectionThere is an assumption that there is an even distribution of characteristics within a population

CHARACTERISTICSThe members of the sample are drawn or selected based on the judgment of the researcher.

The result of these technique are relatively biased

The techniques lack objectivity in terms of the selection of samples.

The sample are not reliableThe techniques are convenient and economical to use.

CONVENIENCE OR ACCIDENTAL /HAPHAZARD SAMPLING

Involves the nonrandom selection of subjects based on their availability or convenient accessibility

the process of including whoever happens to be available at the time.

Example: -first ten cars to enter a car park -the first ten people to walk through a tumstille

at a sporting event -females in the first row of a concert.

QUOTA SAMPLINGInvolves the nonrandom selection of elements based on the identification of specific characteristics to increase representativeness

The process whereby a researcher gathers data from individuals possessing identified characteristics

Sampling is done until specific number of units (quotas) for various sub-populations have been selected.

Example If there are 100 men and 100 w0men in a population and sample of 20 are to be drawn to participate in a cola test challenge, you may want to divide the sample evenly between sexes -10 men and 10 women .

PURPOSIVE SAMPLINGThe process whereby the researcher selects a sample based on experience or knowledge of the group to be sampled called “judgment sampling

Sampling in which decisions concerning the individuals to be included in the samples are taken by the researcher based upon a variety of criteria which may include specialist knowledge ,issue ,or willingness to participate in the research

PURPOSIVE SAMPLING

Example: in life history research, some potential participants may be willing to be interviewed but not be able to provide sufficiently rich data. Researchers may have to select

STEP 5PREPARING

THE INSTRUMENT

The appearance of instrument is very important to the overall success of the study. It should be:-Attractive-Not too long-Questions should be as easy to answer as possible

- The questions in a survey, and the way they are asked are of crucial importance. Fowler points out that there are four practical standards that all survey questions should meet:

• Is this a question that can be asked exactly the way it is written?

• Is this a question that will mean the same thing to everyone?

• Is this a question that people can answer?• Is this a question that people will be willing to

answer, given the data collection procedures?

- The most important thing for researchers to keep in mind, however, is that whatever type of instrument is used, the same questions must be asked of all respondents in the sample.

TYPES OF QUESTIONS

Closed-Ended Questions

Open-Ended Questions

Closed-ended Questions- Most surveys rely on multiple-choice or other forms of what are called closed-ended questions. Multiple-choice questions allow a respondent to select his or her answer from a number of options. They may be used to measure opinions, attitudes, or knowledge.Open-ended Questions- allow for more individualized responses, but they are sometimes difficult to interpret. They are also often hard to score, since so many different kinds of responses are received.

Closed-Ended Questionso Example:1. Which subject do you like least?a. Social studiesb. Englishc. Scienced. Mathematicse. Other (specify)

Open-Ended Questionso Example:1. What do you consider to be the most important

problem facing classroom teachers in high schools today?

Closed-Ended Open-EndedAdvantages

Enhance consistency of response across respondents

Easier and faster to tabulate More popular with respondents

Allow more freedom of response

Easier to construct Permit follow-up by interviewer

Disadvantages May limit breadth of responses Take more time to construct Require more questions to cover

the research topic

Tend to produce responses that are inconsistent in length and content across respondents

Both questions and responses subject to misinterpretation

Harder to tabulate and synthesize

Advantages and Disadvantages of Closed-Ended Versus Open-Ended Questions

• PRETESTING THE QUESTIONNAIREOnce the questions to be included in the questionnaire on the interview schedule have been written, the researcher is well advised to try them out with a small sample similar to the potential respondents.

• OVERALL FORMATThe format of a questionnaire how the questions look to the respondents – is very important in encouraging them to respond. Perhaps the most important rule to follow is to ensure that the questions are spread out – that is, uncluttered. No more than one question should be presented on a single line. When respondents have to spend a lot of time reading a question, they quickly become discouraged from continuing.

Instrumentation•It refers to the tools or means by which researchers attempt to measure variables or items of interest in the data-collection process.

Problems in the Instrumentation Process in Survey Research

• Several threats to the validity of the instrumentation process in surveys can cause individuals to respond differently from how they might otherwise respond.

EXAMPLE: 1. A group of individuals is brought together to

be interviewed all in one place and an extraneous event (say, a fire drill) occurs during the interview process.

2. Researchers do not take care in preparing their questionnaires.

3. If the conditions under which individuals are questioned in interview studies are somewhat unusual.

4. The characteristics of a data collector (such as garish dress, insensitivity, rudeness and use of offensive language)

5. Problem with Administration

6. Problem with Interpretation

7. Problem with scoring/interpretation

Evaluating Threats to Internal Validity in Survey Research

•What is Validity? - it is the criteria for how effective the design is in employing methods of measurement that will capture the data to address the research questions.Internal Validity - It is a confirmation of the correctness of the study design.

Mortality• Different proportions of participants or different kinds of participants drop out from the control or program groups.

• Differential loss of participants across groups. - Did some participants drop out? Did this affect the results?

- Did about the same number of participants make it through the entire study in both experimental and comparison groups?

Example:In a health experiment designed to determine the effect of various exercises, those subjects who find the exercises most difficult stop participating.

Location•A location threat can occur if the collection of data is carried out in places that may affect responses.

EXAMPLE:•a survey of attitudes toward the police conducted in a police station.

Instrumentation•The changes in the instrument, observers, or scorers which may produce changes in the outcomes.

EXAMPLE:

Two examiners for an instructional experiment administered the post-test with different instructions and procedures.

Instrument DecayIt can occur in interview surveys if the interviews get tired or are rushed.

STEP 6PREPARING

THE COVER LETTER

- Ideally, the cover letter motivates the members of the sample to respond.The cover letter should be:• Brief• Addressed specifically to the individual being asked to

respond• Should explain the purpose of the survey• Emphasize the importance of the topic of the research• Engage the respondent’s cooperation• If possible, it should indicate the researcher’s

willingness to share the results of the study once it is completed.

• Should specify the date by which the completed questionnaire is to be returned, and it should be individually signed by the researcher.

STEP 7TRAINING

INTERVIEWERS

The general topics to be covered in training interviewers should always include at least the following:• All interviewers should have a common understanding of

the purposes of the study.• The conventions that are used in the design of the

questionnaire with respect to wording and instructions for skipping questions so that interviewers can ask the questions in a consistent and standardized way.

• Probing refers to following up incomplete answers in ways that do not favor one particular answer over another.

• Procedures for recording answers to open-ended and closed-ended questions. This is especially important with regard to answers to open-ended questions which interviewers are expected to record verbatim.

• Rules and guidelines for handling the interpersonal aspects of the interview in a non-biasing way.

USING AN INTERVIEW TO MEASURE ABILITY

used primarily to obtain information on variables other than cognitive ability

used extensively in this field to study both the content and progress of cognition

used to study though processes and sequences employed in problem solving

NONRESPONSESome members of the sample will not respond

May be due to a number of reasons

Unwillingness to participate in surveys

TOTAL NONRESPONSE

ITEM NONRESPONSE

TOTAL NONRESPONSEReasons:

- Refuse to be interviewed- Not be at home when the

interviewer calls- Be unable to take part in the

interview for various reasons- Cannot even be located

- A few questionnaires may not be deliverable

- A few respondents will return their questionnaires unanswered

- Questionnaires has not been returned

- Random replacement

ITEM NONRESPONSEReasons:

- The respondent may not know the answer to a particular question

- He or she may find certain questions embarrassing or irrelevant

- The respondent may be pressed for time

- The interviewer may decide to skip over part of the questions

- The interviewer may fail to record an answer

- Some answers may be unclear, illegible or inconsistent with other answers

- Rarely as high as total nonresponse

- Nature of question asked and the mode of data collection

Suggestions for increasing the response rate in surveys:

Administration of the questionnaire or interview schedule

- Simple and convenient for each individual

- The respondent knows something about the information

- Train how to ask questions- Train how to dress

Format of the questionnaire or interview schedule

- Sufficient space is provided- Specify the information you

want- Obtain information about the

objective- Use close-ended rather than or

in addition to open-ended questions

- No threatening questions- Eliminate any leading

questions- Check the items with judges- Pretest the questionnaire

STEP 8DATA ANALYSIS

Data Analysis in Survey Research• After administering the survey, the next step in survey research process is to analyze the responses of the participants. Handling survey data includes conducting a precise survey data analysis which lets you interpret the results accurately.

Steps in Data Analysis

1.Data Validation2.Response Partitioning3.Data Coding4.Standard Analysis

Data ValidationData validation ensures that the survey questionnaires are completed and present consistent data.In this step, you should not include the questions that were not answered by most respondents in the data analysis as this would result to bias in the results.

Response PartitioningHomogenous subgrouping of the responses makes data analysis faster and easier.

Based on the demographic data gathered from the survey, you may partition the responses into subgroups.

Data CodingData coding simply means converting the nominal and ordinal scale data in such a way that the statistical package to be used can handle the survey data accurately.

This step is actually performed when you design the questionnaire, but the data codes become helpful during data analysis.

Standard Data Analysis

•Standard data analysis includes computing for the proportion of variables and standard errors.

SURVEY RESEARCHAPPLICATION AND EXAMPLE

APPLICATIONEncompasses any measurement procedures that involve asking questions of respondents.

Form a short –paper and pencil feedback

Where can we use /applyAnalyze behaviorMeet the pragmatic needs of the mediaEvaluating political candidates Public health officialsProfessional organizationsAdvertising and marketing director

Russian and America college student’s attitudes , perceptions, and tendencies toward teaching cheating

The study investigated if the academic dishonesty problem crosses national boundaries

Investigated the students attitudes ,beliefs, and cheating tendencies

Report difference between Russia and American students

Methods and Sample Undergraduates business students from USA and Russia

Questionnaires Sample collected from Colorado State University (USA)

Novgorod state university and Norman school college (RUSSIA)

SURVEY INSTRUMENTIdentical self-report questionnaires29 –question survey Consisting of a series of (yes/no) Scalar questionQuestion that asked students to ass what proportion of their peers they believe cheat

Yes /No questionsHave you cheated during college ?Have you received information about an exam from students in earlier sections of the class?

Scalar questionAsk about students attitudes and beliefs about cheating

Seven point scale anchored with strongly disagree to strongly disagree

Scenarios John Doe took Marketing 400 in fall semester ,his fried ,Jane took Marketing 400 in the spring semester .John gave Jane all his prior work from the course. Jane found John’s answers prior exams and uses these to prepare for tests in the course

Jane also discovered that John had receive good grades on some written assignments for the class. Many of these assignments required John to go to the library to look up articles about various topics. Jane decides to forgo the library work uses John’s articles for her papers in the class.

RESULTS(TABLE 1)Cheated in some point in college55%-American 64%-RussianCheating in class2.9% -american38.1%Russian

Conveying information to their peers92%-Russian68.5%-AmericanScenario5.2% American63.9 %Russian

Table 2Cheat on class69% -Russian24%-American

ConclusionReveals that American and Russian business college have different attitudes, perceptions, tendencies towards cheating.

Analysis of the studyPurpose /justificationDefinitionsPrior researchHypothesisSampleInstrumentationProcedures/internal ValidityData analysisInterpretation

THANK YOU!