BY TEMTIM ASSEFAOCTOBER, 2013

Quantitative Research Method (Research Design)

Overview of Quantitative Research

Uses deductive method of knowledge acquisition

Intends to falsifies an existing theory or develop new relationships between constructs

Tries to generate generalizable knowledge Accepts objectivity of knowledge

Uses a standard measurement instruments The researcher is independent in the process

of knowledge constructionIntends with prediction and controlling

Research Process

Problem

Conceptual FW, Hypothesis

Develop Instrument

Research Design

Data Collection & Analysis

Data Interpretation

4

Direction of Abstraction/ Substruction

Theory(Theoretical system)

Construct

Concept

Deductive

(qualitative)

Methods(Operational System)

Measures

Scaling/Data

analysis

(quantitative)

Inductive

5

Rigor in Quantitative Research

Theoretical Grounding: Axioms & postulates – substruction-validity of hypothesized relationships

Design validity (internal & external) of research design; Instrument validity and reliability

Statistical assumptions met (scaling, normal curve, linear relationship, etc.)

(Note: Polit & Beck: reliability, validity, generalizability, objectivity)

6

Literature Review Study Aims

Study Aims Study Question

Study Question Study Hypothesis

7Aim, Question, and Hypothesis

Study Aim: To explore IT increases organizational efficiency

Study Question: Does IT increases organizational efficiency?

Study Hypothesis:Null: H0: There is no difference between organizations which introduce IT and those which do not.

When do you choose

1. The first type of research question is that demanding a quantitative answer.

Examples are: ‘How many students choose to study education?’ or ‘How many maths teachers do we need and how many have we got in our school district?’ That we need to use quantitative research to answer

2. Numerical change can likewise accurately be studied only by using quantitative methods. Are the numbers of students in our university rising or falling?

3. When we often want to explain phenomena. What factors predict the recruitment of maths teachers? What factors are related to changes in student achievement over time?

4. Testing of hypotheses . We might want to explain something – for example, whether there is a relationship between IT use and organizational performance

Types of quantitative Research

Basically there are two types 1. confirmatory or exploratory research.

Hair et al. (1995) suggest that confirmatory studies are those seeking to test (confirm) a prespecified relationship,

2. Exploratory studies are those which define possible relationships in only the most general form and then allow multivariate techniques to estimate a relationship(s).

in exploratory studies, the method and the data will define the nature of the relationships.

Quantitative Research Design

A research Design is nothing more than a plan for conducting a research in such a way as to answer a research questions.

A number of questions arise to select the research design who, what shall be the focus of the study? What attributes of individuals, organizations, systems, etc, In what contexts observations will be made (organizations,

laboratories, etc), what methods employed to analyze the data?

Types of Quantitative Research

Researchers are constrained with people, time, money, etc to select the best research design

A prime consideration is designing cost effective researchSome of the Quantitative research design method

includes Field study Field experiment Lab experiment Experimental simulation Adaptive experiment Archival research

12

Types of Quantitative Research Designs

Descriptive X? Y? Z? What is X, Y, and Z?

Correlational rxy

Is there a relationship between X and Y?

Causal ΔX ΔY? Does a change in X cause a change in

Y?

Field Experiment

A field experiment is a research study

conducted in a realistic situation in

which one or more independent

variables are manipulated by the

experimenter under conditions as the

situation will permit.

Field Experiment steps

It follows all steps of scientific process

1) selection and determination of a problem,

2) selection of participants and measuring

instruments,

3) selection of a research plan,

4) execution of the plan,

5) analysis of data and

6) formation of conclusions

Features of FE

It has three unique features

1. the research takes place in natural setting

2. the experimenter manipulates one or more independent

variables while exerting much control over confounding

variables; and

3. the effect of the manipulations on one or more dependent

variables is systematically observed.

FE Design

There three type of designs

Controlling Nuisance in Field Experiment

Solomon Four Groups in True ExperimentExperimental group 1: R O X O

Control group 1: R O O

Experimental group 2: R X O

Control group 2: R O

Removing statistically the effect of suspected confounding variables

Data collection and Analysis

The following methods are used to collect data Questionnaire Structured interview Computer log files

Data analysis Descriptive statistical methods Inferential statistical methods

Advantages of FE

Conducted in natural settings and has higher experimental

validity

Realism simply increases the strength of the variables. It

also contributes to external validity, since the more realistic

the situation, the more valid are generalizations to other

situations likely to be.

Help to clearly identify antecedents of observed effects in

casual relationships

Used for the development of theory as well as for the

solution of applied problems;

The logic of FE can be applied in the analysis of many

naturally occurring changes

Appropriateness for studying complex social and

psychological influences, process, and changes in lifelike

Disadvantage

The methods used to control confounding variables in

FE are not sufficient

Manipulation of variables cause legal and ethical

problems

Difficult to control dynamically changing environment

during the course of the experiment

Difficult to precisely measure dependant variables in

the field settings. In other words, the dependent

variable measures are often so inadequate they

cannot pick up all the variance that has been

engendered by the independent variables.

Expensive to conduct compared to lab experiment

Needs highly skilled person to design and conduct

As indicated earlier, the main weaknesses of field experiments are practical. Manipulation of independent variables and randomization are perhaps the two most important problems.

One other weakness in field experimental situations is lack of precision. In other words, the dependent variable measures are often so inadequate they cannot pick up all the variance that has been engendered by the independent variables.

Role of FE in computer Science

It has many applications in IS To develop theory

To test hypothesis

To evaluate IS tools and techniques

Practical Examples

Fukada et al (n.d.) used field experiment to study the effect

of Road Facility Management Support System on asset

management of the public infrastructure.

Mayur et al (2000) made study to compare and suggest the

best training method for companies between instructor

based training and computer based training methods.

Chen et al (2007) made a field experiment study to identify

effects of different types of social information on

contributions to an online communities.

Field StudiesField studies are non-experimental scientific

inquiries aimed at discovering the relations and interactions among sociological, psychological, and educational variables in real social structures.

The field study investigator ordinarily manipulates no independent variables. Neither randomization nor experimental manipulation was possible.

Types of Field Studies

Katz (1953) has divided field studies into two broad types: exploratory and hypothesis testing.

Exploratory studies have three purposes: to discover significant variables in the field situation, to discover relations among variables, and to lay the groundwork for later, more systematic and rigorous testing of hypotheses.

Strengths of Field Studies

Field studies are in realism, significance, strength of variables, theory orientation, and heuristic quality. The variance of many variables in actual field settings is large, especially when compared to the variance of the variables of laboratory experiments.

In a field situation there is usually so much noise in the channel that even though the effects may be strong and the variance great, it is not easy for the experimenter to separate the variables.

Strengths and Weaknesses of Field Studies

Its most serious weakness, of course, is its nonexperimental character. Thus statements of relations are weaker than they are in experimental research.

Another methodological weakness is the lack of precision in the measurement of field variables. Studies of organizations, for example, are mostly field studies, and the measurement of organizational variables well illustrates the difficulties.

Other weakness of field studies are practical problems: feasibility, cost, sampling, and time.

Review Questions

Explain the different quantitative research design methods

What is the strength and weakness of each methodWhat are the different survey research methods What is the main data analysis methodswhat problem can you address with quantitative

research methods What are the procedures in quantitative Research How do you use Quantitative research in computer

science?