Diane K. Willimack U.S. Census Bureau

27
1

description

Considering the Establishment Survey Response Process in the Context of the Administrative Sciences. Diane K. Willimack U.S. Census Bureau. Survey Methodology draws upon multiple disciplines –. Statistics/sampling Psychology Sociology Economics Political science Computer science - PowerPoint PPT Presentation

Transcript of Diane K. Willimack U.S. Census Bureau

Page 1: Diane K. Willimack U.S. Census Bureau

1

Page 2: Diane K. Willimack U.S. Census Bureau

2

Considering the Establishment Survey Response Process

in the Context of the Administrative Sciences

Diane K. WillimackU.S. Census Bureau

Page 3: Diane K. Willimack U.S. Census Bureau

3

Survey Methodology draws upon multiple disciplines –

Statistics/sampling Psychology Sociology Economics Political science Computer science Human-computer interaction

Page 4: Diane K. Willimack U.S. Census Bureau

4

Examples

Cognitive response model

draws upon Cognitive Psychology Survey participation decision models

draw upon Social Psychology Web survey design

draws upon Software Development & Human-Computer Interaction

Page 5: Diane K. Willimack U.S. Census Bureau

5

Establishment survey methodology

draws upon Household Survey Research

Page 6: Diane K. Willimack U.S. Census Bureau

6

The establishment survey response process

is viewed as WORK.

Page 7: Diane K. Willimack U.S. Census Bureau

7

Hybrid Response Model(Sudman et al., 2000 ICES-2)

1. Encoding in memory / record formation

2. Selection/identification of respondent(s)

3. Assessment of priorities

4. Comprehension of data request

5. Retrieval from memory and/or records

6. Judgment of adequacy of response

7. Communication

8. Release of data

Page 8: Diane K. Willimack U.S. Census Bureau

8

Hybrid Response Model(Sudman et al., 2000 ICES-2)

1. Encoding in memory / record formation

2. Selection/identification of respondent(s)

3. Assessment of priorities

4. Comprehension of data request

5. Retrieval from memory and/or records

6. Judgment of adequacy of response

7. Communication

8. Release of data

Page 9: Diane K. Willimack U.S. Census Bureau

9

Disciplines relevant for surveys of businesses and organizations –

Organizational behavior Managerial science Administrative science

Behavior of people in organizations

Page 10: Diane K. Willimack U.S. Census Bureau

10

Hybrid Response Model(Sudman et al., 2000 ICES-2)

1. Encoding in memory / record formation

2. Selection/identification of respondent(s)

3. Assessment of priorities

4. Comprehension of data request

5. Retrieval from memory and/or records

6. Judgment of adequacy of response

7. Communication

8. Release of data

Page 11: Diane K. Willimack U.S. Census Bureau

12

Organizational Goals

1. Produce goods & services

2. Maintain viability over time

Attributes of Organization

Structure Differentiation of

functions (De)centralization Authority

hierarchies Coordination Effectiveness

People

Social Behavior

Page 12: Diane K. Willimack U.S. Census Bureau

16

Dimensions of Social Behaviorin Organizations

Authority Responsibility Accountability Influence Allegiance / Loyalty

Page 13: Diane K. Willimack U.S. Census Bureau

21

Social Behavior + Role-taking = Work

Role-taking – the manifestation of social behavior among persons in organizations for the purpose of accomplishing work.

Coordination Communication Interpersonal interaction Cooperation

Page 14: Diane K. Willimack U.S. Census Bureau

22

Role Episode

Role Sender

Expectations SentRole

Role Receiver:“Focal Person”

ReceivedRole

RoleBehavior

Page 15: Diane K. Willimack U.S. Census Bureau

23

Role Episode: Responding to a Survey

Role Sender

Expectations:

Compliance

Sent Role:

Data specsInfluence

Focal Person

Received Role:

InterpretsR’s request

RoleBehavior:

Compliance

Respondent (R)“Local Data Provider”

(LDP)

Request forInformation

Organi-zationalfactors

thatconvey

to R

Interpersonal factorsassociated with ‘LDP’

Personal attributesof ‘LDP’

Page 16: Diane K. Willimack U.S. Census Bureau

24

Role Episode between LDP and Supervisor

Focal Person

Received Role:

Assigned workPerformance

criteria

RoleBehavior:

Compliance

Role Sender

Expectations:

Compliance

Sent Role:

AssignmentAuthority

Supervisor“Local Data Provider”

(LDP)

Organi-zationalfactors

thatconvey to theSuper-visor

Interpersonal factorsassociated with ‘LDP’

Personal attributesof ‘LDP’

Page 17: Diane K. Willimack U.S. Census Bureau

25

Role Conflict

Role episodes between:– R and LDP– LDP and Supervisor

Page 18: Diane K. Willimack U.S. Census Bureau

26

Role Episodes: A Framework for Evaluating Response Process

“Draw” the role episode diagram for people involved in providing survey data

Account for multiple roles of each player Study, understand, analyze interactions

between people in the organization

Page 19: Diane K. Willimack U.S. Census Bureau

27

Role Episodes: A Framework for Evaluating Response Process

continued

Use as a tool – Diagnose potential problems and

breakdowns– Suggest strategies that facilitate response

process– Avoid strategies that hinder organizational

processes

Page 20: Diane K. Willimack U.S. Census Bureau

28

Census BureauExample

Page 21: Diane K. Willimack U.S. Census Bureau

29

Developing Data Collection Software for the U.S. Economic Census

Detailed establishment-level data “Task analysis” with business

respondents– “How do respondents go about pulling

together all this data?”

Page 22: Diane K. Willimack U.S. Census Bureau

30

Developing Data Collection Software for the U.S. Economic Census

continued

Pervasive use of spreadsheets– Means of communication– Organizational norm for exchanging data

Some Rs lacked response “capacity” – e.g., knowledge of specific data items– Unable to “assign” items to LDPs

R LDP: sent role relied on differentiation of expertise

Page 23: Diane K. Willimack U.S. Census Bureau

31

Developing Data Collection Software for the U.S. Economic Census

continued

Re-engineered software– Versatile spreadsheet functionality– Supported organizational context for R’s

and LDP’s roles

Page 24: Diane K. Willimack U.S. Census Bureau

36

Conclusions

Page 25: Diane K. Willimack U.S. Census Bureau

37

Survey organizations…

Are members of businesses’ external environment

Have indirect / disjoint relationship with businesses

Cannot manage the response process

Page 26: Diane K. Willimack U.S. Census Bureau

38

Models of Social Behavior in Organizations

Framework for studying organizational context for survey response process

Address research questions– Who is the “right” respondent?

• Interplay between Authority and Responsibility / Capacity

– How to facilitate reporting from multiple data sources?• Respondents, “Local Data Providers,” and Role Episodes

– What are effects of alternative data collection strategies on data quality?

Page 27: Diane K. Willimack U.S. Census Bureau

39

Future Research

Other theories / models of social behavior in organizations– Management– Influence– Authority

Do this approach add value? How can it be applied?