Evaluation of Reference Services Dr. Dania Bilal IS 530 Fall 2005.

14
Evaluation of Reference Services Dr. Dania Bilal IS 530 Fall 2005

Transcript of Evaluation of Reference Services Dr. Dania Bilal IS 530 Fall 2005.

Page 1: Evaluation of Reference Services Dr. Dania Bilal IS 530 Fall 2005.

Evaluation of Reference Services

Dr. Dania Bilal

IS 530

Fall 2005

Page 2: Evaluation of Reference Services Dr. Dania Bilal IS 530 Fall 2005.

Why Evaluate?

Assess and improve the quality of existing services

Identify the need for new types of services or programs

Justify funding and support

Page 3: Evaluation of Reference Services Dr. Dania Bilal IS 530 Fall 2005.

Why Evaluate?

Manage human and physical resources more effectively and efficiently

Justify the need for maintaining services and need for additional programs

Page 4: Evaluation of Reference Services Dr. Dania Bilal IS 530 Fall 2005.

Levels of Evaluation

Lancaster’s scheme:– Inputs– Outputs– Outcomes

Page 5: Evaluation of Reference Services Dr. Dania Bilal IS 530 Fall 2005.

Levels of Evaluation: Inputs

Materials available to provide a service– Reference collection

• Print, CD-ROM, Web-based databases

• Virtual materials

Page 6: Evaluation of Reference Services Dr. Dania Bilal IS 530 Fall 2005.

Levels of Evaluation: Outputs

Measurement of quality of providing a service:– Answering reference questions

• accuracy

• completeness

– Assistance given in using sources

Page 7: Evaluation of Reference Services Dr. Dania Bilal IS 530 Fall 2005.

Levels of Evaluation: Outcomes

Meeting user information needs– Level of satisfaction– Level of knowledge gained or improved

Discussion Question: How should professionals assess user satisfaction?

Page 8: Evaluation of Reference Services Dr. Dania Bilal IS 530 Fall 2005.

Evaluation Guidelines

RUSA guidelines for reference services– http://www.ala.org/rusaTemplate.cfm?Section=

referenceguide&Template=/ContentManagement/ContentDisplay.cfm&ContentID=26884

Page 9: Evaluation of Reference Services Dr. Dania Bilal IS 530 Fall 2005.

Evaluation of Print Sources

Direct examination using criteria– Authority, currency, physical condition, format,

target audience, curriculum needs, objectiveness, etc.

Standardized lists Interlibrary Loan Requests Collection mapping software

Page 10: Evaluation of Reference Services Dr. Dania Bilal IS 530 Fall 2005.

Evaluation Electronic Sources

User Interface– Search features– Retrieval features

Help file Content vis-à-vis purpose and target

audience Currency

Page 11: Evaluation of Reference Services Dr. Dania Bilal IS 530 Fall 2005.

Evaluation Techniques: Electronic Sources Design

– Record structure– Navigation – Visual elements (Icons and their metaphors,

colors, etc.)– Hyperlinks– Overall user interaface

Authority

Page 12: Evaluation of Reference Services Dr. Dania Bilal IS 530 Fall 2005.

Evaluation of Reference Staff

Approachability Knowledge of reference collection Knowledge of local services and referral Skills in identifying user needs Communication with users

Page 13: Evaluation of Reference Services Dr. Dania Bilal IS 530 Fall 2005.

Evaluation of Reference Transactions Types:

– Obtrusive• Issues & challenges

– Unobtrusive• Issues & challenges

– Reference statistics

Page 14: Evaluation of Reference Services Dr. Dania Bilal IS 530 Fall 2005.

Evaluation of User Satisfaction

Assess satisfaction of all types of users, including specific populations

Techniques– interviews– via telephone– via the Web– via other means