From Far and Near: Analysis of On Campus and Distance Learning Students’ Responses to a Library...

From Far and Near: From Far and Near: Analysis of On-Campus and Distance Analysis of On-Campus and Distance Learning Students’ Responses to a Learning Students’ Responses to a

Library AssessmentLibrary Assessment

J. Ann Jerabek

Head of Interlibrary Services

Sam Houston State University

Joe Hardenbrook

Library Instruction Coordinator

& Educational Technologist

Millikin University

Lynn M. McMain

Head of Reference and Instructional Services


S. Thomas Kordinak

Professor of Psychology


IntroductionIntroductionSam Houston State University, medium-

sized regional institution located in Huntsville, TX

Task: develop an instrument to assess use of Library resources and services by students and faculty

Why Assess?Why Assess?

Discover what Library resources and services are being used

Determine how users access Library resources and services

Provide data for decision-making

Why Assess?Why Assess?

Find out how often and from what venue “distance learning” users access and use resources

Provide documentation and reports to the University and for accreditation review

Apply ACRL standards and guidelines for assessment

Literature ReviewLiterature Review

Libraries have conducted many use studies with on-campus students

Several also examined use by distance learning students

Few compare both groups

Assessment InstrumentAssessment Instrument Survey selected as preferred method of assessment

– Flexible, variable length, different types of questions– Can be administered without extensive training– Machine-readable

Print format chosen– Machine readable, can be analyzed with SPSS– Allows for greater flexibility regarding stratification of

the sample population– Eliminates difficulty of verifying student use of

University assigned e-mail addresses

Survey DesignSurvey Design Quick to complete; no longer than 10 mins. Human subjects/IRB approval Assess specific Library services and resources:

Reference Service

Ask-a-Librarian E-mail service

Interlibrary Loan

Reserves

Copy Services

Library-based computer lab

Databases & Indexes

OPAC

Electronic Journals Search

Online Tutorials

F2F Library Instruction

Library homepage

Special Collections

Study Carrels

Microforms

Gov’t Docs.

Overall service

Survey DesignSurvey DesignSeparate surveys were administered to faculty

and studentsThis presentation covers the student survey

resultsSurvey divided into 5 parts:

– Frequency of use– Use of a specific resource or service– Resources and/or services used during last Library

visit– Overall rating of Library services– Demographic information

Student Student Survey: Survey:

First PageFirst Page

Student Student Survey: Survey:

Second PageSecond Page

MethodologyMethodologyOn-Campus, Off-Campus, and OnlineOn-Campus:

– Classes selected in each of the four colleges to provide a representative sample:

Arts & Sciences Business Administration Education & Applied Science Criminal Justice

– Either librarian or faculty member administered survey to class

MethodologyMethodology

Off-Campus– Face-to-face off-campus classes selected– Survey administered by librarian or faculty

memberOnline

– Survey mailed to students enrolled in selected online courses

– Participant returned survey in postage paid return envelope

ResultsResults Administered in spring 2004 2200 student surveys distributed, 1080 returned

(return rate=50%) 959 usable surveys Surveys scanned optically and data analyzed using

SPSS Responses grouped into 3 categories:

– Students enrolled in ONLY main campus courses– Students enrolled in BOTH main campus courses and

distance learning courses at satellite campus– Students enrolled ONLY in distance learning courses,

whether at the satellite campus or elsewhere, or online

DemographicsDemographics


Gender– Male (41%)– Female (56%)– No Listing (3%)

Age– Mean age: 22.58– Range from 17 to 63 years


College Affiliation

College

26

20

31

19

5

0

5

10

15

20

25

30

35

Arts & Sciences BusinessAdministration

Education & AppliedScience

Criminal Justice No affiliation

Per

cen

t

DemographicsDemographicsClassification:

– 17% Freshmen– 17% Sophomores– 29% Juniors– 37% Seniors

Graduate students removed from sample because it was not statistically significant

Enrolled hours:– Less than 12 hrs. (9%)– 12-16 hrs. (73%)– 16+ hrs. (17%)

Part 1: Frequency of UsePart 1: Frequency of Use


How frequently do you use Library services and resources?

Asks students to report their use of Library services or resources on a 6 point scale– From “have not used”– To “more than twice a week”


On-Campus – Visiting Library building (39%)– Accessing Library homepage (25%)– Using the Library homepage from a personal

computer (18%)– Using a computer in the Library’s reference

area (15%)– Accessing the Library’s databases (14%)


On-Campus/Satellite– Visiting the Library building (38%)– Accessing the Library’s homepage (21%)– Using a computer in the Library’s reference

area (18%)– Using the Library’s homepage from a personal

computer (13%)– Using the Electronic Journals link (9%), tied

with Using the databases (9%)

Part 1: Frequency of UsePart 1: Frequency of UseOff-Campus

– Accessing the Library homepage (25%)– Accessing the Library homepage from the

satellite campus (23%)– Using the Library homepage from a personal

computer (23%)– Using a computer in the Library’s reference area

(21%)– Accessing the Library’s databases (18%), tied

with obtaining a full-text article (18%), and using the Electronic Journals link (18%)

Part 1: Frequency of UsePart 1: Frequency of UseComparison of the three groups:

39

25

1815 14

97

10

38

21

13

18

9 96

8

13

2523

2118 18

2318

0

510

15

2025

30

3540

45

Visit LibraryBldg.

Access Lib.Hmpg.

Use Lib.Hmpg. frompers. comp.

UseComputer in

Lib. Ref.Area

Use Lib.Databases

Use Elec.Journals

Link

Access Lib.Hmpg. fromsat. campus

Obtain Full-Text Article

Pe

rce

nt

On-Campus

On-Campus/Satellite

Off-Campus

Part 2: Using Specific ResourcesPart 2: Using Specific Resources

Part 2: Using Specific ResourcesPart 2: Using Specific Resources 3 yes/no questions about specific Library services

and resources:– Used the “Ask-a-Librarian” e-mail service

On-Campus: 5% On-Campus/Satellite: 0% Off-Campus: 0%

– Completed any online library tutorial On-Campus: 23% On-Campus/Satellite: 7% Off-Campus: 15%

– Received a library instruction session presented by a librarian

On-Campus: 55% On-Campus/Satellite: 36% Off-Campus: 31%

Part 3: Resources used at last Part 3: Resources used at last visitvisit

Part 3: Resources used at last visitPart 3: Resources used at last visitAsked users to identify Library resources

and services used during last visit

-- Use computers in Reference Area

-- Use Reference Materials

-- Use Online Catalog

-- Use Interlibrary Loan

-- Use Special Collections

-- Use Reserve Material

-- Use a Study Carrel

-- Check Out Books/Books

-- Use Book Collection

-- Use Photocopy Machines

-- Use Microfiche or Microfilm

-- Use Government Documents

-- Ask for Reference Assistance

-- Use Computer Lab in Library

Part 3: Resources used at last visitPart 3: Resources used at last visitMost popular responses for on-campus

students:– Computer Lab

55%

– Computers in Library Reference Area 44%

– Photocopy Machines 39%

– Checking out Books 35%

– Using Library Catalog 30%

Part 3: Resources used at last visitPart 3: Resources used at last visitMost popular responses for on-campus/satellite

students:– Computer Lab

53%

– Photocopy Machines 38%

– Computers in Library Reference Area 37%



Part 3: Resources used at last visitPart 3: Resources used at last visitMost popular responses for off-campus

students:– Computers in Library Reference Area

43%

– Computer Lab 25%


– Using Reference Materials 18%


Part 3: Resources used at last visitPart 3: Resources used at last visitComparison of the three groups:

Resources Used at Last Visit

55

4439

3530

26

53

37 38

2622

1725

43

13

2318 18

0

10

20

30

40

50

60

ComputerLab

Computersin LibraryReference

Area

PhotocopyMachines

Checkingout Books

UsingLibraryCatalog

UsingReferenceMaterials

Pe

rce

nt On-Campus

On-Campus/Satellite

Off-Campus

Part 4: Overall RatingPart 4: Overall Rating

Part 4: Overall RatingPart 4: Overall RatingAsked respondents to provide an overall

rating of Library services and resourcesUsed a 5 point scale ranging from “very

poor” to “very good”Overall Rating of Library Services

33

38

26

3

0

5

10

15

20

25

30

35

40

Very Good Good Average Very Poor / Poor

Per

cen

t

Analysis & ConclusionAnalysis & Conclusion

Noteworthy Percentages

Statistically Significant Differences


Ask-A-Librarian

On-line Tutorials

Library Instruction


Checking Out Books

Photocopying

Computer Lab


Explore New Marketing Approaches

Increase Faculty Contact

Questions?Questions?

From Far and Near: Analysis of On Campus and Distance Learning Students’ Responses to a Library...

Education

Transcript of From Far and Near: Analysis of On Campus and Distance Learning Students’ Responses to a Library...