BY CAROL MAKSIANFLORIDA GULF COAST UNIVERSITY

DECEMBER 15, 2008

Library Instruction Evaluation Tools Used in the Florida State

University Library System

Why do we need assessment?

Internal Review – Anecdotal evidence is common, but how do we know if we’re succeeding in our instructional programs?

Feedback to Instructional Faculty – What did we teach their students in the short time that we had them?

Part of an internal review. What can we do better to make our instruction program first-class?

Accreditation – Accrediting agencies now focus on instructional outcomes. What have students gained from instruction? Have they learned?

Per Jim Alderman, UNF. Slide 5 of One Shot to Teach One Shot to Assess presentation for the PSPC Information Literacy Subcommittee meeting February 14, 2008.

Southern Association of Colleges & Schools

3.8.2 The institution ensures that users have access to regular and timely instruction in the use of the library and other learning/information resources.

 Rationale and Notes:

To ensure appropriate use of the library and other learning/information resources, the institution is expected to provide timely and effective access to the library/learning resources that enables students, faculty and staff to take full advantage of the learning resources provided by the institution.

Relevant Questions for Consideration:• What is the objective and the type of assistance available to learning/information resource users?• What delivery mechanisms exist for instruction and assistance to library users and how are they

assessed?• How does the institution determine the effectiveness of its learning/information resource

programs? Sample Documentation:• Documentation of the availability and type of instruction• Documentation of the assessment of the instruction• Reports of library instructional activity that demonstrate broad participation in the instructional

program by all segments of the institution at all teaching locations

p. 59 of Resource Manual for the Principles of Accreditation: Foundations for Quality Enhancement

How are Florida Universities Assessing Their Instructional Programs?

The following survey of Florida State University Libraries was taken during the week of December 8, 2008 using Checkbox survey software.

7 libraries participated in the survey:FAMU, FGCU, FIU, FSU, NCF, UCF, USF

Polytechnic

Two libraries: UNF and USF sent current assessment documents or drafts.

FAMU -- No

FGCU -- No

FIU -- Yes

FSU -- No

NCF -- No

UCF -- Yes

USF Polytechnic -- Yes

FAMU -- No

FGCU -- Yes

FIU -- No

FSU -- Yes

NCF -- Not created one yet

UCF -- Some use own

USF Polytechnic -- Yes

If you do not evaluate all classes, which classes do you sample?

FAMU -- No

FGCU -- May tailor surveys for a class

FIU -- No

FSU -- No

NCF -- Not created one yet – 1st year classes are ver y different from senior seminars.

UCF -- No

USF Polytechnic -- No

Has anyone had problems implementing a web evaluation?

FAMU -- Paper

FGCU -- Paper. (We have done a couple of web surveys.)

FIU -- Paper

FSU -- Paper

NCF -- Not created one yet

UCF -- Depends on librarian

USF Polytechnic -- Paper

When do you think is the best time to administer an evaluation?

FAMU -- In class

FGCU -- In class

FIU -- 8-15 days

FSU – After class, 1-7 days

NCF -- At the end of the semester

UCF -- In class

USF Polytechnic -- In class

FAMU -- No

FGCU -- May tailor surveys for a class

FIU -- No

FSU -- No

NCF -- Not created one yet – 1st year classes are ver y different from senior seminars.

UCF -- No

USF Polytechnic -- No

Do you get feedback from all of the library instruction sessions taught or do you do just get

samples?

 I get feedback from all the First Year Experience classes, but the rest of the undergraduate classes do not give me feedback. FSU

All. USF Polytechnic

Most feedback is done verbally by the students or the professor. NCF

We get a very good sample usually several for each library instructor, for each grade level and across disciplines. FIU

Feedback is received from all of the library instruction sessions FAMU

Usually it is just samples. However, we do collect evaluations from certain courses. UCF

We do not get feedback from all classes, just samples. FGCU

How you have used or plan to use these evaluative tools to improve library instruction?

I am presently working on a pre/post test for the FYE classes. We have a librarian who in charge of assessment and our committee is developing tests. I did another version of a pre/post test and did not think it was focused so we are redeveloping another. FSU

Adjusted level of details and content USF Polytechnic

We have just developed a QEP (Quality Enhancement Program) for 1st year students to improve writing and research skills. There will be some type of assessment at the end of these QEP classes but that assessment is still in the design stage. NCF

How you have used or plan to use these evaluative tools to improve library instruction?

For FIU, we send all classes a single evaluation form but other types of evaluation are done by individual librarians including minute papers, correcting assignments, pre-post tests, classroom response systems, and bibliography analysis.

    Librarians use these tools to gain a better

understanding of what students learned during the presentation and use comments to help improve their instruction. Most of the tools used are primarily level 1 -- reaction and how did they like the presentation. A few questions may address level 2--learning but not many. FGCU

Do you report the findings to administration or your supervisor?

Other Comments

I think we do not do enough assessment in our classes. I would like to assess every class or at least do a great deal more.

Want to create electronic one for faculty requesting the session Seeing other evaluation forms being used at various institutions will be

helpful in developing ours. Since we send our evaluations a week or more after the library session,

we are impressed to see the overwhelming number of comments we get that specifically address class content. Apparently, they were listening. :)

Our library instruction survey for students will be electronically administered using Survey Monkey during the next semester

We are continually trying to improve them. We have used various tools to assess instruction classes. While the forms

are not very detailed, generally instructors have learned something from each one. I do not think we need to reinvent the wheel with regards to assessment and would like to know about successful tools librarians have used in their classes.

Current /Draft Evaluation tools of Florida SULs

PLEASE GO TO:PSPC INFORMATION LITERACY

SUBCOMMITTEE WIKI

HTTP: / / INFOLITFLORIDA.PBWIKI .COM/

Thank you so much for participating!

To those librarians who were interrupted while taking the survey, my apologies if the

survey timed out