Online Knowledge Surveysas a Means of Library Instruction Assessment

Steven Baumgart, Memorial LibraryElizabeth Hassemer, Steenbock Memorial Library

2

Objectives

• Ease of web survey software

• Example uses of web survey software in library instruction sessions

• Knowledge surveys

– What is a knowledge survey?

– Advantages to knowledge surveys

– How to create a knowledge survey

3

Online Survey Software

• WebSurvey (UW DoIT)

• SurveyMonkey

• Zoomerang

• Survey Solutions Express

4

Creating an Online Survey

5

Creating an Online Survey

6

Creating an Online Survey

7

Creating an Online Survey

8

Pedagogy: Theory

• Engages students

• Encourages full participation

• Gives students space to process

9

Pedagogy: Advantages

• Easy collection and tabulation of data

• Full-disclosure

• Tailor classes on-the-fly to meet student needs

• Connects with students by using their technology

10

Pedagogy: Practice

• Comment cards WebSurvey

• Post-session instructor evaluations• In-class exercises WebSurvey

• On-the-fly tailoring of classes

• Pre- and post-testing– Knowledge survey

11

Knowledge Survey

• Measures confidence in subject material

• Comprehensive, allowing granularity

• Based on learning outcomes

• Linked to Bloom’s TaxonomyWebSurvey

12

Knowledge Survey Activity

Formulate questions for your learning outcomes that you could ask students at the end of a library instruction class to test them on what they've learned.

13

Knowledge Survey: Advantages

• Planning tool for instructors

• Quick and easy to create

• Indicator of students’ strengths and weaknesses

• Allows instructor to ask questions too difficult to score

• Allows instructor to score results quickly

• Objective assessment measure

14

Knowledge Survey: Preliminary Results

• Before library session, confidence is closer to performance

• After library session, confidence is over-reported

• Students with previous library instruction perform better

• Students who know their topics perform the same as students who do not have topics

15

Knowledge Survey: Preliminary Results

0102030405060708090100

Q1 Q2 Q3 Q4 Q5

Pre-Test

Pre-KS

On average, pre-library session students are 5%more confident than their performance indicates.

QuestionsQ1: Select best database

Q2: Search OPAC

Q3: Formulate a search

Q4: Limit results/modify search

Q5: Where to begin research

16

Knowledge Survey: Preliminary Results

0102030405060708090100

Q1 Q2 Q3 Q4 Q5

Post-Test

Post-KS

On average, post-library session students are 31%more confident than their performance indicates.

QuestionsQ1: Select best database

Q2: Search OPAC

Q3: Formulate a search

Q4: Limit results/modify search

Q5: Where to begin research

17

Thank You!

Steven BaumgartMemorial Library, UW-Madisonsbaumgart@library.wisc.edu

Elizabeth HassemerSteenbock Memorial Library, UW-Madisonehassemer@library.wisc.edu