Post on 01-Jan-2016
Assessment and Evaluation Using Technology
Assignment Week 4Chandra Wilson
EDU697: Capstone: A Project ApproachDr. Phillip Orlando
May 20, 2013
2
RedesignThe first thing that came to mind when given the Program
Learning Outcomes was online tests and surveys. I’ve taken a slide show I created from my EDU652:
Instructional Design & Delivery course, and redesigned it to reflect the two Program Learning Outcomes.
PLO 6: “Technology resources to facilitate effective assessment and evaluation” Tests are a great way to assess and evaluate what a student
knows both before and after a lesson has been taught. By testing them prior to teaching the lesson, the instructor
can get a feel for what the students already know or don’t know. This will help the teacher in tailoring the lesson to touch on areas that are well known and spend more time on areas that aren’t as well known.
3
Redesign Cont.PLO 7: “Utilize technology to collect and analyze data,
interpret results, and communicate findings”Survey’s provide a great way to collect information, analyze the
data collected, and interpret the results of the data collected.Part of the challenge for this week, was finding a previous
assignment that I could redesign, or assignments I could merge together. As I was looking through my previous assignments, I found a tests and surveys slide show and thought of how perfect they fit together to include both learning outcomes.
The technology used would be a slide show to teach why tests and surveys are useful, as well as using online versions of tests and surveys to gain information on what students do or don’t know about a subject.
4
OverviewIntroductionSurvey/Test GoalsSurvey/Test Question TypesQuestion SequencingFeedbackResults ProcessingConclusion
5
IntroductionThere are many ways to test the knowledge of your students. This
can be accomplished through online surveys or by standard tests. Surveys or tests can be given prior to teaching the material or after
the material has already been taught.Prior to creating a survey or test, the following questions should be
asked: What is the purpose of the curriculum? (Popham, 2003) What do my students already know about the topic that is either about
to be taught, or has already been taught? (Popham, 2003) How long will it take my students to master the content? (Popham,
2003) What, if anything did my students learn? (Popham, 2003)
By asking these questions, you can assess what to teach by either expanding on certain areas that are unknown, and minimizing areas that are well known. You can also gauge how much the student has learned from what you have already taught them.
6
Introduction Cont.Another thing you need to consider is, are you going to assess
your students through survey or test.Although both are used as data collection, they are different in
nature.A survey is a collection of general data that can be used in a
variety of ways: To learn what a student knows prior to a lesson To learn how a student likes to be taught To find out what a student wants to be taught To find out how affective the teaching method was
A test can be used in two different ways: As a tool to see how much a user knows prior to being taught a
subject. As a specific collection of data that assist with how much knowledge
the user retained from the lesson.
7
Survey/Test GoalsThere are several goals that you should keep in mind
when creating a survey or test:How long will it take to complete?
Keeping in mind if it is on-line, what is the deadline to complete the survey or test? Is there a time limit set for the test to be completed in?
How many questions will it contain?What types of questions will it contain?What do you hope to accomplish with the survey or test?
Are you just trying to collect data for a survey or are you testing for something specific?
These questions will help you decide if you need a survey or a test.
8
Survey/Test Question TypesBefore you begin to author a survey or test, you need
to know what types of questions will be asked.You will also need to know if the entire survey or test
is going to have the same types of questions or multiple types of questions.
There are several question types: True/False
User will use either-or judgment (Horton, 2012) Pick-One
User will choose a single correct answer from a list (Horton, 2012) Pick-Multiple
User will choose multiple correct answers from a list (Horton, 2012)
9
Survey/Test Question Types Cont.Fill-in-the-Blanks
User will fill in the correct answer (Horton, 2012)Matching-List
Users will identify associations between two lists (Horton, 2012)
Sequence Users will sequence items in order from a list (Horton, 2012)
Composition Users will create an original explanation, such as a short
essay (Horton, 2012)Performance
Users will perform a step of procedures typically in a simulation (Horton, 2012)
10
Question SequencingQuestion sequencing must be clear and smooth moving
(Kothari, 2004)The relation of one question to the next should be
apparent (Kothari, 2004)Questions leading from easiest to answer in the beginning
to harder questions towards the end (Kothari, 2004)Place sensitive or controversial questions towards the end
of the survey (Kothari, 2004)During testing, questions can either be placed in order of
how they were taught or can be randomUse the true/false, single answer, multiple choice
questions at the beginning and the composition/performance questions toward the end
11
FeedbackStudents crave feedbackThis can be given in several ways:
Showing an automatic score at the end of a test (Horton, 2012)
Giving a right/wrong indicator during the test (Horton, 2012)
Use a progress bar at the top of the survey or test
12
Results ProcessingResults for tests are as easy as right and wrong answers,
with a total percentage leading to a gradeResults for a survey can come in several ways:
Pie ChartsBar ChartsColumn ChartsLine ChartsArea Charts
Part of providing feedback to students, is to allow them to see the results from the survey.
By showing them how the other students answered, they can get a sense of how they are doing compared to the other students.
13
ConclusionSurveys are a collection of general dataTests are a collection of specific dataBoth can give an instructor information on
how much a student knows, has learned, or would like to learn
Ensuring surveys and tests are thoroughly designed, will keep students encouraged and willing to continue the learning process
14
ReferencesHorton, W. (2012). E-Learning by Design (2nd
ed.). San Francisco, CA: John Wiley and Sons, Inc.
Kothari, C.R. (2004). Research Methodology: Methods and Techniques. New Delhi, India: New Age International (P) Limited, Publishers
Popham, J.W. (2003). Test Better, Teach Better: The Instructional Role of Assessment. Alexandria, VA: Association for Supervision and Curriculum Development