Building a Winning Infrastructure for Distance Education: A ...
-
Upload
databaseguys -
Category
Documents
-
view
702 -
download
2
Transcript of Building a Winning Infrastructure for Distance Education: A ...
![Page 1: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/1.jpg)
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Building a Winning Infrastructure for Distance Education: A Case Study
Stuart VardenKitty Daniels
Susan Feather2002 OSRA Conference
St. Louis, MOFebruary 21, 2002
![Page 2: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/2.jpg)
2
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Overview
1. Web and Database Support– Stuart Varden
2. Faculty Support– Kitty Daniels
3. Testing in an Online Course: A Challenge– Susan Feather
![Page 3: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/3.jpg)
3
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Web and Database Support
• Use Blackboard, Inc. System (BB5)
• Use HorizonLive and Real Presenter Systems for Voice-Over-Graphics Presentations
• NACTEL Web Page
![Page 4: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/4.jpg)
4
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Support Staff
• BB5 Systems Support• Two Course Technology Support
persons:– Graphics support– Implement Quizzes, Exams, Syllabi,
Assignments and other instructional documents
– Student/Instructor Help Desk
• Database Administrator
![Page 5: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/5.jpg)
5
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Database Function• Administration System
– Student Registration– Maintain Records on Screening Tests
• Reporting for:– Internal Control– External Funding Agencies & Sponsors
• Sloan Foundation• U.S. Government • NACTEL Board• New York State• Regional Accreditation Agencies (Middle States)
![Page 6: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/6.jpg)
6
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Database Functions (Cont.)
• Research– Three Main Thrusts (FIPSE/LAAG):
• Enhanced Student Services• Secure Online Test Proctoring• Mentoring
– Student/Faculty Research Data Source• Doctoral Dissertation Research• Faculty Research
![Page 7: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/7.jpg)
7
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Evolution of Database Function
• Stage 1:– Standalone MS Access Databases
• Stage 2:– Perceived as Having Low Impact– Proctoring– Courseware (Lack of control; change
management issues)
![Page 8: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/8.jpg)
8
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Evolution of Database Function
• Stage 3:– Integration of All Databases– Move from MS Access to Sequel Server
• Stage 4:– Interface to University Registration Systems– Calendar Issues– Billing Structure– Third Party Tuition Payments
![Page 9: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/9.jpg)
9
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Evolution of Database Function
• Stage 5:– Leadership Heading to Mainstream
• Major Program• More Online Program Demand – the 9/11 Effect• Translates Into Dollars ($)
– It Is Now Understood That NACTEL Web Page Must Guide the Student Through a Sequence of Functions and Services with the Database Having a Role Throughout
– Still Learning and Reinventing
![Page 10: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/10.jpg)
10
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Faculty Support
• Orientation for NACTEL faculty
• On-going support for NACTEL faculty
• University-wide support
![Page 11: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/11.jpg)
11
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Orientation
• Online Seminar– Student version– Faculty version– Provide introduction to Blackboard,
Horizon Live– Provide essential Internet concepts– Prepare computers for online education
![Page 12: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/12.jpg)
12
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Orientation contd.
• “Shadowing” of experienced faculty
![Page 13: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/13.jpg)
13
School of Computer Science School of Computer Science and Information Systemsand Information Systems
On-Going Support• Faculty support
– Team Teaching– Team Course Development– Team Course Maintenance– Faculty Meetings
• Technical support• Instructional design support
![Page 14: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/14.jpg)
14
School of Computer Science School of Computer Science and Information Systemsand Information Systems
University-Wide Support• Center for Instructional Technologies
– Blackboard Seminars and Conferences– Online Seminars
• Online Course Design• Designing Accessible Courses• Moderating Online Discussions• Using Audio and Video for Online Courses—An Introduction to
Web Streaming
• Faculty Resource Web Site• Teaching, Learning, and Technology Roundtable
![Page 15: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/15.jpg)
15
School of Computer Science School of Computer Science and Information Systemsand Information Systems
• Student assessment and evaluation (how much, how often, hands-on, practical vs. theoretical)
• Secure testing – need for authentication
Testing in Online Courses:A Challenge
![Page 16: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/16.jpg)
16
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Tests• “Feared by learners, discounted by instructional
designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.” (Horton, 2000)
![Page 17: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/17.jpg)
17
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Two Types . . .• Formal
– Online Quizzes – Cumulative exams (midterm, final)– Submission of homework assignments (fax, e-mail, Drop
Box) – Projects/Papers (individual and group work)– Lab assignments and reports
• Informal– Participation in class discussion board– E-mail responses– Responses to open-ended questions in an online chat
Assessment at a Distance
![Page 18: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/18.jpg)
18
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Distance Learning SoftwareCourse Management Systems
– Blackboard - www.blackboard.com (adopted by Pace)
– WebCT – www.webct.com
Other Assessment Software– Question Mark – www.questionmark.com – eZ.Exam – www.ncspearson.com/ncscorp/ezexam – ExamSoft – www.examsoft.com – Secure Exam – www.softwaresecure.com – Test.com – www.test.com – Cyber Exam – www.atpcorp.com/cyberexam.htm – Test Pilot – www.clearLearning.com/index.html – Chi Tester – www.chitester.weber.edu
![Page 19: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/19.jpg)
19
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Blackboard Assessment Features• Assessment Manager
– Creates quizzes, exams, and surveys– Password protects exam(s)– Enables timed quizzes/exams– Calculates and records grades
• Pool Manager– Stores questions to be used and reused
• Online Gradebook (Spreadsheet)– Stores grades, allows editing, weighting– Exports Gradebook into Excel– Resets quizzes/exams
![Page 20: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/20.jpg)
20
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Blackboard Question TypesTrue/False
– Make a binary decision – right or wrong?– Make question simple and straightforward
Multiple choice – Maximum 20 choices
Multiple Answer– Choose more than one answer
Fill in the blank– Evaluated on an exact text match – Doesn’t accept synonyms, grammatical variants,
common misspellings
![Page 21: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/21.jpg)
21
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Blackboard Question Types• Matching
– Maximum 20– Keep the list short!
• Ordering/Ranking• Short Answer/Essay
– Not automatically graded– Learner can cut/paste from another open program– Limit on number of characters
![Page 22: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/22.jpg)
22
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Blackboard Advanced Options•Categorize questions to create from Question Pool
– Specific or random– Import and export capability
•Allow HTML coded text•Upload multimedia
– Images– Audio– Files/websites
• Create a Link to file (Example: Link to File)• Display it on the page
![Page 23: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/23.jpg)
23
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Options Not Available . . . Yet
• Spell Checker
• Enter mathematical symbols/functions
• Greater storage for essay type questions
• E-mail sent upon completion
• Interactive questions (hot spot, drag and drop)
![Page 24: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/24.jpg)
24
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Hot Spot Question
In the above diagram, place the marker on the area that makes this a parallel circuit. Then click the Submit button.
![Page 25: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/25.jpg)
25
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Drag and Drop Question
![Page 26: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/26.jpg)
26
School of Computer Science School of Computer Science and Information Systemsand Information Systems
How Can Cheating Be Reduced?Trust Approach• Remind learners . . .
• they are responsible for their own learning.• they only cheat themselves.• that you trust them.
Fence Approach • Try to make cheating impossible or harder than actually studying.• Create new test questions for each test.• Randomly select questions from a list.• Randomly order multiple choice answers.• Require proctored exams.
Threat Approach• Threaten punishment with clearly stated policy if caught cheating.
![Page 27: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/27.jpg)
27
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Purpose of Proctoring Program• The proctoring program was designed to focus
on the issue of periodic student verification when taking an examination in an online course.
• “The basic purpose of having a test administrator or proctor in the room is to prevent the test from being compromised.”
• “Ninety percent of respondents will usually be honest. The other 10 percent can be a real headache.” (Odin Westgaard, Ed.D, Tests That Work)
![Page 28: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/28.jpg)
28
School of Computer Science School of Computer Science and Information Systemsand Information Systems
The Proctor Defined
• A person selected by the student and approved by Pace University
• The proctor will be responsible for administering and supervising any major examinations throughout the student’s degree (i.e. midterm and final exams)
![Page 29: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/29.jpg)
29
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Proctor Criteria• Cannot be a relative, student in the
program, or coworker• Acceptable proctors . . .
– Company Supervisor/Manager– Corporate Instructor– Official College Testing Service– Librarian– Official Learning/Tutoring Center(And more . . .)
![Page 30: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/30.jpg)
30
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Consortium of Testing Centers http://testing.byu.edu/Consortium/find.asp
![Page 31: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/31.jpg)
31
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Proctor Responsibilities• Verify the identity of a student when taking a proctored
exam• Have e-mail and Internet access (access to fax
machine helpful)• Gain access to the examination via the Internet using
provided password• Validate an exam by ensuring that the student is
adhering to the exam guidelines• Sign and return a verification form upon completion of
the proctored examination
![Page 32: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/32.jpg)
32
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Proctored Exam Considerations
• Determine the specific course criteria:– Which exam/s will require a proctor?– When will they be available?– How will the proctor receive the examination?– How will the completed examination be
returned?– What resources will be allowed?– What is the time limit?
![Page 33: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/33.jpg)
33
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Proctored Exam Considerations
• Determine the specific course criteria:– When is the completed examination due?– What kind of feedback will the students receive
after exam?– When will the grades be posted?
![Page 34: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/34.jpg)
34
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Proctoring Program Steps1. Selection of person to serve as proctor
2. Complete online proctor application process
3. Provide proctor with the exam information and password
4. Proctor administers exam and returns a signed
verification form
ChangeProctor
5. Exam Complete
![Page 35: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/35.jpg)
35
School of Computer Science School of Computer Science and Information Systemsand Information Systems
NACTEL’s Proctoring Program http://support.csis.pace.edu/nactel/program/proctoring.cfm
![Page 36: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/36.jpg)
36
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Proctor Database SQL Server (Spring 2001)
![Page 37: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/37.jpg)
37
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Proctor Database• Instructors have access to proctor information and e-
mail capability for their courses only• Students have ability to edit, verify, invalidate proctor
and apply for a new proctor• Students have ability to search for currently approved
proctors by location (only those proctors who are willing to proctor for other students
• Soon . . .• Proctors will have access to update contact
information, retrieve exam information/passwords and verify administration of any proctored exam
![Page 38: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/38.jpg)
38
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Current Problems/Concerns• Scheduling a day/time with proctor• Computer/printer malfunctions• Problem accessing/submitting online exam• Proctor database is student dependent, rather
than proctor dependent• Lost connection during exam requiring that it be
reset– Connection Keeper (sends ping to ISP)http://www.gammadyne.com/conkeep.htm
![Page 39: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/39.jpg)
39
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Proctor Survey Responses“Your services are great to help people further their education/careers.”
“This was accomplished seamlessly. It demonstrated a lot of thought went into this procedure.”
“Your communications are clear, organized, and allow for ease in response. You've made the process simple and easy to use. Thanks!”
“The use of e-mail and the Internet is an excellent method to distribute the needed information as opposed to regular mail service.”
“I think the process works very well. Tricia keeps in contact and the e-mails I have gotten all have the pertinent information. I’ve enjoyed working with Pace and the students.”
![Page 40: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/40.jpg)
40
School of Computer Science School of Computer Science and Information Systemsand Information Systems
ReferencesHorton, W. (2000). Designing Web-Based TrainingWestgaard, O. (1999). Tests That Work “Survey of Course and Test Delivery/Management
Systems for Distance Learning” http://www.student.seas.gwu.edu/~tlooms/assess.html
“Web-Based Assessment” http://sunil.umd.edu/documents/assess.htm
“Quizzing and Testing On the Internet” http://illinois.online.uillinois.edu/stovall.quizzes
![Page 41: Building a Winning Infrastructure for Distance Education: A ...](https://reader035.fdocuments.in/reader035/viewer/2022062703/554ddee0b4c905cc0e8b52ff/html5/thumbnails/41.jpg)
41
School of Computer Science School of Computer Science and Information Systemsand Information Systems
Questions?