Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system...
Transcript of Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system...
![Page 1: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/1.jpg)
Building a Database to House
Survey Results
![Page 2: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/2.jpg)
Winona State University
• Regional mid-sized (approx. 8750
headcount enrollment) University with
a predominantly traditional,
residential undergraduate student
body.
• A campus in Rochester comprised
mostly of transfer and graduate
students.
![Page 3: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/3.jpg)
Show of Hands
• Annually send students some kind of background survey? Use student surveys to conduct course or instructor assessments?
• Reporting results to staff and faculty quickly after surveys are conducted is a challenge?
• Have a desire to tie survey results to your Student Information System?
• Wish it was easier to do longitudinal comparisons across surveys?
![Page 4: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/4.jpg)
![Page 5: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/5.jpg)
Original attempt at creating a system for assessment goes back to 1999.
– Got a grant, hired some consultants, and came up with a working solution after several attempts.
– Survey tool was limited in capability.
– Complex and time-consuming to manage.
….. And then the person managing it left
![Page 6: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/6.jpg)
Fall 2010: Introduced SurveyDB
• Goal : Support internal surveys and external surveys. – Qualtrics: course evaluations, assessment day surveys, etc.– National Survey of Student Engagement (NSSE) results
• Goal : Use off-the-shelf tools we were familiar with - Microsoft SQL Server, Qualtrics, SharePoint, Reporting Services, and Powershell.
• Goal : Integrate with data from our Student Information System and data mart to feed “Terrific Reporting”.
• Goal: Enable a single launch page for large (multiple) survey sets.
• Goal: Get it done in time for the next Assessment day.
![Page 7: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/7.jpg)
![Page 8: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/8.jpg)
![Page 9: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/9.jpg)
Completion Reporting
![Page 10: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/10.jpg)
Completion Reporting
![Page 11: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/11.jpg)
SurveyDB
DataMart
Scriptsfunction Get-QualtricsSurvey {
[CmdletBinding()]param
([parameter(Mandatory=$true)]
[String]$QualtricsWSServerID,[parameter(Mandatory=$true)][String]$QualtricsWSUserName,
[parameter(Mandatory=$true)][String]$QualtricsWSPassword,[parameter(Mandatory=$true)][String]$SurveyID
)
Qualtrics
![Page 12: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/12.jpg)
Basic Storage Elements
![Page 13: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/13.jpg)
Think of a SurveyInstance as the delivery of a set of questions to a group of participants on a given occasion.
SurveyInstance vs. Survey
Instance 1: Opinion survey given to new incoming freshman the 10th day after courses begin.
Instance 2: Same questions asked of those same people right after finals in Fall.
![Page 14: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/14.jpg)
![Page 15: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/15.jpg)
![Page 16: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/16.jpg)
Storing Question Structure
![Page 17: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/17.jpg)
Handling Changes in Questions
• Sex?• What is your Sex?• Are you Male or Female?• Please indicate your gender• Which gender do you identify as?
Even though the question may change a bit, we still want to track results over time.
![Page 18: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/18.jpg)
Storing Multiple Choice Options
![Page 19: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/19.jpg)
ChoiceSetVersions
• Used for True/False, Yes/No, and multiple choice questions.
• ChoiceSetVersions can be shared by different questions.
• ChoiceSetVersions may change over time.
• We want to retain the set of choices available at the time the question was asked.
![Page 20: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/20.jpg)
Why Would the Set of Choices Change?
Question 7: Which tools did you bring with you to college?
![Page 21: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/21.jpg)
Choices Change Over Time
![Page 22: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/22.jpg)
Storing Survey Responses
• “A SurveyResponse represents an individual’s set of responses to a SurveyInstance.”
• It identifies the individual responding.
• Indicates the current status of the response: Not Started, Started, Finished.
• Denotes the dates and times when the survey response was started and completed.
![Page 23: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/23.jpg)
Storing Responses to Questions
• “A QuestionResponse represents the answer to a particular version of a question within a SurveyInstance.”
• If the question is a fill-in-the-blank type, the QuestionResponse contains the answer.
• If the question is multiple choice, the QuestionResponse points to a Choices record.
• Note that a question can be tagged as “seen, but not answered”
![Page 24: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/24.jpg)
Survey Response
![Page 25: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/25.jpg)
• A Person is an individual. Person records tie the individual back to our student information system and to SurveyResponses.
• Panels are pre-defined lists of people.
• EligibleParticipants are people are individuals who have been invited to respond to a SurveyInstance.
Structures for Identifying Respondents
![Page 26: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/26.jpg)
People Relationships
![Page 27: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/27.jpg)
Survey Relationships
• A Survey is a group of related SurveyInstances.
• A SurveySet represents a group of SurveyInstances that are part of an overall survey effort – Fall 2011 New Freshman Surveys for example.
• A SurveySetCollection represents a SurveySetoffered over time – Assessment Day surveys from 2007 thru 2011 for example
![Page 28: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/28.jpg)
Relating Surveys to One Another
![Page 29: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/29.jpg)
External References
![Page 30: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/30.jpg)
External References
• Some entities have “external reference” fields which help relate records to other systems.
• The ExtReference field contains a key to the data in the external system, QID1 for example.
• The ExtReferenceType identifies what object the external reference refers to: Qualtrics, SIS, etc.
• Used to make integration easier.
![Page 31: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/31.jpg)
Extensibility Via Attributes
• “Attributes” are user-defined fields that allow us to store new types of information without changing the structure of SurveyDB.
• Any entity can have attributes attached to it. The “TableName” field is used to identify the entity the attribute applies to.
• Attribute values are matched with table records via “KeyValue” fields.
• Sample uses: Gender of Eligible Participant. CourseID that Survey applies to.
![Page 32: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/32.jpg)
How Information flows from SurveyDB to Qualtrics and Back Again
![Page 33: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/33.jpg)
Obligatory Funny Picture
![Page 34: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/34.jpg)
Qualtrics Web Svcs Demo
![Page 35: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/35.jpg)
Qualtrics Web Svcs Demo
• Panel Upload
• Create Distribution
• Download Invitation URLs
![Page 36: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/36.jpg)
Survey Definitions, Too…
![Page 37: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/37.jpg)
Obligatory Humorous Quotes
“A child of five would understand this. Send someone
to fetch a child of five.”
Groucho Marx
“Ending a sentence with a preposition is something up
with which I will not put.”
Winston Churchill
![Page 38: Building a Database to House Survey Results · 2015-01-15 · Original attempt at creating a system for assessment goes back to 1999. –Got a grant, hired some consultants, and came](https://reader033.fdocuments.in/reader033/viewer/2022041818/5e5c12cad1a6c24f9e6d0084/html5/thumbnails/38.jpg)
Recap1) Surveys in Qualtrics
2) SurveyDB to hold survey structure,
participants, & results
3) PowerShell scripts for integration
4) SharePoint as a front-end for survey
takers
5) SQL Server Reporting Services to
report results