Using Game Mechanics & Social Networking

Your feedback welcome: http://tinyurl.com/expertiza

Using game mechanics and social Using game mechanics and social networking to motivate student networking to motivate student

contributions to a coursecontributions to a course

Edward F. GehringerDept. of Computer Science

North Carolina State University

Your feedback welcome …http://tinyurl.com/expertiza

Your feedback welcome: http://tinyurl.com/expertiza04/11/23

Outline The goal: Authentic assessment Virtual demo Social networking and game mechanics Reputation systems Summary


Authentic assessment What is it? Why is it hard? How can we facilitate it?

Student-generated content Peer review

04/11/23


Student-generated content gets students working together to

improve others’ learning experiences, helps them learn, by performing tasks

that are similar to real-world responsibilities,

gives them experience in writing their ideas up for an audience of their peers,

allows each cohort to “stand on the shoulders” of students in earlier classes.

04/11/23


“Virtual” demo Creating an assignment Selecting a topic Reviewing Feedback from author to reviewer Teammate review

Your feedback welcome: http://tinyurl.com/expertiza04/11/2304/11/23

Setting up a wiki assignment

Your feedback welcome: http://tinyurl.com/expertiza04/11/2304/11/23

Let’s create some teams …


Here’s how we import it


Now there are five teams …


“Virtual” demo Setting up an assignment Selecting a topic Reviewing Feedback from author to reviewer Teammate review


Selecting a Topic


Let’s review a wiki page


Click on the assignment …


… then on “Others’ work”


Choose a review


Read the submitted wiki page


Then fill out the review template


Save and view the review


Now the reviewee logs in …


… and views the scores


Click on “View” to expand review


Notice the link down at the bottom


Use it to give feedback to the reviewer


Then the reviewer can view the feedback


Review of teammates


Summary of feedback in Expertiza Reviews Feedback to author Teammate reviews Metareviews (x reviews y’s review of z)


Instructor report


How to motivate students? Runners in a race are motivated by

seeing other runners ahead of them. Players in online games are motivated to

catch the leaders. Can we do the same thing in our peer-

review system?

04/11/23


Motivating Students: Achievement System Categories in we can track achievement

Quality of submitted work Quality of reviews Helpfulness to authors Contribution to team

These factors make up reputation.

Your feedback welcome: http://tinyurl.com/expertiza04/11/23 Your feedback welcome: http://tinyurl.com/expertiza

Recognizing Achievement: Leaderboards Students can list their achievements for

all to see.


Now a new review is entered …

04/11/23


… and the leaders change

04/11/23


A new metareview is entered …


… and a new leader is recognized


What we have here is …

a social network! Connections among many individuals. Information contributed from many

sources (albeit coerced!) Can be used to discover competencies of

individuals.


Future work: Message boards for extra credit Student a posts a question Student b responds Student a rates student b’s response Others can rate response too.

TAs can also respond Prompt reviews/answers are

more helpful, so reward for these …


New Features Coming to Expertiza Levels

“Special power”―rearranging messages Microtasks/micropayments … incentivize useful work


Outline The goal: Authentic assessment Virtual demo Student-generated content Social networking and game mechanics Reputation systems Summary


Are the evaluations reliable? Author feedback Metareviewing helps. Algorithmic strategies


Algorithmic approaches

Strategies use quality and leniency as metrics for assigning grades.

Quality is dependent on leniency, and vice versa.

Their approach yields a system of simultaneous equations, which can be solved to yield values for quality.

Other researchers have devised similar methodologies.


Other reputation systems What we have seen are “reputation

systems” devoted to evaluating required work.

Other reputation system deal with voluntary work.

Our hope is to blend the two.


Outline The goal: Authentic assessment Virtual demo Student-generated content Social networking and game mechanics Reputation systems Summary


Summary If students do “real” tasks, authentic

assessment is possible. Peer assessment provides a scalable

approach to authentic assessment. Incentives such as leaderboards and

micropayments can be used to encourage student contributions.

A reputation system is needed for quality control.

04/11/23

Using Game Mechanics & Social Networking

Documents

Transcript of Using Game Mechanics & Social Networking