Measuring Skills Using Games

What would you rather do …Take a test

orplay a game?

The Problem and Mission

The value of Build-It-Yourself will be largely measured by how well we can prove that our students learn valuable skills.

Tests are the most obvious way to measure skills.

The Problem:No one likes to take tests!

Our Mission:Create playful games that measure building skills quantitatively.

The Problem and Mission

Target audience:Boys and girls 8 – 13. (playful)Parents (constructive)

Game Attributes:1) Takes less than 10 minutes

to play.2) Funky, game-like, inspired

by Lemonade Stand and other Tycoon games.Choose an avatar. Your avatar will be presented with a problem. You must solve the problem.

“There must be millions of people all over the

world who never get any love letters . . . I could be

their leader.”

Charlie Brown

“Honey, Where’s my super suit?”

Mr. Incredible

“Go in peace my daughter. And remember that, in a world of ordinary mortals, you are a Wonder Woman.” Queen

Hippolyte

Choose an avatar

Problem Solving Skills

1) Define and focus on a problem.2) Research and build on the ideas of others.

Don’t reinvent the wheel.3) Teamwork.4) Break a solution into simple parts.5) Document.

We want to measure how well kids know the problem solvingprocess exercised in BIY workshops.

If we cannot measure how well kids can execute the problem solving process in a short game, is it meaningful to measure how well they know a problem solving process?

Lab books, finished projects and presentations are a reflection of execution.

Definitions of problem solving skills.

1) Focus on problem / missionQP1 Describe the problem / mission clearly, concisely and convincingly.QP2 Use technology constructively to solve or better understand a social issue.

2) ResearchQR1 Find appropriate images in Google and embed them in PPT.QR2 Build on solutions created by others. Find previous art. Incorporate the ideas of others.

3) Break a solution into simple partsQB1 Know the benefits of modular construction. (quick to build, easy to edit, reusable)

QB2 Define and assign tasks to complete a project.

4) TeamworkQT1 Share ideas, supplies and tools.QT2 Help other teammates and / or teach other teammates.QT3 Team goals are more important that individual goals.

Use collaboration tools??? Perhaps we should add this to our curriculum.

5) DocumentationQD1 Create a PPT lab book that invites people to read it.QD2 Define concepts clearly, concisely and convincingly. Can you read a message quickly from a

distance?

Measuring Skills Using Games

Skill Game Storyline Prototypes

Problem / Mission:

1) An important robot is broken. Fix it. (Benjamin)

2) Someone is in trouble. Rescue them. (Carolyn)

3) The economy is in trouble. Stimulate it. (Qin En)

Focus on a problem

1) View an animated clip that shows 5 things happening. and then select the best definition of the problem. (5 gold coins if you make the proper selection.)

Research Skills

1) Filter useful information from useless information. (15 of 45 bits of information are useful.)

2) Connect useful information

(Decision is made that requires knowledge of two independent bits of information.)

3) Know what information is necessary to solve a problem.

(Decision requires finding information in Google)

Teamwork Skills

1) Value team before individual success(Select 1 resume out of 10 that focuses on team before individual accomplishments.)

2) Communicate effectively(Select 1 resume out of 10 that communicates clearly, concisely and convincingly.)

3) Listen, be open minded, compromise, brainstorm(Select a decision that reflects compromise or win – win.)

• skilled / talented• offer help• contribute ideas• if you pick bad teammates it becomes very hard to solve or your teammates will slow you down.

Break into simple parts

1) Break solution into simple, focused modules and tasks2) Identify series vs parallel tasks

Documentation Skills

1) Clear2) Well organized, easy to find specific info3) Concise, Relevant, Accurate4) Document results and edits

Select user’s manuel that has 1, 2, 3 and / or 4 qualities.

Skill Measurement Matrix Focus on a problem (20%) 0 10 201) Observe and define the problem No part of the problem

identified.Part of the problem selected. May include irrelevant information.

Problem and focus selected.

Research a problem (20%) 0 4 61) Filter useful information Select useless information Select 2 sections of useful

information.

2) Connect information Selection reflects connecting 2 bits of information

3) Find critical information Calculate correct answer. Must find fact on Google.

Break a solution into simple parts (20%) 0 41) Choose project plan tasks and parts Select 5 or 20 critical parts and

or tasks that are simple, focused components of a solution.

Teamwork (20%) 0 6 81) Communicate convincingly Select 1 of 10 resumes that

reflects good communication

2) Value team over individual success Select 1 of 10 resumes that reflects team over individual.

3) Listen and compromise Select plan that reflects compromise and win - win.

Document (20%) 0 6 81) Clear Select 1 of 10 user's manuels

that is clear.

2) Well organized, easy to find info Select 1 of 10 user's manuels that is well organized

3) Concise, relevant, accurate info Select user's manuel that is concise, relevant and accurate.

Project Plan Skill Measuring Game Project Plan20-Feb

Tasks Est hrs Status Hours

RemainingPPT Final Presentation (10 slides) 4 2Design specification (skill definitions, scoring) 4 4Test finished prototype (survey, summarize results) 3 3

Storyline content for:opening trailer (must be spectacular) 3 2problem definition 1 1research 4 4break problem into parts 2 2teamwork 4 4documentation 4 4Graphic content (characters, backgrounds, props)opening trailer 6 5problem definition 2 2research 2 2break problem into parts 4 4teamwork 4 4documentation 2 2Sound effects 3 3Scratch program 12 12HTML for research section 4 4Meetings 24 23Documentation 4 2Total 96 89

Total Weeks Feb 20 - Aug 10 24Weeks Remaining 24Hours / week required to complete project 3.7 as of 20-Feb

Research

http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.117.8503&rep=rep1&type=pdfDefinition of problem solving skills1) Identify the problem (Focus on problem)2) Define the problem through thinking about it and sorting out the relevant information (Research)3) Explore solutions through looking at alternatives, brainstorming, and checking outdifferent points of view (Teamwork)4) Act on the strategies (Break solution into simple parts)5) Look back and evaluate the effects of your activity (Document)

http://www.ehow.com/how_2120954_teach-problem-solving-skills.htmlThe University of Phoenix NO FUN way.

Examples:http://www.lemonadestandgame.com/Simple, intuitive, no graphics, makes you think strategically.

Skill Game Storyline PrototypesProblem / Mission:1) An important robot is broken. Fix it. (Benjamin)2) Explore a curious object on a remote planet. (Rahul)3) Someone is in trouble. Rescue them. (Carolyn)4) The economy is in trouble. Fix it. (Qin En)

RPG / Tycoon Style Game:You are a famous “Problem Solver.” (Trouble Shooter)Your fee is 50 gold coins to start plusA bonus (up to 50 GC) based on how well you solve a problem.

You must make decisions that solve the problem.Each decision has a cost / benefit ratio.Your goal is to solve the problem at the lowest cost.(i.e. maximize your profit.)

John’s notes for Game Graphics and Storylines:

RPG / Tycoon Style Game:A trailer presents a problem.

You explore an RPG space and select:1. Definition of the problem and goal.2. The most important research info.3. A strategy that solves the problem.4. Teammates needed to solve the problem.5. Documentation that enables your teammates to work together.

John’s notes for Game Graphics and Storylines:

Intro trailer:

John’s notes for Game Graphics and Storylines:

Mr. Problem Solver

You are …

Ms. Trouble Shooter

Click one

Intro trailer:The economy is in the toilet!

Many kids do not have enough money to buy the candy or computer games they need.

John’s notes for Game Graphics and Storylines:

                            

  

Intro trailer:

Some young BIY entrepreneurs have set out to build a robot that will provide a service, put people to work and make many on their team rich and famous beyond their wildest dreams.

John’s notes for Game Graphics and Storylines:

Intro trailer:However, their business is failing.

Your mission is to help them find the problem, fix it, and earn a fortune?

John’s notes for Game Graphics and Storylines:

Intro trailer:You can go to …The Computer Cove to find information and document.

John’s notes for Game Graphics and Storylines:

Bank

Headquarters

Possible problems:

The socialists say, "There are too many greedy, scurrilous scoundrels and vile villains." A vile competitor stole your customers.

The capitalists say, "Too many lazy no-gooders are looking for free rides. Not enough people are building.“

A vile employee is embezzling your profits.

The robot never worked.

Nobody wants to pay 25 cents.

The robot costs more to run than it can earn.

The robot was doing a robust business then it broke.

www.build-it-yourself.com

John’s notes for Game Graphics and Storylines:

1. Financial history.2. Parts life cycle.3. People in the news.4. Testimonials.

Start M1 M2 M3 M4 M5 M6110,500$ 35,750$ 550,000$ 53,250$ 350,500$ 475,000$ 59,500$ 340,500$ 150,250$ 250,000$ 50,250$ 90,500$ 51,000$ (304,750)$ 399,750$ (196,750)$ 300,250$ 384,500$

1,000,000$ 1,051,000$ 746,250$ 1,146,000$ 949,250$ 1,249,500$ 1,634,000$

Rocket Works Financial History

$-

$200,000

$400,000

$600,000

$800,000

$1,000,000

$1,200,000

$1,400,000

$1,600,000

$1,800,000

$2,000,000

Start M1 M2 M3 M4 M5 M6 M7 M8

Missions

Dol

lars

Bank GalaxyBank Galaxy

Intro trailer:You can go to …Headquarters to recruit teammates and build.

John’s notes for Game Graphics and Storylines:

Bank

Headquarters

CandidatesCandidates

HeadquartersHeadquarters

Game RoomGame RoomKitchenKitchen

Wellesley Student$500/day

Successful negotiator.Community organizer.

Harvard Student$1000/dayCan sell.

Claims to be the best.

MIT Student$2000/day

Techno-guru.Hero is Ghandi.

ApplicantsValue team before individual successCommunicate effectivelyListen, be open minded, compromise

High School Graduate$10/day

Follows instructions and keeps it simple.

Talks from the heart.

BU Stud$400/day

Doesn’t get bogged down with philosophy

or politics.World Solitaire Champ

???You design your own Teammate

ApplicantsValue team before individual successCommunicate effectivelyListen, be open minded, compromise

CandidatesCandidates

HeadquartersHeadquarters

Game RoomGame RoomKitchenKitchen

KitchenKitchen

$10/day/employee25% of prospects like the food. You can’t recruit good people with perks.$25/day/employee50% of prospects like the food. Food is not a reason for joining your team.$50/day/employee100% of prospects like the food.Many people want to work for you.

Intro trailer:You can go to …Bank Galactica to monitor your gold coins.

John’s notes for Game Graphics and Storylines:

Bank

Headquarters

Bank GalaxyBank Galaxy

$56,735,000$56,735,000

Gold Coins Earned

$ Specifications

$ Research

$ Recruiting

$ Construction

$ Documentation

$ Balance

Balance Sheet