Openness and the Future of Assessment
-
Upload
david-wiley -
Category
Education
-
view
3.152 -
download
3
Transcript of Openness and the Future of Assessment
![Page 1: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/1.jpg)
Openness and the Future
David WileyInstructional Psychology & Technology
Brigham Young University
![Page 2: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/2.jpg)
Download These Slides
http://slideshare.net/opencontent/
![Page 3: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/3.jpg)
Context
The societal superstructure is changing
![Page 4: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/4.jpg)
Analog Digital
Music, Phones, TV, Newspapers,Movies, Journals, Communications,
Intelligence, Defense
![Page 5: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/5.jpg)
Tethered Mobile
Phones, Internet Access,Employment
![Page 6: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/6.jpg)
Isolated Connected
People, Content, Systems
![Page 7: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/7.jpg)
Generic Personal
Cars, Computers, Mobile Phones
![Page 8: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/8.jpg)
Consuming Creating
Radio / Podcasting, Newspapers / Blogs Movies / Vodcasting
![Page 9: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/9.jpg)
Closed Open
Software (OSs, Applications), Content (Blogs, Wikis)
![Page 10: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/10.jpg)
Then vs NowAnalog Digital
Tethered Mobile
Isolated Connected
Generic Personal
Consumption Creating
Closed Open
![Page 11: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/11.jpg)
Education vs EverydayAnalog Digital
Tethered Mobile
Isolated Connected
Generic Personal
Consumption Creating
Closed Open
![Page 12: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/12.jpg)
Characteristics of E-learning
Analog or Digital
Tethered or Mobile
Isolated or Connected
Generic or Personal
Consuming or Creating
Closed or Open
![Page 13: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/13.jpg)
Decimation
California State University system – 33%University of New Hampshire – 50%
Double digit cuts everywhere
![Page 14: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/14.jpg)
Exploding Demand
From 120M to 250M+ in next 15 years
![Page 15: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/15.jpg)
![Page 16: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/16.jpg)
![Page 17: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/17.jpg)
Nonrivalrous Media
New opportunities
![Page 18: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/18.jpg)
![Page 19: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/19.jpg)
![Page 20: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/20.jpg)
Free Copy, Distribute, Edit
Technology enables us to share and educate as never before
![Page 21: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/21.jpg)
Except We Can’t
© forbids copying, distributing, and editing
![Page 22: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/22.jpg)
© Cancels the Possibilities
Of digital media and the internet
![Page 23: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/23.jpg)
InternetEnables
What to do?
CopyrightForbids
![Page 24: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/24.jpg)
![Page 25: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/25.jpg)
Use copyright to enforce sharing
![Page 26: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/26.jpg)
![Page 27: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/27.jpg)
The 4Rs
Reuse – copy verbatimRedistribute – share with others
Revise – adapt and editRemix – combine with others
![Page 28: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/28.jpg)
2003-05
2003-08
2003-11
2004-02
2004-05
2004-08
2004-11
2005-02
2005-05
2005-08
2005-11
2006-02
2006-05
2006-12
2007-03
2007-06
2007-11
2008-02
2008-05
2008-08
2008-11
2009-02
2009-05
2009-08
2009-11
2010-02
2010-05
2010-08
2010-11
2011-02
2011-05
0
50,000,000
100,000,000
150,000,000
200,000,000
250,000,000
300,000,000
350,000,000
400,000,000
450,000,000
Over 400 Million Items
![Page 29: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/29.jpg)
![Page 30: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/30.jpg)
The “Open” in OER, OCW, &c.
(1) Free (2) 4R permission
![Page 31: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/31.jpg)
![Page 32: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/32.jpg)
![Page 33: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/33.jpg)
![Page 34: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/34.jpg)
InternetEnables
OERAllows
Sharing and educating at unprecedented scale
![Page 35: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/35.jpg)
OER = Content Infrastructure
Platform for education innovation
![Page 36: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/36.jpg)
![Page 37: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/37.jpg)
Informal Learning
Open, standards-based way to issue, manage, and display credentials
for ANY learning
![Page 38: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/38.jpg)
![Page 39: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/39.jpg)
Transcript 2.0
Fixes many problems with current transcripts
![Page 40: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/40.jpg)
![Page 41: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/41.jpg)
OBI = Credential Infrastructure
Platform for education innovation
![Page 42: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/42.jpg)
Open Education Infrastructure
Democratizes innovation opportunities
![Page 43: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/43.jpg)
OER
LearnAnything
Badges
IssueManageDisplay
Credentials
![Page 44: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/44.jpg)
OER
LearnAnything
Badges
IssueManageDisplay
Credentials
Assessment?
![Page 45: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/45.jpg)
Mind the Gap!
HUGE demand over the next 10 yearsEntrepreneurs are on their way
![Page 46: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/46.jpg)
Anywhere, Free
If I can learn anywhere for free,and show my credentials anywhere for free…
![Page 47: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/47.jpg)
Assess Anywhere, Free?
What does this look like?
![Page 48: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/48.jpg)
1. Ubiquitous Assessment
“Assessment as Status Update”(Tweets, product and book reviews, etc.)
![Page 49: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/49.jpg)
Ubiquitous Assessment
What kind of infrastructure does this require?
![Page 50: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/50.jpg)
Ubiquitous Assessment
No one is working on this infrastructure
![Page 51: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/51.jpg)
2. Leveraging Big, Messy Data
10s of 1000s of tiny data points per personspread across a year
User-generated items
![Page 52: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/52.jpg)
Leveraging Big, Messy Data
What kind of psychometrics are needed to deal with this?
![Page 53: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/53.jpg)
3. From Summative to Formative
The majority will be formative
At scale does formative function as summative?
![Page 54: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/54.jpg)
From Summative to Formative
How will the role of high stakes assessments evolve?
![Page 55: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/55.jpg)
4. Scaling Constructed Response
We can’t condemn next-gen assessment to selected response
![Page 56: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/56.jpg)
Scaling Constructed Response
“Gamify grading”
![Page 57: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/57.jpg)
Google’s ESP Game
A symmetric verification game
(Verbosity is an asymmetric example)
![Page 58: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/58.jpg)
![Page 59: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/59.jpg)
For Example, In Education
• Rubrics• Multi-person Review• Inter-rater Reliability Component• Sanity Sampling
![Page 60: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/60.jpg)
Future Assessment?
Analog or Digital
Tethered or Mobile
Isolated or Connected
Generic or Personal
Consuming or Creating
Closed or Open
![Page 61: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/61.jpg)
Key Trends
Ubiquitous assessmentFrom summative to formative
Leveraging big, messy dataScaling constructed response
![Page 62: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/62.jpg)
Expand Our Thinking
Beyond traditional educationBeyond traditional psychometrics
Beyond traditional assessment
![Page 63: Openness and the Future of Assessment](https://reader036.fdocuments.in/reader036/viewer/2022062404/5549b924b4c905fc7f8b4bdc/html5/thumbnails/63.jpg)
Thank You
http://davidwiley.org/