MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

75
MOOCs, Automation, Artificial Intelligence and Pedagogical Agents George Veletsianos, PhD Canada Research Chair, Associate Professor School of Education and Technology, Royal Roads University June 18, 2014 :: University of Edinburgh

description

Open courses are a sociocultural phenomenon. This phenomenon represents symptoms, responses, and failures facing Higher Education. In this talk, I examined open courses and MOOCs from a variety of angles and discussed the degree to which MOOCs have portrayed education as a product that can be packaged, automated, and delivered. Empirical research on the design and development of pedagogical and intelligent agents that may be used in MOOCs was also presented. More information here: http://www.veletsianos.com/2014/06/05/moocs-automation-artificial-intelligence-seminar/

Transcript of MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Page 1: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

George Veletsianos, PhD Canada Research Chair, Associate Professor

School of Education and Technology, Royal Roads University June 18, 2014 :: University of Edinburgh

Page 2: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents
Page 3: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents
Page 4: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

School of Education and Technology

http://tinyurl.com/RRUMALAT

Page 5: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents
Page 6: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

An opportune time

Page 7: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents
Page 8: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents
Page 9: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents
Page 10: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents
Page 11: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents
Page 12: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Today’s roadmap

1.  The MOOC as a sociocultural phenomenon

2.  Automation of teaching historically, and in the context of MOOCs

3.  Pedagogical agents as teaching automation artifacts in online learning

Page 13: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

- #change11 cMOOC - MOOCs repurposed in my courses (for student analyses) - Teaching an open course in the Fall (Networked Scholars - #scholar14)

- Research agenda focuses on experiences in emerging online settings (e.g., open courses, social media, pedagogical agents)

Page 14: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

- #change11 cMOOC - MOOCs repurposed in my courses (for student analyses) - Teaching an open course in the Fall (Networked Scholars - #scholar14)

- Research agenda focuses on experiences in emerging online settings (e.g., open courses, social media, pedagogical agents)

Page 15: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

The MOOC as a sociocultural phenomenon

(with Rolin Moe)

Page 16: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

If the MOOC is not just a learning model, what is it?

•  A response to increasing costs

Page 17: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

If the MOOC is not just a learning model, what is it?

•  A response to increasing costs •  A symptom of the belief that education à workforce

training

Page 18: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

If the MOOC is not just a learning model, what is it?

•  A response to increasing costs •  A symptom of the belief that education à workforce

training •  Representative of current political landscape

Page 19: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

If the MOOC is not just a learning model, what is it?

•  A response to increasing costs •  A symptom of the belief that education à workforce

training •  Representative of the current political landscape •  Representative of the perspective that technology

provides solutions

Page 20: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

If the MOOC is not just a learning model, what is it?

•  A response to increasing costs •  A symptom of the belief that education à workforce

training •  Representative of the current political landscape •  Representative of the perspective that technology

provides solutions •  Indicative of scholarly failures

Page 21: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

If the MOOC is not just a learning model, what is it?

•  A response to increasing costs •  A symptom of the belief that education à workforce

training •  Representative of the current political landscape •  Representative of the perspective that technology

provides solutions •  Indicative of scholarly failures •  Representative of the belief that education can be

packaged and automated

Page 22: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

The automation of teaching

Page 23: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

An “industrial revolution” must occur in education, one “in which educational science and the ingenuity of educational technology combine to modernize the grossly inefficient and clumsy procedures of conventional education.”

Pressey (1933, pp. 582)

Page 24: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

His solution: Teaching Machines, devices that he was contemplating as early as 1915 (Benjamin, 1988).

Page 25: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents
Page 26: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

B.F. Skinner’s 1935 Teaching Machine

Page 27: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Basulto (2014) predicts an “artificially intelligent machine” could teach massive open online courses, “lecturing, grading and engaging with students…Unlike humans, machines would be willing to complete all the coursework and do all the assignments…”

Page 28: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

“With the menial job of checking and grading assignments taken over by computers, we (human teachers) will be left with the responsibility to intervene and mentor our students” (Yair, 2014 in ACM Inroads) The Automatic Teacher would free the teacher “from mechanical tasks… so that she may be a real teacher, not largely a clerical worker” (Pressey, 1927)

Page 29: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Enamored with effectiveness and efficiency

Page 30: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Margie’s future schoolroom in 2157 was “right next to the bedroom, and the mechanical teacher was on and waiting for her… [all the] lessons were shown and the questions were asked [on the big screen].”

Asimov (1951)

Page 31: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

“Regressive trend” toward mass production, commercialization, and commodification.

Noble (1988)

Page 32: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Has the trend materialized? “strong pressures to produce mediocre instructional products based on templates and preexisting content”

(Wilson, Parrish, & Veletsianos, 2008, pp.42) “Shovelware” = information masquerading as a course.

(Morrison & Anglin, 2006)

Page 33: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Let’s unpack “automation.” Is automation the norm in academia already?

Page 34: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents
Page 35: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents
Page 36: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents
Page 37: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents
Page 38: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Social media automation Cross-posting (e.g., Facebook – Twitter) Pingbacks (blog comments) Blog post alerts (e.g., Facebook, Twitter, Linkedin)

Page 39: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents
Page 40: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents
Page 41: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents
Page 42: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Digital literacies? Scholarly literacies? We should contrast these activities to the automation of teaching that is evident in some MOOC practices & in some MOOCs.

Page 43: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Case Study

Page 44: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Tools à Functions Email Scheduler à coordination Study Group via OpenStudy à Pedagogical

Support Interactive coding via Codeacademy à

Assessment

Ponti (in press)

Page 45: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

These artifacts “remove the need for exposure to teachers, by providing participants with peer interactions and automated coordination and testing”

(Ponti, in press)

Page 46: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents
Page 47: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Automated courses: for learners that are independent, self-organized, intrinsically motivated and capable?

(Ponti in press; Tomkin & Charlevoix, 2014)

Page 48: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

However, even though “MOOC teaching functions are often disaggregated and delegated to automated processes and community-based social learning, the place and visibility of the teacher remain of central importance.”

(Bayne & Ross, 2014)

Page 49: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Learners describe “a unique and powerful sphere of intimacy that developed for them with their xMOOC instructor, most especially in the context of the pre-recorded instructional videos”

Adams, C., Yin, Y., Vargas Madriz, L. F., & Mullen, C. S. (in press). A phenomenology of learning large: the tutorial sphere of xMOOC video lectures. Distance Education.

Page 50: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

The case of “Mary,” who wrote a short story instead of an essay and shared the story on a

MOOC discussion board

Page 51: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

“The professor was totally checked out, he never visited the discussion board… and it was just depressing and discouraging And I thought his videos were not valuable at all so I didn’t watch them. So, it was almost like that course didn’t have an instructor …there was someone who built the class and created the reading but that was it.”

Page 52: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

The artifacts in the Mechanical MOOC reconfigured facilitation/instruction.

What other functions can automated artifacts play?

Page 53: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Pedagogical agents

Page 54: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

What or Who is a pedagogical agent?

“A virtual character employed in a digital

learning environments to serve various educational goals.”

Page 55: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents
Page 56: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

… and not just pedagogical

Page 57: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Back to education: What kinds of goals?

Learning Motivation

Engagement

Encouragement Comfort

Believability

Play & Fun

Page 58: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Complexity of the field

•  Empirical evidence in support of the prior

claims (motivation, comfort, etc) is mixed, and often ambiguous.

Page 59: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

If you were to design a pedagogical agent,

what choices would you make, and what would those choices depend on?

Page 60: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Example #1: Gender Gulz et al; Kim & colleagues; Baylor & colleagues

Page 61: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Contextual relevance Veletsianos 2007, 2010

Page 62: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Example #2: Agent appearance Domagk (2010)

- Including an agent = no impact on learning (expected) -  Appealing agents promoted transfer

- Unappealing agents hindered learning

Page 63: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Agent-learner relationships & agent-learner interactions

•  A few studies in educational contexts - not the majority

•  These studies occur in open-ended environments (not the norm in the field)

•  Emerging evidence: enjoyment of social chat, verbal abuse, fun with the system

•  Computers As Social Actors (Media equation), Uncanny valley

Page 64: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Research Questions

•  What topics are discussed in agent-learner conversations?

•  What social practices emerge in agent-learner conversations?

Page 65: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Series of studies

•  Students have access to agents for weeks at a time

•  Naturalistic settings

•  Variety of methods: Computer Mediated Discourse Analysis, phenomenology, open coding using standard interpretive lens, quasi-experimental

Page 66: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Results #1: Small-talk

•  Hey Mark, how are you today? •  Did you watch the [football] game last

night?

Page 67: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Results #2: Playfulness

•  Did you watch the [football] game last night?

•  Do you have a girl/boyfriend?

Page 68: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Results #3: Abusive/aggressive comments

•  You stupid [expletive]!

•  shut up. Don’t correct me. •  Agent: I can’t answer that.

User: WHY NOT!? “The fact that he couldn't help me made me really angry… I don’t remember what the question was but [the agent] should have been able to answer it!”

Page 69: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Conflicts

“I hated Joan or whatever the super-

agent lady was called. She asked me at one point 'Are you testing me?' like we were going to have some sort of a confrontation or something. I've never wanted to hurt a digital person before!”

Page 70: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Results #4: Sharing personal information

•  I am worried about my exam score •  My girlfriend broke up with me

Page 71: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Results #5: Agent Role •  Agent as instructor/learning companion

(results from prior literature)

•  Agent as mediator – Can you tell professor X that she needs to

program you better?

•  Agent as partner (sometimes you just want to talk) – This was an easy assignment, Mark.

Page 72: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

•  Social and psychological issues are as significant as technology design issues.

•  How would results differ: –  with different agents? (e.g., appearance) – with agents of varied social intelligence? –  in MOOCs –  in studies of shorter/longer duration?

Page 73: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Perhaps what we need is a Turing test for MOOC instruction

Page 74: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Is your MOOC instructor a person or a bot?

Page 75: MOOCs, Automation, Artificial Intelligence and Pedagogical Agents

Thank you!

www.veletsianos.com

www.veletsianos.com/publications

@veletsianos on Twitter

veletsianos at gmail.com