1

Michael A. Parmentier

Director, Readiness and Training Policy and ProgramsOffice of the Secretary of Defense

Michael A. Parmentier

Director, Readiness and Training Policy and ProgramsOffice of the Secretary of Defense

A Presentation to DoD’s Governmentand Industry Partners

A Presentation to DoD’s Governmentand Industry Partners

Advanced Distributed Learning

2

• Collaboration• Learning Technologies• Shared Problems• Shared Solutions

• Collaboration• Learning Technologies• Shared Problems• Shared Solutions

ADLADL

3

“Learning” encompasses:• Training

• Education• Performance Mentoring

“Learning” encompasses:• Training

• Education• Performance Mentoring

“LEARNING”“LEARNING”

4

ADL VisionADL VisionADL Vision

• Quality Education andTraining

• Tailored to Needs

• Delivered Cost Effectively• Anytime• Anywhere

Builds upon the success of the Defense Modeling andBuilds upon the success of the Defense Modeling andSimulation InitiativeSimulation Initiative

5

1994Iraqi

borderfeint1994

RestoreDemocracy

1992-4Somaliafamine

1990,92, 96Liberia3 NEOs

1991, 94Somalia 2

NEOs

1993-6ProvidePromise

1993Rwandafamine

1993Able

Sentry

1991-2Sea Angel

I/II

1992HurricaneAndrew

1992LA

Riots

1992-6Southern

Watch

1992SierraLeoneNEO

1992-6SinaiMNF

1993-6DenyFlight

1992Typhoon

Iniki

1991-6ProvideComfort

1990-1DesertStorm

1991, 94Haiti

2 NEOs

1991-3GTMO/Haiti

refugees

1992Provide

Hope

1990Just

Cause

1993-6SharpGuard

1996Taiwan

maneuvers

1991Pinatubo

NEO

1994North

Korea alert

Use of U.S. ForcesUse of U.S. ForcesSince 1990Since 1990

1995-6BosniaIFOR

Today-2010?•Chem / Bio•Anti-Terrorism•Counter-Proliferation

Today-2010?•Chem / Bio•Anti-Terrorism•Counter-Proliferation

Trained and Ready for What?Future Missions Like the Recent Past -- and More

Trained and Ready for What?Trained and Ready for What?Future Missions Like the Recent Past -- and More

6

ADL PerspectiveADL PerspectiveADL Perspective

Distributed Learning

Distributed Learning

EmbeddedTraining

EmbeddedTraining

DistributedSimulationDistributedSimulation

InteragencyTrainingSystems

InteragencyTrainingSystems

Digital KnowledgeLibraries

Digital KnowledgeLibraries

OfficeOffice

SchoolSchool

HomeHome FieldField

ArmoryArmory

7

ADL StrategyADL StrategyADL Strategy

� Exploit existing network-based technologies

� Create platform neutral, reusable courseware and content tolower costs

� Promote widespread collaboration to satisfy common needs

� Enhance performance with emerging and next-generationlearning technologies

� Develop common framework that drives COTS product cycle

� Design the “computer managed” learning framework

� Establish a coordinated implementation process

Use learning technologies to modernize DoD trainingUse learning technologies to modernize DoD training

8

Accessibility: the ability to access instructional components fromone remote location and deliver them to many other locations

Interoperability: the ability to use instructional componentsdeveloped in one location, with one set of tools or platform, inanother location, with a different set of tools or platform

Durability: the ability to operate instructional components whenbase technology changes, without redesign or recoding

Reusability: the ability to incorporate instructional componentsinto multiple applications

Affordability: the ability to significantly increase learningeffectiveness while reducing time and costs

Accessibility: the ability to access instructional components fromone remote location and deliver them to many other locations

Interoperability: the ability to use instructional componentsdeveloped in one location, with one set of tools or platform, inanother location, with a different set of tools or platform

Durability: the ability to operate instructional components whenbase technology changes, without redesign or recoding

Reusability: the ability to incorporate instructional componentsinto multiple applications

Affordability: the ability to significantly increase learningeffectiveness while reducing time and costs

Key ADL CharacteristicsKey ADL Characteristics

9

Common Open Technical Architectureand “Object Oriented” Software Are Keys to Reuse

Common Open Technical ArchitectureCommon Open Technical Architectureand “Object Oriented” Software Are Keys to Reuseand “Object Oriented” Software Are Keys to Reuse

The Old Way: Stove-piped by Service,Mission, Location

Simulation Software Components

Common Software(utilities/services consistentacross applications)

Unique Software(objects tailored to particular use)

The New Way:Shared Core,

Re-Used Applications

10

Next Generation of Learning TechnologyOffers Potential for Even Greater Efficiency

Next Generation of Learning TechnologyNext Generation of Learning TechnologyOffers Potential for Even Greater EfficiencyOffers Potential for Even Greater Efficiency

Studies suggest that Tutor Learning Achievement Is Better thanClassroom Achievement by 2 Standard Deviations

Improvements from Learning Technology

2σ Goal

# St

uden

ts#

Stud

ents

1σ

ClassroomStudents

ClassroomStudents

CurrentTechnology

CurrentTechnology

Next-Generation Technology

Next-Generation Technology

Average tutoredstudent’s

achievement Is betterthan 98% of

classroom students

Adapted From: Bloom, B.S. The Two-Sigma Problem: The Search for Methods of GroupInstruction as Effective as One-to-One Tutoring. Educational Researcher. 13,4-16 (1984)

11

0.390.50

0.84

1.05

0.0

0.2

0.4

0.6

0.8

1.0

1.2

1.4

Computer BasedInstruction

(N=233)

InteractiveMultimedia

Instruction (N=47)

"Intelligent"Tutoring Systems

(N=11)

Recent IntelligentTutoring Systems

(N=5)

Some Effect Sizes for Technology-Based Instruction

(Standard Deviations)

Some Effect Sizes for Technology-Based Instruction

(Standard Deviations)

12

Classroom and Tutorial InteractivityClassroom and Tutorial InteractivityClassroom and Tutorial Interactivity

• Average number of questions asked by anystudent during a classroom hour -- 0.11

• Average number of questions asked by astudent during a tutorial hour -- 21.1(Research methods); 32.2 (Algebra)

• Average number of questions asked by anystudent during a classroom hour -- 0.11

• Average number of questions asked by astudent during a tutorial hour -- 21.1(Research methods); 32.2 (Algebra)

13

Directives and ActivitiesDirectives and ActivitiesDirectives and Activities

Develop a strategy and master plans forusing learning technologies on a broad scale• QDR• President’s Executive Order / FTTI• Deputy Secretary’s Direction

• Congressional Reports– HASC– SASC

• DSB TF on Military Training and Education

Develop a strategy and master plans forusing learning technologies on a broad scale• QDR• President’s Executive Order / FTTI• Deputy Secretary’s Direction

• Congressional Reports– HASC– SASC

• DSB TF on Military Training and Education

14

Ongoing ADL Activities Ongoing ADL Activities

ADL Initiative

ADL Initiative

TFDLATTFDLAT

ArmyArmy

NavyNavy

USAFUSAF

USMCUSMCJCSJCS

DSBDSB

LogisticsLogistics

HealthAffairsHealthAffairs

C3IC3I

Reserve Affairs

Reserve Affairs

ACOMACOM

NationalGuard

NationalGuard

OSD COSD C

DoDEADoDEA

WhiteHouseWhiteHouse

NPRNPRDoCDoC

DoLDoL

DoJDoJ

PresidentialTask ForcePresidentialTask Force

EDUCAUSEIMS

EDUCAUSEIMSGMGM

BoeingBoeingIT

IndustryIT

Industry

WesternGovernorsWestern

Governors

DAUDAU

TradeAssoc’sTrade

Assoc’s

CoastGuardCoastGuard

Opportunities for DoD to leverage resources within the Departmentand across the Public and Private Sectors

Opportunities for DoD to leverage resources within the Departmentand across the Public and Private Sectors

15

ADL Standards FocusADL Standards FocusADL Standards Focus

ADL is focusing on web-based learning system standards

But not Internetstandards(others are doing that)

Internet TechnologiesHTMLHTTPXML

JAVA/JavaScript...

Learning System Standardscontent

metadataLMS data model

….

16

Evolution ofWeb-based Learning Technologies

Evolution ofEvolution ofWeb-based Learning TechnologiesWeb-based Learning Technologies

19981998 19991999 20002000

Early versions ofweb-deliveredlearning content(early stage)

First robustweb-based learningproductsand capabilities(1st generation)

Second generationproducts and servicesbased on industrystandards for web-basedlearning(mature/stable environment)

Growth/AdoptionCurve

IGNITIONPHASE

17

ADL ApproachADL ApproachADL Approach

• Examine military training learning models

• Develop a common “Shareable CoursewareObject Reference Model” (SCOM)

• Map learning models to SCO reference model(to determine standards requirements)

• Submit requirements to appropriate groups

18

SCO TermsSCO TermsSCO Terms

Shareable Courseware Object

Reference Model

A software model that defines theinterrelationship of course components, datamodels, and protocols such that courseware“objects” are shareable across systems thatconform with the same model.

19

Standards EffortsStandards EffortsStandards Efforts

• IEEE 1484 (meeting June 10, 99 with Chair)– de jure standards body

• IMS– Closer to “consortium” model

• AICC– Airline industry-based

• Macromedia/Oracle/Netg/Asymetrix– de facto standards

• ADL Technical Work Group– Catalyst

• President’s Federal Training Technology Task Force- Lead agency with NIST for Standards Focus Group

20

ADL ProcessADL ProcessADL Process

ADL IIndustryServices

Army

Air Force

Marines

Navy

(Joint Staff)

“SCO”Reference

Model

IEEE

IMS

ADL TWG

VENDORS

AICC

FederalAgencies

21

SCO-RM (0.5.2)SCO-RM (0.5.2)SCO-RM (0.5.2)

SCO Interchange Format (I.F.) [1]

Objectives [1c]

[1b] Assignment HierarchyTier 3: Course (Root)

Tier 2: “Block”(Parent Node)

Tier 2: “Block”(Parent Node)

Tier 1: “AU”(Leaf Node)

“Executable Content” [2]

Executable ContentMetadata [2a]

(Internal organization offiles, objects, etc.)

Metadata [1e]

Metadata [1e]

Metadata [1e]

Metadata [1e]

Rules [1d]

[4] Run Time ContentManagement

[4b] Executable ContentAPI

[4c] Content data model

(Points to)

ExternalCourse

Metadata[1a]

[3] “RawMedia”

1

2

3

4[4a] Executable Launch

[3a] Raw MediaMetadata

22

Summary of ADL PrototypesSummary of ADL PrototypesSummary of ADL Prototypes

• Performance Mentoring Example: Repair and Maintenance / GM• Objective: Apply GM methodology for training mentoring on demand• Status: DUSD(L) providing “Dual Use” incentives - multiple proposals

• On-line School Example: DAU’s ADL Prototype• Objective: Provide equal or better education opportunities to a wider audience• Status: Course delivery and management system with 5 courses on line today and another 14 courses in FY 99

• Joint Training Example: JCS ADL Prototype “DOCNET”• Objective: Provide high quality doctrine education to the Total Force, anytime, anywhere• Status: Initial Prototype on the web - 3 more modules planned

• Interagency Training Example: DoJ - DoD WMD• Objective: Increase Readiness to respond to WMD situations• Status: Areas of common interest being discussed

• Performance Mentoring Example: Repair and Maintenance / GM• Objective: Apply GM methodology for training mentoring on demand• Status: DUSD(L) providing “Dual Use” incentives - multiple proposals

• On-line School Example: DAU’s ADL Prototype• Objective: Provide equal or better education opportunities to a wider audience• Status: Course delivery and management system with 5 courses on line today and another 14 courses in FY 99

• Joint Training Example: JCS ADL Prototype “DOCNET”• Objective: Provide high quality doctrine education to the Total Force, anytime, anywhere• Status: Initial Prototype on the web - 3 more modules planned

• Interagency Training Example: DoJ - DoD WMD• Objective: Increase Readiness to respond to WMD situations• Status: Areas of common interest being discussed

23

Where we are headed ?Where we are headed ?Where we are headed ?

• ADL– Vision– Strategy

– Implementation Plan

• Federal Training Technology Initiative– Uses ADL as a model

– Develop technical standards

24

Benefits of ADLBenefits of ADLBenefits of ADL

Potential to significantly reduce costs by up to 30%while satisfying education and training requirements

• Makes “learning” available to Total Force

• Enables just-in-time, just-enough, performanceaiding.

• Leverages private-sector intellectual and financialinvestments: architecture, industry standards,courseware, etc.

• Creates an “open forum” for broad public and privatecollaboration: among DOD, federal agencies,technology suppliers, private businesses, nationalworkforce, etc.

25

DoD must:

• Fundamentally reengineer how it does business to educateand train effectively in tomorrow’s knowledge-basedenvironment

• Provide incentives for change

• Collaborate across DoD as well as with the public andprivate sectors

• Develop common architectures that will allow it to takeadvantage of rapidly changing technology

• Experiment

DoD must:

• Fundamentally reengineer how it does business to educateand train effectively in tomorrow’s knowledge-basedenvironment

• Provide incentives for change

• Collaborate across DoD as well as with the public andprivate sectors

• Develop common architectures that will allow it to takeadvantage of rapidly changing technology

• Experiment

Bottom LinesBottom LinesBottom Lines

26

www.adlnet.orgwww.adlnet.org

Advanced Distributed Learning

27

Backup ChartsBackup Charts

Advanced Distributed Learning

28

CommonCommonFrameworkFramework

Test BedsTest BedsTest Beds

ProductDevelopment

ProductProductDevelopmentDevelopment

TechnicalSolutionsTechnicalSolutions

ContentAdvocates

ContentAdvocates

ResearchPrioritiesResearchPriorities

Business Market Group

Business Market Group

1. Identify Performance Requirements

??

2 b. Define areas for R&D of new tools

2 a. Develop and refine Technical Guidelines

3. Collaboratively develop and test instructional and tools that conform to Technical Guidelines

4. Identify priorities for development and production

??

ADL ADL Collaboratory Collaboratory ConceptConcept

29

Projected ADL Time TableProjected ADL Time TableProjected ADL Time Table

• Build consensus (Q1 99 - under way)

• Issue draft ADL SCO Model (June 30, 1999)

• Refine SCO specifications with industry DoD, andgovernment communities (Q2/3 1999)

• Release Version 1 ADL SCO specifications (Sept.1999)

• Industry implementation/adoption (Q3/Q4 1999)

30

Some TermsSome TermsSome Terms

• Distance Learning: Structured learningthat takes place when the instructor is notphysically present

• Distributed Learning: Structured learningthat takes place anytime, anywhere it isneeded or desired

• Distance Learning: Structured learningthat takes place when the instructor is notphysically present

• Distributed Learning: Structured learningthat takes place anytime, anywhere it isneeded or desired

31

Some Example ADL TechnologiesSome Example ADL TechnologiesSome Example ADL Technologies

• Computer-Managed Instruction (CMI)

• Computer-Based Instruction (CBT)

• Interactive Multimedia Instruction (IMI)

• Intelligent Tutoring Systems (ITS)

• Networked Tutorial Simulation (NTS)

• Web-Based Training (WBT)

• Computer-Managed Instruction (CMI)

• Computer-Based Instruction (CBT)

• Interactive Multimedia Instruction (IMI)

• Intelligent Tutoring Systems (ITS)

• Networked Tutorial Simulation (NTS)

• Web-Based Training (WBT)