UNCLASSIFIED

Proposed FY09 ATO-D: Improved Mobility and Operational

Performance through Autonomous Technologies (IMOPAT)

Jeff Koshko, Intelligent Ground Systems

Jeffrey.koshko@us.army.mil, 586-753-2600

DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited.

Report Documentation Page Form ApprovedOMB No. 0704-0188

Public reporting burden for the collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering andmaintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information,including suggestions for reducing this burden, to Washington Headquarters Services, Directorate for Information Operations and Reports, 1215 Jefferson Davis Highway, Suite 1204, ArlingtonVA 22202-4302. Respondents should be aware that notwithstanding any other provision of law, no person shall be subject to a penalty for failing to comply with a collection of information if itdoes not display a currently valid OMB control number.

1. REPORT DATE 09 APR 2008

2. REPORT TYPE N/A

3. DATES COVERED -

4. TITLE AND SUBTITLE Proposed FY09 ATO-D: Improved Mobility and OperationalPerformance through Autonomous Technologies (IMOPAT)

5a. CONTRACT NUMBER

5b. GRANT NUMBER

5c. PROGRAM ELEMENT NUMBER

6. AUTHOR(S) Joff Koshko

5d. PROJECT NUMBER

5e. TASK NUMBER

5f. WORK UNIT NUMBER

7. PERFORMING ORGANIZATION NAME(S) AND ADDRESS(ES) US Army RDECOM-TARDEC 6501 E 11 Mile Rd Warren, MI 48397-5000

8. PERFORMING ORGANIZATION REPORT NUMBER 18807

9. SPONSORING/MONITORING AGENCY NAME(S) AND ADDRESS(ES) 10. SPONSOR/MONITOR’S ACRONYM(S) TACOM/TARDEC

11. SPONSOR/MONITOR’S REPORT NUMBER(S) 18807

12. DISTRIBUTION/AVAILABILITY STATEMENT Approved for public release, distribution unlimited

13. SUPPLEMENTARY NOTES The original document contains color images.

14. ABSTRACT

15. SUBJECT TERMS

16. SECURITY CLASSIFICATION OF: 17. LIMITATIONOF ABSTRACT

SAR

18. NUMBEROF PAGES

16

19a. NAME OFRESPONSIBLE PERSON

a. REPORT unclassified

b. ABSTRACT unclassified

c. THIS PAGE unclassified

Standard Form 298 (Rev. 8-98) Prescribed by ANSI Std Z39-18

UNCLASSIFIED

Schedule & CostMILESTONES FY09 FY10 FY11 FY12

M&S and Field ExperimentsLocal 360 SA

- Task Analysis- Integrate Detection Algorithms- Integrate Digital Recording

- Integrate Dismount System

Improved Mobility- Soldier Task Balancing

- Assisted Mobility

Solider Monitor/State CS System- Sensor Integration

- Algorithm Integration- Integration Technique

360/90 Day/Night

Near-field Sensor Coverage

Integration Platform

With IV System

Advanced

Crew StationsSoldier Monitoring& State

Integrate, Enhance, Demonstrate

360 LSA/Assist-Mob/Soldier Monitor & State

to Maximize Soldier-System

360 LSA and Mobility Capabilities

(Secure Mobility)

Purpose

Enable indirect vision (IV) based Soldier–systems

(manned/unmanned/Soldier) to move quickly and safely while

maintaining 360 local situational awareness (LSA) to enhance

operational performance.

Product

• Advanced Crew Stations integrated with 360/90 Day/Night LSA,

Assisted Mobility, and Soldier Monitoring / State technologies to

improve Soldier performance.

• Quantitative understanding (performance levels) of future indirect

vision operations for the movement and security of Soldier-

systems at a platoon and below level when utilizing:

• Assisted mobility

• LSA system with aided target cueing

• Digital video recording of 360/90 with intelligent tagging

• Soldier monitoring and state based crew station (CS) design

Payoff

• Improvement in Vehicle & Soldier Survivability, Vehicle

Lethality/Self-Defense & Control along with Greater

Survivability/Lethality for Dismount Soldiers

• Two Mounted Soldier ability to maintain 360 LSA with IV

• One Mounted Soldier ability to move vehicle (manned or

unmanned) quickly and safely with IV

• Data and Information to feed programmatic decisions

• Risk reduction for FCS

54

D.TAR.2009.04 Improved Mobility and Operational

Performance through Autonomous Technologies

(IMOPAT)

D.TAR.2009.04 Improved Mobility and Operational

Performance through Autonomous Technologies

(IMOPAT)

Total

5 64

654

6

TARDEC

NVESDARL-HRED NSRDEC

UNCLASSIFIED

Development Plan and Progression

FY09 FY12

Moderate Speed OpsComplex (non-Urban)

UrbanOps 10

BaselineComplex (non-Urban)

UrbanOps 09

High Speed OpsComplex (non-Urban)

Urban

Ops 11

M&S/SIL Eval M&S/SIL Eval M&S/SIL Eval M&S/SIL Eval M&S/SIL Eval M&S/SIL Eval

Mobility(TARDEC)

LSA(NVESD)

Soldier

Monitor

& Cue(NSRDEC/ARL)

Integration

& Evaluation

(TARDEC/ARL)

Enhanced DAS Sensor

System

Digital Video Recorder for SA

Pop-up Threat and Gunfire Detection

Extend FFW & AugCog to Mounted Crew Develop and Enhance Soldier Physiological Monitoring

TARDEC NVESD NSRDEC ARL-HRED

Enhanced Tele-ops / Indirect Vision Drive-by-Wire System

Assisted Autonomous Mobility (Semi-Autonomous Control)

Develop Neuro-physiological Monitoring

Develop Soldier Cueing Techniques

Integrated Secure Mobility

Capability

Integration of Mobility, SA, and Soldier Monitoring and Cueing

UNCLASSIFIED

Partners / Responsibilities

TARDEC• Develop Enhanced Indirect Vision Drive / Tele-operation Systems

• Develop Assisted Autonomy Systems

• Develop Warfighter Machine Interfaces

• Integrate and Evaluate• Vehicle LSA Systems (NVESD)

• Soldier Monitoring & State Classification Systems (NSRDEC/ARL-HRED)

• Assisted Mobility (Other TARDEC Programs)

• Dismount LSA Systems (NSRDEC)

• Perform SIL and Vehicle/Field Experiments

ARL-HRED• Define and Develop Experimentation Plans

• Work with TARDEC on Indirect Vision Drive and Assisted Autonomy Systems• Provide HFE Support for Systems Development and Integration

• Develop Information Flow Requirements and Algorithms for Mobility and LSA

• Work with NSRDEC on Soldier Monitoring and Workload Management Systems

NVESD• Enhance DAS Sensor Systems / Threat Detection Algorithms

• Pop-Up Targeting and Gun-Fire Detection (before/during/after shot)

• Develop Digital Vehicle LSA Recording and Cueing System

NSRDEC• Enhance and Transition Mid-Maturity Dismount Soldier Monitoring Systems from

Augmented Cognition Program

• Develop/Enhance Low-Maturity Soldier Monitoring System• Work with ARL-HRED on Soldier Monitoring Systems

• Develop Dismount LSA System

UNCLASSIFIED

Urban Engineering Evaluation

Test Scenario

T0 T1

T4

T6 / T8

T2 T3

T5

T9

T0 – Start Movement

T0 / T1 - Convoy

T1 / T2 – Increased Vigilance

T3 – ICV Processes SA from UAV

at Dismount LocationT4/ T5 – Difficult Urban Terrain

T6 – UGV Begins Recon/ICV Processes SA from UGV

at Dismount Location

T7 – ICV Dismounts Troops/Troops clear buildingT8 – ICV Remounts Troops/ UGV and MGV debark

T9 – End of Mission

Degraded Road

Suspected enemy activity.

Look for IED/RPG.

Squad dismounts

to clear building.

Robotic Aerial Vehicle RouteRobotic Ground Vehicle Route

Manned Vehicle RouteT1 /T2

T4/T5

T6T7 / T8 T7

T8

UGV Recons

Intersection.

Mission Start

Mission End

UNCLASSIFIED

System IntegrationSystem Integration

(Lab)(Lab)

FY93

FY96

FY98

FY00FY03

FY06

CrewmanCrewman’’ss

AssociateAssociate

Baseline SMIBaseline SMI

FY08Crew integration and Automation (CAT)Robotic Follower (RF) ATDs

Warfighter Experiment Fort Bliss

IVES STOField Experiment

PARTNERING WITH ARL TO APPLY SEMI-

AUTONOMOUS TECHNOLOGY

RoboticsCollaboration ATO

Demo IIISemi-Autonomous

Development

CAT and RF ATDsRDECOM-UAMBL Experiment

Near AutonomousUnmanned Systems ATO

Continuous Technology Transition To

PM FCS (BCT) & PM Soldier

Evolution of TARDEC’s Intelligent Ground Systems Programs

Improved Mobility & Operational

Performance through Autonomous Technologies

Safe Unmanned Operations in Urban

Environments

UNCLASSIFIED

Testbed Platforms

Manned Platform Unmanned Platforms

Crew-integration and Automation Testbed

(CAT)eXperimental

Unmanned Vehicle

(XUV)

Talon

Crusher

gMAV

UNCLASSIFIED

CAT Crewstations

Common Crew Surrogate

Mission Module Workstation

Warfighter Machine Interfaces

UNCLASSIFIED

Modeling and Simulation System Integration Labs

Motion Based Simulation

System Integration Lab

UNCLASSIFIED

MMWS

GB

Eth

ern

et

GB

Eth

ern

et

WMI

DSS

WMIDisplay

MESSVMS

Simulator

ESSChannel

ESSChannel

ISBS ANSSimulator

RCComputer

RVTComputer

Radio

Video Bridge

Video Switch

DismountController

= Video Equipment

= Shuttle PC= cPCI SBC

= Network= Other

Technology FeederHW Architecture

WMI = Warfighter Machine Interface

MMWS = Mission Module Workstation

ISBS = Intelligent System Behavior SimulatorDSS = Decision Support System

ESS = Embedded Simulation System

Display

= Video

= TCP/IP

= USB

= Wireless

MESS = Master Embedded Simulation SystemICS = Integrated Computer System

VTI = Vetronics Technology Integration

ANS = Autonomous Navigation SystemVMS = Vehicle Management System

Radio

Video Bridge

Common Crew Surrogate

Controller

UNCLASSIFIED

Technology FeederSW Service Architecture

Data Store

Services

WMI

*BCME/PPS/SU

*surrogate

UNCLASSIFIED

Technology FeederSW Service Architecture

Presenter

ServicesServices

ServicesServices

HUB

Data

Services

XML

Logic

EventProcessor

Config

<<discover>>

Display

Screen

Updates

Operator

Events

Service

Events

Screen

Config

Service Data

Service Lookup

Self Managed

Widget Data

WMI

Data StoreServices

*BCME/

PPS/

SU

<<register>>

* Surrogate

UNCLASSIFIED

Teleop

(Manual)

Semi-

Teleop

(Autonomy assisting operator)

Semi-

Autonomous

(Operator Assisting

autonomy)

Autonomous

(No operator control)

Focus: Reduce operator intervention time and workload through:

• Increased SA/SU

• Technology Integration

• Advanced WMI

• Leverage as much as possible from FCS to support RC objectives

Automation

Technology FeedersMobility Autonomy

UNCLASSIFIED

Technology FeedersMobility Autonomy

FY 08 (RC ATO)• Aggressiveness• Steerable Waypoint • Confidence• Long Range• Safety Push / Clear Map• Obstacles Map Aid• Wonder Women

FY 07 (RC ATO)• Bias• Speed Adjust• Obstacle Overlays• Apriori Overlays

UNCLASSIFIED

2006 Pilot Experiment (TARDEC)

Tracked participants eye-movements and performance in full 6-DOF motion base simulator while executing supervisory control.

Eye Tracking Pilot Experiment

UNCLASSIFIED

18.0Indirect Vision

Manual 15 mph

54.0Auto-Pilot 15 mph

49.5Auto-Pilot 25 mph

Plan on Move (%)

Condition

Planning on Move During Convoy Ops

Mental Demand

20

30

40

50

60

70

80

Wo

rklo

ad

Auto-Pilot 15 mph

Auto-Pilot 25 mph

Indirect VisionManual15 mph

RDECOM-UAMBL Experiment 2006 (RUX06)Soldier Performance/Workload w/Automations

Local Area 360 SA – IdentificationAccuracy and Response Time