Information Fusion Per Husmann Rasmussen, DDRE N/X Workshop Aalborg 3. Oct 2001.

Information FusionInformation Fusion

Per Husmann Rasmussen, DDREN/X Workshop Aalborg 3. Oct

2001

04/18/23PHR FOFT / Datamatik 2

Task Group on Information FusionTask Group on Information FusionTGonIFTGonIF

Task Group on Information FusionTask Group on Information FusionTGonIFTGonIF

NATO Project within RTB/IST NATO Project within RTB/IST Follow up to NATO DFD projectFollow up to NATO DFD project 1.1.2000 - 31.12.20021.1.2000 - 31.12.2002 CA, DK, FR, GE, NL, UK, USCA, DK, FR, GE, NL, UK, US

Research Lab’s and Military AdvisorsResearch Lab’s and Military Advisors Follow On: TGonIFDFollow On: TGonIFD


TGonIF: ObjectiveTGonIF: ObjectiveTGonIF: ObjectiveTGonIF: Objective

To improve the information fusion capability, involving JDL Data Fusion level 2 (Situation Assessment) and level 3 (Threat Assessment), in an ASC of a Combined/Joint HQ while in Peace Support Operations

To understand the role and to determine the optimum organisation & information processing requirements of the ASC in Peace Support Operations


Data Fusion Process ModelData Fusion Process ModelData Fusion Process ModelData Fusion Process Model

Pre-processing

ObjectRefinement

Situation´Refinement

ThreatRefinement

Sources

HCI

SupportDatabase

FusionDatabase

DBMS

DATA FUSION DOMAIN

ProcessRefinement


TGonIF: TasksTGonIF: TasksTGonIF: TasksTGonIF: Tasks

Develop a Conceptual Model of an ASC Define Military Environment and Scenario Define an ASC Concept

Develop and Evaluate the Functional Model of the ASC

Identify Functions that could be Automated


Operational Preparation of the Operational Preparation of the Battlespace (OPB)Battlespace (OPB)

Operational Preparation of the Operational Preparation of the Battlespace (OPB)Battlespace (OPB)

Physical Environment

Socio-Political Environment

Operational Environment

OPBC2 Command

Support


OPB Physical EnvironmentOPB Physical EnvironmentOPB Physical EnvironmentOPB Physical Environment




OPB

Engineer

Met

NBC





OPB

Cabinet Officevia HigherCommand

Media

CIMIC

Own & UNPolical

Direction

PR

‘Host’cultural &DPRE

Considerations

Allied/’Host’Political

Considerations

OPB Socio-Political EnvironmentOPB Socio-Political EnvironmentOPB Socio-Political EnvironmentOPB Socio-Political Environment





OPB

G5CIMIC

G3CommandSupport

G2Intelligence

Neutral Forces &NGOs Status &

Intentions

Own ForcesOrganisation &

Status

IPB(BAE, SO, EO &

DSO)

Terms of EngangementG1

Legal

OPB Operation EnvironmentOPB Operation EnvironmentOPB Operation EnvironmentOPB Operation Environment


The ASC in Peace Support OperationsThe ASC in Peace Support OperationsThe ASC in Peace Support OperationsThe ASC in Peace Support Operations

MilitaryReports

DisasterReports

Socio-PoliticalReports

IS/COINReports

CrimeReports

Classification

Correlation

Situation ‘Views’

Report typeSpecific

Aggregation


Orientate

Decide(CCIRM)

Observe

Act(CCIRM)

Direction(CCIRM)

Collect(SANDAs)

Collate &Evaluate

Process(PCS)

Process(IPB)

Disseminate

InformationRequirements

SANDA Tasks

Additional information

needed to meetcurrent

direction

DirectionGuidance &

Blue Situation

Collected Reports

Red SituationIPB BAE, SO,

EO & DSO

G3

BAE, SO & DSO

OtherCustomers

UnsolicitedReports

ReportsEXECUTION

Approved Products

Produces:Battlefield Area EvaluationSituation Overlay (Graphical Estimate)Event OverlayDecision Support Overlay

Collection by SANDAs ofrequired information

Creates Perceived Current Situation (i.e. PerceivedGround Truth) by classifing, correlating and aggregatingreports andharmonising resultant PCS with that of peerand subordinate ASCs

The ASC OODA Loopand Intelligence Cycle

Collation includes obvious single sourcecorrelationsEvaluation adds reliability & credibility ratings

Decide where to collect, by when,in what form, for what purpose & for whom

Precision Targeting& Combat Information

Artillery &Battlegroups& lower cmds

Battlegroups& lower cmds

Real Time ManoeuvreCombat information

Determine new information needs inlight of changes in the blue & red

situations and commander's direction &guidance

Match Assets to Informationrequirements

Produce Collection Plan

BAE,SOEO & DSO

PCS

INTERNAL MANAGEMENT

G2 OODA Loop

Situational Awareness & Understanding

YES

NO

The degree to which the processing iscompleted depends upon the iteration ofthe cycle and the purpose of theinformation. Fullest in intial planning

BAE & EO used in initialiteration, thereafter DSO

ASC OODA LoopASC OODA LoopASC OODA LoopASC OODA Loop


The Information FusionThe Information FusionThe Information FusionThe Information Fusion

ClassificationClassification

CorrelationCorrelation

AggregationAggregation

Classification does either ORBAT independent or dependent classification of the information

Correlation reduces the data set and to enhance the information content by fusing the information contained in the correlated reports

Aggregation process is to reduce the amount of details by aggregating a number situation elements to a higher level entity


Determineunit type

Determineunit type

Determinecommand

level

Determinecommand

level

equipmentequipmenttypetype

equipmentequipmentcategorycategory

militarymilitaryknowledgeknowledge

(GEFC)(GEFC)

militarymilitaryknowledgeknowledge

(GEFC)(GEFC)

Classification exampleClassification exampleDFD


AC

B

t1

t2

t3

Correlation RelationsCorrelation RelationsDFD


Situation:Situation: Template in MilExp KB: Result:Template in MilExp KB: Result:

t1

t2

t3

1-2 km (distance FLOT)

1-2 km (distance 1-2 ech)

2 km (depth unit)

1-2

km

DFD

Template AggregationTemplate AggregationTemplate AggregationTemplate Aggregation


ScenarioScenarioScenarioScenario

IFOR in FRY, 1-7 January, 2005 (1996)IFOR in FRY, 1-7 January, 2005 (1996) Multi National Division (MND) IFOR into the Banja

Luka region of Bosnia-Herzegovina, FRY

Themes (selected):Themes (selected): A movement of forces back to barracks Displaced population and ethnic resistance Political structures forming and the involvement of crime Infrastructure needs and problems None Government Organisation (NGO) involvement

International Police Task Force (IPTF) Mined areas


Conceptual Model (Level 0)Conceptual Model (Level 0)Conceptual Model (Level 0)Conceptual Model (Level 0)

Produce Multi-National INT

(f rom MIC Models)

Psy Ops

(f rom Use Case View)

Own Sources


FSCC


MET Cell


Higher Formation AS Cell


Subordinate AS Cell


Flanking AS Cell


Other Sources


Targeting Cell


TERA

(f rom Use Case View)G3


Civ ilian Sources


Map Agency


NIC(s)


Own Agencies


CIMIC


Other Agencies


The Chief G2


COP ?

(f rom Use Case View)0- Produce Multi-National INT

(from Use Case View)

Psy infoRFI and Int pict...

Info

Tasking, through CC...

BDA, & Info

Intel pict

Foreca...

RFI

RFIIntelligence pict...

RFI, Info and In...

Own Info and Intel

Flank Info and intel and RFI

Own Info and Intel and RFI

Info

RFI

RFI

Target Info

Perceived Situation Assessment

Terrain analysis

RFI

Blue SAint pict

Info

RFI

Map info

Sanitized Natl&Strategic Intellige...

MN AS Intelligence

Intellige...

RFI, Intelligence

Country assessm...RFI,and int pict

Intel

RFI

PIRs, CCIRs

Red/Brown SA

Global SA

Step-up ASC/alternate


Full replication

Full replication


PackagesPackagesPackagesPackages

3- Create & Maintain PCS

6- Estimate Future Situations

7- Manage Information

1- Direct the Cell

2- Conduct IPB

8- Manage Other Functions

5- Manage CCIRM Process

UK

DA & GE

CA

US FR FR


(from MIC Models)

<<include>>

<<include>>

<<includ...

<<includ...

<<include>>

<<include>>

<<inlcude>>


Perceived SituationPerceived SituationPerceived SituationPerceived Situation

31-Message Processing

33-Correlation 34-Aggregation32-Classification 35-Situation Element Selection


(from MIC Models)

<<include>>

<<include>>

<<include>>

<<include>>

<<include>>


ClassificationClassificationClassificationClassification

31- Message Processing


35- Situation Element Selection


33- Correlation

(from Use Case View)34- Aggregation


5- Manage CCIRM Process


32- Classification


Decomposed Messages

Audit

Filtered Classification Hypotheses

+theClassification

Classi fied Reports & Revisions

Audit

Audi t

Target Information

7- Manage Information


Update Background Knowledge

Exploit Background Knowledge


ConclusionConclusionConclusionConclusion

Conceptul model of MIC establishedConceptul model of MIC established

” ”Operational” Demo’s on follow on ProjectOperational” Demo’s on follow on Project

Counter Terrorism to be includedCounter Terrorism to be included

HCI is not a Topic of TGonIFHCI is not a Topic of TGonIF

International Cooperation very well establishedInternational Cooperation very well established

Information Fusion Per Husmann Rasmussen, DDRE N/X Workshop Aalborg 3. Oct 2001.

Documents

Transcript of Information Fusion Per Husmann Rasmussen, DDRE N/X Workshop Aalborg 3. Oct 2001.