Approaches to the Evaluation of Intelligence Data
-
Upload
pandora-carpenter -
Category
Documents
-
view
25 -
download
3
description
Transcript of Approaches to the Evaluation of Intelligence Data
WIR VERSTEHENDIE ZEICHEN DER ZEIT
KEEPING PACEWITH THE SIGNAL OF TIME
Approaches to the EvaluationApproaches to the Evaluationof Intelligence Dataof Intelligence Data
Workshop IST-036/RWS-005Workshop IST-036/RWS-005
Massive Military Data Fusion and Massive Military Data Fusion and Visualisation: Users Talk with Visualisation: Users Talk with DevelopersDevelopers
Definitions Definitions
VisualisationVisualisation should generate an should generate an environment supporting the perception environment supporting the perception process of presented information.process of presented information.
VisualisationVisualisation should help average users should help average users to produce better results and help the to produce better results and help the ”artist” to become more creative.”artist” to become more creative.
SIGINTSIGINT makes contributions to describe makes contributions to describe the situation for military and political the situation for military and political decision-makers on the basis of decision-makers on the basis of information intercepted from information intercepted from communication and signal distribution communication and signal distribution processes.processes.
OverviewOverview
Data modelData model Information processing tasksInformation processing tasks Visualisation examplesVisualisation examples Further aspectsFurther aspects
Data Data archivearchive
VisualisatioVisualisationn
Tolerable access time
old
actual
ArchiveClean up
VisualisationAnalysisEvaluation
Raw DataAudio Text Fax ...
DataLink
AggregationAggregation
ClG S
MD
TMGarbage Target / mission data base
Sensor / source
Add valuable meta data•Technical operational parameters•Feature extraction results
Data Data reductionreduction
Pre-Pre-processinprocessingg
ClassificationClassification
AcquisitionAcquisition
Signal InputSignal Input
Data Data ModelModel
Rep...
Link
ReportReportColl
SEL SelectionSelection
CollectioCollectionn
...
Data fusionData fusion
Information Processing TasksInformation Processing TasksTaskTask OperationOperation ResultResult ExampleExample
AcquisitionAcquisition Sensor Signal Sensor Signal Processing in Processing in RealtimeRealtime
Raw Raw SignalSignalFileFile
AudioAudio TextText FaxFax
ClassificatiClassificationon
Determining Determining targets of interest targets of interest in respect of in respect of target/mission target/mission data basedata base
Signal ofSignal ofInterestInterest
GarbageGarbage
Pre-Pre-processingprocessing
Adding technical Adding technical operational operational parameters and parameters and additional featuresadditional features
AdditionalAdditionalFeatureFeature
FileFile
Time, durationTime, duration Frequency ...Frequency ... Language, Language, speaker,speaker, topic, ... topic, ...
SelectionSelection Interactive Interactive selection of a selection of a relevant signal relevant signal collectioncollection
Signals within a Signals within a window defined in window defined in parameter spaceparameter space
ReportingReporting Fillout a form or Fillout a form or edit a result file !edit a result file !
S F
R
Aggregation: Data Fusion – ReportingDrill Down: ~ confidence, security, permission
*** Visualisationneeded !
***
***
Visualisation Examples:Visualisation Examples: Raw Signal - Raw Signal - AudioAudio
Traditional 2Drepresentationof signal analysisresults incl.audio processing
Visualisation Examples:Visualisation Examples: Raw Signal - Raw Signal - TextText
VIDA – Visual Document Analysis Dr. Michael Towsey, MEDAV
• Keyword Analysis• Feature vector generation for
automatic classification processes• Grafical summary• Textual summary
• Example: the Arthur Enderson / enron story
The full displayThe full display
Information text box
Menu Bar Information panel
List of topics in document
Selected topic
Movable panel divide
List of word associations
Redraw arcsbutton
Hide ArcsButton
Slider
Graph panel
Analysis Tool Bar
Automatic Keyword ExtractionAutomatic Keyword Extraction
n-gram analysisn-gram analysis
Association Analysis Association Analysis – ”Arthur – ”Arthur Anderson”Anderson”
Visualisation Examples:Visualisation Examples: Collection –Collection – E-mail E-mail
Command & Control Command & Control structuresstructures
Using statistical Using statistical methods of pattern methods of pattern recognitionrecognition
Visualisation Examples:Visualisation Examples: Collection –Collection – Radio Radio network Inetwork I
Visual terrain modelsVisual terrain models Fusion of communication Fusion of communication
eventsevents Drill-Down into the raw Drill-Down into the raw
datadata Additional information by Additional information by
background projectionbackground projection Use of virtual reality Use of virtual reality
projection methodsprojection methods
Background Information:
Simulated radio wave propagation
Network: 4711TOA: 010700B Apr 01Frequency: 5815Location: alpha
Comment: Increased communication activity after event Yankee
COMINT-Situation displayed in a COMINT-Situation displayed in a terrain modelterrain model
Visualisation Examples:Visualisation Examples: Collection - Collection - Radio Radio network IInetwork II
Trans-mitter
Time
Receiver
• technical technical parameters:parameters:• Call sign senderCall sign sender• Call sign receiverCall sign receiver• Time of ArrivalTime of Arrival
Frequency of contact Frequency of contact is described by the is described by the size of the spheresize of the sphere
Communication- one transmitter / one receiver- gaps- unequal intensity
Activities of a transmitter
Activities of a receiver
Further Aspects:Further Aspects: Archive Archive
• The archive contains the complete data set – including:• Raw data• Definitions of collections• Reports• All links from aggregated data to original raw
data
Raw DataAudio Text Fax ...
Rep...
Coll...
Models for the automatic generation
of reports can be trained and tested
using archived operational data sets
Thank youThank you