Piranha - ORNL0.412607 ord w 0.427525 o 0.930737 ord w 0.978947 o 0.446173 ord w 08058 0. o 0.592417...

19
OAK RIDGE NATIONAL LABORATORY U. S. DEPARTMENT OF ENERGY US naturalized citizen indicted for hiding indicted here in federal court for concealing his links Cold war leaves a deadly anthrax legacy By Judith Miller NEW YORK TIMES NEWS SERVICE June 2, 1999 VOZROZHDENIYA ISLAND, Uzbekistan -- In the spring of 1988, germ scientists 850 miles east of Moscow were ordered to undertake their most critical mission. 6 Indonesians Barred From U.S. Current and Former Military Officers Placed on Watch List By Dana Priest and Peter Slevin Washington Post Staff Writers Friday, January 16, 2004; Page A15 The State Department has decided to put a half- dozen current and former Indonesian military officers, including a leading presidential candidate, on a watch list of indicted war criminals, effectively barring them from entering the United States, according to U.S. government officials. Dr. Thomas E. Potok Applied Software Engineering Research Group Oak Ridge National Laboratory US naturalized citizen indicted for hiding indicted here in federal court for concealing his links Cold war leaves a deadly anthrax legacy By Judith Miller NEW YORK TIMES NEWS SERVICE June 2, 1999 VOZROZHDENIYA ISLAND, Uzbekistan -- In the spring of 1988, germ scientists 850 miles east of Moscow were ordered to undertake their most critical mission. 6 Indonesians Barred From U.S. Current and Former Military Officers Placed on Watch List By Dana Priest and Peter Slevin Washington Post Staff Writers Friday, January 16, 2004; Page A15 The State Department has decided to put a half- dozen current and former Indonesian military officers, including a leading presidential candidate, on a watch list of indicted war criminals, effectively barring them from entering the United States, according to U.S. government officials. Piranha Knowledge Discovery Engine

Transcript of Piranha - ORNL0.412607 ord w 0.427525 o 0.930737 ord w 0.978947 o 0.446173 ord w 08058 0. o 0.592417...

Page 1: Piranha - ORNL0.412607 ord w 0.427525 o 0.930737 ord w 0.978947 o 0.446173 ord w 08058 0. o 0.592417 ord w 0.335562 o 0.762008 ord w 89652 0. o 0.938931 ord w 0.457311 o 0.459791 ord

OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY

US naturalized citizen indicted for hiding terrorist links

CLEVELAND, United States (AFP) - A man was indicted here in federal court for concealing his links to terrorist groups from US authorities when he applied for naturalization, the Federal Bureau of Investigation announced.

Cold war leaves a deadly anthrax legacy

By Judith Miller NEW YORK TIMES NEWS SERVICE

June 2, 1999

VOZROZHDENIYA ISLAND, Uzbekistan -- In the spring of 1988, germ scientists 850 miles east of Moscow were ordered to undertake their most critical mission.

6 Indonesians Barred From U.S. Current and Former Military Officers Placed on Watch List By Dana Priest and Peter SlevinWashington Post Staff WritersFriday, January 16, 2004; Page A15 The State Department has decided to put a half-dozen current and former Indonesian military officers, including a leading presidential candidate, on a watch list of indicted war criminals, effectively barring them from entering the United States, according to U.S. government officials.

US naturalized citizen indicted for hiding terrorist links

CLEVELAND, United States (AFP) - A man was indicted here in federal court for concealing his links to terrorist groups from US authorities when he applied for naturalization, the Federal Bureau of Investigation announced.

Cold war leaves a deadly anthrax legacy

By Judith Miller NEW YORK TIMES NEWS SERVICE

June 2, 1999

VOZROZHDENIYA ISLAND, Uzbekistan -- In the spring of 1988, germ scientists 850 miles east of Moscow were ordered to undertake their most critical mission.

6 Indonesians Barred From U.S. Current and Former Military Officers Placed on Watch List By Dana Priest and Peter SlevinWashington Post Staff WritersFriday, January 16, 2004; Page A15 The State Department has decided to put a half-dozen current and former Indonesian military officers, including a leading presidential candidate, on a watch list of indicted war criminals, effectively barring them from entering the United States, according to U.S. government officials.

Dr. Thomas E. Potok Applied Software Engineering Research Group

Oak Ridge National Laboratory

US naturalized citizen indicted for hiding terrorist links

CLEVELAND, United States (AFP) - A man was indicted here in federal court for concealing his links to terrorist groups from US authorities when he applied for naturalization, the Federal Bureau of Investigation announced.

Cold war leaves a deadly anthrax legacy

By Judith Miller NEW YORK TIMES NEWS SERVICE

June 2, 1999

VOZROZHDENIYA ISLAND, Uzbekistan -- In the spring of 1988, germ scientists 850 miles east of Moscow were ordered to undertake their most critical mission.

6 Indonesians Barred From U.S. Current and Former Military Officers Placed on Watch List By Dana Priest and Peter SlevinWashington Post Staff WritersFriday, January 16, 2004; Page A15 The State Department has decided to put a half-dozen current and former Indonesian military officers, including a leading presidential candidate, on a watch list of indicted war criminals, effectively barring them from entering the United States, according to U.S. government officials.

US naturalized citizen indicted for hiding terrorist links

CLEVELAND, United States (AFP) - A man was indicted here in federal court for concealing his links to terrorist groups from US authorities when he applied for naturalization, the Federal Bureau of Investigation announced.

Cold war leaves a deadly anthrax legacy

By Judith Miller NEW YORK TIMES NEWS SERVICE

June 2, 1999

VOZROZHDENIYA ISLAND, Uzbekistan -- In the spring of 1988, germ scientists 850 miles east of Moscow were ordered to undertake their most critical mission.

6 Indonesians Barred From U.S. Current and Former Military Officers Placed on Watch List By Dana Priest and Peter SlevinWashington Post Staff WritersFriday, January 16, 2004; Page A15 The State Department has decided to put a half-dozen current and former Indonesian military officers, including a leading presidential candidate, on a watch list of indicted war criminals, effectively barring them from entering the United States, according to U.S. government officials.

PiranhaKnowledge Discovery Engine

Page 2: Piranha - ORNL0.412607 ord w 0.427525 o 0.930737 ord w 0.978947 o 0.446173 ord w 08058 0. o 0.592417 ord w 0.335562 o 0.762008 ord w 89652 0. o 0.938931 ord w 0.457311 o 0.459791 ord

2

OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY

How could you not have seen this coming?Terrorist Bombing

Page 3: Piranha - ORNL0.412607 ord w 0.427525 o 0.930737 ord w 0.978947 o 0.446173 ord w 08058 0. o 0.592417 ord w 0.335562 o 0.762008 ord w 89652 0. o 0.938931 ord w 0.457311 o 0.459791 ord

3

OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY

We’ve traded a stack of paper for a stack of DVDs

Should we pull out of Iraq?What should we do about Iran?

Can we trust the Windows OS?

What if China destroys key satellites?

Page 4: Piranha - ORNL0.412607 ord w 0.427525 o 0.930737 ord w 0.978947 o 0.446173 ord w 08058 0. o 0.592417 ord w 0.335562 o 0.762008 ord w 89652 0. o 0.938931 ord w 0.457311 o 0.459791 ord

4

OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY

National scope of our work

• How can we run the battle from networked vehicles? US Army - US Army − We led a DARPA study on the suitability of intelligent

agent technology• Can software tell us in 3 to 5 minutes if we should

destroy an incoming missile? - Missile Defense Agency − We serve on an expert panel to assess battle

management software capabilities• What threats exist in the in 10,000 new

documents we received today? - Department of Homeland Defense − We led a DHS Text Analysis Workshop to set research

directions and goals for the department

Page 5: Piranha - ORNL0.412607 ord w 0.427525 o 0.930737 ord w 0.978947 o 0.446173 ord w 08058 0. o 0.592417 ord w 0.335562 o 0.762008 ord w 89652 0. o 0.938931 ord w 0.457311 o 0.459791 ord

5

OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY

Key Technologies and Resources• Intelligent Agents

− Software processes − Can communicate in

unstable environments− Form teams to solve

problems− Live, die, and reproduce to

solve problems• High Performance

Computing− Red/White Oak Clusters− 135 Dell Computers− Largest cluster computer at

ORNL (1.7 TFLOPS, 270 GB Memory, 11.3 TB Disk)

Black Board

IntelligentAgentsIntelligent

AgentsIntelligentAgents

IntelligentAgentsIntelligent

AgentsIntelligentAgents

IntelligentAgentsIntelligent

AgentsIntelligentAgents

Page 6: Piranha - ORNL0.412607 ord w 0.427525 o 0.930737 ord w 0.978947 o 0.446173 ord w 08058 0. o 0.592417 ord w 0.335562 o 0.762008 ord w 89652 0. o 0.938931 ord w 0.457311 o 0.459791 ord

6

OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY

Challenge – What to do with this?

• What is in there?• Are there any

threats?• What am I

missing?

Page 7: Piranha - ORNL0.412607 ord w 0.427525 o 0.930737 ord w 0.978947 o 0.446173 ord w 08058 0. o 0.592417 ord w 0.335562 o 0.762008 ord w 89652 0. o 0.938931 ord w 0.457311 o 0.459791 ord

7

OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY

Process

Minutes MinutesMonths

Page 8: Piranha - ORNL0.412607 ord w 0.427525 o 0.930737 ord w 0.978947 o 0.446173 ord w 08058 0. o 0.592417 ord w 0.335562 o 0.762008 ord w 89652 0. o 0.938931 ord w 0.457311 o 0.459791 ord

8

OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY

Process

Minutes Minutes

Months

Organize theInformation

Nuclear materials

Nuclear materials

Chemical Weapons

Chemical Weapons

ThreatsThreats

Potential Targets

Potential Targets

Money Laundering

Money Laundering

Connect theInformation

Piranha

Minutes DaysMonths

Page 9: Piranha - ORNL0.412607 ord w 0.427525 o 0.930737 ord w 0.978947 o 0.446173 ord w 08058 0. o 0.592417 ord w 0.335562 o 0.762008 ord w 89652 0. o 0.938931 ord w 0.457311 o 0.459791 ord

9

OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY

Breakthrough: Inverse Corpus Frequency

( ) ⎟⎠⎞

⎜⎝⎛

++

+=11log1log 22 c

CfW ijij

0

50000

100000

150000

200000

250000

5 55 105 155 205 255 305 355 405 455 505 555 605 655 705 755 805 855 905

Number of Documents (K)

Uni

que

Term

Cou

nt

Reed, Jiao, et al., “TF-ICF: A New Term Weighting Scheme for Clustering Dynamic Data Streams,” The Fifth International Conference on Machine Learning and Applications (2006) to appearReed et al., “Multi-Agent System for Distributed Cluster Analysis,” Third International Workshop on Software Engineering for Large-Scale Multi-Agent Systems (SELMAS'04), May 24-25, 2004, Edinburgh, Scotland

• Look at the forest, not the trees

We analyzed near 1 million documents from 6 major research corpora

We found 229,023 unique terms (A large dictionary contains around 70,000 terms)

We use this term frequency distribution as our “global” term frequency

Page 10: Piranha - ORNL0.412607 ord w 0.427525 o 0.930737 ord w 0.978947 o 0.446173 ord w 08058 0. o 0.592417 ord w 0.335562 o 0.762008 ord w 89652 0. o 0.938931 ord w 0.457311 o 0.459791 ord

10

OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY

TF-ICF Performance Evaluation

Name Term Weighting Scheme

TF-IDF

MI

ATC

Okapi

LTU

)/log()log( jijij nNfw ×=

N

f

N

f

Nf

wi M

jij

N

iij

ij

j

∑∑== ×

=

11

log

∑= ⎥

⎥⎦

⎢⎢⎣

⎡⎟⎠

⎞⎜⎝

⎛⎟⎟⎠

⎞⎜⎜⎝

⎛×+

⎟⎠

⎞⎜⎝

⎛⎟⎟⎠

⎞⎜⎜⎝

⎛×+

=N

i j

ij

j

ij

ij

nN

fmax_f

nN

fmax_f

w

1

2

log5.05.0

log5.05.0

⎟⎟⎠

⎞⎜⎜⎝

⎛++−

⎟⎟⎟⎟

⎜⎜⎜⎜

+×+=

5.05.0log

_5.15.0 ij

j

ij

ijij

fnN

fdlavg

dlfw

dlavgdl

nNf

wi jij

j

_2.08.0

log)0.1)(log(

×+

⎟⎠

⎞⎜⎝

⎛+

=

SMART 3891 3 1460 1033

20 News 4650 12 399 385

Term Weighting SchemesData Set # of

Docs# of

ClassesLargest

ClassSmallest

Class

Reuters 2349 58 1041 1

Test Data Sets

Basic K-Means

Single Link (HAC)

Complete Link (HAC)

UPGMA (HAC)

Test Algorithms

Page 11: Piranha - ORNL0.412607 ord w 0.427525 o 0.930737 ord w 0.978947 o 0.446173 ord w 08058 0. o 0.592417 ord w 0.335562 o 0.762008 ord w 89652 0. o 0.938931 ord w 0.457311 o 0.459791 ord

11

OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY

TF-ICF Performance Evaluation

Hierarchical Agglomerative Clustering Algorithm

0.0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

Euclidean Distance Cosine Similarity

Ave

rage

F-M

easu

re

TFICF TFIDF MI ATC Okapi LTU

Reed, Jiao, et al., “TF-ICF: A New Term Weighting Scheme for Clustering Dynamic Data Streams,” International Conference on Machine Learning and Applications, Orlando, FL, Dec. 14-16, 2006.

Page 12: Piranha - ORNL0.412607 ord w 0.427525 o 0.930737 ord w 0.978947 o 0.446173 ord w 08058 0. o 0.592417 ord w 0.335562 o 0.762008 ord w 89652 0. o 0.938931 ord w 0.457311 o 0.459791 ord

12

OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY

How Piranha Works

• Standard Approach11.5 Days

• Agent approach8 minutes 24 Seconds!2000 times fasterWith no loss of accuracy

2 Patents, 2 licenses

2 Invention disclosures in process

Head Node

Computer 4

Computer 5

Computer 6

Computer 7

Computer 8

Computer 9

Computer 10

Computer 11

Computer 1

Computer 2

Computer 3

IntelligentAgents

IntelligentAgents

IntelligentAgents

Black Board

Docword0.37068

word0.492333

word0.412607

word0.427525

word0.930737

word0.978947

word0.446173

word0.08058

word0.592417

word0.335562

word0.762008

word0.89652

word0.938931

word0.457311

word0.459791

word0.822132

word0.36959

word0.955044

word0.697507

word0.424708

word0.264228

word0.194726

word0.615864

word0.614114

word0.425498

word0.03065

word0.228638

word0.667838

word0.050275

word0.965724

word0.585864

word0.978729

word0.308229

word0.324661

word0.702205

word0.564679

word0.928135

word0.428677

word0.249835

word0.840986

word0.533131

word0.089476

word0.95258

word0.49666

word0.904506

word0.364454

word0.518086

word0.337456

Docword0.37068

word0.492333

word0.412607

word0.427525

word0.930737

word0.978947

word0.446173

word0.08058

word0.592417

word0.335562

word0.762008

word0.89652

word0.938931

word0.457311

word0.459791

word0.822132

word0.36959

word0.955044

word0.697507

word0.424708

word0.264228

word0.194726

word0.615864

word0.614114

word0.425498

word0.03065

word0.228638

word0.667838

word0.050275

word0.965724

word0.585864

word0.978729

word0.308229

word0.324661

word0.702205

word0.564679

word0.928135

word0.428677

word0.249835

word0.840986

word0.533131

word0.089476

word0.95258

word0.49666

word0.904506

word0.364454

word0.518086

word0.337456

Docword0.37068

word0.492333

word0.412607

word0.427525

word0.930737

word0.978947

word0.446173

word0.08058

word0.592417

word0.335562

word0.762008

word0.89652

word0.938931

word0.457311

word0.459791

word0.822132

word0.36959

word0.955044

word0.697507

word0.424708

word0.264228

word0.194726

word0.615864

word0.614114

word0.425498

word0.03065

word0.228638

word0.667838

word0.050275

word0.965724

word0.585864

word0.978729

word0.308229

word0.324661

word0.702205

word0.564679

word0.928135

word0.428677

word0.249835

word0.840986

word0.533131

word0.089476

word0.95258

word0.49666

word0.904506

word0.364454

word0.518086

word0.337456

Docword0.37068

word0.492333

word0.412607

word0.427525

word0.930737

word0.978947

word0.446173

word0.08058

word0.592417

word0.335562

word0.762008

word0.89652

word0.938931

word0.457311

word0.459791

word0.822132

word0.36959

word0.955044

word0.697507

word0.424708

word0.264228

word0.194726

word0.615864

word0.614114

word0.425498

word0.03065

word0.228638

word0.667838

word0.050275

word0.965724

word0.585864

word0.978729

word0.308229

word0.324661

word0.702205

word0.564679

word0.928135

word0.428677

word0.249835

word0.840986

word0.533131

word0.089476

word0.95258

word0.49666

word0.904506

word0.364454

word0.518086

word0.337456

Docword0.37068

word0.492333

word0.412607

word0.427525

word0.930737

word0.978947

word0.446173

word0.08058

word0.592417

word0.335562

word0.762008

word0.89652

word0.938931

word0.457311

word0.459791

word0.822132

word0.36959

word0.955044

word0.697507

word0.424708

word0.264228

word0.194726

word0.615864

word0.614114

word0.425498

word0.03065

word0.228638

word0.667838

word0.050275

word0.965724

word0.585864

word0.978729

word0.308229

word0.324661

word0.702205

word0.564679

word0.928135

word0.428677

word0.249835

word0.840986

word0.533131

word0.089476

word0.95258

word0.49666

word0.904506

word0.364454

word0.518086

word0.337456

Docword0.37068

word0.492333

word0.412607

word0.427525

word0.930737

word0.978947

word0.446173

word0.08058

word0.592417

word0.335562

word0.762008

word0.89652

word0.938931

word0.457311

word0.459791

word0.822132

word0.36959

word0.955044

word0.697507

word0.424708

word0.264228

word0.194726

word0.615864

word0.614114

word0.425498

word0.03065

word0.228638

word0.667838

word0.050275

word0.965724

word0.585864

word0.978729

word0.308229

word0.324661

word0.702205

word0.564679

word0.928135

word0.428677

word0.249835

word0.840986

word0.533131

word0.089476

word0.95258

word0.49666

word0.904506

word0.364454

word0.518086

word0.337456

Docword0.37068

word0.492333

word0.412607

word0.427525

word0.930737

word0.978947

word0.446173

word0.08058

word0.592417

word0.335562

word0.762008

word0.89652

word0.938931

word0.457311

word0.459791

word0.822132

word0.36959

word0.955044

word0.697507

word0.424708

word0.264228

word0.194726

word0.615864

word0.614114

word0.425498

word0.03065

word0.228638

word0.667838

word0.050275

word0.965724

word0.585864

word0.978729

word0.308229

word0.324661

word0.702205

word0.564679

word0.928135

word0.428677

word0.249835

word0.840986

word0.533131

word0.089476

word0.95258

word0.49666

word0.904506

word0.364454

word0.518086

word0.337456

Docword0.37068

word0.492333

word0.412607

word0.427525

word0.930737

word0.978947

word0.446173

word0.08058

word0.592417

word0.335562

word0.762008

word0.89652

word0.938931

word0.457311

word0.459791

word0.822132

word0.36959

word0.955044

word0.697507

word0.424708

word0.264228

word0.194726

word0.615864

word0.614114

word0.425498

word0.03065

word0.228638

word0.667838

word0.050275

word0.965724

word0.585864

word0.978729

word0.308229

word0.324661

word0.702205

word0.564679

word0.928135

word0.428677

word0.249835

word0.840986

word0.533131

word0.089476

word0.95258

word0.49666

word0.904506

word0.364454

word0.518086

word0.337456

Docword0.37068

word0.492333

word0.412607

word0.427525

word0.930737

word0.978947

word0.446173

word0.08058

word0.592417

word0.335562

word0.762008

word0.89652

word0.938931

word0.457311

word0.459791

word0.822132

word0.36959

word0.955044

word0.697507

word0.424708

word0.264228

word0.194726

word0.615864

word0.614114

word0.425498

word0.03065

word0.228638

word0.667838

word0.050275

word0.965724

word0.585864

word0.978729

word0.308229

word0.324661

word0.702205

word0.564679

word0.928135

word0.428677

word0.249835

word0.840986

word0.533131

word0.089476

word0.95258

word0.49666

word0.904506

word0.364454

word0.518086

word0.337456

Docword0.37068

word0.492333

word0.412607

word0.427525

word0.930737

word0.978947

word0.446173

word0.08058

word0.592417

word0.335562

word0.762008

word0.89652

word0.938931

word0.457311

word0.459791

word0.822132

word0.36959

word0.955044

word0.697507

word0.424708

word0.264228

word0.194726

word0.615864

word0.614114

word0.425498

word0.03065

word0.228638

word0.667838

word0.050275

word0.965724

word0.585864

word0.978729

word0.308229

word0.324661

word0.702205

word0.564679

word0.928135

word0.428677

word0.249835

word0.840986

word0.533131

word0.089476

word0.95258

word0.49666

word0.904506

word0.364454

word0.518086

word0.337456

Docword0.37068

word0.492333

word0.412607

word0.427525

word0.930737

word0.978947

word0.446173

word0.08058

word0.592417

word0.335562

word0.762008

word0.89652

word0.938931

word0.457311

word0.459791

word0.822132

word0.36959

word0.955044

word0.697507

word0.424708

word0.264228

word0.194726

word0.615864

word0.614114

word0.425498

word0.03065

word0.228638

word0.667838

word0.050275

word0.965724

word0.585864

word0.978729

word0.308229

word0.324661

word0.702205

word0.564679

word0.928135

word0.428677

word0.249835

word0.840986

word0.533131

word0.089476

word0.95258

word0.49666

word0.904506

word0.364454

word0.518086

word0.337456

Docword0.37068

word0.492333

word0.412607

word0.427525

word0.930737

word0.978947

word0.446173

word0.08058

word0.592417

word0.335562

word0.762008

word0.89652

word0.938931

word0.457311

word0.459791

word0.822132

word0.36959

word0.955044

word0.697507

word0.424708

word0.264228

word0.194726

word0.615864

word0.614114

word0.425498

word0.03065

word0.228638

word0.667838

word0.050275

word0.965724

word0.585864

word0.978729

word0.308229

word0.324661

word0.702205

word0.564679

word0.928135

word0.428677

word0.249835

word0.840986

word0.533131

word0.089476

word0.95258

word0.49666

word0.904506

word0.364454

word0.518086

word0.337456

Docword0.37068

word0.492333

word0.412607

word0.427525

word0.930737

word0.978947

word0.446173

word0.08058

word0.592417

word0.335562

word0.762008

word0.89652

word0.938931

word0.457311

word0.459791

word0.822132

word0.36959

word0.955044

word0.697507

word0.424708

word0.264228

word0.194726

word0.615864

word0.614114

word0.425498

word0.03065

word0.228638

word0.667838

word0.050275

word0.965724

word0.585864

word0.978729

word0.308229

word0.324661

word0.702205

word0.564679

word0.928135

word0.428677

word0.249835

word0.840986

word0.533131

word0.089476

word0.95258

word0.49666

word0.904506

word0.364454

word0.518086

word0.337456

IntelligentAgents

IntelligentAgents

IntelligentAgents

IntelligentAgents

IntelligentAgents

IntelligentAgents

Docword0.37068

word0.492333

word0.412607

word0.427525

word0.930737

word0.978947

word0.446173

word0.08058

word0.592417

word0.335562

word0.762008

word0.89652

word0.938931

word0.457311

word0.459791

word0.822132

word0.36959

word0.955044

word0.697507

word0.424708

word0.264228

word0.194726

word0.615864

word0.614114

word0.425498

word0.03065

word0.228638

word0.667838

word0.050275

word0.965724

word0.585864

word0.978729

word0.308229

word0.324661

word0.702205

word0.564679

word0.928135

word0.428677

word0.249835

word0.840986

word0.533131

word0.089476

word0.95258

word0.49666

word0.904506

word0.364454

word0.518086

word0.337456

Docword0.37068

word0.492333

word0.412607

word0.427525

word0.930737

word0.978947

word0.446173

word0.08058

word0.592417

word0.335562

word0.762008

word0.89652

word0.938931

word0.457311

word0.459791

word0.822132

word0.36959

word0.955044

word0.697507

word0.424708

word0.264228

word0.194726

word0.615864

word0.614114

word0.425498

word0.03065

word0.228638

word0.667838

word0.050275

word0.965724

word0.585864

word0.978729

word0.308229

word0.324661

word0.702205

word0.564679

word0.928135

word0.428677

word0.249835

word0.840986

word0.533131

word0.089476

word0.95258

word0.49666

word0.904506

word0.364454

word0.518086

word0.337456

Docword0.37068

word0.492333

word0.412607

word0.427525

word0.930737

word0.978947

word0.446173

word0.08058

word0.592417

word0.335562

word0.762008

word0.89652

word0.938931

word0.457311

word0.459791

word0.822132

word0.36959

word0.955044

word0.697507

word0.424708

word0.264228

word0.194726

word0.615864

word0.614114

word0.425498

word0.03065

word0.228638

word0.667838

word0.050275

word0.965724

word0.585864

word0.978729

word0.308229

word0.324661

word0.702205

word0.564679

word0.928135

word0.428677

word0.249835

word0.840986

word0.533131

word0.089476

word0.95258

word0.49666

word0.904506

word0.364454

word0.518086

word0.337456

Docword0.37068

word0.492333

word0.412607

word0.427525

word0.930737

word0.978947

word0.446173

word0.08058

word0.592417

word0.335562

word0.762008

word0.89652

word0.938931

word0.457311

word0.459791

word0.822132

word0.36959

word0.955044

word0.697507

word0.424708

word0.264228

word0.194726

word0.615864

word0.614114

word0.425498

word0.03065

word0.228638

word0.667838

word0.050275

word0.965724

word0.585864

word0.978729

word0.308229

word0.324661

word0.702205

word0.564679

word0.928135

word0.428677

word0.249835

word0.840986

word0.533131

word0.089476

word0.95258

word0.49666

word0.904506

word0.364454

word0.518086

word0.337456

Docword0.37068

word0.492333

word0.412607

word0.427525

word0.930737

word0.978947

word0.446173

word0.08058

word0.592417

word0.335562

word0.762008

word0.89652

word0.938931

word0.457311

word0.459791

word0.822132

word0.36959

word0.955044

word0.697507

word0.424708

word0.264228

word0.194726

word0.615864

word0.614114

word0.425498

word0.03065

word0.228638

word0.667838

word0.050275

word0.965724

word0.585864

word0.978729

word0.308229

word0.324661

word0.702205

word0.564679

word0.928135

word0.428677

word0.249835

word0.840986

word0.533131

word0.089476

word0.95258

word0.49666

word0.904506

word0.364454

word0.518086

word0.337456

Docword0.37068

word0.492333

word0.412607

word0.427525

word0.930737

word0.978947

word0.446173

word0.08058

word0.592417

word0.335562

word0.762008

word0.89652

word0.938931

word0.457311

word0.459791

word0.822132

word0.36959

word0.955044

word0.697507

word0.424708

word0.264228

word0.194726

word0.615864

word0.614114

word0.425498

word0.03065

word0.228638

word0.667838

word0.050275

word0.965724

word0.585864

word0.978729

word0.308229

word0.324661

word0.702205

word0.564679

word0.928135

word0.428677

word0.249835

word0.840986

word0.533131

word0.089476

word0.95258

word0.49666

word0.904506

word0.364454

word0.518086

word0.337456

Docword0.37068

word0.492333

word0.412607

word0.427525

word0.930737

word0.978947

word0.446173

word0.08058

word0.592417

word0.335562

word0.762008

word0.89652

word0.938931

word0.457311

word0.459791

word0.822132

word0.36959

word0.955044

word0.697507

word0.424708

word0.264228

word0.194726

word0.615864

word0.614114

word0.425498

word0.03065

word0.228638

word0.667838

word0.050275

word0.965724

word0.585864

word0.978729

word0.308229

word0.324661

word0.702205

word0.564679

word0.928135

word0.428677

word0.249835

word0.840986

word0.533131

word0.089476

word0.95258

word0.49666

word0.904506

word0.364454

word0.518086

word0.337456

Docword0.37068

word0.492333

word0.412607

word0.427525

word0.930737

word0.978947

word0.446173

word0.08058

word0.592417

word0.335562

word0.762008

word0.89652

word0.938931

word0.457311

word0.459791

word0.822132

word0.36959

word0.955044

word0.697507

word0.424708

word0.264228

word0.194726

word0.615864

word0.614114

word0.425498

word0.03065

word0.228638

word0.667838

word0.050275

word0.965724

word0.585864

word0.978729

word0.308229

word0.324661

word0.702205

word0.564679

word0.928135

word0.428677

word0.249835

word0.840986

word0.533131

word0.089476

word0.95258

word0.49666

word0.904506

word0.364454

word0.518086

word0.337456

IntelligentAgents

IntelligentAgents

Docword0.37068

word0.492333

word0.412607

word0.427525

word0.930737

word0.978947

word0.446173

word0.08058

word0.592417

word0.335562

word0.762008

word0.89652

word0.938931

word0.457311

word0.459791

word0.822132

word0.36959

word0.955044

word0.697507

word0.424708

word0.264228

word0.194726

word0.615864

word0.614114

word0.425498

word0.03065

word0.228638

word0.667838

word0.050275

word0.965724

word0.585864

word0.978729

word0.308229

word0.324661

word0.702205

word0.564679

word0.928135

word0.428677

word0.249835

word0.840986

word0.533131

word0.089476

word0.95258

word0.49666

word0.904506

word0.364454

word0.518086

word0.337456

IntelligentAgents

Docword0.37068

word0.492333

word0.412607

word0.427525

word0.930737

word0.978947

word0.446173

word0.08058

word0.592417

word0.335562

word0.762008

word0.89652

word0.938931

word0.457311

word0.459791

word0.822132

word0.36959

word0.955044

word0.697507

word0.424708

word0.264228

word0.194726

word0.615864

word0.614114

word0.425498

word0.03065

word0.228638

word0.667838

word0.050275

word0.965724

word0.585864

word0.978729

word0.308229

word0.324661

word0.702205

word0.564679

word0.928135

word0.428677

word0.249835

word0.840986

word0.533131

word0.089476

word0.95258

word0.49666

word0.904506

word0.364454

word0.518086

word0.337456

Docword0.37068

word0.492333

word0.412607

word0.427525

word0.930737

word0.978947

word0.446173

word0.08058

word0.592417

word0.335562

word0.762008

word0.89652

word0.938931

word0.457311

word0.459791

word0.822132

word0.36959

word0.955044

word0.697507

word0.424708

word0.264228

word0.194726

word0.615864

word0.614114

word0.425498

word0.03065

word0.228638

word0.667838

word0.050275

word0.965724

word0.585864

word0.978729

word0.308229

word0.324661

word0.702205

word0.564679

word0.928135

word0.428677

word0.249835

word0.840986

word0.533131

word0.089476

word0.95258

word0.49666

word0.904506

word0.364454

word0.518086

word0.337456

Page 13: Piranha - ORNL0.412607 ord w 0.427525 o 0.930737 ord w 0.978947 o 0.446173 ord w 08058 0. o 0.592417 ord w 0.335562 o 0.762008 ord w 89652 0. o 0.938931 ord w 0.457311 o 0.459791 ord

13

OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY

US PACOM“Tremendously successful project”

“Software agents … lead to substantially improved analytical products.”

“A grand slam home run!”

Software Agents “working at HQ USCINCPAC operationally.”

Piranha Text Analysis

Potok et al., “VIPAR: Advanced Information Agents discovering knowledge in an open and changing environment,” Proc. 7th World Multiconference on Systemics, Cybernetics and Informatics Special Session on Agent-Based Computing, 2003. Awarded Best Paper Elmore, et al., “Dynamic Data Fusion Using An Ontology-Based Software Agent System,” 7th World Multiconference on Systemics, Cybernetics and Informatics, 2003.

Page 14: Piranha - ORNL0.412607 ord w 0.427525 o 0.930737 ord w 0.978947 o 0.446173 ord w 08058 0. o 0.592417 ord w 0.335562 o 0.762008 ord w 89652 0. o 0.938931 ord w 0.457311 o 0.459791 ord

14

OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY

CYPHER: Current Cyber security Approach

Repels KnownAttack Signatures

Repels anomalousRequests

The attack is unknown,

and not unusual?

What if …

Page 15: Piranha - ORNL0.412607 ord w 0.427525 o 0.930737 ord w 0.978947 o 0.446173 ord w 08058 0. o 0.592417 ord w 0.335562 o 0.762008 ord w 89652 0. o 0.938931 ord w 0.457311 o 0.459791 ord

15

OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY

CYPHER: New Approach

Find who is going after the “gold”

Page 16: Piranha - ORNL0.412607 ord w 0.427525 o 0.930737 ord w 0.978947 o 0.446173 ord w 08058 0. o 0.592417 ord w 0.335562 o 0.762008 ord w 89652 0. o 0.938931 ord w 0.457311 o 0.459791 ord

16

OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY

CYPHER: Cybersecurity Example

Activity Log EntryFilter: misc-000264 IDS247 - MISC - Large UDP Packet Date: 07/20TOD: 00:05:03.171193 Source IP: 63.76.192.107User John DoeResearch Area Nuclear PhysicsSource Port: 23882Target IP: 160.91.64.211Target Name: smith.aol.comTarget Port: 6970Length: 1285

NetRegDatabase63.76.192.107

John DoeBN 123456

CME Database

Johnathon DoeBN 123456

Nuclear Physics

DNS Database63.76.192.107

John DoeBN 123456

•1,000,000 records daily•Critical Decisions

−Is someone trying to hack into the system?−Are attack from “script kiddies” or state sponsored?−What are they going after and why?

Page 17: Piranha - ORNL0.412607 ord w 0.427525 o 0.930737 ord w 0.978947 o 0.446173 ord w 08058 0. o 0.592417 ord w 0.335562 o 0.762008 ord w 89652 0. o 0.938931 ord w 0.457311 o 0.459791 ord

17

OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY

Caught! 45 “low and slow” pings from:−Czech Republic, Austria, Hungary, Latvia, France, Chile, and Canada.

2 attacks on nanotechnology scientists

Hidden

Patented

Page 18: Piranha - ORNL0.412607 ord w 0.427525 o 0.930737 ord w 0.978947 o 0.446173 ord w 08058 0. o 0.592417 ord w 0.335562 o 0.762008 ord w 89652 0. o 0.938931 ord w 0.457311 o 0.459791 ord

18

OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY

Summary

• Current technology cannot solve emerging national challenges

• Intelligent software agents are a significant breakthrough technology

• Results indicate high-potential to help solve these national challenges

• We have a progression of significantly successfully deployed agent systems and research to our credit

Page 19: Piranha - ORNL0.412607 ord w 0.427525 o 0.930737 ord w 0.978947 o 0.446173 ord w 08058 0. o 0.592417 ord w 0.335562 o 0.762008 ord w 89652 0. o 0.938931 ord w 0.457311 o 0.459791 ord

19

OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY

Contact Information

• Contact Information

Thomas E. Potok, [email protected]