Visual Analytics - Los Alamos National...

19
Visual Analytics for discovering group structures in networks Takashi Nishikawa 1,2 Adilson E. Motter 2,3 1 Department of Mathematics, Clarkson University 2 Department of Physics & Astronomy, Northwestern University 3 Northwestern Institute on Complex Systems (NICO), Northwestern University LANL seminar March 16, 2010 Funded by NSF

Transcript of Visual Analytics - Los Alamos National...

Page 1: Visual Analytics - Los Alamos National Laboratorycnls.lanl.gov/~chertkov/SmarterGrids/Talks/Nishikawa.pdf · Visual Analytics for discovering group structures in networks Takashi

Visual Analytics for discovering group structures

in networksTakashi Nishikawa1,2

Adilson E. Motter2,3

1Department of Mathematics, Clarkson University2Department of Physics & Astronomy, Northwestern University

3Northwestern Institute on Complex Systems (NICO), Northwestern University

LANL seminar March 16, 2010

Funded by NSF

Page 2: Visual Analytics - Los Alamos National Laboratorycnls.lanl.gov/~chertkov/SmarterGrids/Talks/Nishikawa.pdf · Visual Analytics for discovering group structures in networks Takashi

Exploratory Analysisin Networks

Most network analyses try to detecta given type of structure, such as

- Small-world Watts & Strogatz, Nature 393, 440 (1998), ....

- Scale-freeBarabási & Albert, Science 286, 509 (1999), ....

- Community structureNewman & Girvan, PRE 69, 026113 (2004),Porter, Onnela, & Mucha, Notices Amer Math Soc 56, 1082 (2009), ....

Page 3: Visual Analytics - Los Alamos National Laboratorycnls.lanl.gov/~chertkov/SmarterGrids/Talks/Nishikawa.pdf · Visual Analytics for discovering group structures in networks Takashi

Exploratory Analysisin Networks

• An exploratory analysis tries to discover an unknown structure.Newman & Leicht, PNAS 104, 9564 (2007)

• We take visual analytics approach for this problem.

Page 4: Visual Analytics - Los Alamos National Laboratorycnls.lanl.gov/~chertkov/SmarterGrids/Talks/Nishikawa.pdf · Visual Analytics for discovering group structures in networks Takashi

Visual Analytics

• Visual interaction between the human user and the analytical tools for analyzing and interpreting high-dimensional complex data

• We take this approach for discovering an unknown group structure among nodes in a network data set.

Page 5: Visual Analytics - Los Alamos National Laboratorycnls.lanl.gov/~chertkov/SmarterGrids/Talks/Nishikawa.pdf · Visual Analytics for discovering group structures in networks Takashi

Only 5% of links are chosen

randomly and shown.

DegreeNeighbor’s mean degree2nd neighbor’s mean degreeClustering coefficient

Discovering Unknown Group Structures

Betweenness centralityLaplacian eigenvectorsNormalized Laplacian eigenvectorsMean shortest path

Distinct groups?

Page 6: Visual Analytics - Los Alamos National Laboratorycnls.lanl.gov/~chertkov/SmarterGrids/Talks/Nishikawa.pdf · Visual Analytics for discovering group structures in networks Takashi

How it works: Random 2D Projection

Only 5% of links are chosen

randomly and shown.

Page 7: Visual Analytics - Los Alamos National Laboratorycnls.lanl.gov/~chertkov/SmarterGrids/Talks/Nishikawa.pdf · Visual Analytics for discovering group structures in networks Takashi

Reject Divide

How it works:Visual Interactions

Page 8: Visual Analytics - Los Alamos National Laboratorycnls.lanl.gov/~chertkov/SmarterGrids/Talks/Nishikawa.pdf · Visual Analytics for discovering group structures in networks Takashi

How it works:Patterns of User Inputs

Page 9: Visual Analytics - Los Alamos National Laboratorycnls.lanl.gov/~chertkov/SmarterGrids/Talks/Nishikawa.pdf · Visual Analytics for discovering group structures in networks Takashi

How it works:Grouping Binary Patterns

Page 10: Visual Analytics - Los Alamos National Laboratorycnls.lanl.gov/~chertkov/SmarterGrids/Talks/Nishikawa.pdf · Visual Analytics for discovering group structures in networks Takashi
Page 11: Visual Analytics - Los Alamos National Laboratorycnls.lanl.gov/~chertkov/SmarterGrids/Talks/Nishikawa.pdf · Visual Analytics for discovering group structures in networks Takashi

= the number of nodes in group k

Properties Discriminating Nodes

We choose node properties with largest Dj, and project points onto the corresponding subspace.

Gk: set of indices for nodes in group k

For node property j, define

Page 12: Visual Analytics - Los Alamos National Laboratorycnls.lanl.gov/~chertkov/SmarterGrids/Talks/Nishikawa.pdf · Visual Analytics for discovering group structures in networks Takashi

Example 2Community Structure

Text

pwithin = 0.3pacross = 0.03

0.3

0.03 0.03

0.3 0.30.03

Page 13: Visual Analytics - Los Alamos National Laboratorycnls.lanl.gov/~chertkov/SmarterGrids/Talks/Nishikawa.pdf · Visual Analytics for discovering group structures in networks Takashi

Example 3Mixed Group Structure

0.01

0.01

0.2

0.020.01

0.01

0.01 0.010.2

Page 14: Visual Analytics - Los Alamos National Laboratorycnls.lanl.gov/~chertkov/SmarterGrids/Talks/Nishikawa.pdf · Visual Analytics for discovering group structures in networks Takashi

Example 4: PACS Network

89.75 05.45Nodes are connected if there are more papers than expected by random & independent occurrenceComplex systems

Nonlinear dynamics and chaos

Page 15: Visual Analytics - Los Alamos National Laboratorycnls.lanl.gov/~chertkov/SmarterGrids/Talks/Nishikawa.pdf · Visual Analytics for discovering group structures in networks Takashi

Data source: http://www.atsweb.neu.edu/ngulbahce/pacsdata.htmlReference: M. Herrera, D.C. Roberts and N. Gulbahce, arxiv:0904.1234

Example 4: PACS Network

Page 16: Visual Analytics - Los Alamos National Laboratorycnls.lanl.gov/~chertkov/SmarterGrids/Talks/Nishikawa.pdf · Visual Analytics for discovering group structures in networks Takashi

Example 4: PACS Network

Page 17: Visual Analytics - Los Alamos National Laboratorycnls.lanl.gov/~chertkov/SmarterGrids/Talks/Nishikawa.pdf · Visual Analytics for discovering group structures in networks Takashi

A problem with k-Means Clustering

Page 18: Visual Analytics - Los Alamos National Laboratorycnls.lanl.gov/~chertkov/SmarterGrids/Talks/Nishikawa.pdf · Visual Analytics for discovering group structures in networks Takashi

Future Work

Comprehensive benchmarking

• As a network group detection method: against community detection algorithms, expectation-maximization method, ...

• As a high-dimensional clustering method: against k-means clustering, unsupervised SVM, ...

Page 19: Visual Analytics - Los Alamos National Laboratorycnls.lanl.gov/~chertkov/SmarterGrids/Talks/Nishikawa.pdf · Visual Analytics for discovering group structures in networks Takashi

Future Work

• Can we substitute human eye with 2-means clustering or unsupervised two-class SVM?

• Exploring a high-dimensional network parameter space, given only coarse & non-uniform sample points: How does dynamical properties (cascading, synchronization, etc.) depend on network structural parameters?