Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications....

28
[email protected] http://informatics.indiana.edu/rocha/i-bic biologically Inspired computing INDIANA UNIVERSITY Informatics luis rocha 2015 biologically-inspired computing lecture 10

Transcript of Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications....

Page 1: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

[email protected]://informatics.indiana.edu/rocha/i-bic

biologicallyInspired

computing

INDIANAUNIVERSITY

Informatics luis rocha 2015

biologically-inspired computinglecture 10

Page 2: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

biologicallyInspired

computing

[email protected]://informatics.indiana.edu/rocha/i-bic

INDIANAUNIVERSITY

Informatics luis rocha 2015

course outlook

Assignments: 35% Students will complete 4/5 assignments based

on algorithms presented in class Lab meets in I1 (West) 109 on Lab

Wednesdays Lab 0 : January 14th (completed)

Introduction to Python (No Assignment) Lab 1 : January 28th

Measuring Information (Assignment 1) Graded

Lab 2 : February 11th

L-Systems (Assignment 2) Due February 25th

Lab 3: March 11th

Cellular Automata and Boolean Networks (Assignment 3)

Sections I485/H400

Page 3: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

biologicallyInspired

computing

[email protected]://informatics.indiana.edu/rocha/i-bic

INDIANAUNIVERSITY

Informatics luis rocha 2015

Readings until now

Class Book Nunes de Castro, Leandro [2006]. Fundamentals of Natural

Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 – Cellular Automata Chapter 8, sections 8.1, 8.2, 8.3.10

Lecture notes Chapter 1: What is Life? Chapter 2: The logical Mechanisms of Life Chapter 3: Formalizing and Modeling the World Chapter 4: Self-Organization and Emergent

Complex Behavior posted online @ http://informatics.indiana.edu/rocha/i-

bic Optional

Flake’s [1998], The Computational Beauty of Life. MIT Press. Chapters 10, 11, 14 – Dynamics, Attractors and chaos

Page 4: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

[email protected]://informatics.indiana.edu/rocha/i-bic

biologicallyInspired

computing

INDIANAUNIVERSITY

Informatics luis rocha 2015

discrete dynamical systemsBoolean networks

NK Boolean Network (N=13, K=3)DDLab (Andy wuensche): http://www.ddlab.com/

There are 213=8192 possible states but only a small set of attractors

Page 5: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

biologicallyInspired

computing

[email protected]://informatics.indiana.edu/rocha/i-bic

INDIANAUNIVERSITY

Informatics luis rocha 2015

Page 6: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

biologicallyInspired

computing

[email protected]://informatics.indiana.edu/rocha/i-bic

INDIANAUNIVERSITY

Informatics luis rocha 2015

attractor behavior

The 213=8192 states in state space are organized into 15 basins attractor periods ranging between 1 and 7. The number of states in each basin is: 68, 984, 784, 1300,

264, 76,316, 120, 64, 120, 256, 2724,604, 84, 428.

self-organization

Page 7: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

[email protected]://informatics.indiana.edu/rocha/i-bic

biologicallyInspired

computing

INDIANAUNIVERSITY

Informatics luis rocha 2015 an automata network model built from qualitative data

the drosophila segment polarity network

Based on the ODE model of von Dassow et al. (2000), consists of 4-cell parasegments, each cell with 15 interacting genes and proteins.

260 network configurationsReproduces wild-type and mutant gene expression patterns in development of fruit fly

2 intercellular inputs: nhh (hedgehog), nWG (wingless)1 intracellular input: SLP (sloppy paired)

Albert & Othmer [2003]. J. Theor. Bio.223: 1-18.

Page 8: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

[email protected]://informatics.indiana.edu/rocha/i-bic

biologicallyInspired

computing

INDIANAUNIVERSITY

Informatics luis rocha 2015 an automata network model built from qualitative data

the drosophila segment polarity network

Based on the ODE model of von Dassow et al. (2000), consists of 4-cell parasegments, each cell with 15 interacting genes and proteins.

260 network configurationsReproduces wild-type and mutant gene expression patterns in development of fruit fly

2 intercellular inputs: nhh (hedgehog), nWG (wingless)1 intracellular input: SLP (sloppy paired)

Albert & Othmer [2003]. J. Theor. Bio.223: 1-18.

Page 9: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

[email protected]://informatics.indiana.edu/rocha/i-bic

biologicallyInspired

computing

INDIANAUNIVERSITY

Informatics luis rocha 2015 an automata network model built from qualitative data

the drosophila segment polarity network

Based on the ODE model of von Dassow et al. (2000), consists of 4-cell parasegments, each cell with 15 interacting genes and proteins.

260 network configurationsReproduces wild-type and mutant gene expression patterns in development of fruit fly

2 intercellular inputs: nhh (hedgehog), nWG (wingless)1 intracellular input: SLP (sloppy paired)

Albert & Othmer [2003]. J. Theor. Bio.223: 1-18.

Page 10: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

biologicallyInspired

computing

[email protected]://informatics.indiana.edu/rocha/i-bic

INDIANAUNIVERSITY

Informatics luis rocha 2015

dynamical behavior

Observing the state-transition graph converges to one of

10 possible stable configurations Steady-state

attractors observed

experimentally wildtype

plus 3 variants broad stripe no-segmentation Ectopic

plus 3 variants

Cell-types in a spatial arrangement

Page 11: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

biologicallyInspired

computing

[email protected]://informatics.indiana.edu/rocha/i-bic

INDIANAUNIVERSITY

Informatics luis rocha 2015

dynamical behavior

Observing the state-transition graph converges to one of

10 possible stable configurations Steady-state

attractors observed

experimentally wildtype

plus 3 variants broad stripe no-segmentation Ectopic

plus 3 variants

Cell-types in a spatial arrangement

Page 12: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

biologicallyInspired

computing

[email protected]://informatics.indiana.edu/rocha/i-bic

INDIANAUNIVERSITY

Informatics luis rocha 2015

quantifying micro-level canalization

Measuring two forms of canalization Kr= 2 Ke= 6 - 2 = 4 Ks = 4

input redundancy, effective connectivity and input symmetry

Marques-Pita & Rocha, [2013]. PLoS ONE, 8(3): e55946.

kFf f

r

nxk

2

max #

|

kFf

o

f

s

nxk

2

min)(

|

xkxkxk re )()(

6)( xk

Prime Implicants (Quine-McCluskey) plus group invariance

Page 13: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

biologicallyInspired

computing

[email protected]://informatics.indiana.edu/rocha/i-bic

INDIANAUNIVERSITY

Informatics luis rocha 2015

per-node schema redescription

extracting micro-level canalization drosophila segment polarity genes network

In biological Boolean network models

Page 14: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

biologicallyInspired

computing

[email protected]://informatics.indiana.edu/rocha/i-bic

INDIANAUNIVERSITY

Informatics luis rocha 2015

per-node schema redescription

extracting micro-level canalization drosophila segment polarity genes network

In biological Boolean network models

Page 15: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

biologicallyInspired

computing

[email protected]://informatics.indiana.edu/rocha/i-bic

INDIANAUNIVERSITY

Informatics luis rocha 2015

canalization map as minimal control

understanding natural “computation” How cells

compute minimal wiring

(control) of micro-level

two-symbol schemata as threshold networks

Each schema represented by conjunction of literals and symmetric group constraints

Marques-Pita & Rocha, [2013]. PLoS ONE, 8(3): e55946.

Page 16: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

biologicallyInspired

computing

[email protected]://informatics.indiana.edu/rocha/i-bic

INDIANAUNIVERSITY

Informatics luis rocha 2015

(macro-level) dynamics canalization map

Full dynamics (of single-cell model) captured by threshold network of 2*N+M nodes

from per-node schemata redescription

Dynamical modularity

Marques-Pita & Rocha, [2013]. PLoSONE, 8(3): e55946.

Page 17: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

biologicallyInspired

computing

[email protected]://informatics.indiana.edu/rocha/i-bic

INDIANAUNIVERSITY

Informatics luis rocha 2015

(macro-level) control

inputs in drosophila segment polarity net: SLP, nWG, nhh

Dynamical unfolding from partial information

How much control certain nodes have on network dynamics.

Marques-Pita & Rocha, [2013]. PLoSONE, 8(3): e55946.

Page 18: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

[email protected]://informatics.indiana.edu/rocha/i-bic

biologicallyInspired

computing

INDIANAUNIVERSITY

Informatics luis rocha 2015

minimal conditions (“pre-patterns”) for wild-type attractorcontrol in the spatial model

Less than half of the nodes are needed to ensure convergence to wt, which is very robust and larger than previously thought.But losing one essential input (enputs) leads to a “unspecific” attractor. In this case could go to wt, wt (ptc mutant) or no segmentation.

Marques-Pita & Rocha, [2013]. PLoS ONE, 8(3): e55946.

Page 19: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

biologicallyInspired

computing

[email protected]://informatics.indiana.edu/rocha/i-bic

INDIANAUNIVERSITY

Informatics luis rocha 2015

redundancy in intracellular signaling networks

Activation of AKT in generic fibroblasts (130 node BN) LUT of 28=256 entries redescribed

by only 15 schemata Large amount of canalization

Very few actual inputs need to be known to determine state-transition

canalization

Helikar et al [2008]. PNAS 105: 1913-8

Upcoming work: analysis ofbiochemical models in the entirecell collective

Page 20: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

biologicallyInspired

computing

[email protected]://informatics.indiana.edu/rocha/i-bic

INDIANAUNIVERSITY

Informatics luis rocha 2015

Self-organization

Emergent Behavior from system/environment coupling Classifies Walls and Other

Robots Self-organization Embodied cognition

Robot example

http://www.johuco.com/muram/muram.html

Jonathan Connell ‘s Muramator

Page 21: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

biologicallyInspired

computing

[email protected]://informatics.indiana.edu/rocha/i-bic

INDIANAUNIVERSITY

Informatics luis rocha 2015

biological interpretations of attractor behavior

Genetic regulatory networks Genes are on or off Development, morphogenesis Attractors interpreted as different cell types

Classification in Immune networks Representation in artificial neural networks Stable patterns of species abundances in ecosystems

self-organization

attractors spontaneous order To be improved by natural selection

Order is the raw material for evolution: how much of life is Natural Selection and how much is self-organization? (credit assignment problem)

Page 22: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

biologicallyInspired

computing

[email protected]://informatics.indiana.edu/rocha/i-bic

INDIANAUNIVERSITY

Informatics luis rocha 2015

Page 23: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

biologicallyInspired

computing

[email protected]://informatics.indiana.edu/rocha/i-bic

INDIANAUNIVERSITY

Informatics luis rocha 2015

random Boolean networks

Discrete dynamical systems Extremely large number o coupled elements Systems of binary variables (0,1), coupled to one another in a

network The activity of each element depends on previous state of other

elements Simplifies continuous systems while maintaining essential

behavior Statistical properties of sets of networks

Understanding of macroscopic, emergent properties Similar to temperature

Typically irreversible

self-organization

Page 24: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

biologicallyInspired

computing

[email protected]://informatics.indiana.edu/rocha/i-bic

INDIANAUNIVERSITY

Informatics luis rocha 2015

Boolean networks

basin of attraction All states in trajectories leading to an attractor (state

cycle) length of cycle

Number of states in cycle 1 to 2N

perturbation (minimal) Flipping of one node to the opposite state

Damage Change in behavior from a perturbation

Structural perturbation Permanent in connections or Boolean rules in the

network

definitions

Page 25: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

biologicallyInspired

computing

[email protected]://informatics.indiana.edu/rocha/i-bic

INDIANAUNIVERSITY

Informatics luis rocha 2015

Kauffman’s statistical analysis

Random networks Started with random initial conditions

Self-organization is not a result of special initial conditions

Statistical analysis K 2

Steady state, ordered, crystallization (5 K to ) K=N

Disordered, chaotic Mean length of cycles: 0.5 x 2N/2

Mean number of cycles: N/e High reachability, sensitive to perturbation

Number of other state cycles system can reach after perturbation

K=2 Mean length: n1/2

Mean number of cycles: n1/2

Low reachability Percolation of frozen clusters (isolated subsets) Not very sensitive to perturbation

Of NK-Boolean Networks

Page 26: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

biologicallyInspired

computing

[email protected]://informatics.indiana.edu/rocha/i-bic

INDIANAUNIVERSITY

Informatics luis rocha 2015

edge of chaos

2 K 5 Good for evolvability? Some changes with large repercussions Best capability to perform information exchange

Information can be propagated more easily Problems with analysis

Network topology is random Not scale-free, as later explored by Aldana

Real genetic networks tend to have lower values of K (in ordered regime)

Genes as simply Boolean may be oversimplification Though a few states can approximate very well continuous

data

Page 27: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

[email protected]://informatics.indiana.edu/rocha/i-bic

biologicallyInspired

computing

INDIANAUNIVERSITY

Informatics luis rocha 2015

dynamical behavior of ensembles of networkscriticality in Boolean networks

Aldana, M. [2003]. Physica D. 185: 45–66

Random topology

scale-free topology

Page 28: Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 –Cellular Automata

biologicallyInspired

computing

[email protected]://informatics.indiana.edu/rocha/i-bic

INDIANAUNIVERSITY

Informatics luis rocha 2015

Next lectures

Class Book Nunes de Castro, Leandro [2006]. Fundamentals of Natural

Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 – Cellular Automata Chapter 8, sections 8.1, 8.2, 8.3.10

Lecture notes Chapter 1: What is Life? Chapter 2: The logical Mechanisms of Life Chapter 3: Formalizing and Modeling the World Chapter 4: Self-Organization and Emergent Complex

Behavior posted online @ http://informatics.indiana.edu/rocha/i-bic

Papers and other materials Optional

Flake’s [1998], The Computational Beauty of Life. MIT Press. Chapters 10, 11, 14 – Dynamics, Attractors and chaos

readings