Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications....
Transcript of Info biologically-inspired computing · Computing: Basic Concepts, Algorithms, and Applications....
[email protected]://informatics.indiana.edu/rocha/i-bic
biologicallyInspired
computing
INDIANAUNIVERSITY
Informatics luis rocha 2015
biologically-inspired computinglecture 10
biologicallyInspired
computing
[email protected]://informatics.indiana.edu/rocha/i-bic
INDIANAUNIVERSITY
Informatics luis rocha 2015
course outlook
Assignments: 35% Students will complete 4/5 assignments based
on algorithms presented in class Lab meets in I1 (West) 109 on Lab
Wednesdays Lab 0 : January 14th (completed)
Introduction to Python (No Assignment) Lab 1 : January 28th
Measuring Information (Assignment 1) Graded
Lab 2 : February 11th
L-Systems (Assignment 2) Due February 25th
Lab 3: March 11th
Cellular Automata and Boolean Networks (Assignment 3)
Sections I485/H400
biologicallyInspired
computing
[email protected]://informatics.indiana.edu/rocha/i-bic
INDIANAUNIVERSITY
Informatics luis rocha 2015
Readings until now
Class Book Nunes de Castro, Leandro [2006]. Fundamentals of Natural
Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 – Cellular Automata Chapter 8, sections 8.1, 8.2, 8.3.10
Lecture notes Chapter 1: What is Life? Chapter 2: The logical Mechanisms of Life Chapter 3: Formalizing and Modeling the World Chapter 4: Self-Organization and Emergent
Complex Behavior posted online @ http://informatics.indiana.edu/rocha/i-
bic Optional
Flake’s [1998], The Computational Beauty of Life. MIT Press. Chapters 10, 11, 14 – Dynamics, Attractors and chaos
[email protected]://informatics.indiana.edu/rocha/i-bic
biologicallyInspired
computing
INDIANAUNIVERSITY
Informatics luis rocha 2015
discrete dynamical systemsBoolean networks
NK Boolean Network (N=13, K=3)DDLab (Andy wuensche): http://www.ddlab.com/
There are 213=8192 possible states but only a small set of attractors
biologicallyInspired
computing
[email protected]://informatics.indiana.edu/rocha/i-bic
INDIANAUNIVERSITY
Informatics luis rocha 2015
biologicallyInspired
computing
[email protected]://informatics.indiana.edu/rocha/i-bic
INDIANAUNIVERSITY
Informatics luis rocha 2015
attractor behavior
The 213=8192 states in state space are organized into 15 basins attractor periods ranging between 1 and 7. The number of states in each basin is: 68, 984, 784, 1300,
264, 76,316, 120, 64, 120, 256, 2724,604, 84, 428.
self-organization
[email protected]://informatics.indiana.edu/rocha/i-bic
biologicallyInspired
computing
INDIANAUNIVERSITY
Informatics luis rocha 2015 an automata network model built from qualitative data
the drosophila segment polarity network
Based on the ODE model of von Dassow et al. (2000), consists of 4-cell parasegments, each cell with 15 interacting genes and proteins.
260 network configurationsReproduces wild-type and mutant gene expression patterns in development of fruit fly
2 intercellular inputs: nhh (hedgehog), nWG (wingless)1 intracellular input: SLP (sloppy paired)
Albert & Othmer [2003]. J. Theor. Bio.223: 1-18.
[email protected]://informatics.indiana.edu/rocha/i-bic
biologicallyInspired
computing
INDIANAUNIVERSITY
Informatics luis rocha 2015 an automata network model built from qualitative data
the drosophila segment polarity network
Based on the ODE model of von Dassow et al. (2000), consists of 4-cell parasegments, each cell with 15 interacting genes and proteins.
260 network configurationsReproduces wild-type and mutant gene expression patterns in development of fruit fly
2 intercellular inputs: nhh (hedgehog), nWG (wingless)1 intracellular input: SLP (sloppy paired)
Albert & Othmer [2003]. J. Theor. Bio.223: 1-18.
[email protected]://informatics.indiana.edu/rocha/i-bic
biologicallyInspired
computing
INDIANAUNIVERSITY
Informatics luis rocha 2015 an automata network model built from qualitative data
the drosophila segment polarity network
Based on the ODE model of von Dassow et al. (2000), consists of 4-cell parasegments, each cell with 15 interacting genes and proteins.
260 network configurationsReproduces wild-type and mutant gene expression patterns in development of fruit fly
2 intercellular inputs: nhh (hedgehog), nWG (wingless)1 intracellular input: SLP (sloppy paired)
Albert & Othmer [2003]. J. Theor. Bio.223: 1-18.
biologicallyInspired
computing
[email protected]://informatics.indiana.edu/rocha/i-bic
INDIANAUNIVERSITY
Informatics luis rocha 2015
dynamical behavior
Observing the state-transition graph converges to one of
10 possible stable configurations Steady-state
attractors observed
experimentally wildtype
plus 3 variants broad stripe no-segmentation Ectopic
plus 3 variants
Cell-types in a spatial arrangement
biologicallyInspired
computing
[email protected]://informatics.indiana.edu/rocha/i-bic
INDIANAUNIVERSITY
Informatics luis rocha 2015
dynamical behavior
Observing the state-transition graph converges to one of
10 possible stable configurations Steady-state
attractors observed
experimentally wildtype
plus 3 variants broad stripe no-segmentation Ectopic
plus 3 variants
Cell-types in a spatial arrangement
biologicallyInspired
computing
[email protected]://informatics.indiana.edu/rocha/i-bic
INDIANAUNIVERSITY
Informatics luis rocha 2015
quantifying micro-level canalization
Measuring two forms of canalization Kr= 2 Ke= 6 - 2 = 4 Ks = 4
input redundancy, effective connectivity and input symmetry
Marques-Pita & Rocha, [2013]. PLoS ONE, 8(3): e55946.
kFf f
r
nxk
2
max #
|
kFf
o
f
s
nxk
2
min)(
|
xkxkxk re )()(
6)( xk
Prime Implicants (Quine-McCluskey) plus group invariance
biologicallyInspired
computing
[email protected]://informatics.indiana.edu/rocha/i-bic
INDIANAUNIVERSITY
Informatics luis rocha 2015
per-node schema redescription
extracting micro-level canalization drosophila segment polarity genes network
In biological Boolean network models
biologicallyInspired
computing
[email protected]://informatics.indiana.edu/rocha/i-bic
INDIANAUNIVERSITY
Informatics luis rocha 2015
per-node schema redescription
extracting micro-level canalization drosophila segment polarity genes network
In biological Boolean network models
biologicallyInspired
computing
[email protected]://informatics.indiana.edu/rocha/i-bic
INDIANAUNIVERSITY
Informatics luis rocha 2015
canalization map as minimal control
understanding natural “computation” How cells
compute minimal wiring
(control) of micro-level
two-symbol schemata as threshold networks
Each schema represented by conjunction of literals and symmetric group constraints
Marques-Pita & Rocha, [2013]. PLoS ONE, 8(3): e55946.
biologicallyInspired
computing
[email protected]://informatics.indiana.edu/rocha/i-bic
INDIANAUNIVERSITY
Informatics luis rocha 2015
(macro-level) dynamics canalization map
Full dynamics (of single-cell model) captured by threshold network of 2*N+M nodes
from per-node schemata redescription
Dynamical modularity
Marques-Pita & Rocha, [2013]. PLoSONE, 8(3): e55946.
biologicallyInspired
computing
[email protected]://informatics.indiana.edu/rocha/i-bic
INDIANAUNIVERSITY
Informatics luis rocha 2015
(macro-level) control
inputs in drosophila segment polarity net: SLP, nWG, nhh
Dynamical unfolding from partial information
How much control certain nodes have on network dynamics.
Marques-Pita & Rocha, [2013]. PLoSONE, 8(3): e55946.
[email protected]://informatics.indiana.edu/rocha/i-bic
biologicallyInspired
computing
INDIANAUNIVERSITY
Informatics luis rocha 2015
minimal conditions (“pre-patterns”) for wild-type attractorcontrol in the spatial model
Less than half of the nodes are needed to ensure convergence to wt, which is very robust and larger than previously thought.But losing one essential input (enputs) leads to a “unspecific” attractor. In this case could go to wt, wt (ptc mutant) or no segmentation.
Marques-Pita & Rocha, [2013]. PLoS ONE, 8(3): e55946.
biologicallyInspired
computing
[email protected]://informatics.indiana.edu/rocha/i-bic
INDIANAUNIVERSITY
Informatics luis rocha 2015
redundancy in intracellular signaling networks
Activation of AKT in generic fibroblasts (130 node BN) LUT of 28=256 entries redescribed
by only 15 schemata Large amount of canalization
Very few actual inputs need to be known to determine state-transition
canalization
Helikar et al [2008]. PNAS 105: 1913-8
Upcoming work: analysis ofbiochemical models in the entirecell collective
biologicallyInspired
computing
[email protected]://informatics.indiana.edu/rocha/i-bic
INDIANAUNIVERSITY
Informatics luis rocha 2015
Self-organization
Emergent Behavior from system/environment coupling Classifies Walls and Other
Robots Self-organization Embodied cognition
Robot example
http://www.johuco.com/muram/muram.html
Jonathan Connell ‘s Muramator
biologicallyInspired
computing
[email protected]://informatics.indiana.edu/rocha/i-bic
INDIANAUNIVERSITY
Informatics luis rocha 2015
biological interpretations of attractor behavior
Genetic regulatory networks Genes are on or off Development, morphogenesis Attractors interpreted as different cell types
Classification in Immune networks Representation in artificial neural networks Stable patterns of species abundances in ecosystems
self-organization
attractors spontaneous order To be improved by natural selection
Order is the raw material for evolution: how much of life is Natural Selection and how much is self-organization? (credit assignment problem)
biologicallyInspired
computing
[email protected]://informatics.indiana.edu/rocha/i-bic
INDIANAUNIVERSITY
Informatics luis rocha 2015
biologicallyInspired
computing
[email protected]://informatics.indiana.edu/rocha/i-bic
INDIANAUNIVERSITY
Informatics luis rocha 2015
random Boolean networks
Discrete dynamical systems Extremely large number o coupled elements Systems of binary variables (0,1), coupled to one another in a
network The activity of each element depends on previous state of other
elements Simplifies continuous systems while maintaining essential
behavior Statistical properties of sets of networks
Understanding of macroscopic, emergent properties Similar to temperature
Typically irreversible
self-organization
biologicallyInspired
computing
[email protected]://informatics.indiana.edu/rocha/i-bic
INDIANAUNIVERSITY
Informatics luis rocha 2015
Boolean networks
basin of attraction All states in trajectories leading to an attractor (state
cycle) length of cycle
Number of states in cycle 1 to 2N
perturbation (minimal) Flipping of one node to the opposite state
Damage Change in behavior from a perturbation
Structural perturbation Permanent in connections or Boolean rules in the
network
definitions
biologicallyInspired
computing
[email protected]://informatics.indiana.edu/rocha/i-bic
INDIANAUNIVERSITY
Informatics luis rocha 2015
Kauffman’s statistical analysis
Random networks Started with random initial conditions
Self-organization is not a result of special initial conditions
Statistical analysis K 2
Steady state, ordered, crystallization (5 K to ) K=N
Disordered, chaotic Mean length of cycles: 0.5 x 2N/2
Mean number of cycles: N/e High reachability, sensitive to perturbation
Number of other state cycles system can reach after perturbation
K=2 Mean length: n1/2
Mean number of cycles: n1/2
Low reachability Percolation of frozen clusters (isolated subsets) Not very sensitive to perturbation
Of NK-Boolean Networks
biologicallyInspired
computing
[email protected]://informatics.indiana.edu/rocha/i-bic
INDIANAUNIVERSITY
Informatics luis rocha 2015
edge of chaos
2 K 5 Good for evolvability? Some changes with large repercussions Best capability to perform information exchange
Information can be propagated more easily Problems with analysis
Network topology is random Not scale-free, as later explored by Aldana
Real genetic networks tend to have lower values of K (in ordered regime)
Genes as simply Boolean may be oversimplification Though a few states can approximate very well continuous
data
[email protected]://informatics.indiana.edu/rocha/i-bic
biologicallyInspired
computing
INDIANAUNIVERSITY
Informatics luis rocha 2015
dynamical behavior of ensembles of networkscriticality in Boolean networks
Aldana, M. [2003]. Physica D. 185: 45–66
Random topology
scale-free topology
biologicallyInspired
computing
[email protected]://informatics.indiana.edu/rocha/i-bic
INDIANAUNIVERSITY
Informatics luis rocha 2015
Next lectures
Class Book Nunes de Castro, Leandro [2006]. Fundamentals of Natural
Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 – Cellular Automata Chapter 8, sections 8.1, 8.2, 8.3.10
Lecture notes Chapter 1: What is Life? Chapter 2: The logical Mechanisms of Life Chapter 3: Formalizing and Modeling the World Chapter 4: Self-Organization and Emergent Complex
Behavior posted online @ http://informatics.indiana.edu/rocha/i-bic
Papers and other materials Optional
Flake’s [1998], The Computational Beauty of Life. MIT Press. Chapters 10, 11, 14 – Dynamics, Attractors and chaos
readings