Datalog-Based Program Analysis - Bitbucket

94
Yue Li and Tian Tan Static Program Analysis 2020 Spring

Transcript of Datalog-Based Program Analysis - Bitbucket

Yue Li and Tian Tan

Static Program Analysis

2020 Spring

Nanjing University

Tian Tan

2020

Datalog-Based

Static Program Analysis

Program Analysis

1. Motivation

2. Introduction to Datalog

3. Pointer Analysis via Datalog

4. Taint Analysis via Datalog

Tian Tan @ Nanjing University 3

Contents

Contents

1. Motivation

2. Introduction to Datalog

3. Pointer Analysis via Datalog

4. Taint Analysis via Datalog

Tian Tan @ Nanjing University 4

Imperative vs Declarative

Goal: select adults from a set of persons

Tian Tan @ Nanjing University 5

Imperative vs Declarative

Goal: select adults from a set of persons

โ€ข Imperative: how to do (~implementation)

Tian Tan @ Nanjing University 6

Set<Person> selectAdults(Set<Person> persons) {Set<Person> result = new HashSet<>();for (Person person : persons)if (person.getAge() >= 18)

result.add(person);return result;

}

Imperative vs Declarative

Goal: select adults from a set of persons

โ€ข Imperative: how to do (~implementation)

โ€ข Declarative: what to do (~specification)

Tian Tan @ Nanjing University 7

SELECT * FROM Persons WHERE Age >= 18;

Set<Person> selectAdults(Set<Person> persons) {Set<Person> result = new HashSet<>();for (Person person : persons)if (person.getAge() >= 18)

result.add(person);return result;

}

How to Implement Program Analyses?

Tian Tan @ Nanjing University 8

Kind Statement Rule

New i: x = new T() ๐‘œ๐‘– โˆˆ ๐‘๐‘ก(๐‘ฅ)

Assign x = y๐‘œ๐‘– โˆˆ ๐‘๐‘ก(๐‘ฆ)

๐‘œ๐‘– โˆˆ ๐‘๐‘ก(๐‘ฅ)

Store x.f = y ๐‘œ๐‘– โˆˆ ๐‘๐‘ก ๐‘ฅ , ๐‘œ๐‘— โˆˆ ๐‘๐‘ก ๐‘ฆ

๐‘œ๐‘— โˆˆ ๐‘๐‘ก(๐‘œ๐‘– . ๐‘“)

Load y = x.f ๐‘œ๐‘– โˆˆ ๐‘๐‘ก ๐‘ฅ , ๐‘œ๐‘— โˆˆ ๐‘๐‘ก ๐‘œ๐‘– . ๐‘“

๐‘œ๐‘— โˆˆ ๐‘๐‘ก(๐‘ฆ)

Call l: r = x.k(a1,โ€ฆ,an)

๐‘œ๐‘– โˆˆ ๐‘๐‘ก ๐‘ฅ , ๐‘š = Dispatch(๐‘œ๐‘– , k)

๐‘œ๐‘ข โˆˆ ๐‘๐‘ก ๐‘Ž๐‘— , 1 โ‰ค ๐‘— โ‰ค ๐‘›๐‘œ๐‘ฃ โˆˆ ๐‘๐‘ก(๐‘š๐‘Ÿ๐‘’๐‘ก)๐‘œ๐‘– โˆˆ ๐‘๐‘ก(๐‘š๐‘กโ„Ž๐‘–๐‘ )

๐‘œ๐‘ข โˆˆ ๐‘๐‘ก ๐‘š๐‘๐‘— , 1 โ‰ค ๐‘— โ‰ค ๐‘›

๐‘œ๐‘ฃ โˆˆ ๐‘๐‘ก(๐‘Ÿ)

Specification

Pointer Analysis, Imperative Implementation

Tian Tan @ Nanjing University 9

Solve(๐‘š๐‘’๐‘›๐‘ก๐‘Ÿ๐‘ฆ)WL=[ ],PFG={},S={},RM={},CG={}

AddReachable(๐‘š๐‘’๐‘›๐‘ก๐‘Ÿ๐‘ฆ)while WL is not empty do

remove ๐‘›, ๐‘๐‘ก๐‘  from WLฮ” = pts โ€“ pt(n)Propagate(n, ฮ”)if n represents a variable x then

foreach ๐‘œ๐‘– โˆˆ ฮ” doforeach x.f = y โˆˆ ๐‘† do

AddEdge(y, ๐‘œ๐‘– . ๐‘“)foreach y = x.f โˆˆ ๐‘† do

AddEdge(๐‘œ๐‘– . ๐‘“, y)ProcessCall(x, ๐‘œ๐‘–)

AddReachable(m)

if m โˆ‰ RM then

add m to RM

๐‘† โˆช= ๐‘†๐‘šforeach i: x = new T() โˆˆ ๐‘†๐‘š do

add ๐‘ฅ, {๐‘œ๐‘–} to WL

foreach x = y โˆˆ ๐‘†๐‘š do

AddEdge(y, x)

AddEdge(s, t)

if s โ†’ t โˆ‰ PFG then

add s โ†’ t to PFG

if ๐‘๐‘ก(๐‘ ) is not empty then

add ๐‘ก, ๐‘๐‘ก(๐‘ ) to WL

ProcessCall(x, ๐‘œ๐‘–)foreach l: r = x.k(a1,โ€ฆ,an) โˆˆ ๐‘† do

๐‘š = Dispatch(๐‘œ๐‘–, k)

add ๐‘š๐‘กโ„Ž๐‘–๐‘ , {๐‘œ๐‘–} to WL

if l โ†’ ๐‘š โˆ‰ CG then

add l โ†’ ๐‘š to CG

AddReachable(๐‘š)

foreach parameter ๐‘๐‘– of ๐‘š do

AddEdge(๐‘Ž๐‘–, ๐‘๐‘–)AddEdge(๐‘š๐‘Ÿ๐‘’๐‘ก, ๐‘Ÿ)

Propagate(n, pts)

if pts is not empty then

pt(n) โ‹ƒ= pts

foreach n โ†’ s โˆˆ PFG do

add ๐‘ , pts to WL

Pointer Analysis, Imperative Implementation

Tian Tan @ Nanjing University 10

Solve(๐‘š๐‘’๐‘›๐‘ก๐‘Ÿ๐‘ฆ)WL=[ ],PFG={},S={},RM={},CG={}

AddReachable(๐‘š๐‘’๐‘›๐‘ก๐‘Ÿ๐‘ฆ)while WL is not empty do

remove ๐‘›, ๐‘๐‘ก๐‘  from WLฮ” = pts โ€“ pt(n)Propagate(n, ฮ”)if n represents a variable x then

foreach ๐‘œ๐‘– โˆˆ ฮ” doforeach x.f = y โˆˆ ๐‘† do

AddEdge(y, ๐‘œ๐‘– . ๐‘“)foreach y = x.f โˆˆ ๐‘† do

AddEdge(๐‘œ๐‘– . ๐‘“, y)ProcessCall(x, ๐‘œ๐‘–)

AddReachable(m)

if m โˆ‰ RM then

add m to RM

๐‘† โˆช= ๐‘†๐‘šforeach i: x = new T() โˆˆ ๐‘†๐‘š do

add ๐‘ฅ, {๐‘œ๐‘–} to WL

foreach x = y โˆˆ ๐‘†๐‘š do

AddEdge(y, x)

AddEdge(s, t)

if s โ†’ t โˆ‰ PFG then

add s โ†’ t to PFG

if ๐‘๐‘ก(๐‘ ) is not empty then

add ๐‘ก, ๐‘๐‘ก(๐‘ ) to WL

ProcessCall(x, ๐‘œ๐‘–)foreach l: r = x.k(a1,โ€ฆ,an) โˆˆ ๐‘† do

๐‘š = Dispatch(๐‘œ๐‘–, k)

add ๐‘š๐‘กโ„Ž๐‘–๐‘ , {๐‘œ๐‘–} to WL

if l โ†’ ๐‘š โˆ‰ CG then

add l โ†’ ๐‘š to CG

AddReachable(๐‘š)

foreach parameter ๐‘๐‘– of ๐‘š do

AddEdge(๐‘Ž๐‘–, ๐‘๐‘–)AddEdge(๐‘š๐‘Ÿ๐‘’๐‘ก, ๐‘Ÿ)

Propagate(n, pts)

if pts is not empty then

pt(n) โ‹ƒ= pts

foreach n โ†’ s โˆˆ PFG do

add ๐‘ , pts to WL

โ€ข How to implement worklist?โ€ข Array list or linked list?โ€ข Which worklist entry should be

processed first?

Pointer Analysis, Imperative Implementation

Tian Tan @ Nanjing University 11

Solve(๐‘š๐‘’๐‘›๐‘ก๐‘Ÿ๐‘ฆ)WL=[ ],PFG={},S={},RM={},CG={}

AddReachable(๐‘š๐‘’๐‘›๐‘ก๐‘Ÿ๐‘ฆ)while WL is not empty do

remove ๐‘›, ๐‘๐‘ก๐‘  from WLฮ” = pts โ€“ pt(n)Propagate(n, ฮ”)if n represents a variable x then

foreach ๐‘œ๐‘– โˆˆ ฮ” doforeach x.f = y โˆˆ ๐‘† do

AddEdge(y, ๐‘œ๐‘– . ๐‘“)foreach y = x.f โˆˆ ๐‘† do

AddEdge(๐‘œ๐‘– . ๐‘“, y)ProcessCall(x, ๐‘œ๐‘–)

AddReachable(m)

if m โˆ‰ RM then

add m to RM

๐‘† โˆช= ๐‘†๐‘šforeach i: x = new T() โˆˆ ๐‘†๐‘š do

add ๐‘ฅ, {๐‘œ๐‘–} to WL

foreach x = y โˆˆ ๐‘†๐‘š do

AddEdge(y, x)

AddEdge(s, t)

if s โ†’ t โˆ‰ PFG then

add s โ†’ t to PFG

if ๐‘๐‘ก(๐‘ ) is not empty then

add ๐‘ก, ๐‘๐‘ก(๐‘ ) to WL

ProcessCall(x, ๐‘œ๐‘–)foreach l: r = x.k(a1,โ€ฆ,an) โˆˆ ๐‘† do

๐‘š = Dispatch(๐‘œ๐‘–, k)

add ๐‘š๐‘กโ„Ž๐‘–๐‘ , {๐‘œ๐‘–} to WL

if l โ†’ ๐‘š โˆ‰ CG then

add l โ†’ ๐‘š to CG

AddReachable(๐‘š)

foreach parameter ๐‘๐‘– of ๐‘š do

AddEdge(๐‘Ž๐‘–, ๐‘๐‘–)AddEdge(๐‘š๐‘Ÿ๐‘’๐‘ก, ๐‘Ÿ)

Propagate(n, pts)

if pts is not empty then

pt(n) โ‹ƒ= pts

foreach n โ†’ s โˆˆ PFG do

add ๐‘ , pts to WL

โ€ข How to implement worklist?โ€ข Array list or linked list?โ€ข Which worklist entry should be

processed first?โ€ข How to implement points-to set (pt)?

โ€ข Hash set or bit vector?

Pointer Analysis, Imperative Implementation

Tian Tan @ Nanjing University 12

Solve(๐‘š๐‘’๐‘›๐‘ก๐‘Ÿ๐‘ฆ)WL=[ ],PFG={},S={},RM={},CG={}

AddReachable(๐‘š๐‘’๐‘›๐‘ก๐‘Ÿ๐‘ฆ)while WL is not empty do

remove ๐‘›, ๐‘๐‘ก๐‘  from WLฮ” = pts โ€“ pt(n)Propagate(n, ฮ”)if n represents a variable x then

foreach ๐‘œ๐‘– โˆˆ ฮ” doforeach x.f = y โˆˆ ๐‘† do

AddEdge(y, ๐‘œ๐‘– . ๐‘“)foreach y = x.f โˆˆ ๐‘† do

AddEdge(๐‘œ๐‘– . ๐‘“, y)ProcessCall(x, ๐‘œ๐‘–)

AddReachable(m)

if m โˆ‰ RM then

add m to RM

๐‘† โˆช= ๐‘†๐‘šforeach i: x = new T() โˆˆ ๐‘†๐‘š do

add ๐‘ฅ, {๐‘œ๐‘–} to WL

foreach x = y โˆˆ ๐‘†๐‘š do

AddEdge(y, x)

AddEdge(s, t)

if s โ†’ t โˆ‰ PFG then

add s โ†’ t to PFG

if ๐‘๐‘ก(๐‘ ) is not empty then

add ๐‘ก, ๐‘๐‘ก(๐‘ ) to WL

ProcessCall(x, ๐‘œ๐‘–)foreach l: r = x.k(a1,โ€ฆ,an) โˆˆ ๐‘† do

๐‘š = Dispatch(๐‘œ๐‘–, k)

add ๐‘š๐‘กโ„Ž๐‘–๐‘ , {๐‘œ๐‘–} to WL

if l โ†’ ๐‘š โˆ‰ CG then

add l โ†’ ๐‘š to CG

AddReachable(๐‘š)

foreach parameter ๐‘๐‘– of ๐‘š do

AddEdge(๐‘Ž๐‘–, ๐‘๐‘–)AddEdge(๐‘š๐‘Ÿ๐‘’๐‘ก, ๐‘Ÿ)

Propagate(n, pts)

if pts is not empty then

pt(n) โ‹ƒ= pts

foreach n โ†’ s โˆˆ PFG do

add ๐‘ , pts to WL

โ€ข How to implement worklist?โ€ข Array list or linked list?โ€ข Which worklist entry should be

processed first?โ€ข How to implement points-to set (pt)?

โ€ข Hash set or bit vector?โ€ข How to connect PFG nodes and pointers?

Pointer Analysis, Imperative Implementation

Tian Tan @ Nanjing University 13

Solve(๐‘š๐‘’๐‘›๐‘ก๐‘Ÿ๐‘ฆ)WL=[ ],PFG={},S={},RM={},CG={}

AddReachable(๐‘š๐‘’๐‘›๐‘ก๐‘Ÿ๐‘ฆ)while WL is not empty do

remove ๐‘›, ๐‘๐‘ก๐‘  from WLฮ” = pts โ€“ pt(n)Propagate(n, ฮ”)if n represents a variable x then

foreach ๐‘œ๐‘– โˆˆ ฮ” doforeach x.f = y โˆˆ ๐‘† do

AddEdge(y, ๐‘œ๐‘– . ๐‘“)foreach y = x.f โˆˆ ๐‘† do

AddEdge(๐‘œ๐‘– . ๐‘“, y)ProcessCall(x, ๐‘œ๐‘–)

AddReachable(m)

if m โˆ‰ RM then

add m to RM

๐‘† โˆช= ๐‘†๐‘šforeach i: x = new T() โˆˆ ๐‘†๐‘š do

add ๐‘ฅ, {๐‘œ๐‘–} to WL

foreach x = y โˆˆ ๐‘†๐‘š do

AddEdge(y, x)

AddEdge(s, t)

if s โ†’ t โˆ‰ PFG then

add s โ†’ t to PFG

if ๐‘๐‘ก(๐‘ ) is not empty then

add ๐‘ก, ๐‘๐‘ก(๐‘ ) to WL

ProcessCall(x, ๐‘œ๐‘–)foreach l: r = x.k(a1,โ€ฆ,an) โˆˆ ๐‘† do

๐‘š = Dispatch(๐‘œ๐‘–, k)

add ๐‘š๐‘กโ„Ž๐‘–๐‘ , {๐‘œ๐‘–} to WL

if l โ†’ ๐‘š โˆ‰ CG then

add l โ†’ ๐‘š to CG

AddReachable(๐‘š)

foreach parameter ๐‘๐‘– of ๐‘š do

AddEdge(๐‘Ž๐‘–, ๐‘๐‘–)AddEdge(๐‘š๐‘Ÿ๐‘’๐‘ก, ๐‘Ÿ)

Propagate(n, pts)

if pts is not empty then

pt(n) โ‹ƒ= pts

foreach n โ†’ s โˆˆ PFG do

add ๐‘ , pts to WL

โ€ข How to implement worklist?โ€ข Array list or linked list?โ€ข Which worklist entry should be

processed first?โ€ข How to implement points-to set (pt)?

โ€ข Hash set or bit vector?โ€ข How to connect PFG nodes and pointers?โ€ข How to associate variables to the

relevant statements?

Pointer Analysis, Imperative Implementation

Tian Tan @ Nanjing University 14

Solve(๐‘š๐‘’๐‘›๐‘ก๐‘Ÿ๐‘ฆ)WL=[ ],PFG={},S={},RM={},CG={}

AddReachable(๐‘š๐‘’๐‘›๐‘ก๐‘Ÿ๐‘ฆ)while WL is not empty do

remove ๐‘›, ๐‘๐‘ก๐‘  from WLฮ” = pts โ€“ pt(n)Propagate(n, ฮ”)if n represents a variable x then

foreach ๐‘œ๐‘– โˆˆ ฮ” doforeach x.f = y โˆˆ ๐‘† do

AddEdge(y, ๐‘œ๐‘– . ๐‘“)foreach y = x.f โˆˆ ๐‘† do

AddEdge(๐‘œ๐‘– . ๐‘“, y)ProcessCall(x, ๐‘œ๐‘–)

AddReachable(m)

if m โˆ‰ RM then

add m to RM

๐‘† โˆช= ๐‘†๐‘šforeach i: x = new T() โˆˆ ๐‘†๐‘š do

add ๐‘ฅ, {๐‘œ๐‘–} to WL

foreach x = y โˆˆ ๐‘†๐‘š do

AddEdge(y, x)

AddEdge(s, t)

if s โ†’ t โˆ‰ PFG then

add s โ†’ t to PFG

if ๐‘๐‘ก(๐‘ ) is not empty then

add ๐‘ก, ๐‘๐‘ก(๐‘ ) to WL

ProcessCall(x, ๐‘œ๐‘–)foreach l: r = x.k(a1,โ€ฆ,an) โˆˆ ๐‘† do

๐‘š = Dispatch(๐‘œ๐‘–, k)

add ๐‘š๐‘กโ„Ž๐‘–๐‘ , {๐‘œ๐‘–} to WL

if l โ†’ ๐‘š โˆ‰ CG then

add l โ†’ ๐‘š to CG

AddReachable(๐‘š)

foreach parameter ๐‘๐‘– of ๐‘š do

AddEdge(๐‘Ž๐‘–, ๐‘๐‘–)AddEdge(๐‘š๐‘Ÿ๐‘’๐‘ก, ๐‘Ÿ)

Propagate(n, pts)

if pts is not empty then

pt(n) โ‹ƒ= pts

foreach n โ†’ s โˆˆ PFG do

add ๐‘ , pts to WL

โ€ข How to implement worklist?โ€ข Array list or linked list?โ€ข Which worklist entry should be

processed first?โ€ข How to implement points-to set (pt)?

โ€ข Hash set or bit vector?โ€ข How to connect PFG nodes and pointers?โ€ข How to associate variables to the

relevant statements?โ€ข โ€ฆ

So many implementation details

Pointer Analysis, Declarative Implementation (via Datalog)

Tian Tan @ Nanjing University 15

VarPointsTo(this, o),Reachable(m),CallGraph(l, m) <-

VCall(l, x, k),VarPointsTo(x, o),Dispatch(o, k, m),ThisVar(m, this).

VarPointsTo(pi, o) <-CallGraph(l, m),Argument(l, i, ai),Parameter(m, i, pi),VarPointsTo(ai, o).

VarPointsTo(r, o) <-CallGraph(l, m),MethodReturn(m, ret),VarPointsTo(ret, o),CallReturn(l, r),

VarPointsTo(x, o) <-Reachable(m),New(x, o, m).

VarPointsTo(x, o) <-Assign(x, y),VarPointsTo(y, o).

FieldPointsTo(oi, f, oj) <-Store(x, f, y),VarPointsTo(x, oi),VarPointsTo(y, oj).

VarPointsTo(y, oj) <-Load(y, x, f),VarPointsTo(x, oi),FieldPointsTo(oi, f, oj).

VarPointsTo(x, o) <-Reachable(m),New(x, o, m).

VarPointsTo(x, o) <-Assign(x, y),VarPointsTo(y, o).

FieldPointsTo(oi, f, oj) <-Store(x, f, y),VarPointsTo(x, oi),VarPointsTo(y, oj).

VarPointsTo(y, oj) <-Load(y, x, f),VarPointsTo(x, oi),FieldPointsTo(oi, f, oj).

Pointer Analysis, Declarative Implementation (via Datalog)

Tian Tan @ Nanjing University 16

VarPointsTo(this, o),Reachable(m),CallGraph(l, m) <-

VCall(l, x, k),VarPointsTo(x, o),Dispatch(o, k, m),ThisVar(m, this).

VarPointsTo(pi, o) <-CallGraph(l, m),Argument(l, i, ai),Parameter(m, i, pi),VarPointsTo(ai, o).

VarPointsTo(r, o) <-CallGraph(l, m),MethodReturn(m, ret),VarPointsTo(ret, o),CallReturn(l, r),

โ€ข Succinctโ€ข Readable (logic-based specification)โ€ข Easy to implement

1. Motivation

2. Introduction to Datalog

3. Pointer Analysis via Datalog

4. Taint Analysis via Datalog

Tian Tan @ Nanjing University 17

Contents

Datalog

โ€ข Datalog is a declarative logic programming language that is a subset of Prolog.

โ€ข It emerged as a database language (mid-1980s)*

โ€ข Now it has a variety of applicationsโ€ข Program analysis

โ€ข Declarative networking

โ€ข Big data

โ€ข Cloud computing

โ€ข โ€ฆ

Tian Tan @ Nanjing University 18

David Maier, K. Tuncay Tekle, Michael Kifer, and David S. Warren, โ€œDatalog: Concepts, History, and Outlookโ€. Chapter, 2018.

*

Datalog

โ€ข No side-effects

โ€ข No control flows

โ€ข No functions

โ€ข Not Turing-complete

Tian Tan @ Nanjing University 19

Datalog = Data + Logic(and, or, not)

Datalog

โ€ข No side-effects

โ€ข No control flows

โ€ข No functions

โ€ข Not Turing-complete

Tian Tan @ Nanjing University 20

Datalog = Data + Logic(and, or, not)

Predicates (Data)

โ€ข In Datalog, a predicate (relation) is a set of statements

โ€ข Essentially, a predicate is a table of data

Tian Tan @ Nanjing University 21

person age

Xiaoming 18

Xiaohong 23

Alan 16

Abao 31

Age Age is a predicate, which states the age of some persons.

Predicates (Data)

โ€ข In Datalog, a predicate (relation) is a set of statements

โ€ข Essentially, a predicate is a table of data

โ€ข A fact asserts that a particular tuple (a row) belongs to a relation (a table), i.e., it represents a predicate being true for a particular combination of values

Tian Tan @ Nanjing University 22

person age

Xiaoming 18

Xiaohong 23

Alan 16

Abao 31

Age is a predicate, which states the age of some persons. For Age:โ€ข (โ€œXiaomingโ€,18) means

โ€œXiaoming is 18โ€, which is a factโ€ข (โ€œAbaoโ€,23) means โ€œAbao is 23โ€,

which is not a fact

Age

Atoms

โ€ข Atoms are basic elements of Datalog, which represent predicates of the form

โ€ข Termsโ€ข Variables: stand for any values

โ€ข Constants

Tian Tan @ Nanjing University 23

P(X1,X2,โ€ฆ,Xn)

Name of predicate Arguments (terms)

Atoms

โ€ข Atoms are basic elements of Datalog, which represent predicates of the form

โ€ข Termsโ€ข Variables: stand for any values

โ€ข Constants

โ€ข Examplesโ€ข Age(person,age)

โ€ข Age(โ€œXiaomingโ€,18)

Tian Tan @ Nanjing University 24

P(X1,X2,โ€ฆ,Xn)

Name of predicate Arguments (terms)

Atoms (Cont.)

โ€ข P(X1,X2,โ€ฆ,Xn) is called relational atom

โ€ข P(X1,X2,โ€ฆ,Xn) evaluates to true when predicate Pcontains the tuple described by X1,X2,โ€ฆ,Xn

Tian Tan @ Nanjing University 25

Atoms (Cont.)

โ€ข P(X1,X2,โ€ฆ,Xn) is called relational atom

โ€ข P(X1,X2,โ€ฆ,Xn) evaluates to true when predicate Pcontains the tuple described by X1,X2,โ€ฆ,Xnโ€ข Age(โ€œXiaomingโ€,18) is

Tian Tan @ Nanjing University 26

person age

Xiaoming 18

Xiaohong 23

Alan 16

Abao 31

Age

Atoms (Cont.)

โ€ข P(X1,X2,โ€ฆ,Xn) is called relational atom

โ€ข P(X1,X2,โ€ฆ,Xn) evaluates to true when predicate Pcontains the tuple described by X1,X2,โ€ฆ,Xnโ€ข Age(โ€œXiaomingโ€,18) is true

โ€ข Age(โ€œAlanโ€,23) is

Tian Tan @ Nanjing University 27

person age

Xiaoming 18

Xiaohong 23

Alan 16

Abao 31

Age

Atoms (Cont.)

โ€ข P(X1,X2,โ€ฆ,Xn) is called relational atom

โ€ข P(X1,X2,โ€ฆ,Xn) evaluates to true when predicate Pcontains the tuple described by X1,X2,โ€ฆ,Xnโ€ข Age(โ€œXiaomingโ€,18) is true

โ€ข Age(โ€œAlanโ€,23) is false

Tian Tan @ Nanjing University 28

person age

Xiaoming 18

Xiaohong 23

Alan 16

Abao 31

Age

Atoms (Cont.)

โ€ข P(X1,X2,โ€ฆ,Xn) is called relational atom

โ€ข P(X1,X2,โ€ฆ,Xn) evaluates to true when predicate Pcontains the tuple described by X1,X2,โ€ฆ,Xnโ€ข Age(โ€œXiaomingโ€,18) is true

โ€ข Age(โ€œAlanโ€,23) is false

โ€ข In addition to relational atoms, Datalog also has arithmetic atomsโ€ข E.g., age >= 18

Tian Tan @ Nanjing University 29

person age

Xiaoming 18

Xiaohong 23

Alan 16

Abao 31

Age

Datalog Rules (Logic)

โ€ข Rule is a way of expressing logical inferences

โ€ข Rules also serve to specify how facts are deduced

โ€ข The form of a rule is

Tian Tan @ Nanjing University 30

H <- B1,B2,โ€ฆ,Bn.

Datalog Rules (Logic)

โ€ข Rule is a way of expressing logical inferences

โ€ข Rules also serve to specify how facts are deduced

โ€ข The form of a rule is

Tian Tan @ Nanjing University 31

H <- B1,B2,โ€ฆ,Bn.

Head (consequent)H is an atom

Body (antecedent)Bi is a (possibly negated) atomEach Bi is called a subgoal

The meaning of a rule is โ€œhead is true if body is trueโ€

Datalog Rules (Cont.)

โ€œ,โ€ can be read as (logical) and, i.e., body B1,B2,โ€ฆ,Bnis true if all subgoals B1, B2, โ€ฆ, and Bn are true

For example, we can deduce adults via Datalog rule:

Tian Tan @ Nanjing University 32

H <- B1,B2,โ€ฆ,Bn.

Adult(person) <-Age(person,age),age >= 18.

Datalog Rules (Cont.)

โ€œ,โ€ can be read as (logical) and, i.e., body B1,B2,โ€ฆ,Bnis true if all subgoals B1, B2, โ€ฆ, and Bn are true

For example, we can deduce adults via Datalog rule:

Tian Tan @ Nanjing University 33

H <- B1,B2,โ€ฆ,Bn.

Adult(person) <-Age(person,age),age >= 18.

How to interpret the rules?

Interpretation of Datalog Rules

โ€ข Consider all possible combinations of values of the variables in the subgoals

โ€ข If a combination makes all subgoals true, then the head atom (with corresponding values) is also true

โ€ข The head predicate consists of all true atoms

Tian Tan @ Nanjing University 34

H(X1,X2) <- B1(X1,X3),B2(X2,X4),โ€ฆ,Bn(Xm).

Rule Interpretation: An Example

Tian Tan @ Nanjing University 35

person age

Xiaoming 18

Xiaohong 23

Alan 16

Abao 31

AgeAdult(person) <-Age(person,age),age >= 18.

โ€ข Consider all possible combinations of values of the variables in the subgoals

โ€ข If a combination makes all subgoals true, then the head atom (with corresponding values) is also true

โ€ข The head predicate consists of all true atoms

Rule Interpretation: An Example

Tian Tan @ Nanjing University 36

person age

Xiaoming 18

Xiaohong 23

Alan 16

Abao 31

AgeAdult(person) <-Age(person,age),age >= 18.

Age(โ€œXiaomingโ€,18),18>=18.Adult(โ€œXiaomingโ€) <-

โ€ข Consider all possible combinations of values of the variables in the subgoals

โ€ข If a combination makes all subgoals true, then the head atom (with corresponding values) is also true

โ€ข The head predicate consists of all true atoms

Rule Interpretation: An Example

Tian Tan @ Nanjing University 37

person age

Xiaoming 18

Xiaohong 23

Alan 16

Abao 31

AgeAdult(person) <-Age(person,age),age >= 18.

Age(โ€œXiaomingโ€,18),18>=18.Age(โ€œXiaohongโ€,23),23>=18.

Adult(โ€œXiaomingโ€) <-Adult(โ€œXiaohongโ€) <-

โ€ข Consider all possible combinations of values of the variables in the subgoals

โ€ข If a combination makes all subgoals true, then the head atom (with corresponding values) is also true

โ€ข The head predicate consists of all true atoms

Rule Interpretation: An Example

Tian Tan @ Nanjing University 38

person age

Xiaoming 18

Xiaohong 23

Alan 16

Abao 31

AgeAdult(person) <-Age(person,age),age >= 18.

Age(โ€œXiaomingโ€,18),18>=18.Age(โ€œXiaohongโ€,23),23>=18.Age(โ€œAlanโ€,16),16>=18.

Adult(โ€œXiaomingโ€) <-Adult(โ€œXiaohongโ€) <-

โ€ข Consider all possible combinations of values of the variables in the subgoals

โ€ข If a combination makes all subgoals true, then the head atom (with corresponding values) is also true

โ€ข The head predicate consists of all true atoms

Rule Interpretation: An Example

Tian Tan @ Nanjing University 39

person age

Xiaoming 18

Xiaohong 23

Alan 16

Abao 31

AgeAdult(person) <-Age(person,age),age >= 18.

Age(โ€œXiaomingโ€,18),18>=18.Age(โ€œXiaohongโ€,23),23>=18.Age(โ€œAlanโ€,16),16>=18.Age(โ€œAbaoโ€,31),31>=18.

Adult(โ€œXiaomingโ€) <-Adult(โ€œXiaohongโ€) <-

Adult(โ€œAbaoโ€) <-

โ€ข Consider all possible combinations of values of the variables in the subgoals

โ€ข If a combination makes all subgoals true, then the head atom (with corresponding values) is also true

โ€ข The head predicate consists of all true atoms

Rule Interpretation: An Example

Tian Tan @ Nanjing University 40

โ€ข Consider all possible combinations of values of the variables in the subgoals

โ€ข If a combination makes all subgoals true, then the head atom (with corresponding values) is also true

โ€ข The head predicate consists of all true atoms

person age

Xiaoming 18

Xiaohong 23

Alan 16

Abao 31

Age

Adult(person) <-Age(person,age),age >= 18.

person

Xiaoming

Xiaohong

Abao

Adult

Datalog program = Facts + Rules

Rule Interpretation: An Example

Tian Tan @ Nanjing University 41

โ€ข Consider all possible combinations of values of the variables in the subgoals

โ€ข If a combination makes all subgoals true, then the head atom (with corresponding values) is also true

โ€ข The head predicate consists of all true atoms

person age

Xiaoming 18

Xiaohong 23

Alan 16

Abao 31

Age

Adult(person) <-Age(person,age),age >= 18.

person

Xiaoming

Xiaohong

Abao

Adult

Datalog program = Facts + Rules

Where does initial data come from?

EDB and IDB PredicatesConventionally, predicates in Datalog are divided into two kinds:

1. EDB (extensional database)โ€ข The predicates that are defined in a priori

โ€ข Relations are immutable

โ€ข Can be seen as input relations

2. IDB (intensional database)โ€ข The predicates that are established only by rules

โ€ข Relations are inferred by rules

โ€ข Can be seen as output relations

Tian Tan @ Nanjing University 42

EDB and IDB PredicatesConventionally, predicates in Datalog are divided into two kinds:

1. EDB (extensional database)โ€ข The predicates that are defined in a priori

โ€ข Relations are immutable

โ€ข Can be seen as input relations

2. IDB (intensional database)โ€ข The predicates that are established only by rules

โ€ข Relations are inferred by rules

โ€ข Can be seen as output relations

Tian Tan @ Nanjing University 43

H <- B1,B2,โ€ฆ,Bn.

โ€ข H can only be IDBโ€ข Bi can be EDB or IDB

Logical Or

There are two ways to express logical or in Datalog

1. Write multiple rules with the same head

2. Use logical or operator โ€œ;โ€

Tian Tan @ Nanjing University 44

person hobby

Xiaoming cooking

Xiaoming singing

Xiaohong jogging

Abao sleeping

Alan swimming

โ€ฆ โ€ฆ

HobbySportFan(person) <- Hobby(person, โ€œjoggingโ€).SportFan(person) <- Hobby(person,โ€œswimmingโ€).

SportFan(person) <-Hobby(person,โ€œjoggingโ€);Hobby(person,โ€œswimmingโ€).

Logical Or

There are two ways to express logical or in Datalog

1. Write multiple rules with the same head

2. Use logical or operator โ€œ;โ€

Tian Tan @ Nanjing University 45

person hobby

Xiaoming cooking

Xiaoming singing

Xiaohong jogging

Abao sleeping

Alan swimming

โ€ฆ โ€ฆ

Hobby

The precedence of โ€œ;โ€ (or) is lower than โ€œ,โ€ (and), so disjunctions may be enclosed by parentheses, e.g., H <- A,(B;C).

SportFan(person) <- Hobby(person, โ€œjoggingโ€).SportFan(person) <- Hobby(person,โ€œswimmingโ€).

SportFan(person) <-Hobby(person,โ€œjoggingโ€);Hobby(person,โ€œswimmingโ€).

Negation

โ€ข In Datalog rules, a subgoal can be a negated atom, which negates its meaning

โ€ข Negated subgoal is written as !B(โ€ฆ), and read as not B(โ€ฆ)

Tian Tan @ Nanjing University 46

H(X1,X2) <- B1(X1,X3),!B2(X2,X4),โ€ฆ,Bn(Xm).

Negation

โ€ข In Datalog rules, a subgoal can be a negated atom, which negates its meaning

โ€ข Negated subgoal is written as !B(โ€ฆ), and read as not B(โ€ฆ)

โ€ข For example, to compute the students who need to take a make-up exam, we can write

Tian Tan @ Nanjing University 47

H(X1,X2) <- B1(X1,X3),!B2(X2,X4),โ€ฆ,Bn(Xm).

MakeupExamStd(student) <-Student(student),!PassedStd(student).

Where Student stores all students, and PassedStd stores the students who passed the exam.

Recursion

โ€ข Datalog supports recursive rules, which allows that an IDB predicate can be deduced (directly/indirectly) from itself

Tian Tan @ Nanjing University 48

Recursion

โ€ข Datalog supports recursive rules, which allows that an IDB predicate can be deduced (directly/indirectly) from itself

โ€ข For example, we can compute the reachability information (i.e., transitive closure) of a graph with recursive rules:

Tian Tan @ Nanjing University 49

Reach(from, to) <-Edge(from, to).

Reach(from, to) <-Reach(from, node),Edge(node, to).

Where Edge(a,b) means that the graph has an edge from node a to node b,and Reach(a,b) means that b is reachable from a.

Recursion (Cont.)

โ€ข Without recursion, Datalog can only express the queries of basic relational algebraโ€ข Basically a SQL with SELECT-FROM-WHERE

โ€ข With recursion, Datalog becomes much more powerful, and is able to express sophisticated program analyses, such as pointer analysis

Tian Tan @ Nanjing University 50

Rule Safety

Are these rules ok?

Tian Tan @ Nanjing University 51

A(x) <- B(y), x > y. A(x) <- B(y), !C(x,y).

Rule Safety

Are these rules ok?

Tian Tan @ Nanjing University 52

A(x) <- B(y), x > y. A(x) <- B(y), !C(x,y).

For both rules, infinite values of x can satisfy the rule,which makes A an infinite relation.

Rule Safety

Are these rules ok?

โ€ข A rule is safe if every variable appears in at least one non-negated relational atom

โ€ข Above two rules are unsafe

โ€ข In Datalog, only safe rules are allowed

Tian Tan @ Nanjing University 53

A(x) <- B(y), x > y. A(x) <- B(y), !C(x,y).

For both rules, infinite values of x can satisfy the rule,which makes A an infinite relation.

Recursion and Negation

Is this rule ok?

Tian Tan @ Nanjing University 54

A(x) <- B(x), !A(x)

Recursion and Negation

Is this rule ok?

Tian Tan @ Nanjing University 55

A(x) <- B(x), !A(x)

Suppose B(1) is true.If A(1) is false, then A(1) is true.If A(1) is true, A(1) should not be true.โ€ฆ

Recursion and Negation

Is this rule ok?

The rule is contradictory and makes no sense

In Datalog, recursion and negation of an atom must be separated. Otherwise, the rules may contain contradiction and the inference fails to converge.

Tian Tan @ Nanjing University 56

A(x) <- B(x), !A(x)

Suppose B(1) is true.If A(1) is false, then A(1) is true.If A(1) is true, A(1) should not be true.โ€ฆ

Execution of Datalog Programs

โ€ข Datalog engine deduces facts by given rules and EDB predicates until no new facts can be deduced. Some modern Datalog engines

LogicBlox, Soufflรฉ, XSB, Datomic, Flora-2, โ€ฆ

Tian Tan @ Nanjing University 57

EDB

Rules

IDB

Datalog engine

Execution of Datalog Programs

โ€ข Datalog engine deduces facts by given rules and EDB predicates until no new facts can be deduced. Some modern Datalog engines

LogicBlox, Soufflรฉ, XSB, Datomic, Flora-2, โ€ฆ

โ€ข Monotonicity: Datalog is monotone as facts cannot be deleted

Tian Tan @ Nanjing University 58

EDB

Rules

IDB

Datalog engine

Execution of Datalog Programs

โ€ข Datalog engine deduces facts by given rules and EDB predicates until no new facts can be deduced. Some modern Datalog engines

LogicBlox, Soufflรฉ, XSB, Datomic, Flora-2, โ€ฆ

โ€ข Monotonicity: Datalog is monotone as facts cannot be deleted

โ€ข Termination: A Datalog program always terminates as

1) Datalog is monotone

2) Possible values of IDB predicates are finite (rule safety)

Tian Tan @ Nanjing University 59

EDB

Rules

IDB

Datalog engine

1. Motivation

2. Introduction to Datalog

3. Pointer Analysis via Datalog

4. Taint Analysis via Datalog

Tian Tan @ Nanjing University 60

Contents

Pointer Analysis via Datalog

โ€ข EDB: pointer-relevant information that can be extracted from program syntactically

โ€ข IDB: pointer analysis results

โ€ข Rules: pointer analysis rules

Tian Tan @ Nanjing University 61

Pointer Analysis via Datalog

โ€ข EDB: pointer-relevant information that can be extracted from program syntactically

โ€ข IDB: pointer analysis results

โ€ข Rules: pointer analysis rules

Tian Tan @ Nanjing University 62

New x = new T()

Assign x = y

Store x.f = y

Load y = x.f

Call r = x.k(a, โ€ฆ) Then discuss method calls later

First focus on these statements(suppose the program has just one method)

Datalog Model for Pointer Analysis

Kind Statement

New i: x = new T()

Assign x = y

Store x.f = y

Load y = x.f

Tian Tan @ Nanjing University 63

New(x : V, o : O)

Assign(x : V, y : V)

Load(y : V, x : V, f : F)

Store(x : V, f : F, y : V)

Variables: V

Fields: F

Objects: O

VarPointsTo(v: V, o : O)

FieldPointsTo(oi : O, f: V, oj : O)

EDB

IDB

e.g., fact VarPointsTo(๐‘ฅ,๐‘œ๐‘–) represents ๐‘œ๐‘– โˆˆ ๐‘๐‘ก(๐‘ฅ)

e.g., fact FieldsPointsTo(๐‘œ๐‘–,๐‘“,๐‘œ๐‘—) represents ๐‘œ๐‘— โˆˆ ๐‘๐‘ก(๐‘œ๐‘– . ๐‘“)

An Example

Tian Tan @ Nanjing University 64

1 b = new C();2 a = b;3 c = new C();4 c.f = a;5 d = c;6 c.f = d;7 e = d.f;

Variables: V

Fields: F

Objects: O

An Example

Tian Tan @ Nanjing University 65

1 b = new C();2 a = b;3 c = new C();4 c.f = a;5 d = c;6 c.f = d;7 e = d.f;

New(x : V, o : O)

New

๐‘ ๐‘œ1

๐‘ ๐‘œ3

Variables: V

Fields: F

Objects: O

An Example

Tian Tan @ Nanjing University 66

1 b = new C();2 a = b;3 c = new C();4 c.f = a;5 d = c;6 c.f = d;7 e = d.f;

New(x : V, o : O)

Assign(x : V, y : V)

New

๐‘ ๐‘œ1

๐‘ ๐‘œ3

Assign

๐‘Ž ๐‘

๐‘‘ ๐‘

Variables: V

Fields: F

Objects: O

An Example

Tian Tan @ Nanjing University 67

1 b = new C();2 a = b;3 c = new C();4 c.f = a;5 d = c;6 c.f = d;7 e = d.f;

New(x : V, o : O)

Assign(x : V, y : V)

Store(x : V, f : F, y : V)

New

๐‘ ๐‘œ1

๐‘ ๐‘œ3

Assign

๐‘Ž ๐‘

๐‘‘ ๐‘

Store

๐‘ ๐‘“ ๐‘Ž

๐‘ ๐‘“ ๐‘‘Variables: V

Fields: F

Objects: O

An Example

Tian Tan @ Nanjing University 68

1 b = new C();2 a = b;3 c = new C();4 c.f = a;5 d = c;6 c.f = d;7 e = d.f;

New(x : V, o : O)

Assign(x : V, y : V)

Load(x : V, y : V, f : F)

Store(x : V, f : F, y : V)

New

๐‘ ๐‘œ1

๐‘ ๐‘œ3

Assign

๐‘Ž ๐‘

๐‘‘ ๐‘

Store

๐‘ ๐‘“ ๐‘Ž

๐‘ ๐‘“ ๐‘‘

Load

๐‘’ ๐‘‘ ๐‘“

Variables: V

Fields: F

Objects: O

An Example

Tian Tan @ Nanjing University 69

1 b = new C();2 a = b;3 c = new C();4 c.f = a;5 d = c;6 c.f = d;7 e = d.f;

New(x : V, o : O)

Assign(x : V, y : V)

Load(x : V, y : V, f : F)

Store(x : V, f : F, y : V)

New

๐‘ ๐‘œ1

๐‘ ๐‘œ3

Assign

๐‘Ž ๐‘

๐‘‘ ๐‘

Store

๐‘ ๐‘“ ๐‘Ž

๐‘ ๐‘“ ๐‘‘

Load

๐‘’ ๐‘‘ ๐‘“

Variables: V

Fields: F

Objects: O

Datalog Rules for Pointer Analysis

Tian Tan @ Nanjing University 70

VarPointsTo(x, o) <-New(x, o).

VarPointsTo(x, o) <-Assign(x, y),VarPointsTo(y, o).

FieldPointsTo(oi, f, oj) <-Store(x, f, y),VarPointsTo(x, oi),VarPointsTo(y, oj).

VarPointsTo(y, oj) <-Load(y, x, f),VarPointsTo(x, oi),FieldPointsTo(oi, f, oj).

Kind Statement Rule

New i: x = new T() ๐‘œ๐‘– โˆˆ ๐‘๐‘ก(๐‘ฅ)

Assign x = y๐‘œ๐‘– โˆˆ ๐‘๐‘ก(๐‘ฆ)

๐‘œ๐‘– โˆˆ ๐‘๐‘ก(๐‘ฅ)

Store x.f = y๐‘œ๐‘– โˆˆ ๐‘๐‘ก ๐‘ฅ

๐‘œ๐‘— โˆˆ ๐‘๐‘ก ๐‘ฆ

๐‘œ๐‘— โˆˆ ๐‘๐‘ก(๐‘œ๐‘– . ๐‘“)

Load y = x.f๐‘œ๐‘– โˆˆ ๐‘๐‘ก ๐‘ฅ

๐‘œ๐‘— โˆˆ ๐‘๐‘ก ๐‘œ๐‘– . ๐‘“

๐‘œ๐‘— โˆˆ ๐‘๐‘ก(๐‘ฆ)

Datalog Rules for Pointer Analysis

Tian Tan @ Nanjing University 71

VarPointsTo(x, o) <-New(x, o).

VarPointsTo(x, o) <-Assign(x, y),VarPointsTo(y, o).

FieldPointsTo(oi, f, oj) <-Store(x, f, y),VarPointsTo(x, oi),VarPointsTo(y, oj).

VarPointsTo(y, oj) <-Load(y, x, f),VarPointsTo(x, oi),FieldPointsTo(oi, f, oj).

Kind Statement Rule

New i: x = new T() ๐‘œ๐‘– โˆˆ ๐‘๐‘ก(๐‘ฅ)

Assign x = y๐‘œ๐‘– โˆˆ ๐‘๐‘ก(๐‘ฆ)

๐‘œ๐‘– โˆˆ ๐‘๐‘ก(๐‘ฅ)

Store x.f = y๐‘œ๐‘– โˆˆ ๐‘๐‘ก ๐‘ฅ

๐‘œ๐‘— โˆˆ ๐‘๐‘ก ๐‘ฆ

๐‘œ๐‘— โˆˆ ๐‘๐‘ก(๐‘œ๐‘– . ๐‘“)

Load y = x.f๐‘œ๐‘– โˆˆ ๐‘๐‘ก ๐‘ฅ

๐‘œ๐‘— โˆˆ ๐‘๐‘ก ๐‘œ๐‘– . ๐‘“

๐‘œ๐‘— โˆˆ ๐‘๐‘ก(๐‘ฆ)

Datalog Rules for Pointer Analysis

Tian Tan @ Nanjing University 72

VarPointsTo(x, o) <-New(x, o).

VarPointsTo(x, o) <-Assign(x, y),VarPointsTo(y, o).

FieldPointsTo(oi, f, oj) <-Store(x, f, y),VarPointsTo(x, oi),VarPointsTo(y, oj).

VarPointsTo(y, oj) <-Load(y, x, f),VarPointsTo(x, oi),FieldPointsTo(oi, f, oj).

Kind Statement Rule

New i: x = new T() ๐‘œ๐‘– โˆˆ ๐‘๐‘ก(๐‘ฅ)

Assign x = y๐‘œ๐‘– โˆˆ ๐‘๐‘ก(๐‘ฆ)

๐‘œ๐‘– โˆˆ ๐‘๐‘ก(๐‘ฅ)

Store x.f = y๐‘œ๐‘– โˆˆ ๐‘๐‘ก ๐‘ฅ

๐‘œ๐‘— โˆˆ ๐‘๐‘ก ๐‘ฆ

๐‘œ๐‘— โˆˆ ๐‘๐‘ก(๐‘œ๐‘– . ๐‘“)

Load y = x.f๐‘œ๐‘– โˆˆ ๐‘๐‘ก ๐‘ฅ

๐‘œ๐‘— โˆˆ ๐‘๐‘ก ๐‘œ๐‘– . ๐‘“

๐‘œ๐‘— โˆˆ ๐‘๐‘ก(๐‘ฆ)

Datalog Rules for Pointer Analysis

Tian Tan @ Nanjing University 73

VarPointsTo(x, o) <-New(x, o).

VarPointsTo(x, o) <-Assign(x, y),VarPointsTo(y, o).

FieldPointsTo(oi, f, oj) <-Store(x, f, y),VarPointsTo(x, oi),VarPointsTo(y, oj).

VarPointsTo(y, oj) <-Load(y, x, f),VarPointsTo(x, oi),FieldPointsTo(oi, f, oj).

Kind Statement Rule

New i: x = new T() ๐‘œ๐‘– โˆˆ ๐‘๐‘ก(๐‘ฅ)

Assign x = y๐‘œ๐‘– โˆˆ ๐‘๐‘ก(๐‘ฆ)

๐‘œ๐‘– โˆˆ ๐‘๐‘ก(๐‘ฅ)

Store x.f = y๐‘œ๐‘– โˆˆ ๐‘๐‘ก ๐‘ฅ

๐‘œ๐‘— โˆˆ ๐‘๐‘ก ๐‘ฆ

๐‘œ๐‘— โˆˆ ๐‘๐‘ก(๐‘œ๐‘– . ๐‘“)

Load y = x.f๐‘œ๐‘– โˆˆ ๐‘๐‘ก ๐‘ฅ

๐‘œ๐‘— โˆˆ ๐‘๐‘ก ๐‘œ๐‘– . ๐‘“

๐‘œ๐‘— โˆˆ ๐‘๐‘ก(๐‘ฆ)

Datalog Rules for Pointer Analysis

Tian Tan @ Nanjing University 74

VarPointsTo(x, o) <-New(x, o).

VarPointsTo(x, o) <-Assign(x, y),VarPointsTo(y, o).

FieldPointsTo(oi, f, oj) <-Store(x, f, y),VarPointsTo(x, oi),VarPointsTo(y, oj).

VarPointsTo(y, oj) <-Load(y, x, f),VarPointsTo(x, oi),FieldPointsTo(oi, f, oj).

Kind Statement Rule

New i: x = new T() ๐‘œ๐‘– โˆˆ ๐‘๐‘ก(๐‘ฅ)

Assign x = y๐‘œ๐‘– โˆˆ ๐‘๐‘ก(๐‘ฆ)

๐‘œ๐‘– โˆˆ ๐‘๐‘ก(๐‘ฅ)

Store x.f = y๐‘œ๐‘– โˆˆ ๐‘๐‘ก ๐‘ฅ

๐‘œ๐‘— โˆˆ ๐‘๐‘ก ๐‘ฆ

๐‘œ๐‘— โˆˆ ๐‘๐‘ก(๐‘œ๐‘– . ๐‘“)

Load y = x.f๐‘œ๐‘– โˆˆ ๐‘๐‘ก ๐‘ฅ

๐‘œ๐‘— โˆˆ ๐‘๐‘ก ๐‘œ๐‘– . ๐‘“

๐‘œ๐‘— โˆˆ ๐‘๐‘ก(๐‘ฆ)

An Example

Tian Tan @ Nanjing University 75

1 b = new C();2 a = b;3 c = new C();4 c.f = a;5 d = c;6 c.f = d;7 e = d.f;

VarPointsTo(x, o) <-New(x, o).

VarPointsTo(x, o) <-Assign(x, y),VarPointsTo(y, o).

FieldPointsTo(oi, f, oj) <-Store(x, f, y),VarPointsTo(x, oi),VarPointsTo(y, oj).

VarPointsTo(y, oj) <-Load(y, x, f),VarPointsTo(x, oi),FieldPointsTo(oi, f, oj).

New

๐‘ ๐‘œ1

๐‘ ๐‘œ3

Assign

๐‘Ž ๐‘

๐‘‘ ๐‘

Store

๐‘ ๐‘“ ๐‘Ž

๐‘ ๐‘“ ๐‘‘

Load

๐‘’ ๐‘‘ ๐‘“

VarPointsTo FieldPointsTo

VarPointsTo(v:V, o:O)

FieldPointsTo(oi:O, f:F, oj:O)

New(x:V, o:O)

Assign(x:V, y:V) Load(x:V, y:V, f:F)

Store(x:V, f:F, y:V)

An Example

Tian Tan @ Nanjing University 76

1 b = new C();2 a = b;3 c = new C();4 c.f = a;5 d = c;6 c.f = d;7 e = d.f;

VarPointsTo(x, o) <-New(x, o).

VarPointsTo(x, o) <-Assign(x, y),VarPointsTo(y, o).

FieldPointsTo(oi, f, oj) <-Store(x, f, y),VarPointsTo(x, oi),VarPointsTo(y, oj).

VarPointsTo(y, oj) <-Load(y, x, f),VarPointsTo(x, oi),FieldPointsTo(oi, f, oj).

New

๐‘ ๐‘œ1

๐‘ ๐‘œ3

Assign

๐‘Ž ๐‘

๐‘‘ ๐‘

Store

๐‘ ๐‘“ ๐‘Ž

๐‘ ๐‘“ ๐‘‘

Load

๐‘’ ๐‘‘ ๐‘“

VarPointsTo

๐‘ ๐‘œ1

๐‘ ๐‘œ3

FieldPointsTo

VarPointsTo(v:V, o:O)

FieldPointsTo(oi:O, f:F, oj:O)

New(x:V, o:O)

Assign(x:V, y:V) Load(x:V, y:V, f:F)

Store(x:V, f:F, y:V)

VarPointsTo(๐‘,๐‘œ1) <-New(๐‘,๐‘œ1).

VarPointsTo(๐‘,๐‘œ3) <-New(๐‘,๐‘œ3).

An Example

Tian Tan @ Nanjing University 77

1 b = new C();2 a = b;3 c = new C();4 c.f = a;5 d = c;6 c.f = d;7 e = d.f;

VarPointsTo(x, o) <-New(x, o).

VarPointsTo(x, o) <-Assign(x, y),VarPointsTo(y, o).

FieldPointsTo(oi, f, oj) <-Store(x, f, y),VarPointsTo(x, oi),VarPointsTo(y, oj).

VarPointsTo(y, oj) <-Load(y, x, f),VarPointsTo(x, oi),FieldPointsTo(oi, f, oj).

New

๐‘ ๐‘œ1

๐‘ ๐‘œ3

Assign

๐‘Ž ๐‘

๐‘‘ ๐‘

Store

๐‘ ๐‘“ ๐‘Ž

๐‘ ๐‘“ ๐‘‘

Load

๐‘’ ๐‘‘ ๐‘“

VarPointsTo

๐‘ ๐‘œ1

๐‘ ๐‘œ3

๐‘Ž ๐‘œ1

FieldPointsTo

VarPointsTo(v:V, o:O)

FieldPointsTo(oi:O, f:F, oj:O)

New(x:V, o:O)

Assign(x:V, y:V) Load(x:V, y:V, f:F)

Store(x:V, f:F, y:V)

VarPointsTo(๐‘Ž,๐‘œ1) <-Assign(๐‘Ž,๐‘),VarPointsTo(๐‘,๐‘œ1).

An Example

Tian Tan @ Nanjing University 78

1 b = new C();2 a = b;3 c = new C();4 c.f = a;5 d = c;6 c.f = d;7 e = d.f;

VarPointsTo(x, o) <-New(x, o).

VarPointsTo(x, o) <-Assign(x, y),VarPointsTo(y, o).

FieldPointsTo(oi, f, oj) <-Store(x, f, y),VarPointsTo(x, oi),VarPointsTo(y, oj).

VarPointsTo(y, oj) <-Load(y, x, f),VarPointsTo(x, oi),FieldPointsTo(oi, f, oj).

New

๐‘ ๐‘œ1

๐‘ ๐‘œ3

Assign

๐‘Ž ๐‘

๐‘‘ ๐‘

Store

๐‘ ๐‘“ ๐‘Ž

๐‘ ๐‘“ ๐‘‘

Load

๐‘’ ๐‘‘ ๐‘“

VarPointsTo

๐‘ ๐‘œ1

๐‘ ๐‘œ3

๐‘Ž ๐‘œ1

๐‘‘ ๐‘œ3

FieldPointsTo

VarPointsTo(v:V, o:O)

FieldPointsTo(oi:O, f:F, oj:O)

New(x:V, o:O)

Assign(x:V, y:V) Load(x:V, y:V, f:F)

Store(x:V, f:F, y:V)

An Example

Tian Tan @ Nanjing University 79

1 b = new C();2 a = b;3 c = new C();4 c.f = a;5 d = c;6 c.f = d;7 e = d.f;

VarPointsTo(x, o) <-New(x, o).

VarPointsTo(x, o) <-Assign(x, y),VarPointsTo(y, o).

FieldPointsTo(oi, f, oj) <-Store(x, f, y),VarPointsTo(x, oi),VarPointsTo(y, oj).

VarPointsTo(y, oj) <-Load(y, x, f),VarPointsTo(x, oi),FieldPointsTo(oi, f, oj).

New

๐‘ ๐‘œ1

๐‘ ๐‘œ3

Assign

๐‘Ž ๐‘

๐‘‘ ๐‘

Store

๐‘ ๐‘“ ๐‘Ž

๐‘ ๐‘“ ๐‘‘

Load

๐‘’ ๐‘‘ ๐‘“

VarPointsTo

๐‘ ๐‘œ1

๐‘ ๐‘œ3

๐‘Ž ๐‘œ1

๐‘‘ ๐‘œ3

VarPointsTo(v:V, o:O)

FieldPointsTo(oi:O, f:F, oj:O)

New(x:V, o:O)

Assign(x:V, y:V) Load(x:V, y:V, f:F)

Store(x:V, f:F, y:V)

FieldPointsTo

๐‘œ3 ๐‘“ ๐‘œ1

FieldPointsTo(๐‘œ1,๐‘“, ๐‘œ3) <-Store(๐‘,๐‘“,๐‘Ž),VarPointsTo(๐‘,๐‘œ3),VarPointsTo(๐‘Ž,๐‘œ1).

An Example

Tian Tan @ Nanjing University 80

1 b = new C();2 a = b;3 c = new C();4 c.f = a;5 d = c;6 c.f = d;7 e = d.f;

VarPointsTo(x, o) <-New(x, o).

VarPointsTo(x, o) <-Assign(x, y),VarPointsTo(y, o).

FieldPointsTo(oi, f, oj) <-Store(x, f, y),VarPointsTo(x, oi),VarPointsTo(y, oj).

VarPointsTo(y, oj) <-Load(y, x, f),VarPointsTo(x, oi),FieldPointsTo(oi, f, oj).

New

๐‘ ๐‘œ1

๐‘ ๐‘œ3

Assign

๐‘Ž ๐‘

๐‘‘ ๐‘

Store

๐‘ ๐‘“ ๐‘Ž

๐‘ ๐‘“ ๐‘‘

Load

๐‘’ ๐‘‘ ๐‘“

VarPointsTo

๐‘ ๐‘œ1

๐‘ ๐‘œ3

๐‘Ž ๐‘œ1

๐‘‘ ๐‘œ3

VarPointsTo(v:V, o:O)

FieldPointsTo(oi:O, f:F, oj:O)

New(x:V, o:O)

Assign(x:V, y:V) Load(x:V, y:V, f:F)

Store(x:V, f:F, y:V)

FieldPointsTo

๐‘œ3 ๐‘“ ๐‘œ1

๐‘œ3 ๐‘“ ๐‘œ3

An Example

Tian Tan @ Nanjing University 81

1 b = new C();2 a = b;3 c = new C();4 c.f = a;5 d = c;6 c.f = d;7 e = d.f;

VarPointsTo(x, o) <-New(x, o).

VarPointsTo(x, o) <-Assign(x, y),VarPointsTo(y, o).

FieldPointsTo(oi, f, oj) <-Store(x, f, y),VarPointsTo(x, oi),VarPointsTo(y, oj).

VarPointsTo(y, oj) <-Load(y, x, f),VarPointsTo(x, oi),FieldPointsTo(oi, f, oj).

New

๐‘ ๐‘œ1

๐‘ ๐‘œ3

Assign

๐‘Ž ๐‘

๐‘‘ ๐‘

Store

๐‘ ๐‘“ ๐‘Ž

๐‘ ๐‘“ ๐‘‘

Load

๐‘’ ๐‘‘ ๐‘“

VarPointsTo

๐‘ ๐‘œ1

๐‘ ๐‘œ3

๐‘Ž ๐‘œ1

๐‘‘ ๐‘œ3

๐‘’ ๐‘œ1

๐‘’ ๐‘œ3

VarPointsTo(v:V, o:O)

FieldPointsTo(oi:O, f:F, oj:O)

New(x:V, o:O)

Assign(x:V, y:V) Load(x:V, y:V, f:F)

Store(x:V, f:F, y:V)

FieldPointsTo

๐‘œ3 ๐‘“ ๐‘œ1

๐‘œ3 ๐‘“ ๐‘œ3

An Example

Tian Tan @ Nanjing University 82

1 b = new C();2 a = b;3 c = new C();4 c.f = a;5 d = c;6 c.f = d;7 e = d.f;

New

๐‘ ๐‘œ1

๐‘ ๐‘œ3

Assign

๐‘Ž ๐‘

๐‘‘ ๐‘

Store

๐‘ ๐‘“ ๐‘Ž

๐‘ ๐‘“ ๐‘‘

Load

๐‘’ ๐‘‘ ๐‘“

VarPointsTo

๐‘ ๐‘œ1

๐‘ ๐‘œ3

๐‘Ž ๐‘œ1

๐‘‘ ๐‘œ3

๐‘’ ๐‘œ1

๐‘’ ๐‘œ3

FieldPointsTo

๐‘œ3 ๐‘“ ๐‘œ1

๐‘œ3 ๐‘“ ๐‘œ3

VarPointsTo(x, o) <-New(x, o).

VarPointsTo(x, o) <-Assign(x, y),VarPointsTo(y, o).

FieldPointsTo(oi, f, oj) <-Store(x, f, y),VarPointsTo(x, oi),VarPointsTo(y, oj).

VarPointsTo(y, oj) <-Load(y, x, f),VarPointsTo(x, oi),FieldPointsTo(oi, f, oj).

VarPointsTo(v:V, o:O)

FieldPointsTo(oi:O, f:F, oj:O)

New(x:V, o:O)

Assign(x:V, y:V) Load(x:V, y:V, f:F)

Store(x:V, f:F, y:V)

Handle Method Calls

Tian Tan @ Nanjing University 83

Kind Statement Rule

Call l: r = x.k(a1,โ€ฆ,an)

๐‘œ๐‘– โˆˆ ๐‘๐‘ก ๐‘ฅ , ๐‘š = Dispatch(๐‘œ๐‘– , k)

๐‘œ๐‘ข โˆˆ ๐‘๐‘ก ๐‘Ž๐‘— , 1 โ‰ค ๐‘— โ‰ค ๐‘›๐‘œ๐‘ฃ โˆˆ ๐‘๐‘ก(๐‘š๐‘Ÿ๐‘’๐‘ก)๐‘œ๐‘– โˆˆ ๐‘๐‘ก(๐‘š๐‘กโ„Ž๐‘–๐‘ )

๐‘œ๐‘ข โˆˆ ๐‘๐‘ก ๐‘š๐‘๐‘— , 1 โ‰ค ๐‘— โ‰ค ๐‘›

๐‘œ๐‘ฃ โˆˆ ๐‘๐‘ก(๐‘Ÿ)

EDBโ€ข VCall(l:S, x:V, k:M)โ€ข Dispatch(o:O, k:M, m:M)โ€ข ThisVar(m:M, this:V)

IDBโ€ข Reachable(m:M)โ€ข CallGraph(l:S, m:M)

Statements (Labels):

S

Methods: M

Handle Method Calls

Tian Tan @ Nanjing University 84

Kind Statement Rule

Call l: r = x.k(a1,โ€ฆ,an)

๐‘œ๐‘– โˆˆ ๐‘๐‘ก ๐‘ฅ , ๐‘š = Dispatch(๐‘œ๐‘– , k)

๐‘œ๐‘ข โˆˆ ๐‘๐‘ก ๐‘Ž๐‘— , 1 โ‰ค ๐‘— โ‰ค ๐‘›๐‘œ๐‘ฃ โˆˆ ๐‘๐‘ก(๐‘š๐‘Ÿ๐‘’๐‘ก)๐‘œ๐‘– โˆˆ ๐‘๐‘ก(๐‘š๐‘กโ„Ž๐‘–๐‘ )

๐‘œ๐‘ข โˆˆ ๐‘๐‘ก ๐‘š๐‘๐‘— , 1 โ‰ค ๐‘— โ‰ค ๐‘›

๐‘œ๐‘ฃ โˆˆ ๐‘๐‘ก(๐‘Ÿ)

VarPointsTo(this, o),Reachable(m),CallGraph(l, m) <-

VCall(l, x, k),VarPointsTo(x, o),Dispatch(o, k, m),ThisVar(m, this).

EDBโ€ข VCall(l:S, x:V, k:M)โ€ข Dispatch(o:O, k:M, m:M)โ€ข ThisVar(m:M, this:V)

IDBโ€ข Reachable(m:M)โ€ข CallGraph(l:S, m:M)

Statements (Labels):

S

Methods: M

Handle Method Calls

Tian Tan @ Nanjing University 85

Kind Statement Rule

Call l: r = x.k(a1,โ€ฆ,an)

๐‘œ๐‘– โˆˆ ๐‘๐‘ก ๐‘ฅ , ๐‘š = Dispatch(๐‘œ๐‘– , k)

๐‘œ๐‘ข โˆˆ ๐‘๐‘ก ๐‘Ž๐‘— , 1 โ‰ค ๐‘— โ‰ค ๐‘›๐‘œ๐‘ฃ โˆˆ ๐‘๐‘ก(๐‘š๐‘Ÿ๐‘’๐‘ก)๐‘œ๐‘– โˆˆ ๐‘๐‘ก(๐‘š๐‘กโ„Ž๐‘–๐‘ )

๐‘œ๐‘ข โˆˆ ๐‘๐‘ก ๐‘š๐‘๐‘— , 1 โ‰ค ๐‘— โ‰ค ๐‘›

๐‘œ๐‘ฃ โˆˆ ๐‘๐‘ก(๐‘Ÿ)

VarPointsTo(pi, o) <-CallGraph(l, m),Argument(l, i, ai),Parameter(m, i, pi),VarPointsTo(ai, o).

EDBโ€ข Argument(l:S, i:N, ai:V)โ€ข Parameter(m:M, i:N, pi:V)

Statements (Labels):

S

Methods: M

Nature numbers(indexes)

N

Handle Method Calls

Tian Tan @ Nanjing University 86

Kind Statement Rule

Call l: r = x.k(a1,โ€ฆ,an)

๐‘œ๐‘– โˆˆ ๐‘๐‘ก ๐‘ฅ , ๐‘š = Dispatch(๐‘œ๐‘– , k)

๐‘œ๐‘ข โˆˆ ๐‘๐‘ก ๐‘Ž๐‘— , 1 โ‰ค ๐‘— โ‰ค ๐‘›๐‘œ๐‘ฃ โˆˆ ๐‘๐‘ก(๐‘š๐‘Ÿ๐‘’๐‘ก)๐‘œ๐‘– โˆˆ ๐‘๐‘ก(๐‘š๐‘กโ„Ž๐‘–๐‘ )

๐‘œ๐‘ข โˆˆ ๐‘๐‘ก ๐‘š๐‘๐‘— , 1 โ‰ค ๐‘— โ‰ค ๐‘›

๐‘œ๐‘ฃ โˆˆ ๐‘๐‘ก(๐‘Ÿ)

VarPointsTo(r, o) <-CallGraph(l, m),MethodReturn(m, ret),VarPointsTo(ret, o),CallReturn(l, r).

EDBโ€ข MethodReturn(m:M, ret:V)โ€ข CallReturn(l:S, r:V)

Statements (Labels):

S

Methods: M

Handle Method Calls

Tian Tan @ Nanjing University 87

Kind Statement Rule

Call l: r = x.k(a1,โ€ฆ,an)

๐‘œ๐‘– โˆˆ ๐‘๐‘ก ๐‘ฅ , ๐‘š = Dispatch(๐‘œ๐‘– , k)

๐‘œ๐‘ข โˆˆ ๐‘๐‘ก ๐‘Ž๐‘— , 1 โ‰ค ๐‘— โ‰ค ๐‘›๐‘œ๐‘ฃ โˆˆ ๐‘๐‘ก(๐‘š๐‘Ÿ๐‘’๐‘ก)๐‘œ๐‘– โˆˆ ๐‘๐‘ก(๐‘š๐‘กโ„Ž๐‘–๐‘ )

๐‘œ๐‘ข โˆˆ ๐‘๐‘ก ๐‘š๐‘๐‘— , 1 โ‰ค ๐‘— โ‰ค ๐‘›

๐‘œ๐‘ฃ โˆˆ ๐‘๐‘ก(๐‘Ÿ)

VarPointsTo(this, o),Reachable(m),CallGraph(l, m) <-

VCall(l, x, k),VarPointsTo(x, o),Dispatch(o, k, m),ThisVar(m, this).

VarPointsTo(pi, o) <-CallGraph(l, m),Argument(l, i, ai),Parameter(m, i, pi),VarPointsTo(ai, o).

VarPointsTo(r, o) <-CallGraph(l, m),MethodReturn(m, ret),VarPointsTo(ret, o),CallReturn(l, r).

Whole-Program Pointer Analysis

Tian Tan @ Nanjing University 88

Reachable(m) <-EntryMethod(m).

VarPointsTo(x, o) <-Reachable(m),New(x, o, m).

VarPointsTo(x, o) <-Assign(x, y),VarPointsTo(y, o).

FieldPointsTo(oi, f, oj) <-Store(x, f, y),VarPointsTo(x, oi),VarPointsTo(y, oj).

VarPointsTo(y, oj) <-Load(y, x, f),VarPointsTo(x, oi),FieldPointsTo(oi, f, oj).

VarPointsTo(this, o),Reachable(m),CallGraph(l, m) <-

VCall(l, x, k),VarPointsTo(x, o),Dispatch(o, k, m),ThisVar(m, this).

VarPointsTo(pi, o) <-CallGraph(l, m),Argument(l, i, ai),Parameter(m, i, pi),VarPointsTo(ai, o).

VarPointsTo(r, o) <-CallGraph(l, m),MethodReturn(m, ret),VarPointsTo(ret, o),CallReturn(l, r).

1. Motivation

2. Introduction to Datalog

3. Pointer Analysis via Datalog

4. Taint Analysis via Datalog

89

Contents

Tian Tan @ Nanjing University

Datalog Model for Taint Analysis

On top of pointer analysis

โ€ข EDB predicatesโ€ข Source(m : M) // source methods

โ€ข Sink(m : M) // sink methods

โ€ข Taint(l : S, t : T) // associates each call site to the tainted data from the call site

โ€ข IDB predicateโ€ข TaintFlow(t : T, m : M) // detected taint flows,

e.g., TaintFlow(๐‘ก,๐‘š) denotes that tainted data ๐‘ก may flow to sink method ๐‘š

Tian Tan @ Nanjing University 90

Taint Analysis via Datalog

Tian Tan @ Nanjing University 91

Kind Statement Rule

Call l: r = x.k(a1,โ€ฆ,an)๐‘™ โ†’ ๐‘š โˆˆ ๐ถ๐บ๐‘š โˆˆ ๐‘†๐‘œ๐‘ข๐‘Ÿ๐‘๐‘’๐‘ ๐‘ก๐‘™ โˆˆ ๐‘๐‘ก(๐‘Ÿ)

โ€ข Handles sources (generates tainted data)

โ€ข Handles sinks (generates taint flow information)

Kind Statement Rule

Call l: r = x.k(a1,โ€ฆ,an)

๐‘™ โ†’ ๐‘š โˆˆ ๐ถ๐บ๐‘š โˆˆ ๐‘†๐‘–๐‘›๐‘˜๐‘ 

โˆƒ๐‘–, 1 โ‰ค ๐‘– โ‰ค ๐‘›: ๐‘ก๐‘— โˆˆ ๐‘๐‘ก(๐‘Ž๐‘–)

๐‘ก๐‘— , ๐‘š โˆˆ ๐‘‡๐‘Ž๐‘–๐‘›๐‘ก๐น๐‘™๐‘œ๐‘ค๐‘ 

VarPointsTo(r, t) <-CallGraph(l, m),Source(m),CallReturn(l, r),Taint(l, t).

TaintFlow(t, m) <-CallGraph(l, m),Sink(m),Argument(l, _, ai),VarPointsTo(ai, t),Taint(_, t).

Datalog-Based Program Analysis

โ€ข Prosโ€ข Succinct and readable

โ€ข Easy to implement

โ€ข Benefit from off-the-shelf optimized Datalog engines

โ€ข Consโ€ข Restricted expressiveness, i.e., it is impossible or

inconvenient to express some logics

โ€ข Cannot fully control performance

Tian Tan @ Nanjing University 92

TheX You Need To Understand in This Lecture

โ€ข Datalog language

โ€ข How to implement pointer analysis via Datalog

โ€ข How to implement taint analysis via Datalog

ๅ—ไบฌๅคงๅญฆ

ๆŽๆจพ

่ฐญๆทป

่ฎก็ฎ—ๆœบ็ง‘ๅญฆไธŽๆŠ€ๆœฏ็ณป

็จ‹ๅบ่ฎพ่ฎก่ฏญ่จ€

้™ๆ€ๅˆ†ๆž็ ”็ฉถ็ป„

ไธŽ

่ฝฏไปถๅˆ†ๆž