1

Red Black Trees(Guibas Sedgewick 78)

2

Goal

Keep sorted lists subject to the following operations:

find(x,L)

insert(x,L)

delete(x,L)

catenate(L1,L2) : Assumes that all items in L2 are greater than all items in L1.

split(x,L) : returns two lists one with all item less than or equal to x and the other with all items greater than x.

3

Binary search trees

Binary search tree:

•All internal nodes have degree = 2

•Items are at the leaves.

•All items in left subtree are smaller than all items in right subtree (symmetric order)

12

10985

4

4

Red Black trees - definition

Binary search tree

each node is colored red or black such that

1) Leaves are black

2) All paths from the root to an external node contain the same number of black nodes (black rule)

3) Any red node, if has a parent, has a black parent (red rule)

5

Red Black trees - example

6

Red Black Trees -properties

The depth is O(log n) -- prove as an excercise

==> find takes O(log n) time

How do we do the other operations and keep the trees Red-Black ?

7

Insert

8

Insert (cont)

9

Insert (cont)

10

Insert (cont)

11

Insert (cont)

12

Use rotations

x

y

B

C

y

Ax

B C

<===>

A

x

y

z

y

z x

===>

13

Insert (cont)

xy

z

y

z x

====>

14

Insert (cont)

15

Insert (cont)

16

Insert (cont)

17

Insert (cont)

18

Insert (cont)

19

Insert (cont)

20

Insert -- definition

Convert a leaf to a red internal node with two leaves.

This may create violation to property 2. To restore it we walk up towards the root applying one of the following cases (each case has a symmetric version)

21

Insert -- non terminal casesz

y

x

A B

C D E

z

y

x

A B

C D E

z

y

x

B C

A D E

===>

(1)

(2)

y

x

B C

A D E

===>

22

Insert -- terminal cases

z

y

x

A B

C D E

y

zx

A B C

z

y

x

B C

A D E

===>

(3)

(4)

x

B

x

B

===>

w

D E

w

(5)===>

w zy

A B C

D E

w

x

z

y

x

A B

C D E

w

23

Insert - analysis

O(log n) time worst case, since the height is O(log n)

Suppose you start with an empty tree and do m insertions such that the point of insertion is given to you each time, how much time does it take ?

Obviously O(mlog n),

but maybe we can prove it cannot be that bad ?

24

Amortized analysis

We are interested in the worst case running time of a sequence of operations.

Example: binary counter

single operation -- increment

000000000100010000110010000101

25

Amortized analysis (Cont.)

On the worst case increment takes O(k).

k = #digits

What is the complexity of a sequence of increments (on the worst case) ?

Define a potential of the counter:

Amortized(increment) = actual(increment) +

(c) = ?

26

Amortized analysis (Cont.)

Amortized(increment1) = actual(increment1) + 1- 0

Amortized(increment2) = actual(increment2) + 2- 1

Amortized(incrementn) = actual(incrementn) + n- (n-1)

…

…

+

iAmortized(incrementi) = iactual(incrementi) + n- 0

iAmortized(incrementi) iactual(incrementi)

if n- 0 0

27

Amortized analysis (Cont.)

Define a potential of the counter:

(c) = #(ones)

Amortized(increment) = actual(increment) +

Amortized(increment) = 1+ #(1 => 0) + 1 - #(1 => 0) = O(1)

==> Sequence of n increments takes O(n) time

28

Insert - analysis

Each time we do a color-flip-step the number of red nodes decreases by one.(tree) = #red nodes

Actual(insert) = O(1) + #color-flips-steps

(insert) = O(1) - #color-flips-steps

==> amortized(insert) = O(1)

and the sequence actually takes O(m) time.

29

Delete -- example

30

Delete -- example (cont)

-

31

Delete -- example (cont)

32

Delete -- example2 (cont)

33

Delete -- example2 (cont)

-

34

Delete -- example2 (cont)

-

35

Delete -- example2 (cont)

36

Delete -- definition

Replace the parent of the external node containing the item with the sibling subtree of the deleted item

If the parent of the deleted item is black then we create a short node

To restore the black constraint we go bottom up applying one of the following cases.

37

Delete -- fixing a short node

--

====>(1)

- ====>(2)

38

Delete -- fixing a short node (cont)

- ====>(3) x

y

z

w x

y w

z

- ====>(4) x

y

z

wA

x

yv

v

BA

-x

y

z

w

v

B

A-

wB

39

Delete -- fixing a short node (cont)

- ====>(5) x

y

z

w

yz

v

w

x v-

And apply one of the previous 3 cases.

40

Delete + insert -- analysis

O(log n) time, since the height is O(log n)

Suppose you start with an empty tree and do m insertions and deletions such that the point of insertion is given to you each time, how much time does it take ?

Obviously O(mlog n),

but maybe we can prove it cannot be that bad ?

41

Delete + insert - analysis

The previous potential won’t do the trick

(tree) = #red nodes

Here are the transformation that we want to release potential

42

Delete + insert -- analysis

--

====>

===>

===>

43

Delete + insert -- analysis

(tree) =

#( ) + 2 #( )

==> amortized(delete) = O(1)

amortized(insert) = O(1)

sequence of m delete and inserts, starting from an empty tree takes O(m) time

44

Concatenation

+ =

Define the rank of a node v as the number of black nodes from v to a leaf .

Assume T1 has a black root.

Look on the left spine of T2 for a node x of the same rank as the root of T1

T1

T2

45

Concatenation (cont)

+ =

T1

T2

x

y

Make y a child of p(x)

Continue as for insert

Allocate y make the root of T1 and x children of y.

Color y red

46

Concatenation (analysis)

O(|r1-r2| + 1) = O(log n) worst case.

If the right point on the spine of the taller tree is given then its O(1) amortized

47

Split

x

Concatenate all trees to the left of the path from the root to x to from the left tree T1 (including x).

Concatenate all trees to the right of the path from the root to x to from the right tree T2

48

Split -- analysis.

Can prove that split takes O(log n) time.