Recursion · Recursion • A recursive method is a method that contains a call to itself • Often...

53
Recursion … just in case you didn’t love loops enough …

Transcript of Recursion · Recursion • A recursive method is a method that contains a call to itself • Often...

Page 1: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

Recursion

… just in case you didn’t love loops enough …

Page 2: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

Recursion

• A recursive method is a method that contains a call to itself

• Often used as an alternative to iteration when iteration is awkward or “inelegant”

• Each recursive call is given a smaller portion of the original problem

• Last recursive call solves diminished problem without recursion

Page 3: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

Example // method writes digits of a non-negative number, stacked vertically public void write_vertical(int n) { n = Math.abs(n); if (n < 10) System.out.println(“” + n); else { write_vertical(n / 10); System.out.println(“” + n % 10); } }

Page 4: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

Tracing recursive method write_vertical

1. write_vertical(52406); 52406

2. write_vertical(n/10) ; 5240

3. write_vertical(n/10); 524

4. write_vertical(n/10); 52

5. write_vertical(n/10); 5

n value: Output:

6. System.out.println(“” + n);

5 2 4 0 6

7. System.out.println (“” + n%10);

8. System.out.println (“” + n%10);

9. System.out.println(n%10);

10. System.out.println (“” + n%10); public void write_vertical(int n) { n = Math.abs(n); if (n < 10) System.out.println(n); else { write_vertical(n / 10); System.out.println (n % 10); } }

Page 5: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

Elements of recursive method

• Base case: problem is simplified to the point where recursion becomes unnecessary: n < 10

• Variant expression: the part of the problem that changes, making the problem smaller: n

• Recursive call: method calls itself: write_vertical (n / 10);

Page 6: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

How recursion works

• Activation record: memory block that stores all the information a method needs to work: – values of local variables & parameters – where method should return to (so calling

method can resume execution)

Page 7: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

How recursion works

• When a method call is encountered, execution of current method ceases

• Information for newly called method is stored in an activation record

• Method executes

Page 8: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

How recursion works • If new method contains another method call, the

process just described repeats • Each recursive call generates its own activation

record – as each recursive call is encountered, previous

activation record is stored on run-time stack – when last call fails to generate a new activation

record, stacked calls are removed (in reverse of the order they were stored), and each process continues in succession

Page 9: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

Remember, for a recursive method to be successful ...

• Must be a problem with one or more cases in which some subtasks are simpler versions of the original problem - use recursion for these

• Must also have one or more cases in which entire computation is accomplished without recursion (base case)

Page 10: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

What is wrong with this picture?

// bad code: public int sum (int n) { if (n < 0) return n; else return n + sum(n); }

// Your corrected code:

Page 11: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

Another example: the powers method

• Suppose you wanted to find the value of Xn

• For most values of n, we can solve this iteratively using a simple loop: int answer = 1; for (int c = 1; c <= n; c++) answer *= X;

• We can take care of the cases of n=1 or n=0 with simple if statements; but what about a negative value of n?

Page 12: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

Finding a recursive solution

• We can observe that for any value of n, Xn is equal to X * X(n-1)

• Armed with this information, we can easily develop a recursive solution that covers all values of X and n

Page 13: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

Recursive power method

double rpower (double X, int n) { if (X == 0) return 0; else if (n == 0) return 1; else if (n > 0) return X * rpower(X, n-1); else // n < 0 return 1 / rpower(X, -n); }

Page 14: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

Drawing pictures with recursion

• We used ASCII art to illustrate how iteration worked – we can do the same with recursion

• For example, if we wanted to draw a line using several instances of a single character, we could write a loop like the one below: for (int x = lineLen; x > 0; x--) System.out.print(“$ ”);

• We can do the same task recursively; see next slide

Page 15: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

Example

public void drawLine (int x) { x = Math.abs(x); if (x == 0) return; System.out.print(“$”); drawLine(x-1); }

Trace this code with an initial x value of 5: x value: output:

Page 16: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

Same example, slightly different • The original iterative line drawing routine was

different from typical examples we’ve seen in the past, in that the counter was counting down instead of up

• I did this to illustrate how the iterative version relates to the recursive version – the problem (value of counter) gets smaller with each loop iteration, or each recursive call

• The situation is the same if we have the counter counting up, but it’s a little harder to see

Page 17: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

Example Iterative version: for (int x = 0; x < someConstant; x++) System.out.print (“$ ”); Equivalent recursive version: public void drawLine (int x, int someConstant) { if (x < someConstant) { System.out.print(“$”); drawLine (x+1, someConstant); } } Instead of x getting smaller, the distance between x and someConstant gets smaller

Page 18: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

Using the drawLine method, write a recursive drawSquare method:

// drawLine method: public void drawLine (int x, int someConstant) { if (x < someConstant) { System.out.print(“$”); drawLine (x+1, someConstant); } } // drawSquare method:

Page 19: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

Drawing prettier pictures: random Fractals

• Fractals are mathematical phenomena that describe the kinds of seemingly random shapes that occur in nature

• Graphics programmers use fractals to draw natural-looking scenes

• Your textbook (as paraphrased on the next slide) describes one method for generating random fractals

Page 20: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

Fractals made simple

1. Start with a line; find its midpoint:

2. Bend the line at the midpoint, using a random angle:

3. Lather, rinse, repeat:

Page 21: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

An applet for fractals

• When we draw the lines that make up a fractal, we continually perform 3 tasks: – find the midpoint of a line – randomly generate a distance – draw two new lines, which stretch from a point

the generated distance above the midpoint to the points at the two ends of the original line

Page 22: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

An applet for fractals • We keep performing the three tasks described,

breaking the original line into smaller and smaller segments until some end state is reached

• If we think of the end state as being the minimum distance we want to allow between any two points (or the minimum length of a line segment), we can come up with a recursive solution that starts with the original line length and stops when we have reached the minimum for each segment

Page 23: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

The heart of the matter: the randomFractal method

public void randomFractal( int leftX, int leftY, int rightX, int rightY, Graphics drawingArea) { final int STOP = 4; // When length < EPSILON, draw a line segment int midX, midY; // Midpoints in the x and y dimensions int delta; // Amount to shift the line's midpoint up or down if ((rightX - leftX) <= STOP) drawingArea.drawLine(leftX, leftY, rightX, rightY); else { midX = (leftX + rightX) / 2; midY = (leftY + rightY) / 2; delta = rg.nextInt(rightX - leftX); midY += delta; randomFractal(leftX, leftY, midX, midY, drawingArea); randomFractal(midX, midY, rightX, rightY, drawingArea); } }

Page 24: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

Searching an array

• Think about the problem of searching for a value within an array

• With unsorted data, our only real option is to start at one end of the array and search until we either find the target value or exhaust all of the possibilities

• The method on the next slide illustrates such a process

Page 25: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

Serial search – the brute force way

public int serialSearch(int n) { for (int x = 0; x < array.length; x++) if (array[x] == n) return x; return -1; } What is the order of magnitude (big-O) for this method?

Page 26: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

A recursive search method

• A more efficient search method can be defined recursively, and is somewhat analogous to the random fractal example: – check value at midpoint; if not target then – if greater than target, make recursive call to

search “upper” half of structure – if less than target, recursively search “lower”

half • Works only if data are sorted

Page 27: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

Binary search code

public int binarySearch(int n, int first, int extent) { int mid = extent/2; if (extent == 0) return -1; else { if (array[mid] < n) binarySearch(n, first, extent/2); else if (array[mid] > n) binarySearch(n, mid+1, (extent-1)/2); return mid; } }

Page 28: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

searching 28

Binary search in action

Suppose you have a 13-member array of sorted numbers:

5 14 23 47 59 71 82 99 108 113 130 151 172

[0] [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12]

Searching for value: 113 Initial function call: first = 0, extent = 13, mid = 6

Page 29: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

searching 29

Binary search in action

5 14 23 47 59 71 82 99 108 113 130 151 172

Searching for value: 113 Initial function call: first = 0, extent = 13, mid = 6

Since 113 != 82, make recursive call: binarySearch (target, mid+1, (extent-1)/2);

[0] [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12]

Page 30: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

searching 30

Binary search in action

5 14 23 47 59 71 82 99 108 113 130 151 172

Searching for value: 113 Recursive call(1): first = 7, extent = 6, mid = 10

[0] [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12]

Page 31: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

searching 31

Binary search in action

5 14 23 47 59 71 82 99 108 113 130 151 172

Searching for value: 113 Recursive call(1): first = 7, extent = 6, mid = 10

Since 113 != 130, make recursive call: binarySearch(target, first, extent/2);

[0] [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12]

Page 32: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

searching 32

Binary search in action

5 14 23 47 59 71 82 99 108 113 130 151 172

Searching for value: 113 Recursive call(2): first = 7, extent = 3, mid = 8

[0] [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12]

Page 33: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

searching 33

Binary search in action

5 14 23 47 59 71 82 99 108 113 130 151 172

Searching for value: 113 Recursive call(2): first = 7, extent = 3, mid = 8

Since 113 != 108, make recursive call: binarySearch(target, mid+1, (extent-1)/2);

[0] [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12]

Page 34: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

searching 34

Binary search in action

5 14 23 47 59 71 82 99 108 113 130 151 172

Searching for value: 113 Recursive call(3): first = 9, extent = 1, mid = 9

[0] [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12]

Page 35: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

searching 35

Binary search in action

5 14 23 47 59 71 82 99 108 113 130 151 172

Searching for value: 113 Recursive call(3): first = 9, extent = 1, mid = 9

Since 113 == 113, target is found; found = true, location = 9

[0] [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12]

Page 36: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

searching 36

Binary Search Analysis • Worst-case scenario: item is not in the array

– algorithm keeps searching smaller subarrays – eventually, array size will be 0, and the search will

stop • Analysis requires computing time needed for

operations in function as well as amount of time for recursive calls

• We will analyze the algorithm’s performance in the worst case

Page 37: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

searching 37

Step 1: count operations • Test base case: if (extent==0) 1 operation

• Compute midpoint: mid = first + extent/2; 3 operations

• Test for target at midpoint: if (target == array[mid]) 2 operations

• Test for which recursive call to make: if (target < array[mid]) 2 operations

• Recursive call - requires some arithmetic and argument passing - estimate 10 operations

Page 38: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

searching 38

Step 2: analyze cost of recursion

• Each recursive call is preceded by 18 (or fewer) operations

• Multiply this number by the depth of recursive calls and add the number of operations performed in the stopping case to determine worst-case running time (T(n))

• T(n) = 18 * depth of recursion + 3

Page 39: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

searching 39

Step 3: estimate depth of recursion

• Calculate upper bound approximation for depth of recursion; may slightly overestimate, but will not underestimate actual value – Each recursive call is made on an array segment

that contains, at most, N/2 elements – Subsequent calls are always made on size/2 – Thus, depth of recursion is, at most, the number of

times N can be divided by 2 with a result > 1

Page 40: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

searching 40

Estimating depth of recursion

• Referring to “the number of times N is divisible by 2 with result > 1” as H(n), or the halving function, the time expression becomes: T(n) = 18 * H(n) + 3

• H(n) turns out to be almost exactly equal to log2n: H(n) = log2n meaning that fractional results are rounded down to the nearest whole number (e.g. 3.7 = 3) -- this notation is called the floor function

Page 41: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

searching 41

Worst-case time for binary search

• Substituting the floor function of the logarithm for H(n), the time expression becomes: T(n) = 18 * ( log2n ) + 3

• Throwing out the constants, the worst-case running time (big O) function is: O(log n)

Page 42: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

searching 42

Significance of logarithms

• Logarithmic algorithms are very fast because log n is much smaller than n

• The larger the data set, the more dramatic the difference becomes: – log28 = 3 – log264 = 6 – log21000 < 10 – log21,000,000 < 20

Page 43: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

searching 43

For binary search algorithm...

• To search a 1000 element array will require no more than 183 operations in the worst case

• To search a 1,000,000 element array will require less than 400 operations in the worst case

Page 44: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

When Not to Use Recursion

• When recursive algorithms are designed carelessly, it can lead to very inefficient and unacceptable solutions

• See next 4 slides for a bad example …

Page 45: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

45

Computing the expansion of binomial coefficients

• Examples: (x+y)1 = x+y (x+y)2 = x2+2xy+y2

(x+y)3 = x3+3x2y+3xy2+y3

(x+y)4 = x4+4x3y+6x2y2+4xy3+y4

Etc. • Mathematically, the binomial coefficient of b(n,k)

to the power n and term k is: b(n,k) = b(n-1, k) + b(n-1, k-1) for 0 <= k <= n

Page 46: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

46

Pascal’s Triangle

The coefficient of the kth term for power n is the sum of the kth term’s coefficient and the (k-1)th term’s coefficient for power n-1

Page 47: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

47

Recursive computation of binomial coefficients

int BC (int n, int k) { int y1, y2; if ((k==0 || n==k)) return 1; else { y1=BC(n-1, k); y2=BC(n-1, k-1); return y1+y2; } }

Page 48: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

48

Call tree for initial call of BC(3,1)

Page 49: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

When to use recursion

• In general, use recursion if – A recursive solution is natural and easy to

understand. – A recursive solution does not result in excessive

duplicate computation. – The equivalent iterative solution is too complex.

Page 50: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

Recursive backtracking

• Recursion is best used for solving problems that don’t lend themselves easily to iteration

• We will see several examples of recursive solutions throughout the semester

• One more example: Towers of Hanoi

Page 51: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

import jeliot.io.*; public class Hanoi { public static void main(String [] args) { Hanoi h = new Hanoi(); h.towersOfHanoi(4, 'a', 'b','c'); } public void towersOfHanoi(int N, char from, char to, char spare) { if (N==1) moveOne(from, to); else { towersOfHanoi(N-1, from, spare, to); moveOne(from, to); towersOfHanoi(N-1, spare, to, from); } } private void moveOne (char from, char to) { Output.println(from + "--->" + to); } }

Page 52: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

Preventing infinite recursion

• One-level recursion: every case is either a stopping case or makes a recursive call to a stopping case

• Since most recursive functions are, or have the potential to be, recursive beyond just one level, need more general method for determining whether or not recursion will stop

Page 53: Recursion · Recursion • A recursive method is a method that contains a call to itself • Often used as an alternative to iteration when iteration is awkward or “inelegant”

Preventing infinite recursion

• Define a variant expression – numeric quantity that decreases by a fixed

amount on each recursive call • Base case is when variant expression is

less than or equal to its threshold value