PCP and Hardness of Approximation amanb/pdfs/ Aman Bansal Adwait Godbole PCP and Hardness of...

Click here to load reader

  • date post

    20-Jul-2020
  • Category

    Documents

  • view

    0
  • download

    0

Embed Size (px)

Transcript of PCP and Hardness of Approximation amanb/pdfs/ Aman Bansal Adwait Godbole PCP and Hardness of...

  • PCP and Hardness of Approximation

    Aman Bansal Adwait Godbole

    October 2019

    Aman Bansal Adwait Godbole PCP and Hardness of Approximation October 2019 1 / 37

  • Trajectory

    1 Relaxations of Hard Problems Approximate Problems Gap Problem Connection between Approximation and Gap

    2 A New Proof System Probabilistically Checkable Proof Systems Some Preliminaries Proof of the PCP Theorem

    3 Hardness of Approximation

    Aman Bansal Adwait Godbole PCP and Hardness of Approximation October 2019 2 / 37

  • Trajectory

    1 Relaxations of Hard Problems Approximate Problems Gap Problem Connection between Approximation and Gap

    2 A New Proof System Probabilistically Checkable Proof Systems Some Preliminaries Proof of the PCP Theorem

    3 Hardness of Approximation

    Aman Bansal Adwait Godbole PCP and Hardness of Approximation October 2019 3 / 37

  • Approximate Problems

    Given an instance x ∈ X of an NP-hard optimization problem with objective function Obj : Y → R (which is to be maximized1), a solution y is said to be an α-approximate (for α ≤ 1) solution to the instance if

    α · Obj(y∗) ≤ Obj(y) ≤ Obj(y∗)

    where y∗ is the true (not approximated) solution to the problem instance.

    1If the problem is a minimization problem then we have a slightly different definition Aman Bansal Adwait Godbole PCP and Hardness of Approximation October 2019 4 / 37

  • Approximate Problems

    α-approximate algorithms

    An algorithm A is an α-approximate algorithm if for all x in the instance space X , it returns an α-approximate solution y.

    α-approximate problems

    Problems that render (poly-time) α-approximate algorithms are called α-approximate problems.

    Aman Bansal Adwait Godbole PCP and Hardness of Approximation October 2019 5 / 37

  • Trajectory

    1 Relaxations of Hard Problems Approximate Problems Gap Problem Connection between Approximation and Gap

    2 A New Proof System Probabilistically Checkable Proof Systems Some Preliminaries Proof of the PCP Theorem

    3 Hardness of Approximation

    Aman Bansal Adwait Godbole PCP and Hardness of Approximation October 2019 6 / 37

  • Promise Problem

    A promise problem Π is specified by a pair of sets (YES, NO) such that YES, NO ⊆ X and YES ∩ NO = Φ.

    Any algorithm A solving Π, on input x, should output ‘yes’ if x ∈ YES, ‘no’ if x ∈ NO and any output if x is a don’t care instance

    Recollect the PromiseΠ problem from the midsem.

    Aman Bansal Adwait Godbole PCP and Hardness of Approximation October 2019 7 / 37

  • Gap Problems

    A gap problem is a promise problem parametrized by α (< 1). Let P be an NP-hard optimization problem with objective function Obj : Y → R (which is to be maximized), the corresponding gap problem gapα-P is a promise problem with (YES, NO) sets as given below:

    YES = {〈x, k〉 | ∃y ∈ Y such that Obj(y) ≥ k} NO = {〈x, k〉 | ∀y ∈ Y,Obj(y) < αk}

    Intuitively, the ‘gap’ refers to the interval (αk , k).

    Aman Bansal Adwait Godbole PCP and Hardness of Approximation October 2019 8 / 37

  • Trajectory

    1 Relaxations of Hard Problems Approximate Problems Gap Problem Connection between Approximation and Gap

    2 A New Proof System Probabilistically Checkable Proof Systems Some Preliminaries Proof of the PCP Theorem

    3 Hardness of Approximation

    Aman Bansal Adwait Godbole PCP and Hardness of Approximation October 2019 9 / 37

  • Intuition

    Intuitively, it seems that approximate problems and gap problems are similar.

    α-approximation is a relaxed variant of a search problem

    gapα is a relaxed variant of a decision problem

    Indeed, this notion can be formalized.

    Aman Bansal Adwait Godbole PCP and Hardness of Approximation October 2019 10 / 37

  • α-approximate → gapα

    Connnection between α-approximation and gapα For any problem P and 0 < α < 1, α-approximating P is at least as hard as solving gapα-P.

    Proof: Let A be an α-approximate algorithm for P. The following algorithm solves gapα-P:

    On input (φ, k):

    1. Let k ′ = A(φ)

    2. Accept iff k ′ ≥ αk

    Aman Bansal Adwait Godbole PCP and Hardness of Approximation October 2019 11 / 37

  • Trajectory

    1 Relaxations of Hard Problems Approximate Problems Gap Problem Connection between Approximation and Gap

    2 A New Proof System Probabilistically Checkable Proof Systems Some Preliminaries Proof of the PCP Theorem

    3 Hardness of Approximation

    Aman Bansal Adwait Godbole PCP and Hardness of Approximation October 2019 12 / 37

  • Trajectory

    1 Relaxations of Hard Problems Approximate Problems Gap Problem Connection between Approximation and Gap

    2 A New Proof System Probabilistically Checkable Proof Systems Some Preliminaries Proof of the PCP Theorem

    3 Hardness of Approximation

    Aman Bansal Adwait Godbole PCP and Hardness of Approximation October 2019 13 / 37

  • Probabilistically Checkable Proof System

    (r , q,m, t)-restricted Verifier

    Let r , q,m, t : N→ N. A language L ∈ PCPc,s [r , q,m, t] if L has an (r , q,m, t) restricted verifier V such that

    ∀x ∈ L,∃π of size at most m(|x |),PrR [V π[x ;R] = acc] ≥ c(|x |) ∀x /∈ L, ∀π of size at most m(|x |),PrR [V π[x ;R] = acc] < s(|x |)

    Resource bounds

    1. r(|x |) is a bound on randomness used by V 2. q(|x |) is a bound on the number of locations queried by V 3. m(|x |) is a bound the length of the proof to which V has oracle access 4. t(|x |) is a bound on the runtime of V

    Completeness and Soundness constraints c(|x |) and s(|x |) are the completeness and soundness specifications

    Aman Bansal Adwait Godbole PCP and Hardness of Approximation October 2019 14 / 37

  • Remarks

    The verifier could be adaptive or non-adaptive

    If the verifier is non-adaptive then m(n) ≤ q(n) · 2r(n)

    q(n) ≤ t(n) PCPc,s [r , q] ⊆ NTIME (q(n) · 2r(n)) NP = PCP1,0[0, poly(n)]

    BPP = PCP 2 3 , 1 3 [poly(n), 0]

    Aman Bansal Adwait Godbole PCP and Hardness of Approximation October 2019 15 / 37

  • PCP Theorem

    PCP Theorem

    NP = PCP1, 1 2 [log(n), 1]

    We will today present a weaker version of the PCP theorem.

    PCP Theorem [Weaker]

    NP = PCP1, 1 2 [poly(n), 1]

    Aman Bansal Adwait Godbole PCP and Hardness of Approximation October 2019 16 / 37

  • PCP Theorem

    PCP Theorem

    NP = PCP1, 1 2 [log(n), 1]

    We will today present a weaker version of the PCP theorem.

    PCP Theorem [Weaker]

    NP = PCP1, 1 2 [poly(n), 1]

    Aman Bansal Adwait Godbole PCP and Hardness of Approximation October 2019 16 / 37

  • Trajectory

    1 Relaxations of Hard Problems Approximate Problems Gap Problem Connection between Approximation and Gap

    2 A New Proof System Probabilistically Checkable Proof Systems Some Preliminaries Proof of the PCP Theorem

    3 Hardness of Approximation

    Aman Bansal Adwait Godbole PCP and Hardness of Approximation October 2019 17 / 37

  • Subset XOR

    Consider the function fu(x) = x� u. Here for x, y ∈ {0, 1}n, x� y =

    ∑ i xiyi (mod 2).

    Note that fu is equivalent to choosing a subset (given by u) of ele- ments from [n] and evaluating parity over this subset.

    Random Subsum Principle

    For x, y ∈ {0, 1}n with y 6= 0n, Prx∈{0,1}n [x� y = 1] = 12

    Aman Bansal Adwait Godbole PCP and Hardness of Approximation October 2019 18 / 37

  • Subset XOR

    Consider the function fu(x) = x� u. Here for x, y ∈ {0, 1}n, x� y =

    ∑ i xiyi (mod 2).

    Note that fu is equivalent to choosing a subset (given by u) of ele- ments from [n] and evaluating parity over this subset.

    Random Subsum Principle

    For x, y ∈ {0, 1}n with y 6= 0n, Prx∈{0,1}n [x� y = 1] = 12

    Aman Bansal Adwait Godbole PCP and Hardness of Approximation October 2019 18 / 37

  • Subset XOR

    Consider the function fu(x) = x� u. Here for x, y ∈ {0, 1}n, x� y =

    ∑ i xiyi (mod 2).

    Note that fu is equivalent to choosing a subset (given by u) of ele- ments from [n] and evaluating parity over this subset.

    Random Subsum Principle

    For x, y ∈ {0, 1}n with y 6= 0n, Prx∈{0,1}n [x� y = 1] = 12

    Aman Bansal Adwait Godbole PCP and Hardness of Approximation October 2019 18 / 37

  • Walsh-Hadamard Code

    Main Idea: Bit strings u ∈ {0, 1}n are encoded as the truth table of a linear function over F2

    WH encoding

    For an n-bit string u ∈ {0, 1}n, WH(u) is the 2n bit string representing the truth table of the function f (x) = x� u for x ∈ {0, 1}n.

    Walsh-Hadamard codeword

    f ∈ {0, 1}2n such that f = WH(u) for some u ∈ {0, 1}n.

    Aman Bansal Adwait Godbole PCP and Hardness of Approximation October 2019 19 / 37

  • Walsh-Hadamard Code

    Main Idea: Bit strings u ∈ {0, 1}n are encoded as the truth table of a linear function over F2

    WH encoding

    For an n-bit string u ∈ {0, 1}n, WH(u) is the 2n bit string representing the truth table of the function f (x) = x� u for x ∈ {0, 1}n.

    Walsh-Hadamard codeword