Erasures vs. Errors in Property Testing and Local List ...
Transcript of Erasures vs. Errors in Property Testing and Local List ...
1
Erasures vs. Errors
in Property Testing and
Local List Decoding
Sofya RaskhodnikovaBoston University
Joint work with Noga Ron-Zewi (Haifa University)
Nithin Varma (Boston University)
Goal: study of sublinear algorithms resilient to adversarial corruptions
in the input
Focus: property testing model [Rubinfeld Sudan 96, Goldreich Goldwasser Ron 98]
A Sublinear-Time Algorithm
3
B L A - B L A - B L A - B L A - B L A - B L A - B L A - B L A
approximate answer
? L? B ? L ? A
Quality of
approximation
Resourcesβ’ number of queries
β’ running time
randomized algorithm
A Sublinear-Time Algorithm
4
B L A - B L A - B L A - B L A - B L A - B L A - B L A - B L A
? L? B ? L ? A
approximate answer
Is it always reasonable to assume
the input is intact?
randomized algorithm
Algorithms Resilient to Erasures (or Errors)
5
β₯ β₯ A - B L β₯ β₯ B L A - B L A - β₯ L A - B L A - B L β₯ - B L A
? L? B ? L ?
β’ β€ πΆ fraction of the input is erased (or modified) adversarially before algorithm runs
β’ Algorithm does not know in advance whatβs erased (or modified)
β’ Can we still perform computational tasks?
randomized algorithm
Property Tester [Rubinfeld Sudan 96,
Goldreich Goldwasser Ron 98]
randomized
algorithm
6
Property Testing
Two objects are at distance π = they differ in an π fraction of places
Donβt care
Accept with probability β₯ π/π
Reject with probability β₯ π/π
YES NOfar from
YESπ
Property Tester [Rubinfeld Sudan 96,
Goldreich Goldwasser Ron 98]
randomized
algorithm
7
Property Testing with Erasures
Two objects are at distance π = they differ in an π fraction of places
Donβt care
Accept with probability β₯ π/π
Reject with probability β₯ π/π
YES NOfar from
YESπ
Erasure-Resilient Property Tester [Dixit Raskhodnikova Thakurta Varma 16]
β’ β€ πΌ fraction of the input is erased
adversarially
Donβt care
Accept with probability β₯ π/π
Reject with probability β₯ π/π
Can be
completed
to YESNO
Any completion
is far from
YESπ
Property Tester [Rubinfeld Sudan 96,
Goldreich Goldwasser Ron 98]
randomized
algorithm
8
Property Testing with Errors
Two objects are at distance π = they differ in an π fraction of places
Donβt care
Accept with probability β₯ π/π
Reject with probability β₯ π/π
YES NOfar from
YESπ
Tolerant Property Tester[Parnas Ron Rubinfeld 06]
β’ β€ πΌ fraction of the input is wrong
Donβt care
Accept with probability β₯ π/π
Reject with probability β₯ π/π
YES NOfar from
YESπ
πΌ
Property Tester [Rubinfeld Sudan 96,
Goldreich Goldwasser Ron 98]
randomized
algorithm
9
Property Testing with Errors
Two objects are at distance π = they differ in an π fraction of places
Donβt care
Accept with probability β₯ π/π
Reject with probability β₯ π/π
YES NOfar from
YESπ
Tolerant Property Tester[Parnas Ron Rubinfeld 06]
β’ β€ πΌ fraction of the input is wrong
Donβt care
Accept with probability β₯ π/π
Reject with probability β₯ π/π
YES NOfar from
YESπ
πΌ
Relationships Between Models
Containments are strict:β’ [Fischer Fortnow 05]: standard vs. tolerant
β’ [Dixit Raskhodnikova Thakurta Varma 16]: standard vs. erasure-resilient
β’ new: erasure-resilient vs. tolerant
10
Ξ΅-testable
π-erasure-resiliently Ξ΅-testable
(π, Ξ΅)-tolerantly testable
Our Separation
11
There is a property of π-bit strings that β’ can be πΆ-resiliently πΊ-tested with constant query complexity,β’ but requires ππ π queries for tolerant testing.
Separation Theorem
Most of the talk: constant vs. π π₯π¨π π separation.
Main Tool: Locally List Erasure-Decodeable Codes
β’ Locally list decodable codes have been extensively studied [Goldreich Levin 89, Sudan Trevisan Vadhan 01, Gutfreund Rothblum 08, GopalanKlivans Zuckerman 08, Ben-Aroya Efremenko Ta-Shma 10, Kopparty Saraf 13, Kopparty 15, Hemenway Ron-Zewi Wootters 17, Goi Kopparty Oliveira Ron-ZewiSaraf 17, Kopparty Ron-Zewi Saraf Wootters 18]
β’ Only errors, not erasures were previously considered
β Not the case without the locality restriction [Guruswami 03, Guruswami Indyk 05]
Can locally list decodable codes perform better with erasures than with errors?
12
A Locally List Erasure-Decodable Code
β’ An error-correcting code ππ: Ξ£π β Ξ£π
β’ Parameters: πΆ fraction of erasures, list size β and π queries.
β the fraction of erased bits in w is at most πΆ,β the decoder makes at most π queries to π€,β w.p. β₯ 2/3, for every π₯ β Ξ£π with encoding ππ(π₯)
that agrees with π€ on all non-erased bits, one of the algorithms π΄π, given oracle access to π€,implicitly computes π₯ (that is, π΄π π = π₯π);
β each algorithm π΄π makes at most π queries to π€.
13
β₯ β₯ 0 0 0 1 β₯ β₯ 0 1 0 0 0 1 1 1 β₯ 1 1 1 0 1 1 1 0 1 β₯ 1 0 1 1
(π, β, π)-local list
erasure-decoder π΄1 π΄2 π΄β......Output
π€:
Hadamard Code
β’ Hadamard: 0,1 π β 0,1 2π; Hadamard π₯ = π₯, π¦ π¦β 0,1 π
β’ Impossible to decode when fraction of errors πΆ β₯ π/π.
14An improvement in dependence on πΌ was suggested by Venkat Guruswami
Type of
corruptions
Corruption
tolerance πΆList size,
βNumber of
queries, πUpper
bound
Lower bound
Errors πΌ β 0,π
π
Ξ1
12β πΌ
2 Ξ1
12β πΌ
2
[Goldreich
Levin 89]
[Blinovsky 86,
Guruswami
Vadhan 10,
Grinberg Shaltiel
Viola 18]
Erasures πΌ β (0,1) O1
1 β πΌΞ
1
1 β πΌ
new Implicit in [Grinberg Shaltiel
Viola 18]
How does separating erasures from errors in local list decoding
help with separating them in property testing?
3CNF Properties: Hard to Test, Easy to Decide
β’ Formula ππ : 3CNF formula on π variables, π(π) clauses
β’ Property πππβ 0,1 π: set of satisfying assignments to ππ
β’ πππdecidable by an π(π)-size circuit.
16
For sufficiently small Ξ΅, Ξ΅-testing πππ
requires π π queries.
Theorem [Ben-Sasson Harsha Raskhodnikova 05]
Testing with Advice: PCPs of Proximity (PCPPs)
[Ergun Kumar Rubinfeld 99, Ben-Sasson Goldreich Harsha Sudan Vadhan 06, Dinur Reingold 06]
β’ If π₯ has the property, then βπ(π₯) for which verifier accepts.
β’ If π₯ is π-far, then βπ(π₯) verifier rejects with probability β₯ 2/3.
17
π₯ proof π(π₯)
Every property decidable with a circuit of size πhas PCPP with proof length πΆ(π) and constant query complexity.
Theorem
PCPP Verifier
? ?
Testing 3CNF Properties with/without a Proof
18
π₯ proof π(π₯)
PCPP Verifier
for π ππ
? ?
Ξ΅
π₯
Tester for π ππ
?
Ξ΅
Need Ξ©(π)queries to test
without a proof
Constant query
complexity with
a proof of length π(π)
Separating Property
β’ π₯ satisfies the hard 3CNF property
β’ π is the number of repetitions (to balance the lengths of 2 parts)
β’ π(π₯) is the proof on which the PCPP verifier accepts π₯
β’ Enc uses a locally list erasure-decodable error-correcting code
β E.g., Hadamard;
β Codes with a better rate imply a stronger separation.
19
π₯r Enc(π₯ β π(π₯) )
Separating Property: Erasure-Resilient Testing
Idea: If a constant fraction (say, 1/4) of the encoding is preserved, we can locally list erasure-decode.
20
π₯r Hadamard(π₯ β π(π₯) )
Erasure-Resilient Tester1. Locally list erasure-decode Hadamard to get a list of algorithms.2. For each algorithm, check if:
β’ the plain part is π₯π by comparing u.r. bits with the corresponding bits of the decoding of π₯
β’ PCPP verifier accepts π₯ β π(π₯)3. Accept if, for some algorithm on the list, both checks pass.
Constant query complexity.
Separating Property: Hardness of Tolerant Testing
Idea: Reduce standard testing of 3CNF property to tolerant testing of the separating property.
β’ Given a string π₯, we can simulate access to
β’ All-zero string is Hadamard(π₯ β π(π₯)) with 1/2 of the encoding bits corrupted!
β’ Testing 3CNF property requires Ξ© π queries, where π = π₯ .
The input length for separating property is π β 2ππ.
21
π₯r Hadamard(π₯ β π(π₯) )
π₯r 00000 β¦ 00000
Ξ© π β Ξ© log π queries are needed.
What We Proved
The separating property is
β’ erasure-resiliently testable with a constant number of queries,
β’ but requires Ξ©(logπ) queries to tolerantly test.
22
Tolerant testing is harder than
erasure-resilient testing in general.
Strengthening the Separation: Challenges
If there exists a code that is locally list decodable from an πΌ < 1fraction of erasures with β’ list size β and number of queries π that only depend on πΌβ’ inverse polynomial ratethen there is a stronger separation: constant vs. ππ.
23
The existence of such a code is an open question.
The corresponding question for the case of errors
is the holy grail of research on local decoding.
Strengthening the Separation: Main Ideas
β’ Observation: Queries of the PCPP verifier can be made nearly uniform over proof indices [Dinur 07] + [Ben-Sasson Goldreich Harsha Sudan Vadhan 06, Guruswami Rudra 05]
β No need to decode every proof bit
β’ Idea: Encode the proof with approximate LLDCs that decode a constant fraction of proof bits correctly.
β Approximate LLDCs of inverse-polynomial rate are known [Impagliazzo Jaiswal Kabanets Wigderson 10]
β Approximate LLDCs β approximate locally list erasure-decodable codes of asymptotically the same rate
24
Open Questions and Directions
β’ Even stronger separation -- constant vs. linear?
β’ Separation between errors and erasures for a "natural" property?
β’ Are locally list erasure-decodable codes provably better than LLDCs?
β We showed it for Hadamard in terms of β and π.
β Same question for the approximate case.
β’ Constant-query, constant list size, local list erasure-decodable codes with inverse polynomial rate?
25