Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III:...
Transcript of Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III:...
![Page 1: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/1.jpg)
Nonlinear Analysis with Frames. Part III: Algorithms
Radu Balan
Department of Mathematics, AMSC, CSCAMM and NWCUniversity of Maryland, College Park, MD
July 28-30, 2015Modern Harmonic Analysis and Applications
Summer Graduate ProgramUniversity of Maryland, College Park, MD 20742
![Page 2: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/2.jpg)
Thanks to our sponsors:
”This material is based upon work supported by the National ScienceFoundation under Grants No. DMS-1413249, DMS-1501640. Anyopinions, findings, and conclusions or recommendations expressed in thismaterial are those of the author(s) and do not necessarily reflect the viewsof the National Science Foundation.”
![Page 3: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/3.jpg)
Table of Contents:
1 Problem Formulation
2 PhaseLift
3 IRLS
![Page 4: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/4.jpg)
Problem Formulation PhaseLift IRLS
Table of Contents
1 Problem Formulation
2 PhaseLift
3 IRLS
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 5: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/5.jpg)
Problem Formulation PhaseLift IRLS
Problem FormulationThe phase retrieval problem
Let H = Cn. The quotient space H = Cn/T 1, with classes inducedby x ∼ y if there is real ϕ with x = eiϕy .Frame F = f1, · · · , fm ⊂ Cn and nonlinear maps
α : H → Rm , α(x) = (|〈x , fk〉|)1≤k≤m .
β : H → Rm , β(x) =(|〈x , fk〉|2
)1≤k≤m
.
The frame is said phase retrievable (or that it gives phase retrieval) ifα (or β) is injective.
The general phase retrieval problem a.k.a. phaseless reconstruction:Decide when a given frame is phase retrievable, and, if so, find analgorithm to recover x from y = α(x) (or from y = β(x)) up to aglobal phase factor.
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 6: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/6.jpg)
Problem Formulation PhaseLift IRLS
Problem FormulationThe phase retrieval problem
Let H = Cn. The quotient space H = Cn/T 1, with classes inducedby x ∼ y if there is real ϕ with x = eiϕy .Frame F = f1, · · · , fm ⊂ Cn and nonlinear maps
α : H → Rm , α(x) = (|〈x , fk〉|)1≤k≤m .
β : H → Rm , β(x) =(|〈x , fk〉|2
)1≤k≤m
.
The frame is said phase retrievable (or that it gives phase retrieval) ifα (or β) is injective.The general phase retrieval problem a.k.a. phaseless reconstruction:Decide when a given frame is phase retrievable, and, if so, find analgorithm to recover x from y = α(x) (or from y = β(x)) up to aglobal phase factor.Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 7: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/7.jpg)
Problem Formulation PhaseLift IRLS
Problem FormulationAlgorithms
Our Problem Today: Assume F is phase retrievable. Want reconstructionalgorithms.
Recursive Projections: Gerchberg-SaxtonMatrix Estimation: PhaseLift (Candes, Strohmer, Voroninski’12,CandesLi)Signal Estimation: Iterative Regularized Least Squares (IRLS),Wirtinger Flow (Candes’14)Algorithms for special frames: Reconstruction via Polarization(Alexeev,Bandeira,Fickus, Mixon; Bodmann,Hammen), Fouriertransform (Lim&co MIT; Bates’82; Bal’09; PhaseLift with Masking;4n-4 by Bodmann,Hammen), Shift Invariant Frames (Iwen,Viswanathan,Wang), High Redundancy (BBCE’09)Algorithms for special signals: sparse signals (... e.g.Iwen,Viswanathan,Wang)
Today we focus on two algorithms: PhaseLift and IRLS.
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 8: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/8.jpg)
Problem Formulation PhaseLift IRLS
Problem FormulationAlgorithms
Our Problem Today: Assume F is phase retrievable. Want reconstructionalgorithms.
Recursive Projections: Gerchberg-SaxtonMatrix Estimation: PhaseLift (Candes, Strohmer, Voroninski’12,CandesLi)Signal Estimation: Iterative Regularized Least Squares (IRLS),Wirtinger Flow (Candes’14)Algorithms for special frames: Reconstruction via Polarization(Alexeev,Bandeira,Fickus, Mixon; Bodmann,Hammen), Fouriertransform (Lim&co MIT; Bates’82; Bal’09; PhaseLift with Masking;4n-4 by Bodmann,Hammen), Shift Invariant Frames (Iwen,Viswanathan,Wang), High Redundancy (BBCE’09)Algorithms for special signals: sparse signals (... e.g.Iwen,Viswanathan,Wang)
Today we focus on two algorithms: PhaseLift and IRLS.
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 9: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/9.jpg)
Problem Formulation PhaseLift IRLS
Problem FormulationAlgorithms
Our Problem Today: Assume F is phase retrievable. Want reconstructionalgorithms.
Recursive Projections: Gerchberg-SaxtonMatrix Estimation: PhaseLift (Candes, Strohmer, Voroninski’12,CandesLi)Signal Estimation: Iterative Regularized Least Squares (IRLS),Wirtinger Flow (Candes’14)Algorithms for special frames: Reconstruction via Polarization(Alexeev,Bandeira,Fickus, Mixon; Bodmann,Hammen), Fouriertransform (Lim&co MIT; Bates’82; Bal’09; PhaseLift with Masking;4n-4 by Bodmann,Hammen), Shift Invariant Frames (Iwen,Viswanathan,Wang), High Redundancy (BBCE’09)Algorithms for special signals: sparse signals (... e.g.Iwen,Viswanathan,Wang)
Today we focus on two algorithms: PhaseLift and IRLS.Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 10: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/10.jpg)
Problem Formulation PhaseLift IRLS
Problem FormulationAlgorithms
Our Problem Today: Assume F is phase retrievable. Want reconstructionalgorithms.
Recursive Projections: Gerchberg-SaxtonMatrix Estimation: PhaseLift (Candes, Strohmer, Voroninski’12,CandesLi)Signal Estimation: Iterative Regularized Least Squares (IRLS),Wirtinger Flow (Candes’14)Algorithms for special frames: Reconstruction via Polarization(Alexeev,Bandeira,Fickus, Mixon; Bodmann,Hammen), Fouriertransform (Lim&co MIT; Bates’82; Bal’09; PhaseLift with Masking;4n-4 by Bodmann,Hammen), Shift Invariant Frames (Iwen,Viswanathan,Wang), High Redundancy (BBCE’09)Algorithms for special signals: sparse signals (... e.g.Iwen,Viswanathan,Wang)
Today we focus on two algorithms: PhaseLift and IRLS.Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 11: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/11.jpg)
Problem Formulation PhaseLift IRLS
Table of Contents
1 Problem Formulation
2 PhaseLift
3 IRLS
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 12: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/12.jpg)
Problem Formulation PhaseLift IRLS
PhaseLiftThe Idea
Consider the noiseless case y = β(x). The main idea is embodied in thefollowing feasibility problem:
Find Xsubject to:X = X ∗ ≥ 0A(X ) = y
rank(X ) = 1
(Feas)
Alternatively, since there is a unique rank 1 that satisfies this problem:
Min rank(X )subject to:X = X ∗ ≥ 0A(X ) = y
(L0)
Except for rank(X ) the optimization problem would be convex.
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 13: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/13.jpg)
Problem Formulation PhaseLift IRLS
PhaseLiftThe Idea
Consider the noiseless case y = β(x). The main idea is embodied in thefollowing feasibility problem:
Find Xsubject to:X = X ∗ ≥ 0A(X ) = y
rank(X ) = 1
(Feas)
Alternatively, since there is a unique rank 1 that satisfies this problem:
Min rank(X )subject to:X = X ∗ ≥ 0A(X ) = y
(L0)
Except for rank(X ) the optimization problem would be convex.Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 14: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/14.jpg)
Problem Formulation PhaseLift IRLS
PhaseLiftThe Idea - cont’d
IDEA: Replace rank(X ) by trace(X ) as in the Matrix Completion problem.
Once a solution X is found, the vector x can be easily obtained from thefactorization: X = xx∗.
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 15: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/15.jpg)
Problem Formulation PhaseLift IRLS
PhaseLiftThe Idea - cont’d
IDEA: Replace rank(X ) by trace(X ) as in the Matrix Completion problem.Once a solution X is found, the vector x can be easily obtained from thefactorization: X = xx∗.
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 16: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/16.jpg)
Problem Formulation PhaseLift IRLS
PhaseLiftThe Algorithm
(PhaseLift) minA(X)=y ,X=X∗≥0
trace(X )
which is a convex optimization problem (a semi-definite program: SDP).
Theorem (Candes-Li 2014)Assume each vector fk is drawn independently fromN (0, In/2) + iN (0, In/2), or each vector is drawn independently from theuniform distribution on the complex sphere of radius
√n. Then there are
universal constants c0, c1, γ > 0 so that for m ≥ c0n, for every x ∈ Cn theproblem (PhaseLift) has the same solution as (L0) with probability at least1− c1e−γn.
Hand & Demanet (2013) showed (PhaseLift) is in essence a feasibilityproblem.
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 17: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/17.jpg)
Problem Formulation PhaseLift IRLS
PhaseLiftThe Algorithm
(PhaseLift) minA(X)=y ,X=X∗≥0
trace(X )
which is a convex optimization problem (a semi-definite program: SDP).
Theorem (Candes-Li 2014)Assume each vector fk is drawn independently fromN (0, In/2) + iN (0, In/2), or each vector is drawn independently from theuniform distribution on the complex sphere of radius
√n. Then there are
universal constants c0, c1, γ > 0 so that for m ≥ c0n, for every x ∈ Cn theproblem (PhaseLift) has the same solution as (L0) with probability at least1− c1e−γn.
Hand & Demanet (2013) showed (PhaseLift) is in essence a feasibilityproblem.
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 18: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/18.jpg)
Problem Formulation PhaseLift IRLS
PhaseLiftThe Algorithm
(PhaseLift) minA(X)=y ,X=X∗≥0
trace(X )
which is a convex optimization problem (a semi-definite program: SDP).
Theorem (Candes-Li 2014)Assume each vector fk is drawn independently fromN (0, In/2) + iN (0, In/2), or each vector is drawn independently from theuniform distribution on the complex sphere of radius
√n. Then there are
universal constants c0, c1, γ > 0 so that for m ≥ c0n, for every x ∈ Cn theproblem (PhaseLift) has the same solution as (L0) with probability at least1− c1e−γn.
Hand & Demanet (2013) showed (PhaseLift) is in essence a feasibilityproblem.
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 19: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/19.jpg)
Problem Formulation PhaseLift IRLS
PhaseLiftPerformance Bounds
Consider the measurement model in the presence of noise
y = β(x) + ν
Modify the optimization problem:
minX=X∗≥0
‖A(X )− y‖1 (PL2)
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 20: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/20.jpg)
Problem Formulation PhaseLift IRLS
PhaseLiftPerformance Bounds
Consider the measurement model in the presence of noise
y = β(x) + ν
Modify the optimization problem:
minX=X∗≥0
‖A(X )− y‖1 (PL2)
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 21: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/21.jpg)
Problem Formulation PhaseLift IRLS
PhaseLiftPerformance Bounds - cont’d
Modified Phase Lift algorithm is robust to noise:
Theorem (Candes-Li 2014)Consider the same stochastic process for the random frame F . There is auniversal constant C0 > 0 so that for all x ∈ Cn the solution to (PL2)obeys
‖X − xx∗‖2 ≤ C0‖ν‖1
mFor the Gaussian model this holds with the same probability as in thenoiseless case, whereas the probability of failure is exponentially small in nin the uniform model. The principal eigenvector x0 of X (normalized bythe square root of the principal eigenvalue) obeys
D2(x0, x) ≤ C0 min(‖x‖2,‖ν‖1
m‖x‖2).
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 22: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/22.jpg)
Problem Formulation PhaseLift IRLS
Table of Contents
1 Problem Formulation
2 PhaseLift
3 IRLS
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 23: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/23.jpg)
Problem Formulation PhaseLift IRLS
Iterative Regularized Least-SquaresThe Idea
Consider the measurement process
yk = |〈x , fk〉|2 + νk , 1 ≤ k ≤ m
The Least-Squares criterion:
minx∈Cn
m∑k=1||〈x , fk〉|2 − yk |2
can be understood as the Maximum Likelihood Estimator (MLE) when thenoise vector ν ∈ Rm is normal distributed with zero mean and covarianceσ2Im. However the optimization problem is not convex and has many localminima.
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 24: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/24.jpg)
Problem Formulation PhaseLift IRLS
Iterative Regularized Least-SquaresThe Idea - cont’d
Consider the following optimization criterion:
J(u, v ;λ, µ) =m∑
k=1
∣∣∣∣12(〈u, fk〉〈fk , v〉+ 〈v , fk〉〈fk , u〉)− yk
∣∣∣∣2+λ‖u‖22 + µ‖u − v‖22 + λ‖v‖22
The Iterative Regularized Least-Squares (IRLS) algorithm is based onminimization:
x t+1 = argminuJ(u, x t ;λt , µt)
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 25: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/25.jpg)
Problem Formulation PhaseLift IRLS
Iterative Regularized Least-SquaresThe Idea - cont’d
Consider the following optimization criterion:
J(u, v ;λ, µ) =m∑
k=1
∣∣∣∣12(〈u, fk〉〈fk , v〉+ 〈v , fk〉〈fk , u〉)− yk
∣∣∣∣2+λ‖u‖22 + µ‖u − v‖22 + λ‖v‖22
The Iterative Regularized Least-Squares (IRLS) algorithm is based onminimization:
x t+1 = argminuJ(u, x t ;λt , µt)
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 26: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/26.jpg)
Problem Formulation PhaseLift IRLS
Iterative Regularized Least-SquaresThe Algorithm: Initialization
Step 1. Initialization. Compute the principal eigenvector ofRy =
∑mk=1 yk fk f ∗k using e.g. the power method. Let (e1, a1) be the
eigen-pair with e1 ∈ Cn and a1 ∈ R. If a1 ≤ 0 then set x = 0 and exit.Otherwise initialize:
x0 =√
(1− ρ)a1∑mk=1 |〈e1, fk〉|4
e1 (3.1)
λ0 = ρa1 (3.2)µ0 = ρa1 (3.3)
t = 0 (3.4)
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 27: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/27.jpg)
Problem Formulation PhaseLift IRLS
Iterative Regularized Least-SquaresThe Algorithm: Iterations
Step 2. Iteration. Perform:2.1 Solve the least-square problem:
x t+1 = argminuJ(u, x t ;λt , µt)
using the conjugate gradient method.2.2 Update:
λt+1 = γλt , µt = max(γµt , µmin) , t = t + 1
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 28: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/28.jpg)
Problem Formulation PhaseLift IRLS
Iterative Regularized Least-SquaresThe Algorithm: Stopping
Step 3. Stopping. Repeat Step 2 until:The error criterion is achieved: J(x t , x t ; 0, 0) < ε; or
The desired signal-to-noise-ratio is reached: ‖x t‖2
J(x t ,x t ;0,0) > snr ; orThe maximum number of iterations is reached: t > T .
The final estimate can be xT , or the best estimate obtained in theiteration path: x est = x t0 , where t0 = argmintJ(x t , x t ; 0, 0).
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 29: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/29.jpg)
Problem Formulation PhaseLift IRLS
Iterative Regularized Least-SquaresThe Algorithm: Stopping
Step 3. Stopping. Repeat Step 2 until:The error criterion is achieved: J(x t , x t ; 0, 0) < ε; or
The desired signal-to-noise-ratio is reached: ‖x t‖2
J(x t ,x t ;0,0) > snr ; orThe maximum number of iterations is reached: t > T .
The final estimate can be xT , or the best estimate obtained in theiteration path: x est = x t0 , where t0 = argmintJ(x t , x t ; 0, 0).
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 30: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/30.jpg)
Problem Formulation PhaseLift IRLS
Iterative Regularized Least-SquaresPerformance Bounds
Theorem (B. 2013)Fix 0 6= z0 ∈ Cn. Assume the frame F is so that kerA ∩ S2,1 = 0. Thenthere is a constant A3 > 0 that depends of F so that for every x ∈ Ωz0
and ν ∈ Cn that produce y = β(x) + ν if there are u, v ∈ Cn so thatJ(u, v ;λ, µ) < J(x , x ;λ, µ) then
‖Ju, vK− xx∗‖1 ≤4λA3
+ 2‖ν‖2√A3
(3.5)
Moreover, let Ju, vK = a+e+e∗+ + a−e−e−e∗− be its spectral factorizationwith a+ ≥ 0 ≥ a− and ‖e+‖ = ‖e−‖ = 1. Set x = √a+e+. Then
D2(x , x)2 ≤ 4λA3
+ 2‖ν‖2√A3
+ ‖ν‖22
4µ + λ‖x‖222µ (3.6)
The kernel requirement on A is satisfied for generic frames when m ≥ 6n.In particular it implies the frame is phase retrievable for Cn.
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 31: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/31.jpg)
Problem Formulation PhaseLift IRLS
Iterative Regularized Least-SquaresPerformance Bounds
Theorem (B. 2013)Fix 0 6= z0 ∈ Cn. Assume the frame F is so that kerA ∩ S2,1 = 0. Thenthere is a constant A3 > 0 that depends of F so that for every x ∈ Ωz0
and ν ∈ Cn that produce y = β(x) + ν if there are u, v ∈ Cn so thatJ(u, v ;λ, µ) < J(x , x ;λ, µ) then
‖Ju, vK− xx∗‖1 ≤4λA3
+ 2‖ν‖2√A3
(3.5)
Moreover, let Ju, vK = a+e+e∗+ + a−e−e−e∗− be its spectral factorizationwith a+ ≥ 0 ≥ a− and ‖e+‖ = ‖e−‖ = 1. Set x = √a+e+. Then
D2(x , x)2 ≤ 4λA3
+ 2‖ν‖2√A3
+ ‖ν‖22
4µ + λ‖x‖222µ (3.6)
The kernel requirement on A is satisfied for generic frames when m ≥ 6n.In particular it implies the frame is phase retrievable for Cn.
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 32: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/32.jpg)
Problem Formulation PhaseLift IRLS
Thank you!
Questions?
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 33: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/33.jpg)
Problem Formulation PhaseLift IRLS
ReferencesB. Alexeev, A.S. Bandeira, M. Fickus, D.G. Mixon, Phase retrievalwith polarization, SIAM J. on Imag.Sci., 7(1):35–66, 2014.
R. Balan, B. Bodmann, P. Casazza, D. Edidin, Painless reconstructionfrom Magnitudes of Frame Coefficients, J.Fourier Anal.Applic., 15 (4)(2009), 488–501.
R. Balan, Reconstruction of Signals from Magnitudes of RedundantRepresentations: The Complex Case, available onlinearXiv:1304.1839v1, Found.Comput.Math. 2015,http://dx.doi.org/10.1007/s10208-015-9261-0
B. Bodmann, N. Hammen, Algorithms and error bounds for noisyphase retrieval with low-redundancy frames, arXiv:1412.6678v1[Dec.2014]
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 34: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/34.jpg)
Problem Formulation PhaseLift IRLS
E.J. Cand/’es, T. Strohmer, V. Voroninski, Phaselift: Exact and stablesignal recovery from magnitude measurements via convexprogramming, Comm.Pure Appl.Math., 66(8):1241–1274, 2013.
E.J. Cand/’es, X. Li, Solving quadratic equations via phaselift whenthere are about as many equations as unknowns,Found.Comput.Math., 14(5):1017–1026, 2014.
E.J. Cand/’es, X. Li, M. Soltanolkotabi, Phase retrieval from codeddiffraction patterns, arXiv:1310.3240, 2013.
E.J. Cand/’es, X. Li, M. Soltanolkotabi, Phase Retrieval via WirtingerFlow: Theory and Aplgorithms
R.W. Gerchberg, A practical algorithm for the determination of phasefrom image and diffraction plane pictures, Optik, 35:237, 1972.
M. Iwen, A. Viswanathan, Y. Wang, Robust Sparse Phase RetrievalMade Easy, 2014.
Radu Balan (UMD) Phase Retrieval July 28-30, 2015
![Page 35: Nonlinear Analysis with Frames. Part III: Algorithms€¦Nonlinear Analysis with Frames. Part III: Algorithms Radu Balan Department of Mathematics, AMSC, CSCAMM and NWC University](https://reader033.fdocuments.in/reader033/viewer/2022041416/5e1bba0b67f52b3e4242eba5/html5/thumbnails/35.jpg)
Problem Formulation PhaseLift IRLS
, J.R. Fienup, Phase retrieval algorithms: a comparison, Appliedoptics, 21(15):2758–2769, 1982.
Radu Balan (UMD) Phase Retrieval July 28-30, 2015