Overview of AspectJ Aspect Oriented Software Development Seminar Technion presented by Oren Mishali.
Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute...
-
Upload
rosemary-floyd -
Category
Documents
-
view
219 -
download
1
Transcript of Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute...
![Page 1: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/1.jpg)
Compressive Sampling(of Analog Signals)
Moshe Mishali Yonina C. Eldar
Technion – Israel Institute of Technology
http://www.technion.ac.il/[email protected]://www.ee.technion.ac.il/people/YoninaEldar [email protected]
Advanced topics in sampling (Course 049029)Seminar talk – November 2008
![Page 2: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/2.jpg)
2
Context - Sampling
Digital worldAnalog world
Continuous signal
ReconstructionD2A
SamplingA2D
![Page 3: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/3.jpg)
3
Compression
Original 2500 KB100%
Compressed 950 KB38%
Compressed 392 KB15%
Compressed 148 KB6%
“Can we not just directly measure the part that will not end up being thrown away ?”
Donoho
![Page 4: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/4.jpg)
4
Outline
• Mathematical background
• From discrete to analog
• Uncertainty principles for analog signals
• Discussion
![Page 5: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/5.jpg)
5
References• M. Mishali and Y. C. Eldar, "Reduce and Boost: Recovering
Arbitrary Sets of Jointly Sparse Vectors," IEEE Trans. on Signal Processing, vol. 56, no. 10, pp. 4692-4702, Oct. 2008.
• M. Mishali and Y. C. Eldar, "Blind Multi-Band Signal Reconstruction: Compressed Sensing for Analog Signals," CCIT Report #639, Sep. 2007, EE Dept., Technion.
• Y. C. Eldar, "Compressed Sensing of Analog Signals", submitted to IEEE Trans. on Signal Processing, June 2008.
• Y. C. Eldar and M. Mishali, "Robust Recovery of Signals From a Union of Subspaces", arXiv.org 0807.4581, submitted to IEEE Trans. Inform. Theory, July 2008. #
• Y. C. Eldar, "Uncertainty Relations for Analog Signals", submitted to IEEE Trans. Inform. Theory, Sept. 2008.
![Page 6: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/6.jpg)
6
Mathematical background
• Basic ideas of compressed sensing• Single measurement model (SMV)• Multiple- and Infinite- measurement models (MMV, IMV)• The “Continuous to finite” block (CTF)
![Page 7: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/7.jpg)
7
Compressed Sensing
“Can we not just directly measure the part that will not end up being thrown away ?”
Donoho
“sensing … as a way of extracting information about an object from a small number of randomly selected observations”Candès et. al.
Nyquist rateSampling
AnalogAudioSignal
Compression(e.g. MP3)
High-rate Low-rateCompressedSensing
![Page 8: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/8.jpg)
8
Concept
Goal: Identify the bucket with fake coins.
Nyquist: Weigh a coinfrom each bucket
CompressionBucket #
numbers 1 number
Compressed Sensing: Bucket #
1 number
Weigh a linear combinationof coins from all buckets
![Page 9: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/9.jpg)
9
Mathematical Tools
y A x
non-zero entries at least measurements
Recovery: brute-force, convex optimization, greedy algorithms, and more…
![Page 10: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/10.jpg)
10
CS theory – on 2 slides
Compressed sensing (2003/4 and on) – Main results
Maximal cardinality of linearly independent column subsets
Hard to compute !
is uniquely determined by
Donoho and Elad, 2003
![Page 11: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/11.jpg)
11
is uniquely determined by
is random with high probabilityDonoho, 2006 and Candès et. al., 2006
NP-hard
Convex and tractable
Greedy algorithms: OMP, FOCUSS, etc.
Donoho, 2006 and Candès et. al., 2006
Tropp, Cotter et. al. Chen et. al. and many other
Compressed sensing (2003/4 and on) – Main results
CS theory – on 2 slides
Donoho and Elad, 2003
![Page 12: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/12.jpg)
12
IMV = Infinite Measurement Vectors (countable or uncountable)with joint sparsity prior
How can be found ?
Sparsity models
measurements unknowns
SMV MMV Joint sparsity
Infinite many variables
Exploit prior Reduce problem dimensions
Infinite many constraints
![Page 13: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/13.jpg)
13
Reduction Framework
Find a frame for
Solve MMV
Mishali and Eldar (2008)
Theorem
IMV MMV
Deterministicreduction
Infinite structure allowsCS for analog signals
![Page 14: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/14.jpg)
14
From discrete to analog
• Naïve extension• The basic ingredients of sampling theorem
• Sparse multiband model• Rate requirements• Multicoset sampling and unique representation• Practical recovery with the CTF block
• Sparse union of shift-invariant model• Design of sampling operator• Reconstruction algorithm
![Page 15: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/15.jpg)
15
Naïve Extension to Analog Domain
Standard CSDiscrete Framework
Analog Domain
Sparsity prior what is a sparse analog signal ?
Generalized sampling
Finite dimensional elements Infinitesequence
Continuoussignal
Operator
Random is stable w.h.p Stability Randomness Infinitely manyNeed structure for efficient implementation
Finite program, well-studied Undefined program over a continuous signal
Reconstruction
![Page 16: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/16.jpg)
16
Random is stable w.h.p
Naïve Extension to Analog Domain
Sparsity prior what is a sparse analog signal ?
Generalized sampling
Finite dimensional elements Infinitesequence
Continuoussignal
Operator
Stability Randomness Infinitely manyNeed structure for efficient implementation
Finite program, well-studied Undefined program over a continuous signal
Reconstruction
Questions:
1. What is the definition of analog sparsity ?
2. How to select a sampling operator ?
3. Can we introduce stucture in sampling and still preserve stability ?
4. How to solve infinite dimensional recovery problems ?
Standard CSDiscrete Framework
Analog Domain
![Page 17: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/17.jpg)
17
A step backward
Nyquist1928
Shannon1949
Kotelnikov1933
“Success has many fathers …”
Whittaker1915
Every bandlimited signal ( Hertz)
can be perfectly reconstructed from uniform sampling
if the sampling rate is greater than
![Page 18: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/18.jpg)
18
A step backward
Every bandlimited signal ( Hertz)
can be perfectly reconstructed from uniform sampling
if the sampling rate is greater than
• A signal model• A minimal rate requirement• Explicit sampling and reconstruction stages
Fundamental ingredients of a sampling theorm
![Page 19: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/19.jpg)
19
Discrete Compressed Sensing
Analog Compressive Sampling
![Page 20: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/20.jpg)
20
Analog Compressed Sensing
A signal with a multiband structure in some basis
no more than N bands, max width B, bandlimited to
(Mishali and Eldar 2007)
1. Each band has an uncountable number of non-zero elements
2. Band locations lie on an infinite grid
3. Band locations are unknown in advance
What is the definition of analog sparsity ?
![Page 21: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/21.jpg)
21
Multi-Band Sensing: Goals
bands
Sampling Reconstruction
Goal: Perfect reconstruction
Constraints:
1. Minimal sampling rate
2. Fully blind system
Analog Infinite Analog
What is the minimal rate ?What is the sensing mechanism ?
How to reconstruct from infinite sequences ?
![Page 22: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/22.jpg)
22
Rate Requirement
Average sampling rate
Theorem (non-blind recovery)
Subspace scenarios:Minimal-rate sampling and reconstruction (NB) with known band locations (Lin and Vaidyanathan 98) Half blind system (Herley and Wong 99, Venkataramani and Bresler 00)
Landau (1967)
1. The minimal rate is doubled.2. For , the rate requirement is samples/sec (on average).
![Page 23: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/23.jpg)
23
Sampling
Analog signal
In each block of samples, only are kept, as described by
Point-wise samples
02
30
0
2
2
3
3
Multi-Coset: Periodic Non-uniform on the Nyquist grid
Bresler et. al. (96,98,00,01)
![Page 24: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/24.jpg)
24
The Sampler
DTFTof sampling sequences
Constant
matrixknown
in vector form
unknowns
Length .knownProblems:
1. Undetermined system – non unique solution
2. Continuous set of linear systems
is jointly sparse and unique under appropriate parameter selection ( )
is sparse
Observation:
![Page 25: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/25.jpg)
25
Paradigm
Solve finiteproblem
Reconstruct
0
1
2
3
4
5
6
S = non-zero rows
![Page 26: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/26.jpg)
26
CTF block
Solve finiteproblem
Reconstruct
MMV
Continuous to Finite
Continuous
Finite
span a finite spaceAny basis preserves the sparsity
![Page 27: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/27.jpg)
27
Algorithm
CTF
Continuous-to-finite block: Compressed sensing for analog signals Perfect reconstruction at minimal rate
Blind system: band locations are unkown
Can be applied to CS of general analog signals
Works with other sampling techniques
![Page 28: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/28.jpg)
28
Blind reconstruction flow
Spectrum-blindSampling
No
Yes
Spectrum-blindReconstruction
Uniform at
Multi-coset with
Universal
Ideal low-pass filter
SBR4
CTF
SBR2
CTFBi-section
Yes
No
![Page 29: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/29.jpg)
29Bresler et. al. (96,00)
Final reconstruction (non-blind)
![Page 30: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/30.jpg)
30
Framework: Analog Compressed Sensing
Sampling signals from a union of shift-invariant spaces (SI)
generators
Subspace
![Page 31: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/31.jpg)
31
Framework: Analog Compressed Sensing
What happen if only K<<N sequences are not zero ?
There is no prior knowledge on the exact indices in the sum
Not a subspace !
Only k sequences are non-zero
![Page 32: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/32.jpg)
32
Framework: Analog Compressed Sensing
Only k sequences are non-zero
CTF
Step 1: Compress the sampling sequencesStep 2: “Push” all operators to analog domain
System AHigh sampling rate = m/T
Post-compression
![Page 33: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/33.jpg)
33
Framework: Analog Compressed Sensing
CTF
Eldar (2008)
Theorem
System BLow sampling rate = p/T
Pre-compression
![Page 34: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/34.jpg)
34
Does it work ?
![Page 35: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/35.jpg)
35
Simulations
Brute-Force
M-OMP
5 10 150
0.2
0.4
0.6
0.8
1
r
Em
pir
ica
l s
uc
ce
ss
ra
te
SBR4SBR2
5 10 150
0.2
0.4
0.6
0.8
1
r
Em
pir
ica
l s
uc
ce
ss
ra
te
SBR4SBR2
Sampling rate Sampling rate
Minimal rate Minimal rate
![Page 36: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/36.jpg)
36
Simulations (2)
SBR4 SBR2
r
SN
R
5 10 15
10
15
20
0.2
0.4
0.6
0.8
1
rS
NR
5 10 15
10
15
20
0.2
0.4
0.6
0.8
1
r
SN
R
5 10 15
10
15
20
50 100 150 200 250
0.2 0.4 0.6 0.8 1
0.2 0.4 0.6 0.8 1
Empirical recovery rate
Sampling rate Sampling rate
0% Recovery 100% Recovery 0% Recovery 100% Recovery
Noise-free
![Page 37: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/37.jpg)
37
Simulations (3)
0 5 10 15 20 25
1
2
3
4
5
x 104
Time (nano secs)
-50 0 50
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
n
0 5 10 15 20 25
1
2
3
4
5
x 104
Time (nano secs)
Signal Reconstruction filter
Output
Time (nSecs)
Time (nSecs)
Am
plitu
de
Am
plitu
de
![Page 38: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/38.jpg)
38
Break(10 min. please)
![Page 39: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/39.jpg)
39
Uncertainty principles
• Coherence and the discrete uncertainty principle• Analog coherence and principles• Achieving the lower coherence bound• Uncertainty principles and sparse representations
![Page 40: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/40.jpg)
40
The discrete uncertainty principle
Uncertainty principle
![Page 41: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/41.jpg)
41
Discrete coherence
Which bases achieve the lowest coherence ?
![Page 42: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/42.jpg)
42
Discrete coherence
Which signal achieves the uncertainty bound ?
Spikes Fourier
![Page 43: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/43.jpg)
43
Discrete to analog
• Shift invariant spaces
• Sparse representations
Questions:• What is the analog uncertainty principle ?• Which bases has the lowest coherence ?• Which signal achieves the lower uncertainty bound ?
![Page 44: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/44.jpg)
44
Analog uncertainty principle
Eldar (2008)
Theorem
![Page 45: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/45.jpg)
45
Bases with minimal coherenceIn the DFT domain
Spikes Fourier
What are the analog counterparts ?
• Constant magnitude• Modulation
• “Single” component• Shifts
![Page 46: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/46.jpg)
46
Bases with minimal coherence
In the frequency domain
![Page 47: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/47.jpg)
47
Tightness
![Page 48: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/48.jpg)
48
Sparse representations
• In discrete setting
![Page 49: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/49.jpg)
49
Sparse representations
• Analog counterparts
Undefined program !
But, can be transformed into an IMV model
![Page 50: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/50.jpg)
50
Discussion
• IMV model as a fundamental tool for treating sparse analog signals
• Should quantify the DSP complexity of the CTF block
• Compare approach with the “analog” model
• Building blocks of analog CS framework.
![Page 51: Compressive Sampling (of Analog Signals) Moshe Mishali Yonina C. Eldar Technion – Israel Institute of Technology moshikomoshiko@tx.technion.ac.il.](https://reader036.fdocuments.in/reader036/viewer/2022062713/56649ceb5503460f949b7475/html5/thumbnails/51.jpg)
51
Thank you