An adaptive OPD and dislocation prediction used characteristic of interference pattern for...

7
An adaptive OPD and dislocation prediction used characteristic of interference pattern for interference hyperspectral image compression Jia Wen a, b, , Caiwen Ma b , Penglang Shui b a The School of Electronic and Information Engineering, Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, PR China b The Photoelectric Measurement and Control Technology Research Department, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi'an, Shaanxi, 710119, PR China abstract article info Article history: Received 6 April 2011 Received in revised form 27 June 2011 Accepted 28 June 2011 Available online 13 July 2011 Keywords: Optical information Spectrum compression Interference pattern LASIS Interference hyperspectral image According to the imaging principle and characteristic of LASIS (Large Aperture Static Interference Imaging Spectrometer), we discovered that the 3D (three dimensional) image sequences formed by different interference pattern frames, which were formed in the imaging process of LASIS Interference hyperspectral image, had much stronger correlation than the original interference hyperspectral image sequences, either in 2D (two dimensional) spatial domain or in the spectral domain. We put this characteristic into image compression and proposed an adaptive OPD (optical path difference) and dislocation prediction algorithm for interference hyperspectral image compression. Compared the new algorithm proposed in this paper with Dual-Direction Prediction [1] proposed in 2009, lots of experimental results showed that the prediction error entropy of the new algorithm was much smaller. In the prediction step of lifting wavelet transform, this characteristic would also reduce the entropy of coefcients in high frequency signicantly, which would be more advantageous for quantication coding [2]. © 2011 Elsevier B.V. All rights reserved. 1. Introduction Combining optics with spectroscopy, electronic technology and precision machinery, interference hyperspectral imaging was an advanced technology appeared in the 1980s. As Fig. 1 [3] showed, it could obtain both the space and spectrum information of the measured targets, and had signicant application value in many aspects, such as the aero-remote and military sensing, the resources survey, the environmental monitoring as well as the agriculture and industry. LASIS (Large Aperture Static Interference Imaging Spectrometer) was the representative of the new generation interference hyperspectral imaging technology. Its application had received many scholars' attention and interest. As it had already been equipped on the Chang Efor moon exploration, and would be used for exploration on Mars in the future, the compression of LASIS interference hyperspectral image had become the focus in recent years [2,4,5]. 2. Imaging principle of LASIS [2][3] The schematic diagram of LASIS was shown in Fig. 2(a), which was mainly composed of ve parts: 1) fore-optics system; 2) interferometer; 3) imaging system; 4) detector; and 5) computer. The imaging principle of LASIS was shown in Fig. 2(b). Two directional lights with visual angle 0 andθ entered LASIS respectively. Through the Sagnac interference spectrometer, a bunch of light became two beams of parallel coherent lights. The interference phenomenon happened when the two beams of parallel coherent lights converging at the same point of the imaging mirror's back focal plane. In Fig. 2(b), d was the distance between two beams of lights, θ was the angle between the primary optical axis of the imaging lens and the direction of incident light passing through lateral shear interferometer, f was the effective focal length of imaging lens, x was the distance between the imaging center and the lights converging point. When the interference phenomenon happened, OPD on the detector was: δ = d sin θ ð1Þ when the visual angle θ was very small, sin θ tan θ = x f ð2Þ δ = d sinθ = d x f ð3Þ LASIS would get the interference pattern of targets after pushing and sweeping a eld of view along the shear direction of lateral shear interferometer. In the ideal state, the detector units had the same direction as the direction of pushing and sweeping. The column of Optics Communications 284 (2011) 49034909 Corresponding author at: The Photoelectric Measurement and Control Technology Research Department, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi'an, Shaanxi, 710119, PR China. E-mail address: [email protected] (J. Wen). 0030-4018/$ see front matter © 2011 Elsevier B.V. All rights reserved. doi:10.1016/j.optcom.2011.06.061 Contents lists available at ScienceDirect Optics Communications journal homepage: www.elsevier.com/locate/optcom

Transcript of An adaptive OPD and dislocation prediction used characteristic of interference pattern for...

Page 1: An adaptive OPD and dislocation prediction used characteristic of interference pattern for interference hyperspectral image compression

Optics Communications 284 (2011) 4903–4909

Contents lists available at ScienceDirect

Optics Communications

j ourna l homepage: www.e lsev ie r.com/ locate /optcom

An adaptive OPD and dislocation prediction used characteristic of interferencepattern for interference hyperspectral image compression

Jia Wen a,b,⁎, Caiwen Ma b, Penglang Shui b

a The School of Electronic and Information Engineering, Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, PR Chinab The Photoelectric Measurement and Control Technology Research Department, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi'an, Shaanxi, 710119,PR China

⁎ Corresponding author at: The Photoelectric MeasurResearch Department, Xi'an Institute of Optics andAcademy of Sciences, Xi'an, Shaanxi, 710119, PR China.

E-mail address: [email protected] (J. Wen).

0030-4018/$ – see front matter © 2011 Elsevier B.V. Aldoi:10.1016/j.optcom.2011.06.061

a b s t r a c t

a r t i c l e i n f o

Article history:Received 6 April 2011Received in revised form 27 June 2011Accepted 28 June 2011Available online 13 July 2011

Keywords:Optical informationSpectrum compressionInterference patternLASISInterference hyperspectral image

According to the imaging principle and characteristic of LASIS (Large Aperture Static Interference ImagingSpectrometer), we discovered that the 3D (three dimensional) image sequences formed by differentinterference pattern frames, which were formed in the imaging process of LASIS Interference hyperspectralimage, had much stronger correlation than the original interference hyperspectral image sequences, either in2D (two dimensional) spatial domain or in the spectral domain. We put this characteristic into imagecompression and proposed an adaptive OPD (optical path difference) and dislocation prediction algorithm forinterference hyperspectral image compression. Compared the new algorithm proposed in this paper withDual-Direction Prediction [1] proposed in 2009, lots of experimental results showed that the prediction errorentropy of the new algorithm was much smaller. In the prediction step of lifting wavelet transform, thischaracteristic would also reduce the entropy of coefficients in high frequency significantly, which would bemore advantageous for quantification coding [2].

ement and Control TechnologyPrecision Mechanics, Chinese

l rights reserved.

© 2011 Elsevier B.V. All rights reserved.

1. Introduction

Combining optics with spectroscopy, electronic technology andprecision machinery, interference hyperspectral imaging was anadvanced technology appeared in the 1980s. As Fig. 1 [3] showed, itcould obtain both the space and spectrum information of themeasuredtargets, and had significant application value in many aspects, suchas the aero-remote and military sensing, the resources survey, theenvironmental monitoring as well as the agriculture and industry.LASIS (Large Aperture Static Interference Imaging Spectrometer) wasthe representative of the new generation interference hyperspectralimaging technology. Its application had received many scholars'attention and interest. As it had already been equipped on the “ChangE” for moon exploration, and would be used for exploration on Mars inthe future, the compression of LASIS interference hyperspectral imagehad become the focus in recent years [2,4,5].

2. Imaging principle of LASIS [2][3]

The schematic diagram of LASIS was shown in Fig. 2(a), which wasmainly composed offive parts: 1) fore-optics system; 2) interferometer;3) imaging system; 4) detector; and 5) computer.

The imaging principle of LASIS was shown in Fig. 2(b). Twodirectional lights with visual angle 0 andθ entered LASIS respectively.Through the Sagnac interference spectrometer, a bunch of light becametwo beams of parallel coherent lights. The interference phenomenonhappenedwhen the two beams of parallel coherent lights converging atthe same point of the imaging mirror's back focal plane.

In Fig. 2(b), d was the distance between two beams of lights,θ was the angle between the primary optical axis of the imaging lensand the direction of incident light passing through lateral shearinterferometer, f was the effective focal length of imaging lens, x wasthe distance between the imaging center and the lights convergingpoint. When the interference phenomenon happened, OPD on thedetector was:

δ = d sin θ ð1Þ

when the visual angle θ was very small,

sin θ≈ tan θ =xf

ð2Þ

δ = d sinθ = dxf

ð3Þ

LASIS would get the interference pattern of targets after pushingand sweeping a field of view along the shear direction of lateral shearinterferometer. In the ideal state, the detector units had the samedirection as the direction of pushing and sweeping. The column of

Page 2: An adaptive OPD and dislocation prediction used characteristic of interference pattern for interference hyperspectral image compression

Fig. 1. Interference hyperspectral imaging [3].

4904 J. Wen et al. / Optics Communications 284 (2011) 4903–4909

detector units would output a line of interference pattern of a targetpoint after LASIS finished pushing and sweeping:

Ii xð Þ = ∫ v2v1

Bi vð Þ cos 2πvdxf

� �dv ð4Þ

Fig. 2. (a) Schematic diagram of LASIS. (b) Imaging principle of LASIS.

v1, v2 were the minimum and the maximal values of the wave numberrespectively, i was sequence number of spatial distinguishableunits, δm was the maximum distance of OPD, Bi(v) was the spectraldistributed function of the corresponding unit, Ii(x) was a line ofinterference pattern of the target point.

As different OPD corresponding to different positions of pixels,we could get the interference spectral distribution of the point byrecording the interference amplitude outputted by the detector whenthe pixel point was in different positions.

The data processing of LASIS interference hyperspectral image wasshown in Fig. 3. The data processing had two steps:

First choosing the same ground point from different OPD in theoriginal LASIS interference hyperspectral image sequences toform the interference pattern of point [5]. The interferencepatterns were formed by the corresponding columns of thesame targets chosen from different frames. So the number oforiginal interference hyperspectral image frames we neededto form an interference pattern was almost the same as thenumber of the columns in interference pattern, and every rowof pixels in interference pattern was formed by the sametarget point in different frames, so they would give the spatialinformation of that target point.

Second recovering the spectrum image by doing Fourier transformto the interference pattern of point:

Bi vð Þ = ∫ δm0

Ii xð Þ cos 2πxdvf

� �dx ð5Þ

As in the ideal state, Ii(x) and Bi(v) were both odd functions, sothey could be extended into the negative domain.

Ii xð Þ = ∫ Bi vð Þe j2πvdx= f3dv = F Bi vð Þf g ð6Þ

Bi vð Þ = ∫ Ii xð Þe−j2πvdx= f3dx = F−1 Ii xð Þf g ð7Þ

Page 3: An adaptive OPD and dislocation prediction used characteristic of interference pattern for interference hyperspectral image compression

Fig. 3. Data processing of LASIS interference hyperspectral image.

4905J. Wen et al. / Optics Communications 284 (2011) 4903–4909

Where F was Fourier transform and F−1 was the inverse Fouriertransform. From formula (6) and (7), we could see the interferencepattern Ii(x)and the spectrum distributed functionBi(v) had therelation of Fourier transform and inverse transform.

3. New compression method using the characteristic ofinterference pattern

Suppose there were fframes of r×c LASIS image sequence as Fig. 4shows,r×c pixels in 2 dimensions, they could be shown as follows[1,3]:

X1 =

x1;1;1 x1;2;1 … x1;c;1x2;1;1 x2;2;1 … x2;c;1… … xi;j;1 …

xr;1;1 xr;2;1 … xr;c;1

2664

3775 ð8Þ

Xk =

x1;1;k x1;2;k … x1;c;kx2;1;k x2;2;k … x2;c;k… … xi;j;k …xr;1;k xr;2;k … xr;c;k

2664

3775 ð9Þ

Xf =

x1;1;f x1;2;f … x1;c;fx2;1;f x2;2;f … x2;c;f… … xi;j;f …xr;1;f xr;2;f … xr;c;f

2664

3775 ð10Þ

where i=1, 2, …, r;j=1, 2, …, c;k=1, 2, …, f.

As there was directional shift between frames of interferencehyperspectral image sequences, so in the ideal state, the inter-

ference pattern I1 was formed by

x1;c;1x2;c;1…xr;c;1

2664

3775,

x1;c−1;2x2;c−1;2

…xr;c−1;2

2664

3775,

x1;c−2;3x2;c−2;3

…xr;c−2;3

2664

3775…

x1;3;c−2x2;3;c−2

…xr;3;c−2

2664

3775,

x1;2;c−1x2;2;c−1

…xr;2;c−1

2664

3775,

x1;1;cx2;1;c…xr;1;c

2664

3775, these c columns of r pixels actually

corresponding to the same column of r pixels of actual targets,sothe correlation of these c columns should be very strong.

Step 1. Corresponding-columns-extracted to form interference patternsequences

We extracted the c columns corresponding to the same r points ofactual objects from c frames of interference hyperspectral image se-quences to form a new r×c matrix to form one frame of interferencepattern:

I1 =

x1;1;c x1;2;c−1 x1;3;c−2 … x1;c−2;3 x1;c−1;2 x1;c;1x2;1;c x2;2;c−1 x2;3;c−2 … x2;c−2;3 x2;c−1;2 x2;c;1… … … … … … …xr;1;c xr;2;c−1 xr;3;c−2 … xr;c−2;3 xr;c−1;2 xr;c;1

2664

3775 ð11Þ

Page 4: An adaptive OPD and dislocation prediction used characteristic of interference pattern for interference hyperspectral image compression

Fig. 4. Interference hyperspectral image sequences.

4906 J. Wen et al. / Optics Communications 284 (2011) 4903–4909

Ii =

x1;1;c + i−1 x1;2;c + i−2 x1;3;c + i−3 … x1;c−2;i + 2 x1;c−1;i + 1 x1;c;ix2;1;c + i−1 x2;2;c + i−2 x2;3;c + i−3 … x2;c−2;i + 2 x2;c−1;i + 1 x2;c;i

… … … … … … …xr;1;c + i−1 xr;2;c + i−2 xr;3;c + i−3 … xr;c−2;i + 2 xr;c−1;i + 1 xr;c;i

2664

3775

ð12Þ

Ic =

x1;1;2c−1 x1;2;2c−2 x1;3;2c−3 … x1;c−2;c + 2 x1;c−1;c + 1 x1;c;cx2;1;2c−1 x2;2;2c−2 x2;3;2c−3 … x2;c−2;c + 2 x2;c−1;c + 1 x2;c;c

… … … … … … …xr;1;2c−1 xr;2;2c−2 xr;3;2c−3 … xr;c−2;c + 2 xr;c−1;c + 1 xr;c;c

2664

3775

ð13Þ

Fig. 5. Interference pattern after corresp

To form one frame of interference pattern, we required c framesof LASIS image sequences, so to form c frames of interferencepatterns, we required 2c-1 frames of LASIS image sequences. 3 groupsof 8 continuous interference patterns were shown as follows:

From Fig. 5, we could see that redundancy not only exists in inter-column in every frame of interference pattern, but also exists betweenadjacent frames of interference pattern. So in this paper we wouldeliminate the strong redundancy by the two following steps:

Step 2. Adaptive OPD (optical path difference) prediction method:

An adaptive OPD (optical path difference) prediction method wasproposed in this paper. We made the pixels in the same OPD as a

onding-columns-extracted method.

Page 5: An adaptive OPD and dislocation prediction used characteristic of interference pattern for interference hyperspectral image compression

Fig. 6. Sketch map of forming interference pattern sequences.

Fig. 7. Sketch map of the proposed method for compression.

4907J. Wen et al. / Optics Communications 284 (2011) 4903–4909

channel, and we use pixels in this channel to predict pixels in thedifferent channels. The algorithm was shown as follows:

The pixels in the nth channel would be predicted by the pixels inthe m channels before this channel, that was,

Ik :;nð Þ = Ikmαn + e1k :;nð Þ; n = 1;2;…; c ð14Þ

k was the kth frame, e1 was 3D prediction error, e1kis the kthframe of e1, αn=[α1n, α2n … αmn]Twas the weighted value for the

Fig. 8. Raw data of interference hy

prediction of the nth channel, in order to minimize the error, αn

should be[3,6–8]:

αn = arg min jjIk :;nð Þ−Ikmαnjj2� �

; n = 1;2;…; c ð15Þ

|| • || was Euclid norm.Let

∂jjIk :;nð Þ−Ikmαnjj2∂αn

= 0; n = 1;2;…; c ð16Þ

We got

αn = ITkmIkm� �−1

ITkmIk :;nð Þ; n = 1;2;…; c ð17Þ

Ikm = Ik :;n−mð ÞIk :;n−m + 1ð Þ…Ik :;n−2ð ÞIk :;n−1ð Þ½ � ð18Þ

when nbm, m=n−1

e1k = Ik :;1ð Þ−Ikmα1 Ik :;2ð Þ−Ikmα2…Ik :; cð Þ−Ikmαc½ �; k = 1;2;…; c

ð19Þ

Step 3. Inter-framesprediction toeliminate the inter-frameredundancy:

After corresponding-column-extracted step, columns of pixels in thesame spectral dimension of the original interference hyperspectralimage data would be distributed into different frames, as Fig. 6 showed(pixels of the samecolors express pixels in thesamespectraldimension).After lots of experiments, we found that we could obtain much smallerentropy through doing dislocation prediction between inter-frames toprediction error sequences obtained after Step 2, than doing directlyprediction between inter-frames. The reason was that there was muchstronger correlation in the same spectral dimension of the originalinterference hyperspectral image than in different spectral dimensions.

So an algorithm of dislocation prediction was proposed in thispaper. According to the position as Fig. 6 shows, in order to get smallerinformation entropy, the algorithm of dislocation prediction betweeninter-frames was shown as follows:

e2i =

e1i 1;1ð Þe1i 2;1ð Þ

…e1i r;1ð Þ

e1i 1;1ð Þ−e1i + 1 1;2ð Þe1i 2;1ð Þ−e1i + 1 2;2ð Þ

…e1i r;1ð Þ−e1i + 1 r;2ð Þ

e1i 1;2ð Þ−e1i + 1 1;3ð Þe1i 2;2ð Þ−e1i + 1 2;3ð Þ

…e1i r;2ð Þ−e1i + 1 r;3ð Þ

…………

e1i 1; c−1ð Þ−e1i + 1 1; cð Þe1i 2; c−1ð Þ−e1i + 1 2; cð Þ

…e1i r; c−1ð Þ−e1i + 1 r; cð Þ

2664

3775

i = 1;2;…; c−1;

ð20Þ

Sketch map of the compression method proposed in this paperwas shown in Fig. 7.

4. Experiment and analysis

Compared the method proposed in this paper with the Dual-Direction Prediction method proposed in 2009[1], which also madeprediction in both spatial and spectral domain. Two groups of 8

perspectral image sequences.

Page 6: An adaptive OPD and dislocation prediction used characteristic of interference pattern for interference hyperspectral image compression

4908 J. Wen et al. / Optics Communications 284 (2011) 4903–4909

frames of LASIS interference hyperspectral image sequences(Figs. 8and 10) had been chosen for experiment, define

Entropy = ∑pi⋅ log pið Þ ð21Þ

Experiment results were shown as follows in Figs. 9 and 11,Tables 1 and 2:

The results of experiments showed that, compared with themethod proposed in 2009, prediction error entropy generated by themethod proposed in this paper was much smaller, which would bemore advantageous for efficient realization of the transformation andquantization steps of image compression[2,9].

Fig. 10. Raw data of interference h

Fig. 11. Interference pattern of th

Table 1Prediction error entropy comparison.

Frame 1 Frame 2

Entropy of raw data (Fig. 8) 6.554 6.550Entropy of method proposed in this paper (Step 1) 6.330 6.321Entropy of method proposed in 2009 3.464 3.441Entropy of method proposed in this paper (Step 2) 3.239 3.241Entropy of method proposed in this paper (Step 3) 3.001 3.069

Table 2Prediction error entropy comparison.

Frame 1 Frame 2

Entropy of raw data (Fig. 10) 6.796 6.797Entropy of method proposed in this paper (Step 1) 6.732 6.720Entropy of method proposed in 2009 3.375 3.416Entropy of method proposed in this paper (Step 2) 3.403 3.406Entropy of method proposed in this paper (Step 3) 3.141 3.130

Fig. 9. Interference pattern of the

5. Conclusion

We discovered that either in 2D spatial domain or in the spectraldomain, the 3D image sequences formed by different interferencepattern frames had much stronger correlation than the originalinterference hyperspectral image sequences. As there was muchstronger correlation in the same spectral dimension of the originalinterference hyperspectral image than in different spectral dimen-sions, we could obtain much smaller entropy through doingdislocation prediction between inter-frames to different interferencepattern frames, than doing directly prediction between inter-frames.Compared the new algorithm proposed in this paper with Dual-Direction Prediction [1] proposed in 2009, lots of experimental resultsshowed that the prediction error entropy of the new algorithm was

yperspectral image sequences.

e same target point (Step 1).

Frame 3 Frame 4 Frame 5 Frame 6 Frame 7 Frame 8

6.555 6.556 6.560 6.559 6.546 6.5456.315 6.435 6.467 6.420 6.376 6.4343.386 3.282 3.486 3.385 3.472 3.6773.262 3.460 3.504 3.460 3.387 3.4593.216 3.236 3.218 3.206 3.184 3.218

Frame 3 Frame 4 Frame 5 Frame 6 Frame 7 Frame 8

6.798 6.792 6.794 6.793 6.797 6.7936.710 6.700 6.687 6.684 6.689 6.6963.363 3.501 3.449 3.450 3.477 3.3543.341 3.279 3.395 3.406 3.401 3.3953.133 3.130 3.131 3.117 3.123 3.126

same target point (Step 1).

Page 7: An adaptive OPD and dislocation prediction used characteristic of interference pattern for interference hyperspectral image compression

4909J. Wen et al. / Optics Communications 284 (2011) 4903–4909

much smaller. In the prediction step of lifting wavelet transform, thischaracteristic would also reduce the entropy of coefficients in highfrequency significantly, which would be more advantageous forquantification coding [2].

Acknowledgement

National Natural Science Foundation issues (40805013) and theNational 863 support project (2009AA7080302) are acknowledged.

References

[1] Jing MA, Chengke WU, Yun song LI, Proceedings of IEEE DCC, 2009, p. 458.[2] Jia Wen, CaiwenMa, Penglang Shui, Optics Communications 284 (7) (April 1 2011)

1770.[3] Jing Ma, Chengke WU, “Research on Interferential Hyperspectral Image Compres-

sion Technology”. Xi'an University of Electronic Science and Technology doctoraldissertation, 2009.

[4] P.L. Dragotti, G. Poggi, A.R.P. Ragozini, IEEE Transactions on Geosciences andRemote Sensing 1 (38) (2000) 416.

[5] Xiangli Bin, Zhao Baochang, Xue Mingqiu, Acta Optica Sinica 18 (1) (1998) 18.[6] G.H. Golub, C.V. Loan, Matrix Computations, John Hopkins University Press, 1996.[7] S.H. Hsiesh, Proceedings of SPIE on Applications of Digital Image Processing XXVII,

2004, p. 664.[8] G. Motta, F. Rizzo, J.A. Storer, Proceedings of Data Compression Conference, 2003,

p. 333.[9] Jia Wen, Caiwen Ma, Penglang Shui, Optics Communications 284 (1) (January 1

2011) 64.

Jia Wen, Aug 4, 1983, born in Tianjin, doctor of TheSchool of Electronic and Information Engineering, Xi'anJiaotong University, doctor of the Photoelectric Measure-ment and Control Technology Research Department,Xi'an Institute of Optics and Precision Mechanics, ChineseAcademy of Science, Research fields: digital image

processing.