Visualization and Analysis Methods of Geometric Medical Data captured

from Microwave Tomography

Jan. 15, 2013TIP 2013

Jin Ah Park, Jong-Oh Kim, Ji-Seung Jeong, Jae-Won Lee,Ki-Chul Kim, Nam Kim, Eun-Jong Cha and

Kwan-Hee Yookhyoo@chungbuk.ac.kr

Chungbuk National University, Korea

Introduction

30.0

40.0

50.0

60.0

70.0

80.0

90.0 (Unit: people / 10 million)

Age-Standardized Incidence Transition for Woman Major Cancers

Thyroid Stomach Lung Liver Colon and rectum Breast Cervix uteri

} The incidence of cancer ordered thyroid cancer, breast cancer, colorectal cancer, and lung cancer in 2008.} The case of breast cancer increased to an average annual growth rate of 6.4%} The payments of breast cancer were approximately 5 times increased from 636 billion(2001) to 3,162

billion(2009).

2

[Annual report of national cancer registration business, Ministry of Health and Welfare, Korea, 2010]

0.0

10.0

20.0

30.0

1999 2000 2001 2002 2003 2004 2005 2006 2007 2008

Introduction

X-ray(Mammography)CT(Computed Tomography)

MRI(Magnetic Resonance Imaging), PET(Positron Emission Tomography)

X-ray(Mammography)CT(Computed Tomography)

MRI(Magnetic Resonance Imaging), PET(Positron Emission Tomography)

Body image Breast Tumor Detection Technology

Body image Breast Tumor Detection Technology

MI(Radar-based Microwave Imaging)MT(Microwave Tomography)

MI(Radar-based Microwave Imaging)MT(Microwave Tomography)

Microwave Breast Tumor Detection Technology

Microwave Breast Tumor Detection Technology

A set of points in breast volume andpermittivity and conductivity distribution information(Data inadequate for a breast cancer detection system)

3

PACS(Picture Archiving & Communication System)CAD(Computer Aided Diagnosis) ×××

(Detection with breast cancer using image)

PACS(Picture Archiving & Communication System)CAD(Computer Aided Diagnosis) ×××

(Detection with breast cancer using image)

Breast Cancer Detection SystemBreast Cancer Detection System

To used images acquired(Data suitable for a breast cancer diagnosis system)

To need new breast cancer

dectionsoftware

To need new breast cancer

dectionsoftware

A set of points in breast volume andpermittivity and conductivity distribution information(Data inadequate for a breast cancer detection system)

Background} Breast tumor detection technology

} X-ray(Mammography)} The most common breast cancer imaging techniques} Pain and discomfort accompanied} According to United States Institute of Medicine (IOM) report, an average of

15% misdiagnosis rate

} CT(Computed Tomography)} 3D advanced X-ray imaging technology

4

} Breast tumor detection technology} X-ray(Mammography)

} The most common breast cancer imaging techniques} Pain and discomfort accompanied} According to United States Institute of Medicine (IOM) report, an average of

15% misdiagnosis rate

} CT(Computed Tomography)} 3D advanced X-ray imaging technology

X-ray. (Left) Mammography Filming techniques (Right) Reconstruction Image[http://www.cancer.gov/cancertopics/pdq/screening/breast/Patient/page3]

Computed Tomography(CT) equipment[http://ko.wikipedia.org/wiki/CT]

Background} Breast tumor detection technology

} MRI(Magnetic Resonance Imaging)} Using a powerful magnetic field} Using nuclear magnetic resonance physical phenomena} Obtaining information on the tissue density images

} PET(Positron Emission Tomography)} Diagnosed with the early stages of cancer by the fourth generation of medical

imaging technology

5

} Breast tumor detection technology} MRI(Magnetic Resonance Imaging)

} Using a powerful magnetic field} Using nuclear magnetic resonance physical phenomena} Obtaining information on the tissue density images

} PET(Positron Emission Tomography)} Diagnosed with the early stages of cancer by the fourth generation of medical

imaging technology

Magnetic Resonance Imaging(MRI)[http://www.diagnosisms.com/2012/04/30/mri-for-multiple-sclerosis]

Positron Emission Tomography(PET) http://www.r2tech.com

Background} Breast tumor detection technology

} Radar-based Microwave Imaging(MI)} First introduced by Hagness Professor breast cancer diagnosis technology using MI[S. C.

Hagness, A. Taflove, and J. E. Bridges, IEEE Trans. Biomed. Eng., vol. 45, no. 12, pp. 1470-1479, Dec. 1998.]

} Using technology reflection signal from the breast¨ MI via Space Time beamforming (MIST) techniques¨ Tissue SensignAdaptive Redar(TSAR) techniques

} Microwave Tomography(MT)} Inverse scattering techniques used to obtain images in the diagnosis of breast cancer} Images provide information on the characteristics of the material inside the breast} Performance compared to the cost savings} Imaging technology as a safety

6

} Breast tumor detection technology} Radar-based Microwave Imaging(MI)

} First introduced by Hagness Professor breast cancer diagnosis technology using MI[S. C.

Hagness, A. Taflove, and J. E. Bridges, IEEE Trans. Biomed. Eng., vol. 45, no. 12, pp. 1470-1479, Dec. 1998.]

} Using technology reflection signal from the breast¨ MI via Space Time beamforming (MIST) techniques¨ Tissue SensignAdaptive Redar(TSAR) techniques

} Microwave Tomography(MT)} Inverse scattering techniques used to obtain images in the diagnosis of breast cancer} Images provide information on the characteristics of the material inside the breast} Performance compared to the cost savings} Imaging technology as a safety

Radar-based Microwave Imaging based Breast Cancer Detection[KlemmCraddock, 2008]Microwave Tomography Imaging based

Breast Cancer Detection[Meamey, 2009]

Background} Breast cancer detection system

} PACS(Picture Archiving & Communication System, 1983)} Images acquired such as CT, MRI equipment to fit DICOM standard the

storage, processing, transmission system.

} CAD(Computer Aided Diagnosis)} Raised by Lodwick in 1996. [G.S. Lodwick, Invest. Radiol., 1966, vol. 1, pp. 72-80]

} Images acquired such as Mammography, Ultrasound, MRI, PET, CT the software to perform a secondary diagnosis or lesion detection.

7

} Breast cancer detection system} PACS(Picture Archiving & Communication System, 1983)

} Images acquired such as CT, MRI equipment to fit DICOM standard the storage, processing, transmission system.

} CAD(Computer Aided Diagnosis)} Raised by Lodwick in 1996. [G.S. Lodwick, Invest. Radiol., 1966, vol. 1, pp. 72-80]

} Images acquired such as Mammography, Ultrasound, MRI, PET, CT the software to perform a secondary diagnosis or lesion detection.

Diagram of the microwave breast tumor detection system} Designed and produced diagram of the microwave breast tumor

detection system of ETRI, Korea [2010]

System Control/GUI

Control Signal Control Signal Control Signal

Microwave Espouse Device

Tank/Antenna

Multi-channel RF transceiver/Data gathering

ReconstructionAlgorithm

RF Signal Data file Startreconstructio

n

Startreconstructio

n

Set propertydistribution to initial estimate

Set propertydistribution to initial estimate

Evaluate forward field

solution

Evaluate forward field

solution

Extract Computed Field values

Extract Computed Field values

Calculate Field

misfit error

Calculate Field

misfit error

Endreconstructio

n

Endreconstructio

n

Compare With

stopping criteria

UpdateProperty

distribution

UpdateProperty

distribution

Solve for Parameter

update

Solve for Parameter

update

Determine Regularization

parameter

Determine Regularization

parameter

Compute JacobianCompute Jacobian

전자파 기반 진단 시스템

} 전자파토모그램데이터구성

… … …

Coordinate of each node (unit : m), cubic typeX Y Z

9

……

Permittivity

Conductivity

Permittivity of last iteration corresponding to node

Conductivity of last iteration corresponding to node

Data captured from a MT device

Single layer688 points per

single layer

10

… … …

Coordinate of each node (unit : m), cubic typeX Y Z

…

PermittivityPermittivity of last iteration corresponding to node

Layer 1Layer 2

Layer 3

Layer 23

11

… … …

Coordinate of each node (unit : m), cubic typeX Y Z

Layer 1

Layer2315824 points

Visualization of breast cancer data} 3D image visualization functionNames of function Explanation of function

Permittivity /Conductivity

• 3D tomogram image display

• To detection the presence or absence of malignant tissue by permittivity

or conductivity depending on the size displayed of different colors

• The function is zoom-in, zoom-out, and 360∘ rotation.

• Check the location and size of the malignant tumor

12

• 3D tomogram image display

• To detection the presence or absence of malignant tissue by permittivity

or conductivity depending on the size displayed of different colors

• The function is zoom-in, zoom-out, and 360∘ rotation.

• Check the location and size of the malignant tumor

PermittivityColors/ConductivityColors

• The function to define a color according to the size of the tomogram image

data values

• To divided by 8 colors by dielectric constant or conductivity of the

between minimum and maximum values and define colors by analyzing the

color distribution and distribution of data.

3DRendering

• Permittivity Conductivity 3D image display

• The function is output and analysis capabilities for cut selected area for

each of the X, Y, Z axis cross-sectional images

•The function is output for selected zones cut the two axes of an arbitrary

cross-sectional images

Visualization of breast cancer data} cross-sectional imaging analysis function

Names of function Explanation of function

Saggital

• Cross-sectional imaging output by cutting the X-axis

• The X axis of the cross-sectional cutting move Using the keyboard (X)

• At the same time automatically display that go to the X-axis of the cross-sectional area image

• Min-Max x-value, Current x-value information to automatically output by the number

• Cross-sectional imaging output by cutting theY-axis

•TheY axis of the cross-sectional cutting move Using the keyboard (Y)

•At the same time automatically display that go to theY-axis of the cross-sectional area image

•Min-Max y-value, Current y-value information to automatically output by the number

13

Coronal

• Cross-sectional imaging output by cutting theY-axis

•TheY axis of the cross-sectional cutting move Using the keyboard (Y)

•At the same time automatically display that go to theY-axis of the cross-sectional area image

•Min-Max y-value, Current y-value information to automatically output by the number

Axial

• Cross-sectional imaging output by cutting the Z-axis

•The Z axis of the cross-sectional cutting move Using the keyboard (Z)

•At the same time automatically display that go to the Z-axis of the cross-sectional area image

•Min-Max z-value, Current z-value information to automatically output by the number

SCA • Cross-sectional imaging output by cutting the arbitrary axis

Analysis of breast cancer data

Functions 기능설명

Feature • Extract boundary of 2D/3D cancer shape

Length• Draw a line segment between two points

• Display the length as characters

Angle• Draw line segments displaying an angle among three points

• Display the angle as characters

14

Angle• Draw line segments displaying an angle among three points

• Display the angle as characters

Circle

• Draw a circle on a plane

• Display radius of the circle as characters

• Handle the size of radius of the circle

Edge • Draw an boundary designated by selected points

Visualization of breast cancer data} Delaunay Triangulation

} triangulation is a technique for connecting points in a space into triangular groups(1934)

15

Outer TriangleVertex

(a) (b) (c)(a) Set of points, (b) Delaunay triangulation of the point set with trailers to the outer bounding trianlge, (b) (c) example circles showing the cirum-circle property

[Learnig OpenCV Computer Vision with the openCV Library]

Visualization of breast cancer data} The location and color mapping method

PermColors[0]

PermColors[1]

Permittivity V

alue

Conductivity V

alue

minPerm minCond

Delaunay Triangulation [1934]

layer1

16

PermColors[7]

…

Permittivity V

alue

Conductivity V

alue

maxPerm maxCond

intervalPerm = (maxPerm - minPerm) / (m_nNumBasicColors-1);indexPerm = (m_pPermIntensity - minPerm) * m_nNumBasicColors-1 / (maxPerm-minPerm);diffPerm = m_pPermIntensity[i] - (indexPerm*intervalPerm+minPerm);alphaValue = diffPerm / intervalPerm;PermColor = (1.0-alphaValue)*m_pBasicPermColors + alphaValue*m_pBasicPermColors;

Visualization of breast cancer data} The location and color mapping method

Layer 1

Layer n

Layer 1

Layer n

Connected in a straight line at a certain point in each layer

17

Layer 1

Visualization of breast cancer data} Visualization of breast cancer data

Delaunay TriangulationDelaunay Triangulation

Layer 1 : set of points

18

3DR

endering3D

Rendering

Delaunay TriangulationDelaunay Triangulation

Layer 23 : set of points

Visualization of full data

19

Saggital, Coronal, Axial, SCA

y

z

y

z

y

z

20

x

z

x

z

x

z

} An Example of Saggital, Coronal, Axial, SCA

21

resultposition = (value * secondposition) + ((1-vale) * fristposition);resultcolor = (value * secondcolor) + ((1-vale) * fristcolor);

Analysis} Measurement

} Length of two points

22

Analysis} Measurement

} Angle among three points

23

Analysis} Circle

24

Extract contour of breast cancer by Intelligent scissors}

25

Examples of the boundary

Mark points

26

Extract the boundary of breast cancer

Conclusion} Provide permittivity and conductivity distribution information for each

in a set of points in breast volume by applying microwave inverse

scattering interpretation algorithm

} Visualization of 3D tomogram images using the information obtained

} Cross-sectional imaging analysis function of specific area

} Measuring imaging analysis function

} marking breast tumor as the circle with a radius,

} calculating distance between two points in breast tumor,

} measuring the angle between three points, and

} extracting the boundary of breast cancer

27

} Provide permittivity and conductivity distribution information for each

in a set of points in breast volume by applying microwave inverse

scattering interpretation algorithm

} Visualization of 3D tomogram images using the information obtained

} Cross-sectional imaging analysis function of specific area

} Measuring imaging analysis function

} marking breast tumor as the circle with a radius,

} calculating distance between two points in breast tumor,

} measuring the angle between three points, and

} extracting the boundary of breast cancer