ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

30
ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez

Transcript of ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

Page 1: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

ITKv4Testing Data

Zach Mullen – Patrick Reynolds - Luis Ibanez

Page 2: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

If it is not testedIt is broken...

Page 3: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

In the Beginning...

CVS

Code

BasicFilters

Algorithms

Testing

Data

Input

Baseline

Page 4: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

But Evil Followed...

CVS

Code

BasicFilters

Algorithms

Testing

Data

Input

Baseline

123 Mb 100%

25 Mb 20%

47 Mb 38%37 Mb 30%

20 Mb 16%

17 Mb 14%

Page 5: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

Everything that can go wrong,Will go wrong...

393,580 biorad.pic 446,520 small-tensors.raw 526,780 itkGDCMImageIOTest.dcm 529,352 dicom-sc_cs-1.dcm 1,500,227 GradientRecursive...Test.mha 3,775,680 TensorsCorpusCallosum.raw 4,876,920 DwiCorpusCallosum.raw

50% of Testing Data Input is taken by 3 files

1

0

2

Page 6: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

The Image Changed...

Who ? When ? What ? Why ?

Page 7: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

DIFF of binary is Useless !

CVS DIFF binarySVN DIFF binaryGIT DIFF binary

Page 8: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

So...In Revision Control

We keep the copies of binary files..For NOTHING !

Page 9: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

The Future...

Page 10: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

Video

Page 11: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

10 Gb

per experiment

Page 12: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

Microscopy

Page 13: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

1 Terabyte / day

per experiment

Page 14: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

Remote Sensing

Page 15: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

1 Gb / day

per experiment

Page 16: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

Git Submodule

Page 17: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

Two Git Repositories

CVS

Code

BasicFilters

Algorithms

Testing

Data

Page 18: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

Two Git Repositories

CVS

Code

BasicFilters

Algorithms

Testing

Data Data

Input

Baseline

Page 19: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

Two Git Repositories

CVS

Code

BasicFilters

Algorithms

Testing

Data Data

Input

Baseline

Page 20: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

Two Git Repositories

CVS

Code

BasicFilters

Algorithms

Testing

Data Data

Input

Baseline

HISTORY

Data

Page 21: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

MIDASOption

Page 22: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

One Git Repository + Database

CVS

Code

BasicFilters

Algorithms

Testing

Data

Page 23: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

One Git Repository + Database

CVS

Code

BasicFilters

Algorithms

Testing

DataData

Input

Baseline

MIDAS

Page 24: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

One Git Repository + Database

CVS

Code

BasicFilters

Algorithms

Testing

DataData

Input

Baseline

MIDAS

What Image ?

Page 25: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

One Git Repository + Database

CVS

Code

BasicFilters

Algorithms

Testing

DataData

Input

Baseline

MIDAS

HASH Id

myimage.png.md5

Page 26: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

add_test( itkTest01 ${IO_TESTS}${ITK_DATA_ROOT}/Input/cthead1.png

)

midas_add_test( itkTest01 ${IO_TESTS}

MIDAS{ cthead1.png.md5 }

Page 27: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

ctest -N

itkTest01_FetchData

itkTest01

Page 28: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

Type: CMAKE

CMake

MIDAS

6feffa5g.png

Download

image1.png.md5

6feffa5g

6feffa5g

Page 29: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

If the image changes...

CMake

MIDAS

5abff7c.png

Download

image1.png.md5

6feffa5g

5abff7c

5abff7c

Page 30: ITKv4 Testing Data Zach Mullen – Patrick Reynolds - Luis Ibanez.

End