Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer...
Transcript of Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer...
![Page 1: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/1.jpg)
Automatic Texture Guided Color Transfer and Colorization
B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1
1 Inria-LJK (UGA, CNRS), France2 Polytechnique Montréal, Canada
![Page 2: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/2.jpg)
2
Color Transfer
Input & Reference Our Result
![Page 3: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/3.jpg)
3
Colorization
Input & Reference Our Result
![Page 4: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/4.jpg)
4
Applications
● Photography / Cinema – Colors = mood, atmosphere, emotion
© Sweeney Todd
© The Matrix © Le Fabuleux Destin d'Amelie Poulain
© The Grand Budapest Hotel
![Page 5: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/5.jpg)
5
Applications
● Visualization / Imaging– Colors = information
© livescience.com© H. Zaidi
![Page 6: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/6.jpg)
6
Previous Work
● Global histogram transfers[Reinhard01], [Xiao06], [Pitié07]
[Reinhard01] Input Reference Result
![Page 7: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/7.jpg)
7
Previous Work
● Global histogram transfers[Reinhard01], [Xiao06], [Pitié07]
++ Simple, fast
++ Work well on similar images
[Reinhard01] Input Reference Result
![Page 8: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/8.jpg)
8
Previous Work
● Global histogram transfers[Reinhard01], [Xiao06], [Pitié07]
- - Unreliable
[Xiao 2006] Input Reference Result
![Page 9: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/9.jpg)
9
Previous Work
● Global histogram transfers[Reinhard01], [Xiao06], [Pitié07]
- - Unreliable
- - Can create new colors
Input Reference Result [Xiao 2006]
![Page 10: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/10.jpg)
10
Previous Work
● Local Transfers
Images from [Hristova15]
![Page 11: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/11.jpg)
11
Previous Work
● Local Transfers[Tai05], [Bonneel11], [Hristova15]
++ More accurate than global transfers
[Hristova15] Input Reference Result
![Page 12: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/12.jpg)
12
Previous Work
● Local Transfers[Tai05], [Bonneel11], [Hristova15]
++ More accurate than global transfers
- - Fail to distinguish between textured regions
[Hristova15] Input Reference Result
![Page 13: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/13.jpg)
13
Colorization
● No source color histogram
![Page 14: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/14.jpg)
14
Colorization
● No source color histogram– Transfer is impossible
– Chrominance need to be added
![Page 15: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/15.jpg)
15
Colorization
● Optimization based stroke diffusion [Levin04]
Input + user strokes Result
![Page 16: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/16.jpg)
16
Colorization
● Exemplar based approaches– Use a reference image [Welsh02], [Charpiat08],
[Gupta12], [Bugeau14]
Input Reference Result
![Page 17: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/17.jpg)
17
Colorization
● Exemplar based approaches
Images from [Gupta12]
Reference
Input
![Page 18: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/18.jpg)
18
Colorization
● Exemplar based approaches
Images from [Gupta12]
Features extraction
Reference
Input
![Page 19: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/19.jpg)
19
Colorization
● Exemplar based approaches
Images from [Gupta12]
Features extraction
Feature matching Reference
Input
![Page 20: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/20.jpg)
20
Colorization
● Exemplar based approaches
Images from [Gupta12]
Features extraction
Feature matching
Result
Reference
Input
![Page 21: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/21.jpg)
21
Colorization
● Exemplar based approaches
++ Very few user input
![Page 22: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/22.jpg)
22
Colorization
● Exemplar based approaches
++ Very few user input
- - Color coherency is hard to preserve
![Page 23: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/23.jpg)
23
Our Approach
![Page 24: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/24.jpg)
24
Our Approach
![Page 25: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/25.jpg)
25
Our Approach
![Page 26: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/26.jpg)
26
Our Approach
![Page 27: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/27.jpg)
27
Descriptors
![Page 28: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/28.jpg)
28
Descriptors
● How to describe a texture ?
![Page 29: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/29.jpg)
29
Descriptors
● How to describe a texture ?
Through the 1st and 2nd order luminance variations [Julesz70-80]
![Page 30: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/30.jpg)
30
Descriptors
● How to describe a texture ?
Through the 1st and 2nd order luminance variations [Julesz70-80] – We chose the covariance matrices introduced by
[Tuzel06] as 2nd order descriptors
![Page 31: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/31.jpg)
31
Descriptors
● How to describe a texture ?
Through the 1st and 2nd order luminance variations [Julesz70-80] – We chose the covariance matrices introduced by
[Tuzel06] as 2nd order descriptors
– Enriched by 1st order means similar to [Karacan13]
![Page 32: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/32.jpg)
32
Descriptors
● How to describe a texture ?
Through the 1st and 2nd order luminance variations [Julesz70-80] – We chose the covariance matrices introduced by
[Tuzel06] as 2nd order descriptors
– Enriched by 1st order means similar to [Karacan13]
– Computed on the luminance and its derivatives
![Page 33: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/33.jpg)
33
Descriptors
● Our feature vector
![Page 34: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/34.jpg)
34
Descriptors
● Our feature vector
Luminance
![Page 35: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/35.jpg)
35
Descriptors
● Our feature vector
First derivatives of theluminance
![Page 36: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/36.jpg)
36
Descriptors
● Our feature vector
Second derivativesof the luminance
![Page 37: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/37.jpg)
37
Descriptors
● Our descriptor
S(p) =Covariance matrix
Information(6x6)
Second orderInformation
Meanof
features(6x1)
First orderInformation
![Page 38: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/38.jpg)
38
Descriptors
● Descriptor for each pixel
![Page 39: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/39.jpg)
39
Descriptors
● Descriptor for each pixel
![Page 40: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/40.jpg)
40
Descriptors
● Descriptor for each pixel
![Page 41: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/41.jpg)
41
Descriptors
● Descriptor for each pixel
![Page 42: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/42.jpg)
42
Descriptors
● Descriptor for each pixel
![Page 43: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/43.jpg)
43
Descriptors
● Descriptor for each pixel
![Page 44: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/44.jpg)
44
Descriptors
● Descriptor for each pixel
![Page 45: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/45.jpg)
45
Descriptors
● Descriptor for each pixel
![Page 46: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/46.jpg)
Descriptors
● Descriptor for each pixel
![Page 47: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/47.jpg)
47
Descriptors
● Descriptor for each pixel
![Page 48: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/48.jpg)
48
Descriptors
● Descriptor for each pixel
![Page 49: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/49.jpg)
49
Descriptors
● Descriptor for each pixel
![Page 50: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/50.jpg)
50
Descriptors
● Descriptor for each pixel
![Page 51: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/51.jpg)
51
Descriptors
● Descriptor window size
Input window 13x13 window 43x43(512x512)
![Page 52: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/52.jpg)
52
Descriptors
● We want homogeneous descriptors over textured regions
![Page 53: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/53.jpg)
53
Descriptors
● We want homogeneous descriptors over textured regions➔ Compute them with a large window
![Page 54: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/54.jpg)
54
Descriptors
● We want homogeneous descriptors over textured regions➔ Compute them with a large window
● We want to preserve image structure and texture transitions
![Page 55: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/55.jpg)
55
Descriptors
● We want homogeneous descriptors over textured regions➔ Compute them with a large window
● We want to preserve image structure and texture transitions➔ Adapt descriptors around those transitions
![Page 56: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/56.jpg)
56
Descriptors
● We want homogeneous descriptors over textured regions➔ Compute them with a large window
● We want to preserve image structure and texture transitions➔ Adapt descriptors around those transitions➔ The descriptors variance allows to detect those
transition areas !
![Page 57: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/57.jpg)
57
Descriptors
● Gradient descent guided by the descriptors variance
![Page 58: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/58.jpg)
58
Descriptors
● Gradient descent guided by the descriptors variance
Input
![Page 59: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/59.jpg)
59
Descriptors
● Gradient descent guided by the descriptors variance
Input Descriptors
![Page 60: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/60.jpg)
60
Descriptors
● Gradient descent guided by the descriptors variance
Input Descriptors Variance
![Page 61: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/61.jpg)
61
Descriptors
● Gradient descent guided by the descriptors variance
Input Descriptors Variance
![Page 62: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/62.jpg)
62
Descriptors
● Gradient descent guided by the descriptors variance
Input Descriptors Variance
![Page 63: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/63.jpg)
63
Descriptors
● Gradient descent guided by the descriptors variance
Input Descriptors Variance
![Page 64: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/64.jpg)
64
Descriptors
● Gradient descent guided by the descriptors variance
Input Descriptors Variance
![Page 65: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/65.jpg)
65
Descriptors
● Gradient descent guided by the descriptors variance
Input Descriptors Variance Descriptors aftergradient descent
![Page 66: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/66.jpg)
66
Descriptors
● Multiscale gradient descent
Descriptors
![Page 67: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/67.jpg)
67
Descriptors
● Multiscale gradient descent
Descriptors Standard gradientdescent
![Page 68: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/68.jpg)
68
Descriptors
● Multiscale gradient descent
Descriptors Standard gradientdescent
Multiscale gradient descent
![Page 69: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/69.jpg)
69
Descriptors
● Multiscale gradient descent
Descriptors Standard gradientdescent
Multiscale gradient descent
!!!
![Page 70: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/70.jpg)
70
Descriptors
● Unnormalized bilateral filter [Aubry14]
![Page 71: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/71.jpg)
71
Descriptors
● Unnormalized bilateral filter [Aubry14]– Guided by the input image luminance
![Page 72: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/72.jpg)
72
Descriptors
● Unnormalized bilateral filter [Aubry14]– Guided by the input image luminance
– Little to no halos, no gradient reversal
![Page 73: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/73.jpg)
73
Descriptors
● Unnormalized bilateral filter [Aubry14]– Guided by the input image luminance
– Little to no halos, no gradient reversal
– Similar to an anisotropic diffusion
![Page 74: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/74.jpg)
74
Descriptors
● Unnormalized bilateral filter [Aubry14]
Input Descriptors aftergradient descent
Descriptors aftergradient descent
and filtering
![Page 75: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/75.jpg)
75
Similarity Maps
![Page 76: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/76.jpg)
76
Similarity Maps
● Similarity computed as the L2 Euclidean distance between two descriptors, filtered by a Gaussian
![Page 77: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/77.jpg)
77
Similarity Maps
● Similarity computed as the L2 Euclidean distance between two descriptors, filtered by a Gaussian
![Page 78: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/78.jpg)
78
Similarity Maps
● Similarity computed as the L2 Euclidean distance between two descriptors, filtered by a Gaussian
Control parameter
![Page 79: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/79.jpg)
79
Similarity Maps
![Page 80: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/80.jpg)
80
Similarity Maps
![Page 81: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/81.jpg)
81
Similarity Maps
![Page 82: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/82.jpg)
82
Color Transfer
![Page 83: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/83.jpg)
83
Color Transfer
● Global transfer from [Reinhard01]
![Page 84: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/84.jpg)
84
Color Transfer
● Global transfer from [Reinhard01]– Transfer the mean and standard deviation of each
channel of the reference to the input
![Page 85: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/85.jpg)
85
Color Transfer
● Global transfer from [Reinhard01]– Transfer the mean and standard deviation of each
channel of the reference to the input
– Translate and stretch the input histogram
![Page 86: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/86.jpg)
86
Color Transfer
● Global transfer from [Reinhard01]– Transfer the mean and standard deviation of each
channel of the reference to the input
– Translate and stretch the input histogram
● We use weighted means and standard deviations using our similarity maps
![Page 87: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/87.jpg)
87
Color Transfer
● Global transfer from [Reinhard01]– Transfer the mean and standard deviation of each
channel of the reference to the input
– Translate and stretch the input histogram
● We use weighted means and standard deviations using our similarity maps➔ Perform a local transfer between similar pixels
![Page 88: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/88.jpg)
88
Color Transfer
● Our Result
Input & Reference Result with σd= 1
![Page 89: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/89.jpg)
89
Color Transfer
● Effect of σd
Input & Reference Result with σd= 2
![Page 90: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/90.jpg)
90
Color Transfer
● Effect of σd
Input & Reference Result with σd= 4
![Page 91: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/91.jpg)
91
Color Transfer
● Effect of σd
= [Reinhard01]
![Page 92: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/92.jpg)
92
Color Transfer
Input Reference Our Result
![Page 93: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/93.jpg)
93
Transfer - Comparisons
Input Reference
![Page 94: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/94.jpg)
Transfer - Comparisons
Input Reference [Reinhard01] [Xiao06]
[Pitié07] [Pouli11] [Hristova15] Our Result
![Page 95: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/95.jpg)
Transfer - Comparisons
Input Reference [Reinhard01] [Xiao06]
[Pitié07] [Pouli11] [Hristova15] Our Result
![Page 96: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/96.jpg)
Transfer - Comparisons
Input Reference [Reinhard01] [Xiao06]
[Pitié07] [Pouli11] [Hristova15] Our Result
![Page 97: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/97.jpg)
Transfer - Comparisons
Input Reference [Reinhard01] [Xiao06]
[Pitié07] [Pouli11] [Hristova15] Our Result
![Page 98: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/98.jpg)
98
Colorization
![Page 99: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/99.jpg)
99
Colorization
● We cannot transfer missing colors
![Page 100: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/100.jpg)
100
Colorization
● We cannot transfer missing colors● Each output pixel is given the mean
chromaticity of the reference
![Page 101: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/101.jpg)
101
Colorization
● We cannot transfer missing colors● Each output pixel is given the mean
chromaticity of the reference, weighted by the similarity maps
![Page 102: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/102.jpg)
102
Colorization
● Result
Input & Reference Result with σd= 0.2
![Page 103: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/103.jpg)
103
Colorization
● Effect of σd
Input & Reference Result with σd= 1
![Page 104: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/104.jpg)
104
Colorization
● Effect of σd
Input & Reference Result with σd= 2
![Page 105: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/105.jpg)
105
Colorization
Input Reference Our Result
![Page 106: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/106.jpg)
106
Colorization - Comparisons
Input Reference
![Page 107: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/107.jpg)
Colorization - Comparisons
Input Reference [Welsh02] [Charpiat08]
[Gupta12] [Bugeau14] [Pierre15] Our Result
![Page 108: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/108.jpg)
Colorization - Comparisons
Input Reference [Welsh02] [Charpiat08]
[Gupta12] [Bugeau14] [Pierre15] Our Result
![Page 109: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/109.jpg)
Colorization - Comparisons
Input Reference [Welsh02] [Charpiat08]
[Gupta12] [Bugeau14] [Pierre15] Our Result
![Page 110: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/110.jpg)
Colorization - Comparisons
Input Reference [Welsh02] [Charpiat08]
[Gupta12] [Bugeau14] [Pierre15] Our Result
![Page 111: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/111.jpg)
Colorization - Comparisons
Input Reference [Welsh02] [Charpiat08]
[Gupta12] [Bugeau14] [Pierre15] Our Result
![Page 112: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/112.jpg)
112
Limitations
● Texture based approach
![Page 113: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/113.jpg)
113
Limitations
● Texture based approach– Not well suited for texture-less images
● Similar to applying a global transfer
![Page 114: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/114.jpg)
114
Limitations
● Texture based approach– Not well suited for texture-less images
– Fine structures can be mistaken as textures
![Page 115: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/115.jpg)
115
Limitations
● Texture based approach– Not well suited for texture-less images
– Fine structures can be mistaken as textures
Input Reference Our Result
![Page 116: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/116.jpg)
116
Limitations
● Texture based approach– Not well suited for texture-less images
– Fine structures can be mistaken as textures
Input Reference Our Result
![Page 117: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/117.jpg)
117
Future Works
![Page 118: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/118.jpg)
118
Future Works
● Edge preserving texture descriptors
![Page 119: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/119.jpg)
119
Future Works
● Edge preserving texture descriptors– Can be used in a lot of different applications
![Page 120: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/120.jpg)
120
Future Works
● Edge preserving texture descriptors– Can be used in a lot of different applications
● Transfer and colorization
![Page 121: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/121.jpg)
121
Future Works
● Edge preserving texture descriptors– Can be used in a lot of different applications
● Transfer and colorization– Several references could be used
![Page 122: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/122.jpg)
122
Future Works
● Edge preserving texture descriptors– Can be used in a lot of different applications
● Transfer and colorization– Several references could be used
– Could be extended to video inputs
![Page 123: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/123.jpg)
123
Thank you for your attention
![Page 124: Automatic Texture Guided Color Transfer and Colorization...Automatic Texture Guided Color Transfer and Colorization B. Arbelot1, R. Vergne1, T. Hurtut2 & J. Thollot1 1 Inria-LJK (UGA,](https://reader030.fdocuments.in/reader030/viewer/2022040906/5e7bc8ffc8494b07f513dfd0/html5/thumbnails/124.jpg)
124
Descriptors
● Effect of each step on a transfer result
Initial descriptors Only grad. descent Only filtering Both