Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by...
Transcript of Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by...
![Page 1: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/1.jpg)
Detecting Photoshopped Faces by
Scripting Photoshop
Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1
Richard Zhang2 Alexei A. Efros1
UC Berkeley1 Adobe Research2
![Page 2: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/2.jpg)
Video Source: https://www.youtube.com/watch?v=5Qqv_C6iVvQ
![Page 3: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/3.jpg)
Warp
detector
![Page 4: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/4.jpg)
Original Automatic random warping manipulations
Dataset
![Page 5: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/5.jpg)
Original
![Page 6: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/6.jpg)
#1 modification
![Page 7: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/7.jpg)
#2 modification
![Page 8: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/8.jpg)
#3 modification
![Page 9: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/9.jpg)
#4 modification
![Page 10: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/10.jpg)
Real-or-fake classification
99.4%
53.5%
% a
ccura
cy
Ours Human
![Page 11: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/11.jpg)
Dilated ResNet Manipulated Image Warp Prediction
What moved where?
![Page 12: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/12.jpg)
Modified Original Flow Modified Original Flow
What moved where?
![Page 13: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/13.jpg)
Results
![Page 14: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/14.jpg)
Manipulated Photo
![Page 15: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/15.jpg)
Suggested “undo” Prediction Manipulated Flow Prediction
![Page 16: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/16.jpg)
Suggested “undo” Prediction Manipulated Suggested “Undo”
![Page 17: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/17.jpg)
Original Photo
![Page 18: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/18.jpg)
Manipulated vs. Original
![Page 19: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/19.jpg)
Prediction Manipulated Undo vs. Original
![Page 20: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/20.jpg)
Manipulated Photo
![Page 21: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/21.jpg)
Suggested “undo” Prediction Manipulated Flow Prediction
![Page 22: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/22.jpg)
Suggested “undo” Prediction Manipulated Suggested “Undo”
![Page 23: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/23.jpg)
Original Photo
![Page 24: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/24.jpg)
Manipulated vs. Original
![Page 25: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/25.jpg)
Suggested “undo” Prediction Manipulated Undo vs. Original
![Page 26: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/26.jpg)
Manipulated Photo
![Page 27: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/27.jpg)
Suggested “undo” Prediction Manipulated Flow Prediction
![Page 28: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/28.jpg)
Suggested “Undo”
![Page 29: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/29.jpg)
Original Photo
![Page 30: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/30.jpg)
Manipulated vs. Original
![Page 31: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/31.jpg)
Prediction Manipulated Undo vs. Original
![Page 32: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/32.jpg)
Manipulated Photo
![Page 33: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/33.jpg)
Suggested “undo” Prediction Manipulated Flow Prediction
![Page 34: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/34.jpg)
Suggested “undo” Prediction Manipulated Suggested “Undo”
![Page 35: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/35.jpg)
Original Photo
![Page 36: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/36.jpg)
Manipulated vs. Original
![Page 37: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/37.jpg)
Suggested “undo” Prediction Manipulated Undo vs. Original
![Page 38: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/38.jpg)
Manipulated Photo
![Page 39: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/39.jpg)
Flow Prediction
![Page 40: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/40.jpg)
Suggested “undo” Prediction Manipulated Suggested “Undo”
![Page 41: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/41.jpg)
Original Photo
![Page 42: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/42.jpg)
Manipulated vs. Original
![Page 43: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/43.jpg)
Suggested “undo” Prediction Manipulated Undo vs. Original
![Page 44: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/44.jpg)
Manipulated Photo
![Page 45: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/45.jpg)
Suggested “undo” Prediction Manipulated Flow Prediction
![Page 46: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/46.jpg)
Suggested “undo” Prediction Manipulated Suggested “Undo”
![Page 47: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/47.jpg)
Original Photo
![Page 48: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/48.jpg)
Manipulated vs. Original
![Page 49: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/49.jpg)
Suggested “undo” Prediction Manipulated Undo vs. Original
![Page 50: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/50.jpg)
Manipulated Photo
![Page 51: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/51.jpg)
Suggested “undo” Prediction Manipulated Flow Prediction
![Page 52: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/52.jpg)
Suggested “Undo”
![Page 53: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/53.jpg)
Original Photo
![Page 54: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/54.jpg)
Manipulated vs. Original
![Page 55: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/55.jpg)
Undo vs. Original
![Page 56: Learning to Detect Photoshopped Faces by Scripting Photoshop · Detecting Photoshopped Faces by Scripting Photoshop Sheng-Yu Wang1 Oliver Wang2 Andrew Owens1 Richard Zhang2 Alexei](https://reader036.fdocuments.in/reader036/viewer/2022090607/605ca62dc7e00a2be378e1bb/html5/thumbnails/56.jpg)
Thank you!
https://peterwang512.github.io/FALdetector
This work was supported, in part, by DARPA MediFor and UC
Berkeley Center for Long-Term Cybersecurity.
The views, opinions and/or findings expressed are those of theauthors and should not be interpreted as representing the official views or policies of
the Department of Defense or the U.S. Government.