Lev Manovich The engeneering of vision
-
Upload
julianalugao -
Category
Documents
-
view
234 -
download
0
Transcript of Lev Manovich The engeneering of vision
-
8/13/2019 Lev Manovich The engeneering of vision
1/211
!"# %&'(#)*+
,+" -'.)'""/)'. (0 1)2)(' 0/(3 4('25/6*5)#)23 5( 4(3765"/2
-
8/13/2019 Lev Manovich The engeneering of vision
2/211
89,:;
4?@A,-: >B 18C=@! @,;%8C% D
"# $ %&'()*+&$(% ,-# . /0.'$1.%&23 045+6(3(75 2%) &6. 4+$.%+. (8 2 '& ""9# :$4*23 2 &(1$41 ; 2 +(). 8(' 1 244 +(11*%$+2&$(% "?()5 0'(?3.1 --@# :$4*23 . 40.'2%&( -A
) +(10*&.' 7 '206$+4 ; $ %&.'2+&$:. 0.'40.+&$:23$41 "-@@# +(10*&.' : $4$(%; 2 *&(12&$(% (8 4$76& "9-
-
8/13/2019 Lev Manovich The engeneering of vision
3/211
-
8/13/2019 Lev Manovich The engeneering of vision
4/211
&JKOK MN SRPJMS^ FT[QMSF QXRYP PJMN LKVMSMPMRS RV ZMNMRS] MP MN VY
TKO\KTPMRS MN OKLY\KL PR Q SYWXKO RV \RWTYPQPMRSQ[ TOR\KNNKN VRO P
MSVROWQPMRS QXRYP PJK _RO[L; PJK MLKSPMPU RV RXaK\PN QSL PJKMO TRNM
dMSL RV MSVROWQPMRS _JM\J WQU XK OK`YMOKL VRO Q ORXRP RO QS QYPRWQ
PQNd# 1QOO TORaK\PN PJKNK ^RQ[N RV WQ\JMSK ZMNMRS RSPR JYWQS ZMNMRS
PJK \RWWRS LKSRWMSQPRO NJQOKL XU JYWQSN QSL [R_ [KZK[ RO^QSMNWN; PR
TOKLQPROB Q TOKU#
$S Q NTK\MQ[ "D,= MNNYK RV +R^SMPMRS fPJK [KQLMS^ TKOMRLM\Q[ RV \R
PR ZMNYQ[ OKTOKNKSPQPMRSNB 4PKZKS 0MSdKO RYP[MSKL PJK YSLKONPQSLM\R^SMPMZK TNU\JR[R^MNPN;
+KOPQMS QXNPOQ\P TORX[KWN \RY[L XK XKNP NR[ZKL XU POQSN[QPMS^ PJKMOPOQSNVROWMS^ PJKW YNMS^ QZQM[QX[K MWQ^K POQSNVROWQPMRSNB LKPK\PQSL TORTKOPMKNB QSL POQSN[QPMS^ PJRNK OK[QPMRSN QSL TORTKOPMKN XQ\2
$S PJMN LKVMSMPMRSB ZMNMRS MN ZQ[YKL WKOK[U VRO MPN PRTR[R^M\Q[ TO
NY\J OK[QPMRSN QN MS\[YNMRSB TORcMWMPUB QSL OK[QPMZK TRNMPMRSN# 2
N\MKSPMNPNB PJKNK TORTKOPMKN WQdK MP Q WROK KVVM\MKSP WKLMYW V
PJMSdMS^ PJQS [QS^YQ^K# 2SL NMS\K PJK WMSL MPNK[V MN MWQ^MSKL QN QS K
\RWTYPQPMRSQ[ KVVM\MKS\U PJQP KZR[ZKL PJORY^J KZR[YPMRSB N\MKSPMNPN
ZMNYQ[ fOKQL; PRTR[R^M\Q[g OKTOKNKSPQPMRSN VRO ZQOMRYN WKSPQ[ TOR
_MPJRYP _QNPKB _K WM^JP LMNTKSNK _MPJ [QS^YQ^K QSL MSNPKQL PJMSd PJOR
RYONK[ZKN MSPR PJK NM[KSP WRZMK PJKQPKO RV RYO WMSLN#
6KOK MN QSRPJKO WRLK[ RV ZMNMRS PJQP SQOOR_N MPN LKVMSMPMRS P
TORTKOPU# $S Q "D@" RZKOZMK_ RV QTT[MKL KcTKOMWKSPQ[ TNU\JR[R^UB PJK
dSR_S QN JYWQS VQ\PRONB 0QY[ 8MPPN _OMPKN;
2 4PKZKS 0MSdKOB F:MNYQ[ +R^SMPMRS; 2S $SPORLY\PMRSBF +R^SMPMRS ", f"D,
-
8/13/2019 Lev Manovich The engeneering of vision
5/211
.Q\J NKSNK WRLQ[MPU JQN \KOPQMS MSJKOKSP QLZQSPQ^KN QSL LMNQLZQSPQ^QSQ[UNMN RV LMVVKOKSP dMSLN RV MSVROWQPMRS# 2YLMPMRS MN WROK SKZMNMRS MN XQNM\Q[[U NK[K\PMZK QSL MSPKOWMPPKSP# 2N Q \RSNK`YKS\KB QYLKPK\PMRS RV _QOSMS^ NPMWY[M PJQP WQU QOMNK QP QSU WRWKSP VORW RSK_JKOKQN ZMNMRS MN _K[[ NYMPKL PR PJK NK[K\PMRS RV QSL \RS\KSPOQPMRS RSKc\[YNMRS RV RPJKON#3
GJQP MN PJK TYOTRNK RV PJMN OKNKQO\J MSPR PJK OK[QPMZK TORTKOPMKN R
WQSYQ[ _ROdKOB PJK aRX RV QS RTKOQPRO MS Q WRLKOS JYWQS>WQ\JMSK NUN
\R\dTMPB OQLQO LMNT[QU RO QS QYPRWQPKL TORLY\PMRS [MSKB MN TOMWQO
JKO _ROd MN PR WRSMPRO PJK LMNT[QUN QSL PR LKPK\P PJRNK NM^SQ[N PJQP O
MS GRO[L GQO $$B KcTKOMWKSPQ[ TNU\JR[R^MNPN JQZK \R[[QXROQPKL _MPJ K
LMNT[QUN QSL TKO\KTPYQ[ NPOQPK^MKN VRO PJKMO RTKOQPRON# (SK RV PJK
OKNKQO\J JQN XKKS PJK OK[QPMZK QLZQSPQ^KN RV ZMNYQ[B QYLMPROU QSL
QSL QSQ[UNMN RV LMVVKOKSP dMSLN RV NM^SQ[N# +RSNK`YKSP[UB 8MPPN LK
WRNP OK[MQX[K QSL KVVM\MKSP VRO PJK \RSNPQSP NYOZKM[[QS\K RV Q NMS^
NK[K\PMZK QSL MSPKOWMPPKSP#F 2\\ROLMS^ PR PJMN WRLK[B MS ROLKO PR YN
RSKHN KUKN WYNP XK [MPKOQ[[U F^[YKL PR PJK N\OKKS#F$S KQ\J RV PJKNK WRLK[NB ZMNMRS MN YSLKONPRRL MS PKOWN RV MPN
NTK\MVM\ PQNdN; OK\RZKOU RV PJOKK>LMWKSNMRSQ[ MSVROWQPMRSB [R^M\
$S VQ\PB PJKOK MN SR NMS^[K WKQSMS^ RV FZMNMRSF _JM\J MN NJQOKL QWRS
LRKN SRP KcMNP# &JK RS[U PJMS^ PJQP YSMPKN PJKNK WRLKOS QTTORQ\JKN PR
KVVM\MKSPB OK[MQX[KB QSL KVVK\PMZK MSNPOYWKSPN RV [QXRO# $S PJMN
NKTQOQPK PRR[N _JM\J \QS XK KWT[RUKL XU KMPJKO Q JYWQS RO Q WQ\JMSK P
$P MN PJMN KWTJQNMN RS PJK TORLY\PMZK YNKN RV ZMNMRS PJQP LMNP
SYWXKO RV OK\KSP JMNPROMKN RV ZMNMRS# $S "D,, 6Q[ 8RNPKO KLMPKL PJK Q
3 0QY[ 8MPPNB F.S^MSKKOMS^ 0NU\JR[R^U QSL .`YMTWKSP )KNM^SBF MS 6QSLXR0NU\JR[R^UB KL# 4#4# 4PKZKSN f%K_ 5ROd QSL 3RSLRS; hRJS GM[KU i 4RSNB $S\#B
-
8/13/2019 Lev Manovich The engeneering of vision
6/211
:MNYQ[MPU _JM\J XORY^JP PR^KPJKO PJK ^ORYSLXOKQdMS^ KNNQUN YSMPKL X
JMNPROM\MNMS^ WRLKOS ZMNMRSB PJQP MNB OKaK\PMS^ MP QN Q SQPYOQ[ RO4 $S PJK [QNP VK_
UKQONB KQ\J RV PJK VMZK \RSPOMXYPRON >> 1QOPMS hQUB hRSQPJQS +OQOUB
?OUNRSB QSL hQ\`YK[MSK 'RNK >> JQZK LKZK[RTKL PJKMO KNNQUN MSPR XRRd
LKVMSK PJK LMOK\PMRS RV PJK LMN\RYONK RS PJK ZMNYQ[ MS JYWQSMPMKN#5
2P PJK \KSPKO RV PJMN LMN\RYONK MN PJK KcTKOMKS\K RV Q NKKMS^ NY
MSV[YKS\KL XU TNU\JM\ NPOY\PYOKNB XU KSLKO QSL TR_KO TRNMPMRSNB Q
XRLU] JR_ MN RSKHN NYXaK\PMZMPU LKPKOWMSKL XU PJK KcTKOMKS\K RV NK
XRYSLQOMKN QOK _ROdN RV QOP QSL RPJKO \Y[PYOQ[ OKTOKNKSPQPMRSNB _JPOQ\KN RV PJMN \JQS^MS^ KcTKOMKS\K#
&JK Q\\RYSPN RV PJKNK _OMPKON OKQP[U KcTQSLKL PJK JROMbRSN RV RY
WRLKOS ZMNMRS# 5KPB _JQP OKWQMSKL YSKcQWMSKL MN PJK KWT[RUWKSP R
MN OKWQOdQX[K PJQP PJK ^ORYSLMS^ TJM[RNRTJM\Q[ QSL TNU\JRQSQ[UPM\ WR
MS PJMN LMN\RYONKB QOK PJKROMbKL VORW PJK KcTKOMKS\K RV Q FZQ\QPMR
TKONRS _QSLKOMS^ MS PJK LKNKOPKL 0QOMNMQS TQOd] VRO 3Q\QSB MP _QN P
JMWNK[VgB FXKMS^ RXNKOZKLF XU Q NJMSMS^ NQOLMSK \QSB _JM[K JK _QN M
SKQO Q NWQ[[ TROP] VRO 8OKYLB MP _QN Q URYS^ _RWQS \RSVMSKL PR MNR[QP
RO NKSP PR Q OKNROP# %RP RS[U QOK PJKNK NYXaK\PN VQO VORW Q WRLKOS _
Q_QU VORW PJK TORPRPUTM\Q[ TKO\KTPYQ[ NTQ\KN RV WRLKOSMPU; PJK \MPU
NJRTTMS^ QO\QLK#
4 6Q[ 8RNPKOB KL#B :MNMRS QSL :MNYQ[MPU f4KQPP[K; ?QU 0OKNNB "D,,g#5 1QOPMS hQUB )R_S\QNP .UKN; PJK )KSM^OQPMRS RV :MNMRS MS &_KSPMKPJ>\Kf?KOdK[KU; &JK *SMZKONMPU RV +Q[MVROSMQ 0OKNNB "DD9g] hRSQPJQS +OQO(XNKOZKO; RS :MNMRS QSL 1RLKOSMPU MS PJK %MSKPKKSPJ +KSPYOU f+QWXO"DDEg] 'RNQ[MSL COQYNNB &JK (TPM\Q[ *S\RSN\MRYN f+QWXOML^K; &JK 1$& 0O?OUNRSB 3RRdMS^ QP PJK (ZKO[RRdKL; 8RYO .NNQUN RS 4PM[[ 3MVK 0QMSPMS^ f*SMZKONMPU 0OKNNB "DDEg] hQ\`YK[MSK 'RNKB 4KcYQ[MPU MS PJK 8MK[L RV :"D,
-
8/13/2019 Lev Manovich The engeneering of vision
7/211
$P MN TOK\MNK[U PJK KcTKOMKS\K RV PJKNK NTQ\KN PJQP ^QZK OMNK PR
PJKROMbMS^ RV ZMNMRS MS PJK _OMPMS^N RV GQ[PKO ?KSaQWMS# 4\OYPMSMb
WRLKOSMPUB ?KSaQWMS _QN QWRS^ PJK VMONP PR SRPM\K PJK \RSPM^YMPU X
KcTKOMKS\KN MS PJK _ROdT[Q\K QSL RYPNMLK RV MP;
GJKOKQN 0RKHN TQNNKON>XU \QNP [QS\KN MS Q[[ LMOK\PMRSN _JM\J NPM[[ QT TKLKNPOMQSN QOK RX[M^KL PR LR NR MS ROLKO PR dKKT QXOKQNP RV POQVVNYXaK\PKL PJK JYWQS NKSNROMYW PR Q \RWT[Kc dMSL RV POQMSMS^# &JKOK \QYO^KSP SKKL VRO NPMWY[M _QN WKP XU PJK VM[W# $S Q VM[WB TKO\KTPMRS MKNPQX[MNJKL QN Q VROWQ[ TOMS\MT[K# &JQP _JM\J LKPKOWMSKN PJK OJUPJW R XK[P MN PJK XQNMN RV PJK OJUPJW RV OK\KTPMRS MS PJK VM[W#6
6KOK ?KSaQWMS Q[OKQLU SRPM\KN PJQP ZMNMRS XK\QWK Q VYS\PMRSQ[ QSL T
Q LMNMSPKOKNPKL RO \RSPKWT[QPMZK RSK# &JK KUK MN POQMSKL PR dKKT T
MSLYNPOMQ[ TORLY\PMRS QP PJK VQ\PROU QSL PR SQZM^QPK PJORY^J PJK \RWT
XKURSL PJK VQ\PROU ^QPKN#
2WRS^ PJK \RSPOMXYPRON PR :MNMRS QSL :MNYQ[MPUB hRSQPJQS +OQOU
PJK TOMWQ\U RV _ROd VRO PJK JMNPROU RV ZMNMRS MS PJK WRLKOS TKOMRL#
(XNKOZKOB JK KcQWMSKN JR_ NY\J SMSKPKKSPJ \KSPYOU LMN\MT[MSKN QN TJU TNU\JRTJUNM\NB QSL NY\J PK\JSM`YKN QN RTPM\Q[ QTTQOQPYNKN QSL M[[YNM
[QPKO TORLY\PMZK LKT[RUWKSP# &JMN VQO>OKQ\JMS^ QO\JKR[R^U MN KcPOKW
PJK Q\\RYSP KSLN MS PJK WMLL[K RV PJK SMSKPKKSPJ \KSPYOUB MP \QS RYP[MS
ZMNMRS RS[U MS ZKOU XORQL PKOWN; QN TQOPM\MTQPMS^ MS PJK TOR\KNN R
QN QLQTPMS^ PR PJK SK_ V[Yc RV LKWQPKOMQ[MbKL MWQ^KN QSL NM^SN# $S R
OKQ[[U JQTTKSKL PR ZMNMRS MS PJK P_KSPMKPJ \KSPYOUB JR_ MP _QN Q\PYQ[[
+OQOUHN &K\JSM`YKN RV PJK (XNKOZKO MN SK\KNNQOU XYP SRP NYVVM\MKS
KWKO^KS\K RV LMN\MT[MSKN QSL PK\JSM`YKN RV ZMNMRS PJQP NMWT[U \QSSR
6 GQ[PKO ?KSaQWMSB F(S 4RWK 1RPMZKN MS ?QYLK[QMOKBF MS $[[YWMSQPMRf%K_ 5ROd; 4\JR\JKS ?RRdNB "D
-
8/13/2019 Lev Manovich The engeneering of vision
8/211
QSQ[UbKL XU +OQOU# $S ROLKO PR YSLKONPQSL PJKMO \YOOKSP LMOK\PMRSN
TJKSRWKSQ RV WROK OK\KSP ROM^MS NY\J QN QYPRWQPMRSB \RWTYPKOMbQP
OKZR[YPMRS#F 1RNP MWTROPQSP[UB _JQP \RY[L SRP JQZK XKKS TOKLM\PKL VO
OQLM\Q[ NJMVP MS PJK SQPYOK RV [QXRO MPNK[V# ?KSaQWMS LKN\OMXKL PJK
PJK QNNKWX[U [MSK _ROdKO RV PJK MSLYNPOMQ[ KOQB _JR _QN SKZKOPJK[KNN
_ROd; [MVPMS^B JQWWKOMS^B VM[MS^B QSL WR[LMS^# &RLQUB JR_KZKOB MS
NQWK _ROdKO MN TQML VRO FTKO\KMZMS^F >> _QP\JMS^B LKPK\PMS^B N\QSSM
&JMN LMNNKOPQPMRS MN QS QO\JKR[R^U RV PJK \YOOKSP[U TORWMSKSP
RV ZMNMRS >> \RWTYPKO ZMNMRS QSL \R^SMPMZK N\MKS\KB ZMOPYQ[ OKQ[MPMSPKOVQ\KN# $S PJMN QO\JKR[R^UB $ POU PR YS\RZKO PJK OK\KSP[U Q\\YWY[QP
"D
-
8/13/2019 Lev Manovich The engeneering of vision
9/211
\Y[PYOK QOK Q[[ NUWTPRWN RV PJMN KWKO^MS^ YSLKONPQSLMS^ RV ZMNMRS
VRO [R^M\Q[ PJMSdMS^# GMPJ PJK \KSPOQ[MPU RV \R^SMPMRS VRO PJK TRNP>MS
RV ZMNYQ[ OKQNRSMS^ Q\`YMOKL SK_ MWTROPQS\K# +RSNK`YKSP[UB PJK _ROd
QSL PK\JSR[R^MKN RV ZMNYQ[ OKQNRSMS^B _JM\J _QN TOKZMRYN[U TYONYKL
XK\QWK Q WQPPKO RV NUNPKWQPM\ OKNKQO\J RS PJK MSLYNPOMQ[ N\Q[K MS N
TNU\JR[R^U QSL N\MKSPMVM\ ZMNYQ[MbQPMRS#
&JK PJMOL \JQTPKO QLLOKNNKN PJK OR[K RV ZMNMRS QN Q _QU PR \QTPY
6MNPROM\Q[[UB PJMN OR[K JQN XKKS T[QUKL XU PJK PK\JSM`YKN RV TKONTK\P
"D=E QSL "DMSLYNPOMQ[ NR\MKPUB ZM
MSNPOYWKSP RV [QXROB PJK WRNP TORLY\PMZK RO^QS RV QS RTKOQPRO MS Q
ROLKO PR WRSMPRO QSL MWTORZK PJK NUNPKWHN TORLY\PMZMPUB KS^MSKK
TNU\JR[R^MNPN JQZK QLRTPKL Q \RWWRS VOQWK_ROd RV MSVROWQPMRS PJKR
WQ\JMSK \RWTRSKSPN#
&RLQUB PJK SYWXKO RV SK_ LMN\MT[MSKN _JM\J NPYLU ZMNMRS \RSPMS
N\MKS\KB \RWTYPKO OQTJM\NB MWQ^K TOR\KNNMS^B \RWTYPKO ZMNMRSB OK
MSPKOVQ\KN QSL NR RS# GJUe 1RLKOS NR\MKPU OK[MKN RS ZMNMRS SRP RS[U Q
TORLY\PMRS RV NYXaK\PMZMPU XYP VMONP RV Q[[ QN Q WKQSN RV K\RSRWM\ T
ZMNMRS JQN XKKS KcPKSNMZK[U PJKROMbKLB PJK NK\RSL NR VQO OKWQMSKL
PJQP PJMN LMNNKOPQPMRS _M[[ XK^MS VM[[MS^ PJMN WMNNMS^ ^QT MS JMNPR
-
8/13/2019 Lev Manovich The engeneering of vision
10/211
+,-.$/% 01 2*3(-4 5$&6*36
01 "#$%&'()$*
3KP YN \RWTQOK P_R NPQPKWKSPN XRPJ OK[QPKL PR PJK `YKNPMRS RV ZMNYQ[
LMVVKOKSP TKOMRLN#
+JQO[KN 6KSOU _QN Q 8OKS\J _OMPKO _JR MN WQMS[U OKWKWXKOKL PRL
N\MKSPMVM\ QKNPJKPM\N _JM\J ^OKQP[U MSV[YKS\KL 7KRO^KN 4KYOQP QSL 0Q7 GOMPMS^ MS PJK
",,ENB JK QLZR\QPKL PJQP QKNPJKPM\ OKNTRSNKN PR NMWT[K TKO\KTPYQ[ K[KW
XOM^JPSKNNB \R[ROB QSL [MSKg SKKL PR XK NPYLMKL N\MKSPMVM\Q[[U;
2OP TYONYKN PJK KcTOKNNMRS RV PJK TJUNMR^SRWU RV PJMS^NB QSL QKNPJKP_JM\J PJKNK PJMS^N QOK NQPMNVUMS^] PJQP MNB _JKS PJKU QOK OKTOKNKSPKLLMNQ^OKKQX[KB XKQYPMVY[ RO Y^[U###QKNPJKPM\ PJMS^N VRO YN QOK OKLYNRYSLN#8
6Q[V Q \KSPYOU [QPKOB MS "D-AB MS PJK QOPM\[K 0JRPR^OQTJU MS 2LZKOPMNK
NPQPKN;
2 WRLKOS KS^MSKKOB MV JMN ^RQ[ QSL PJK VYS\PMRSQ[ TYOTRNK RV JMN _ROd^OKQP KVVROP WQdK Q TORLY\P PJQP MN VROWQ[[U QLK`YQPK QSL TKOVK\P MSPJK TJRPR^OQTJM\ QLZKOPMNKWKSPN RV RYO PMWK QOK SRP NR KQNU PR LKVMFYNKOHN MSNPOY\PMRSN#F 'KNKQO\J MSPR PJK TJUNMR[R^M\Q[ QSL TNU\JR[R^MKVVK\PMZKSKNN MN NPM[[ VQO XKJMSL PJK PMWKNB \RWTQOKL PR PJK NPYLU R9
?RPJ 6KSOU QSL 1RJR[U>%Q^U QO^YK PJQP PJK \OKQPMRS RV ZMNYQ[ QOPMVQ\P
QSL ^ORYSLKL MS N\MKSPMVM\ TNU\JR[R^M\Q[ dSR_[KL^K# 6R_KZKOB PJK MWTK
OQPMRSQ[MbQPMRS MN VYSLQWKSPQ[[U LMVVKOKSP# 8RO 6KSOUB PJK VYS\PM
7 4KK hRNl 2O^mK[[KNB +JQO[KN 6KSOU QSL PJK 8ROWQPMRS RV Q 0NU\JRTJUNMf+JM\Q^R; *SMZKONMPU RV +JM\Q^R 0OKNNB "DA-g#8 nPL# MS 0QY[ +# :MPb QSL 2OSR[L ?# 7[MW\JKOB 1RLKOS 2OP QSL 1RLKOS 4\MKS2SQ[UNMN RV :MNMRS f%K_ 5ROd; 0OQK^KOB "D,=gB ,A# 1U QSQ[UNMN RV KcTKON\MKSPMVM\ QKNPJKPM\N MS PJMN \JQTPKO MN MSLKXPKL PR PJMN ^ORYSLXO9 3jNb[k 1RJR[U>%Q^UB F0JRPR^OQTJU MS 2LZKOPMNMS^BF MS 0JRPR^OQTJU MS +JOMNPRTJKO 0JM[[MTN f%K_ 5ROd; 2TKOPYOKB "D,DgB ,A#
-
8/13/2019 Lev Manovich The engeneering of vision
11/211
KcTOKNNMRS] VRO 1RJR[U>%Q^UB MP MN PR MSLY\K KVVK\PN MS PJK ZMK_KO#
NMPYQPKL MS PJK OKQ[W RV PJK QKNPJKPM\B TORLY\MS^ T[KQNYOK RO LMNT[
[MVK] 1RJR[U>%Q^U MN \RS\KOSKL _MPJ KZKOUPJMS^ TOQ\PM\Q[ >> \JQS^MS^ XK
6KSOU \Q[[N VRO PJK OQPMRSQ[MbQPMRS RV XKQYPU _JM[K 1RJR[U>%Q^U _QSPN
RV \RWWYSM\QPMRS# 6K XK[MKZKN PJQP WRLKOS LKNM^SKON JQZK PR ^OQNT
KVVK\PMZKSKNNF PR XK QX[K PR \RSPOR[ PJK ZMK_KOHN OKNTRSNK >> TOK\M
VMSQ[[UB _JM[K 6KSOUHN FN\MKSPMVM\ QKNPJKPM\NF LKQ[N _MPJ PJK QOPMN
OKNTRSNK RV QS MSLMZMLYQ[ NTK\PQPROB 1RJR[U>%Q^UHN F[Q_N RV ZMNYQ[
KWT[RUKL XU PJK SK_[U KWKO^KL MSNPMPYPMRSN RV WQNN \RWWYSM\QPMR$S PJMN \JQTPKO $ _M[[ LMN\YNN RSK NR[YPMRS PR PJK TORX[KW RV PJK O
QLZQS\KL XU PJK "D-EN QOPMNPM\ QZQSP>^QOLK# $SZKNPM^QPMRSN RV PJK TN
\R[RON QSL K[KWKSPQ[ VROWNB \RSLY\PKL XU TNU\JR[R^MNPN NMS\K PJK NK\RS
\KSPYOUB WQLK TRNNMX[K PJK MLKQ RV Q OQPMRSQ[ ZMNYQ[ [QS^YQ^K \RWTR
FQPRWNF RV ZMNYQ[ \RWWYSM\QPMRS# &JMN MLKQ _QN Q[OKQLU TYONYKL M
NY\J QOPMNPN QN 4KYOQP QSL NY\J PJKROKPM\MQSN QN 6KSOU# 6R_KZKOB MS
PJKWNK[ZKN MS PJK OR[K RV PJK LKNM^SKON RV WQNN \RWWYSM\QPMRSB PJK
[QS^YQ^K Q\`YMOKL SK_ YO^KS\U QSL MWTROPQS\K# &JK \RWTQOMNRS XKP_KK
6KSOU QSL 1RJR[U>%Q^U WQdKN MP \[KQO PJQP MP _QN SR [RS^KO Q `YKNPMRS R
RV Q _ROd RV QOP TORLY\MS^ QS QKNPJKPM\ KVVK\P MS QS MSLMZMLYQ[ NTK\P
`YKNPMRS RV OQPMRSQ[MbMS^ WQNN \RWWYSM\QPMRS >> PJK `YKNPMRS RV K\
MWTROPQS\K# &JKOKVROKB 1RJR[U>%Q^U _OMPKN QXRYP PJK SKKL PR TOK\MN
QLZKOPMNKWKSPNB QSL ?QYJQYN _K[\RWKN KcTKOMWKSPQ[ TNU\JR[R^MNPN#
KcPOKWK MS 4RZMKP 'YNNMQB _JKOK QOPMNPN PJRY^JP PJQP PJKU \RY[L \RSPO
JQXMPN RV NK^WKSPN RV NR\MKPU fQN MS PJK GKNPgB XYP PJK \RSN\MRYNSKN
PJK TOR^OQW RV OKNKQO\J MSPR PJK FQPRWNF RV ZMNYQ[ \RWWYSM\QPMRS X
-
8/13/2019 Lev Manovich The engeneering of vision
12/211
POQSN[QPMS^ MSPR PJK KNPQX[MNJWKSP RV Q SYWXKO RV TNU\JR[R^M\Q[ [QXR
MSNPMPYPMRSN#10 &JKMO ^RQ[ _QN PR \OKQPK Q VY[[U OQPMRSQ[MbKL ZMNYQ[ [QS^YQ
\RWWYSM\QPMRS _JKOK KQ\J ZMNYQ[ K[KWKSP MN \QTQX[K RV \RWWYSM\QPMS
KWRPMRS RO \QYNMS^ Q XKJQZMROQ[ OKNTRSNK#
10 &JKNK MSNPMPYPMRSN MS\[YLKL $%CJ*C f$SNPMPYPK RV 2OPMNPM\ +Y[PYO72CJ% f4PQPK 2\QLKWU RV 2OPMNPM\ 4\MKS\KNB 1RN\R_ "D-">9Eg] :CJ*&.124 f4PQP2OP>&K\JSM\Q[ 4PYLMRNg#
-
8/13/2019 Lev Manovich The engeneering of vision
13/211
71 89./%*6/#$-4 :3;),&4&
-
8/13/2019 Lev Manovich The engeneering of vision
14/211
TORVKNNRO RV TJM[RNRTJUB _QN `YMPK \RSPKSP _MPJ PJK Q[[R\QPMRS RV TNU\
JQL SR MSPKOKNP MS MPN TOQ\PM\Q[ QTT[M\QPMRSN#14
5KPB KZKS XKVROK PJK LMN\MT[MSK RV KcTKOMWKSPQ[ TNU\JR[R^U _QN
JQL Q[OKQLU VRYSL MPN VMONP KQ^KO YNKON >> QOPMNPN QSL QKNPJKPM\M
RV \OKQPMS^ _ROdN RV QOP _JM\J LMOK\P[U M[[YNPOQPKL PJK SK_ N\MKSPMVM\
TNU\JR[R^MNPHN QPRWMNPM\ PJKROU RV TKO\KTPMRS >> NY\J QN PJK _ROdN RV
%KRMWTOKNNMRSMNPN _JM\J OKTOKNKSPKL OKQ[MPU _MPJ LRPN QSL LQNJKN
NKSNROU K[KWKSPN# 'QPJKO PJQS M[[YNPOQPMS^ QS QPRWMNPM\ PJKROU RV T
QSL QOPMNPN OKQ[MbKL PJQP PJKU \RY[L QLRTP MPN QTTORQ\J QN Q XQNMN RVQOP#
GJQP WQLK PJMN MLKQ TRNNMX[Ke 2N KcTKOMWKSPQ[ TNU\JR[R^MNPN N
NKTQOQPK QNTK\PN f\R[ROB VROWB LKTPJB WRPMRSg QSL NYXaK\PKL PJKNK Q
MSZKNPM^QPMRSB VORW PJK RYPNKP PJKU JQL XKKS QNdMS^ P_R `YKNPMRSN#
TNU\JR[R^M\Q[ WK\JQSMNWN QOK OKNTRSNMX[K VRO PJK TKO\KTPMRS RV KQ\J
_JQP MN PJK TNU\JR[R^M\Q[ KVVK\P RS PJK NYXaK\P RV PJK NPMWY[MB NY\J QN K
$P MN PJMN NK\RSL `YKNPMRS _JM\J _QN RV ^OKQP MSPKOKNP PR QKNPJKPM\MQ
K[KWKSPQ[ \R[RON RO VROWN _MPJ dSR_S TNU\JR[R^M\Q[ KVVK\PB QOPMNPN \RY
QSPM\MTQPK ZMK_KONH KWRPMRSN# +RSZKONK[UB QKNPJKPM\MQSN \RY[L SR
^ORYSLKL MS PJK N\MKSPMVM\ [Q_N RV PJK KWRPMRSQ[ KVVK\PN RV TM\PROMQ
2N QS KcQWT[K RV PJMN OKNKQO\JB \RSNMLKO QS QNTK\P RV ZMNYQ[ KcT
FZMNYQ[ \RSVM^YOQPMRS \RSNMLKOKL QN LMNPMS\P VORW NY\J PJMS^N QN \R
VORW PJK OKTOKNKSPQPMRS RV RXaK\PN#F15 GJM[K NRWK TNU\JR[R^MNPN _KOK QSQ[UbMS^ JYW
TKO\KTPMRS RV NMWT[K VROWN NY\J QN N`YQOKNB \MO\[KNB QSL NPOQM^JP [
14 $XML#B 9D#15 :MPb QSL 7[MW\JKOB 1RLKOS 2OP QSL 1RLKOS 4\MKS\KB "==#
-
8/13/2019 Lev Manovich The engeneering of vision
15/211
RPJKON _KOK MSZKNPM^QPMS^ PJKMO TNU\JR[R^M\Q[ KVVK\PN# $S PJK ",AEN Q
+JQO[KN ?[QS\B LKZK[RTKL Q PJKROU RV PJK MSPOMSNM\ TNU\JR[R^M\Q[ NM^SM
QSL RX[M`YK [MSKN#16 ?[QS\ TRTY[QOMbKL PJK MLKQN RV PJK )YP\J TQMSPKO QSL PJKR
4YTKOZM[[K _JR QORYSL ",9E VMONP \[QMWKL PJQP NMWT[K [MSKN \RSZKUKL K
MSJKOKSP TNU\JR[R^M\Q[ OKNTRSNK fVM^# "g;
?[QS\ QO^YKL PJQP PJK NPOQM^JP [MSK MN Q FNUWXR[ RV YSMPUF QSL PJK \YOZKNPOQM^JP [MSKNB PJK WRNP MWTROPQSP MN PJK ZKOPM\Q[ >> NMS\K WQS NPQSQSL NMS\K JK MN XM[QPKOQ[[U NUWWKPOM\# &JK JROMbRSPQ[ [MSK MN SKcP MSRX[M`YKN# ?[QS\ LMN\YNNKN PJOKK PUTKN RV JYWQS VQ\KN \JQOQ\PKOMbKL XUPJK QNNR\MQPKL KVVK\PN RV JQTTMSKNNB OKNP QSL NQLSKNN#17
$S PJK ",,ENB +JQO[KN 6KSOU VYOPJKO QLZQS\KL ?[QS\HN MLKQNB LKZK[R
TORPOQ\PROF PR WKQNYOK PJK JQOWRSU RV [MSK QS^[KN fVM^# -g# 6KSOUHN L
WKQNYOK F_JKPJKO PJK QS^[KN XKP_KKS [MSKN OQLMQPMS^ MS LMVVKOKSP L
QOK JQOWRSMRYN#F18
$P MN NM^SMVM\QSP PJQP PJK VMONP [QXROQPROU OKNKQO\J RS PJK QKN
\RSLY\PKL MS ",A< XU 7YNPQZ 8K\JSKO >> PJK VRYSLKO RV WQPJKWQPM\Q[ WKP
WKQNYOKWKSP RV NKSNQPMRSN _JM\J XK\QWK PJK XQNMN VRO KcTKOMWKSP
PYOS RV PJK \KSPYOUB WQSU TORPR>7KNPQ[P TNU\JR[R^MNPN NPQOPKL PR MSZ
NMWT[K VROWNB MNR[QPMS^ TOKVKOKS\KN VRO N`YQOKNB OK\PQS^[KNB K[[M
LMVVKOKSP [MSKN#19 &JKMO TYX[M\QPMRSN XK\QWK VM[[KL _MPJ FQXNPOQ\PF TM\PYO
VROWN#
&JMN TNU\JR[R^M\Q[ OKNKQO\J MSPR PJK KVVK\PN RV NMWT[K VROWN M
GQNNM[U CQSLMSNdUB 0QY[ C[KKB QSL 0MKP 1RSLOMQSB QWRS^ RPJKON# 8RO
16 $XML#B "AE#17 $XML#B "
-
8/13/2019 Lev Manovich The engeneering of vision
16/211
VQWM[MQO _MPJ PJK _ROdN RV ?[QS\ QSL 6KSOUB QLZQS\KL Q NMWM[QO PJKRO
TNU\JR[R^M\Q[ KVVK\PN RV [MSKN RV LMVVKOKSP ROMKSPQPMRS fVM^ 9g#20 $S QSRPJKO KcQWT[KB CQSLMSN
MS 0RMSP QSL 3MSK PR 0[QSKB QLZR\QPKL FWM\ORN\RTM\F QSQ[UNMN RV PJOK
fTRMSPB [MSKB QSL T[QSKg \[QMWMS^ PJQP PJKOK KcMNPN OK[MQX[K KWRPMR
\RSVM^YOQPMRSN#21 .`YQ[[U PK[[MS^ RV CQSLMSNdUHN TOR^OQW QOK PJK PMP[KN RV P
TYX[MNJKL MS "D"D; F4WQ[[ 2OPM\[KN 2XRYP ?M^ nYKNPMRSN# $# 2XRYP 0RMSP
3MSK#F22
2P VMONPB QOPMNPN _RY[L KWXKL NMWT[K [MSKN RO VROWN MS PJKMO
\RWTRNMPMRSN# 2 PUTM\Q[ \QNK MN 4KYOQP _JR XQNKL PJK ROMKSPQPMRSN RNY\J QN 3K +MO`YK f",DE>D"g QSL 3Q 0QOQLK f",,A>,,gB RS PJK PJKROU _JM\J JK L
?[QS\; F7QMKPU###RV [MSKB [MSKN QXRZK PJK JROMbRSPQ[] \Q[WSKNN###PJK JR
LR_S_QOL LMOK\PMRSN#F23 7OQLYQ[[UB JR_KZKOB QOPMNPN QZK YT OKTOKNKSPQPMR
PR \RWTRNK _ROdN _JM\J _RY[L \RSNMNP NR[K[U RV PJK NMWT[K K[KWKSPN Q[OK
TNU\JR[R^MNPN# $P MNB PJKOKVROKB SRP Q\\MLKSPQ[ PJQP PJK TQMSPMS^N RV
[RRd OKWQOdQX[U NMWM[QO PR PJK ZMNYQ[ NPMWY[M Q[OKQLU _MLK[U YNK
LK\QLKN# &JKU QOK Q[NR KcTKOMWKSPNB Q OKNY[P RV Q NUNPKWQPM\ MSZK
\Q[[KL FPJK N\MKS\K RV QOPBF PJK N\MKS\K _JM\J _RY[L Q[[R_ PJK OK[MQX[K \RW
KWRPMRSQ[ KcTKOMKS\K#
0ORTRNMS^ N\MKSPMVM\Q[[U XQNKL QKNPJKPM\NB 6KSOU _ORPK;
20 $XML#B "AE>A"#21 GQNNM[U CQSLMSNdUB f"D-
-
8/13/2019 Lev Manovich The engeneering of vision
17/211
&JQP _JM\J N\MKS\K \QS QSL WYNP LR MN PR KcTQSL PJK Q^OKKQX[K _MPJMS YN VORW PJMN TRMSP RV ZMK_ MPN NR\MQ[ VYS\PMRS MN MWWKSNK MS PJMN PMW\RSV[M\PN# $P RY^JP PR NTQOK PJK QOPMNP JKNMPQPMRSN QSL YNK[KNN QPPKW_QU MS _JM\J JK \QS VMSL KZKO WROK OM\J QKNPJKPM\ K[KWKSPN] MP RY^JP PR VWKQSN RV LMN\KOSMS^ PJK Y^[UB NR RVPKS MSVROWY[QX[KB JR_KZKO WY\J MP24
6KSOU K`YQPKN QS QOPMNP _MPJ Q N\MKSPMNP _JRNK ZR\QPMRS MN PR TORZM
RV KN\QTMS^ PJK TOKNNYOKN QSL PJK YST[KQNQSP KcTKOMKS\KN RV KZKOULQ
QOP# &JK QOPMNP MN PJK PJKOQTMNP RV Q NR\MKPUB QSL XK\QYNK RV PJK MW
VR[[R_ Q N\MKSPMVM\ WKPJRL MS ROLKO PR WQdK JMN _ROdN WRNP KVVK\PMZ
VRO^KP PJK FRTTOKNNMRS QSL X[MSL \RSV[M\PNF RV WRLKOS KcMNPKS\K#
1RJR[U>%Q^UB MS PJK Q[OKQLU `YRPKL NPQPKWKSP VORW PJK "D-ENB Q[N
QS QTT[MKL N\MKSPMNP >> QS KS^MSKKO# &JK QOPMNPB JR_KZKOB MN SR [RS^
KZKOULQU [MVK# hYNP QN PJK WRLKOS KS^MSKKO NJQTKN KZKOU QNTK\P RV
VRO [MZMS^ fQO\JMPK\PYOKgB PJK WQ\JMSKN VRO POQSNTROPQPMRS fQMOT[Q
TORLY\K RPJKO WQ\JMSKN fPJK PRR[N RV MSLYNPOMQ[ TORLY\PMRSg >> QS QOP
NJQTMS^ PJK TNU\JM\Q[ OKQ[MPUB \RSPOR[[MS^ TKRT[KHN KWRPMRSN QSL MLK
TYX[M\MPUB TRNPKONB QSL RPJKO ZMNYQ[ TORTQ^QSLQ#
1RJR[U>%Q^UHN QTTKQ[ PR LKNM^SKON QSL TJRPR^OQTJKON XOMS^N VR
PJK OKNKQO\J MSPR PJK K[KWKSPQ[ YSMPN RV ZMNMRS >> PJK SKKL PR RTPMWM
\RWWYSM\QPMRS# &JMN SK_ TYOTRNK XK\QWK \OUNPQ[[MbKL QP PJK WRWKSP
\[QMWKL PJK TRNMPMRS RV LKNM^SKON RV WQNN TORTQ^QSLQ MS 4RZMKP 'YN
WRWKSP PJK P_R [MSKN RV MS`YMOU >> QOPMNPM\ KcT[ROQPMRS RV PJK ZMNY
KcTKOMWKSPQ[ TNU\JR[R^U >> KcT[M\MP[U \RSZKO^K MS 4RZMKP LMN\RYONKN
RV 4RZMKP QOP MSNPMPYPKN RV PJK "D-EN NY\J QN $%CJ*C f$SNPMPYPK RV 2OP
"D-E>-=gB 72CJ% f4PQPK 2\QLKWU RV 2OPMNPM\ 4\MKS\KNB 1RN\R_ "D-">9EgB QSL
f4PQPK 6M^J 2OP>&K\JSM\Q[ 4PYLMRNgB .[ 3MNNMPNdUB 2[KcQSLKO 'RL\JKSdRB (
24 nPL# MS $XML#B ,A>,,#
-
8/13/2019 Lev Manovich The engeneering of vision
18/211
\R[[QXROQPKL _MPJ KcTKOMWKSPQ[ TNU\JR[R^MNPN PR MSZKNPM^QPK PJK KVV
QSL PJKMO \RWXMSQPMRSN#25
&JK TQOQLM^W RV OKNKQO\J MSPR PJK K[KWKSPN RV ZMNYQ[ \RWWYSM\QPMR
\RSZKSMKSP[U POQ\KL PJORY^J PJK JMNPROU RV $%CJ*CB _JM\J LYOMS^ PJK VRY
YSMPKL PJK dKU ^ORYTN RV QZQSP>^QOLK QOPMNPN QSL PJKROKPM\MQSN WRN
$S PJK VMONP UKQO RV $%CJ*CHN KcMNPKS\K PJK ^ORYT [KL XU CQSLMSN6MN TOR^OQW \Q[[KL VRO PJK \QPQ[R^MS^ RV XQNM\ K[KWKSPN RV QOP QSL PR
KVVK\PN#26 8R[[R_MS^ CQSLMSNdUHN TORTRNQ[NB $%CJ*C KNPQX[MNJKL MPN R_S T
[QXROQPROU MS PJK 8Q[[ RV "D-E XYP CQSLMSNdU QSL JMN NYTTROPKON _KOK
WRSPJN [QPKO#27 CQSLMSNdU PJKS XK\QWK ZM\K>TOKNMLKSP RV PJK SK_[U VROWKL
JKQL RV MPN [QO^KNP TJUNM\Q[>TNU\JR[R^M\Q[ LMZMNMRS# &JK WKPJRL RV CQ
\JQOQ\PKOMbKL QN FPJK RXNKOZQPMRS RV QSL KcTKOMWKSPQPMRS _MPJ PJK \
QOPMNPM\ \OKQPMRS QSL OK\KTPMRS QN _K[[ PJK _ROd RV QOP MS Q[[ MPN \RWT
25 (PJKO 4RZMKP OKNKQO\J MSNPMPYPKN RV PJK "D-EN _JRNK TOR^OQWN MS\[YN\MKSPMVM\ QTTORQ\J PR QOP QSL QOP JMNPROU MS\[YLK; &JK 4PQPK $SNPMPY XU CQNMWMO 1Q[KZM\JB 3KSMS^OQL "D-9>-Ag] &JK $SNPMPYPK RV 3MPKOQPYORV +RWWYSMNP 2\QLKWU f"D",>99"g] &JK $SNPMPYPK RV 2OP 6MNPROUB Q TQOP RV 1RN\R_ *SMZKONMPU] &'KNKQO\J $SNPMPYPKN RV 4R\MQ[ 4\MKS\KN f1RN\R_ "D-=>9"g#26 GQNNM[U CQSLMSNdUB f"D-EgB F0OR^OQWWQ OQXRPU $SNPMPYPQ dJYLRbJK0OR^OQW RV PJK $SNPMPYPK RV 2OPMNPM\ +Y[PYOKgBF MS 4RZKPNdRK MNdYNNLRdYWKSPQPNMMQ f8MVPKKS UKQON RV 4RZMKP QOP; WQPKOMQ[N QSL LR\YW$I(7$I; "D99gB "-"9D#27 &JK _ROd RV $%CJ*C LYOMS^ VMONP UKQO RV MPN KcMNPKS\K JQN XKKS LR\Y1Q^RWKLRZB F$%CJ*C; ZRbSMdSRZKSMKB VROWMORZQSMK M TKOZUU TKOMRQTTKQOQS\KB VROWQPMRS QSL VMONP TKOMRL RV MPN _ROdB "D-EgB 4RZKPN99->9
-
8/13/2019 Lev Manovich The engeneering of vision
19/211
TNU\JR>TJUNM\Q[ RXaK\P#F28 &JK WKWXKON RV PJK Q\QLKWU MS\[YLKL QOP JMNPROMQ
QOPMNPNB TJUNM\MNPNB TNU\JR[R^MNPNB QSL TJUNMR[R^MNPN#
1KQS_JM[KB 2[KcQSLKO 'RL\JKSdR XK\QWK PJK SK_ TOKNMLKSP RV $%CJ*C
QSL JMN NYTTROPKON VROWY[QPKL Q SK_ TOR^OQW MS PRPQ[ RTTRNMPMRS PR
CQSLMSNdUHN FNYXaK\PMZKF TNU\JR[R^MNW PJKU KWTJQNMbKL PJK WQPKOM
RTTRNKL CQSLMSNdUHN FMSLMZMLYQ[MNPM\F \RWTRNMPMRS MS VQZRO RV \R
WQdMS^ RV RXaK\PN OQPJKO PJQS PJK \OKQPMRS RV QOP#29 6R_KZKOB PJK TORaK\P RV Q N\MKS\K RV Z
K[KWKSPN _QN SRP QXQSLRSKL MS TOQ\PM\KB RS[U PJK KWTJQNMN NJMVPKL V
RV MSLMZMLYQ[ QKNPJKPM\ OKQ\PMRSN PR PJK FRXaK\PMZKF QSQ[UNMN RV PJWQPKOMQ[ RXaK\PN# $%CJ*C WKWXKONB _JR NPQOPKL PR PKQ\J QP PJK SK_[U V
f4PQPK 6M^J 2OP>&K\JSM\Q[ 4PYLMRNgB JQL PJK RTTROPYSMPU PR TYP PJKNK M30 8RO
MSNPQS\KB MS JMN \RYONK RS ^OQTJM\N 'RL\JKSdR _RY[L NPQOP JMN NPYLKSPN
PR \RWXMSK NMWT[K VROWN f\MO\[KB POMQS^[KB QSL N`YQOKg _MPJMS Q ^MZ
ZMNYQ[ KVVK\PMZKSKNN RV ZQOMRYN \RWXMSQPMRSN fVM^# =g#31
$S MPN PJMOL NPQ^K $%CJ*C XK\QWK PJK \KSPKO RV Q\PMZMPU RV PJK TO
TORLY\PMRS QOP >> (NMT ?OMdB ?ROMN 2OZQPRZB %MdR[QM &QOQXYdMSB QS32 $S "D-9B PJMN ^ORYT
VRYSLKL PJK aRYOSQ[ 3.8 f&JK hRYOSQ[ RV PJK 3KVP 8ORSP RV 2OPB 1RN\R_ "D-9>
_JM\J _QN PR YSMPK QOPMNPN RV PJK 3KVP LKLM\QPKL PR OQLM\Q[ OKZR[YPMR
_JQP PJKU TKO\KMZKL QN PJK SK_ V[RYOMNJMS^ RV FXRYO^KRMNF QOP WQLK T
28 0#+# CR^QSB F( bQLQ\JQdJ QdQLKWMM M UKUR bJYOSQ[QF f2XRYP PJK ^RQ[N R aRYOSQ[gB $NdYNNPZR "B SR# " f"D-9g; D#29 2 SYWXKO RV KQO[U \RSNPOY\PMZMNP WQSMVKNPRN QOK SR_ QZQM[QX[K M
%M\JR[QN 6# 2[[MNRSB KL#B 2OP $SPR 3MVK; 'YNNMQS +RSNPOY\PMZMNW "D"=>$SPKOSQPMRSQ[ 0YX[M\QPMRSNB "DDEgB --gB &KdJSM\JKNdQUQ .NPKPMdQ A f32 F$SNPMPYP CJYLRbKNPZKSSRU CY[PYOUBF ,
-
8/13/2019 Lev Manovich The engeneering of vision
20/211
GJQP NJRY[L PJMN OQLM\Q[ OKZR[YPMRSQOU Q\PMZMPU XKe GKNPKOS QO
QOPMNPN [ROMVMKL PJK \RSNPOY\PMZMNPNH LKNMOK PR ^MZK YT PJK POQL
NYXWKO^K PJKWNK[ZKN MS MSLYNPOUB PR [KQZK PJK QOPMNPHN NPYLMR VR
XK\RWK MSLYNPOMQ[ LKNM^SKON#33 GJQP OK\KMZKL TOQ\PM\Q[[U SR QPPKSPMRS _QN QSRPJK
\RSNPOY\PMZMNPN QSL WQSU RPJKO 4RZMKP QOPMNPN _KOK \[QMWMS^ VRO PJ
OR[K RV PJKROKPM\MQSN QSL TOQ\PMPMRSKON RV WQNN ZMNYQ[ \RWWYSM\Q
QLZKOPMNKWKSP# 2SL MP _QN MS PJMN OR[KB TQOPM\Y[QO[U QN QLZKOPMNM
QOPMNPNB QN _K[[ QN PJKMO \RYSPKOTQOPN VORW PJK ?QYJQYNB _KOK QX[K P
FVORW QS KQNK[ PR Q WQ\JMSKF fPR `YRPK PJK PMP[K RV Q XRRd XU &QOQXYdMRV TORLY\PMRS QOPg#34 &JKNK WQ\JMSKN _KOK SRP Q [QPJK RO QS KS^MSK XYP Q TOMS
\QWKOQB Q [M^JP TORaK\PROB Q OQLMR POQSNWMPPKO >> PJK WQ\JMSKN RV W
WQNN TORLY\PMRS#
3KVP QOPMNPN _KOK YSMPKL MS OKaK\PMS^ QOP MS VQZRO RV WQNN TO
3.8 4KO^KM &OKPUQdRZ _OMPKN; F'KZR[YPMRS TYP VRO_QOL SK_ TOQ\PM\Q[ PQ
QVVK\PMS^ WQNN TNU\JKB RO^QSMbMS^ PJK _M[[ RV PJK \[QNNF] F&JK _ROd RV V
_ROd RV \RWWYSMNW >> VYPYOMNW MN VM^JPMS^ VRO PJK NQWK LUSQWM\ R
_MPJRYP _JM\J PJK WRZKWKSP PR_QOL \RWWYSMNW MN MWTRNNMX[K#F35 8RO 3.8B PJMN PQNd RV PJK
OKZR[YPMRSQOU KLY\QPMRS RV PJK WQNNKN OK`YMOKL Q N\MKSPMVM\ WKPJ
&OKPUQdRZ \Q[[KL VRO PJK \OKQPMRS RV Q FN\MKS\K RV QOP QN Q WKQSN RV K
33 $S "D-9B 3YSQ\JQONdU _ORPK; F&JKU o\RSNPOY\PMZMNPNp T[QU QP XKMS^ KS^dSR_ QN WY\J RV PJK KNNKS\K RV WQ\JMSKOU QN Q NQZQ^K#F nPL# MS ?OQSLRS3MPKOQPYOK YSLKO PJK ?R[NJKZMdN f3RSLRS; 0[YPR 0OKNNB "DD"gB "; "AA#34 ?KP_KKS "D-9 QSL "D-@ 'RL\JKSdR LKNM^SKL QLZKOPMNMS^ VRO WQSU 4RZMQ^KS\MKN] 3MNNMPNdUB _JR _QN NKSP PR 7KOWQSU PR TYX[M\MbK PJK QOP RV\OKQPKL XOM[[MQSP LKNM^SN VRO WQSU 7KOWQS VMOWN] NR LML 1RJR[U>%QVQ\Y[PU#35 4KO^KM &OKPUQdRZB F(PdYLQ M dYLQe f0KONTKdPMZY VYPYOMbWQgF oGJKf0KONTK\PMZKN RV VYPYOMNWgpB 3.8 " f"D-9g; "DAB -E9#
-
8/13/2019 Lev Manovich The engeneering of vision
21/211
MSV[YKS\K RS TNU\JKB MS \RSSK\PMRS _MPJ PJK PQNd RV \[QNN NPOY^^[K#F36 $S VQ\PB QOPMNPN NJRY[L
XK\RWK QN N\MKSPMVM\ MS PJKMO _ROd QN 1QOcMNPN QOK MS PJKMO TR[MPM
OQPMRSQ[MbK PJK \OKQPMZK TOR\KNN QSL TYP QOP KLY\QPMRS RS Q N\MKSPM37 &JMN MLKQ _QN WRNP
NUNPKWQPM\Q[[U TORWRPKL XU 0OR[KP\Y[P f(O^QSMbQPMRS RV PJK 'KTOKNKSP
+Y[PYOKg# &JYNB &QOQXYdMS RO^QSMbKL PJK QOPMNPHN _ROdNJRT QMWMS^
&QU[ROMNW QSL 8ROLMNW MSPR QOPMNPM\ TOQ\PM\K; FGK QOK QSQ[UbMS^ T
_MPJ \RWTOKNNMS^ _ROd TKOMRLNB QMW PR OQPMRSQ[MbK _ROd QSL [KMNYO
POMKN PR ^KP Q_QU VORW XRJKWMQS JQXMPN NR \RWWRS PR QOPMNPN#F38 2OPMNPN NJRY[L Q[NR OQPMRS
ZMK_KONH OKQ\PMRSN XU LKZK[RTMS^ Q N\MKS\K _JM\J _RY[L KSQX[K PJKW PRWKQNYOQX[K KVVK\PN MS PJK ZMK_KO# &JYNB PJK QYPJRO RV Q "D-A QOPM\[K
Q\PMZMPMKN RV PJK 2OP 4K\PMRS RV 3KSMS^OQLHN 0OR[KP\Y[P _OMPKN;
2OPMNP>\RWWYSMNPB QOPMNP>OKZR[YPMRSQOU \QWK PR YSLKONPQSL PJK SK_KQTRSN PR XK QX[K PR NPOMdK _MPJRYP Q WMNN# &JK NPOMZMS^ PR \RSN\MRYPJK WQMS PQNd fFMP MN SK\KNNQOU PR dSR_ MS ROLKO PR TORLY\KFg# 2OPMNPPJK XQNMN RV QOPHN KVVK\P RS TKO\KTPMRS QOK PR XK VRYSL \RWT[KPK[U RXPJK PQNd PR WQNPKO PJK FWK\JQSM\NF RV QOPMNPM\ _ROdB MS ROLKO PR ROMKRV OKZR[YPMRSQOU QOP#39
&JMN LYQ[ ^RQ[ RV OQPMRSQ[MbQPMRS _QN NUWXR[MbKL XU PJK TRTY[Q
FTNU\JR>KS^MSKKOBF VOK`YKSP[U KS\RYSPKOKL MS PJK LMN\RYONK RV \RSNP
36 $XML#B "DD#37 3.8 OK`YMOKL PJK NQWK VORW TRKPN QSL _OMPKON _JR \RY[L WQdK PJKMO _OK[UMS^ RS PJK QLZQS\KN WQLK XU 'YNNMQS 8ROWQ[MNPN MS NPYLUMS^ PJK 3.8B PJKNK LKZM\KN XK\QWK PJK PRR[N RV ZKOXQ[ TORTQ^QSLQ# $S PJK VMON_OMPKN; F(0(52I NPYLMKN PJK [Q_N RV TRKPM\ TORLY\PMRS### (0(52I _M[[ JK[T PJ TOR[KPQOMQPB XYP SRP _MPJ ZQ^YK \RSZKONQPMRSN QXRYP PJK HTOR[KPQOM\RSN\MRYNSKNNBH XYP _MPJ TOK\MNK PK\JSM\Q[ dSR_[KL^K RV PJK LKZM\KN RV_ROd#F (NMT ?OMdB FS# HVROWQ[SUM WKPRLHF f4R \Q[[KL HVROWQ[ WKPJRL " f"D-9g; -"=>-"@#&JK WKQSMS^[KNN KcTKOMWKSPQ[ TRKPOU RV 8YPYOMNPN _JM\J ROM^MSQ[[UPJK FMSLKTKSLKSP ZQ[YK RV PJK TRKPM\ NRYSLF SR_ XK\QWK VY[[ RV WKQSMFTRKPM\ MSNPOYWKSPQPMRSF _KOK SR_ NKKS QN PJK PK\JSM`YKN RV RO^QSMbWQNNKN#38 $# 1QPNQB 4RZKPNdRK MNdYNNPZR bQ "@ [KPB -AD#39 $XML#B -,"#
-
8/13/2019 Lev Manovich The engeneering of vision
22/211
3.8# 2[KdNKU 7QNPKZB Q [KQLMS^ VM^YOK RV 0OR[KP\Y[P QN _K[[ QN RV PJK 4RZ
_JR MS "D-" RO^QSMbKL PJK +KSPOQ[ $SNPMPYPK RV 3QXRO \RMSKL PJK TJOQNK
LKN\OMXK PJK TOR\KNN RV PJK OQLM\Q[ OK\RSNPOY\PMRS RV PJK JYWQS TNU\J40 &OKPUQdRZ QTT[MKL PJ
WKPQTJRO PR QOP; F2[RS^ _MPJ WQS RV N\MKS\K PJK QOP _ROdKO NJRY[L XK\RW
TNU\JR>\RSNPOY\PRO#F41
&JK \OY\MQ[ YKNPMRS PJKS XK\RWKN JR_ PR OQPMRSQ[MbK ZMNYQ[ KVV
LMVVKOKSP QTTORQ\JKN QOK TRNNMX[K; PR \OKQPK TQOPM\Y[QO \RSLMPMRS
RV QZQM[QX[K MWQ^KN MS PJK TYX[M\ NTJKOK fPJMN _QN LRSK [QPKO MS PJK T
QSL VMSQ[[UB PR \OKQPK Q TQOPM\Y[QO \RLKB Q SK_ ZMNYQ[ [QS^YQ^K ^YQOQKVVK\PMZK[U QSL KVVM\MKSP[U PR WQNN QYLMKS\KN fRVPKSB MS PJK \QNK R
M[[MPKOQPKg# $P MN PJK [QNP NR[YPMRS _JM\J _QN KcT[ROKL XU 3KVPMNP QOP
3MNNMPNdU#
GJU LML PJK SRPMRS RV Q ZMNYQ[ [QS^YQ^K \RSNMNPMS^ RV NMWT[K QX
QPPOQ\PMZKe 8MONPB QXNPOQ\P KRWKPOM\ VROWN _KOK SKMPJKO QNNR\MQ
OKTOKNKSPQPMRS SRO LML PJKU [RRd [MdK PJK FNYXaK\PMZKF QXNPOQ\P MWT
4K\RSL[UB QN $^RO 7R[RWNPR\d TRMSPN RYPB QXNPOQ\PMRS _QN aYNPMVMKL X
ROM^MS MS POY[U TRTY[QO LK\ROQPMZK QSL OK[M^MRYN QOP fVRO MSNPQS\K42 &JMOL[UB NMWT[K VRO
_KOK TOR\[QMWKL PR XK KVVM\MKSP MS Q NMPYQPMRS RV WQNN \RWWYSM\Q
F&JK WRNP YSQWXM^YRYN QSL MWWKLMQPK[U OK\R^SMbQX[K VROWN QOK ^K
\RSVYNK Q OK\PQS^[K _MPJ Q \MO\[KB RO Q \MO\[K _MPJ Q POMQS^[K#F43 8MSQ[[U QSL WRNP MWTROPQSP
NY\J VROWN _KOK MWQ^MSKL PR XK TKOVK\P[U NYMPKL VRO PJK TYOTRNK RV
ZMK_KO >> XRPJ PJK MLKQ QSL PJK MWQ^KOU XKMS^ TOKTQOKL XU LK\QLKN R
40 $^RO 7R[RWNPR\dB &RPQ[MPQOMQS 2OP f%K_ 5ROd; 6QOTKO+R[[MSN 0YX[MNJ41 &OKPUQdRZB F(PdYLQ M dYLQeBF -E-#42 7R[RWNPR\dB &RPQ[MPQOMQS 2OPB -
-
8/13/2019 Lev Manovich The engeneering of vision
23/211
TNU\JR[R^U RV TKO\KTPMRS QSL MS N\MKSPMVM\ QKNPJKPM\N# &JK POQLMPMR
KVVK\PMZKSKNN RV ZMNYQ[ K[KWKSPN POQSNVROWKL MSPR PJK LOKQW RV W
QLZQS\KL MS 4RZMKP 'YNNMQ MS PJK "D-EN#
&JK WRNP NPOMdMS^ OK\ROL RV PJMN LOKQW MN PJK TQTKO F.S^MSKKOM
RSK RV $%CJ*CHN WKKPMS^N# &JK TQTKO NPQOPN _MPJ QS QSQ[UNMN RV WRLK
ZMNYQ[ KcTKOMKS\K PR MPN K[KWKSPN; F$S PJK VMSQ[ NPQ^K RV MPN LKZK[R
OKTOKNKSPQPMRS QSL JQN WRZKL PR_QOL ZMNYQ[ NKSNQPMRSN QN NY\J#F44 &JK POKSL \RSPMSYKN _MPJ
QXNPOQ\P QOPB PJK QMW RV _JM\JB Q\\ROLMS^ PR PJK QYPJROB MN FPJK RO^QS
?RYO^KRMN QOP \QSSRP ^R XKURSL PJMN NPQ^K RV QSQ[UNMNB XYP MS PJK VMQSQ[UPM\ _ROd _M[[ XK\RWK PJK XQNMN RV Q SK_ ZMNYQ[ \Y[PYOK RV NR\MQ[ \
QN NY\J _M[[ \RS\KOPKL[U NJQTK PJK JYWQS XKMS^ QN QS RO^QSMbKL YSMPB _M
NRWKPJMS^ _JM\J XK[RS^N RS[U PR MPN R_S PMWK#F45
8ORW PJMN TKONTK\PMZKB _K Q[NR NJRY[L SRP XK NYOTOMNKL PR VMSL
OK\YOOKSP QPPKWTPN PR KNPQX[MNJ ZQOMRYN OQTJM\ Q[TJQXKPN QSL LM\P
CJ[KXSMdRZ MS JMN "D"D QOPM\[K F2OPMNPN RV PJK GRO[LF TRNPY[QPKL P_R P
\RLK >> OQTJM\ NM^SN QSL \R[RO K`YMZQ[KSPN# $S PJK Q[OKQLU WKSPMRSKL
CQSLMSNdU TORTRNKL PR \OKQPK Q VY[[ LM\PMRSQOU RV \R[RONB VROWN QSL
LKN\OMTPMRSN RV PJK TNU\JR[R^M\Q[ KVVK\P RV KQ\J K[KWKSP# 0QZK[ 8[ROKSN
NPYLKSPN QP :CJ*&.124 NPQOPKL PR \RWTRNK F4UWXR[QOMYWF fF&JK )M\PMRS
"D--#46 &JMN FMSPKOSQPMRSQ[ QSL QJMNPROM\Q[ LM\PMRSQOUF NJRY[L JQZK \R
WKQSMS^N RV KZKOU ^OQTJM\ NUWXR[# $S PJK MSPORLY\PROU QOPM\[K RV F4U
OK^OKPPKL PJQP _JM[K _JR[K Q\QLKWMKN _KOK XYNU TOKTQOMS^ QSL TOKNK
44 2[[MNRSB 2OP $SPR 3MVKB AD#45 $XML#B ,"#46 0#2# 8[ROKSNdUB f"D--gB F4UWXR[QOMYW f4[RZQO NMWZR[RZg# 0OKLMN[RZMLM\PMRSQOU RV NUWXR[Ng# $SPORLY\PMRSpB &OYLU TR bSQdRZUW NMNPKWQ&QOPYONdR^R *SMZKONMPKPQ -,=B "DA"g; @-">@-A#
-
8/13/2019 Lev Manovich The engeneering of vision
24/211
SQPMRSQ[ [QS^YQ^KNB SR _ROd UKP JQN XKKS LRSK MS \RWTRNMS^ Q NMWM[Q
PJK FYSMZKONQ[ [QS^YQ^K RV WQSdMSL#F47 4MWM[QO TORaK\PN RV Q YSMZKONQ[ ^OQTJM\ Q[
QLZQS\KL MS PJK NQWK UKQON XU $ZQS 0YSMB 0KPO 1MPYOM\JB QSL RPJKO 'YN48
&R NYWWQOMbK; KQO[U 4RZMKP QPPKWTPN PR PJKROMbK QSL TYP MSPR TOQ\P
ZMNYQ[ [QS^YQ^K RV WQNN \RWWYSM\QPMRS XOMS^ PR^KPJKO QOPMNPM\ KcT
OKNKQO\J MS KcTKOMWKSPQ[ TNU\JR[R^U# GJM[K PJK LKNMOK RV 4RZMKP QOP1QOcMNW QSL PR QLRTP &QU[ROMNW QSL 8ROLMNW _KOK Q[OKQLU NYVVM\M
N\MKS\K RV K[KWKSPN RV QOPB PJK Y[PMWQPK aYNPMVM\QPMRS VRO NY\J Q N\
KcTKOMWKSPQ[ TNU\JR[R^U QSL N\MKSPMVM\ QKNPJKPM\N f?[QS\B 6KSOUB QSL
MSZKNPM^QPMRSN RV PJK TNU\JR[R^M\Q[ KVVK\PN RV XQNM\ \R[RON QSL NMWT
Q [QS^YQ^K RV WQNN \RWWYSM\QPMRS \RWTRNKL VORW NMWT[K K[KWKSPN# $
PR KSYWKOQPK ZMNYQ[ K[KWKSPN QSL PR LKN\OMXK PJKMO KVVK\PN MS ROL
FZMNYQ[ KVVK\PMZKSKNN#F $S TOQ\PM\KB MP POQSN[QPKL MSPR PJK \OKQPMR
QSL NMWT[K QXNPOQ\P VROWN#
8ORW "D-" PR "D-D PJK TNU\JR[R^M\Q[ NPYLMKN RV ZMK_KONH OKNTRSNK
Q\PMZK[U \RSLY\PKL MS PJK \KSPOQ[ QOP MSNPMPYPKN# $S "D-< 72CJ% \OKQPKL
[QXROQPROUB Q TNU\JRTJUNM\N LKTQOPWKSPB QSL [QXROQPROMKN VRO KcTK
PJKROU#49 $S ROLKO PR QOOMZK QP PJK ^KSKOQ[ [Q_N RV PJK KVVK\PMZKSKNN RV
MSZKNPM^QPRON JQZK NUNPKWQPM\Q[[U QSQ[UbKL PJK XQNM\ LMWKSNMRSN
47 $XML#B @-AB @-9#48 1R[RdB FH4[RZQO NMWZR[RZH 0QZ[Q 8[ROKSNdR^RBF 9--#49 .#3# ?K[MQaKZQB 2OdJMPKdPYOSR>TORNPOQSNPZKSSQUQ NOKLQ RORLQ dQdZRNTOMUQPMUQ f2O\JMPK\PYOQ[ QSL NTQ\MQ[ \MPU KSZMORSWKSP QN QS RXaf1RN\R_; 4PORUMbLQPB "DAAgB "9#B1 2*3(-4 5$&6*36 -#' $,/ A*#'CD&'; :%&E4/6
-
8/13/2019 Lev Manovich The engeneering of vision
25/211
PKcPYOK# $P _QN JRTKL PJQP PJK OKNY[PN RV PJK QSQ[UNMN _RY[L TYP ZMNYQ
N\MKSPMVM\ XQNMN# hQ\d +JKSB Q +RWWYSMNP ?OMPMNJ QOPMNP POQMSKL M
"D-ENB _ORPK QXRYP PJMN TOR^OQW RV QOP TORLY\PMRS XQNKL RS TNU\JR[R^
2OP WYNP XK Q N\MKS\KB QS MSLYNPOU# 0M\PYOKN QSL N\Y[TPYOKN NJRY[L XKKcQ\P N\MKSPMVM\ TOMS\MT[KN QVPKO \R[RON QSL VROWN JQL XKKS \[QNNMVMOKQ\PMRS ZQ[YKN###2 TM\PYOK Q\\ROLMS^ PR PJK 3KVP _QN OKQ[[U SRPJMS^ XY\KOPQMS TOKLKPKOWMSKL JYWQS OKQ\PMRSN# 2OPMNPN NJRY[L XK KS^MSKKO50
&JKOK LRKN SRP QTTKQO PR XK Q LMNQ^OKKWKSP QWRS^ PJK 3KVP QN P
\OKQPK TOKLKPKOWMSKL ZMK_KO OKNTRSNKN# ?YP JR_ _QN PJMN PR XK Q\JMK
QNNYWMS^ PJQP _K JQZK MNR[QPKL PJK K[KWKSPN RV Q ZMNYQ[ \RLKB JR_ NJR
PJK ZMK_KOe )R PJKU MSLY\K KWRPMRSNB LR PJKU \RWWYSM\QPK MLKQN RO L
Q WROK LMOK\P _QUe
&R QSN_KO PJMN YKNPMRSB 4RZMKP QOPMNPN RV PJK "D-EN OK[MKL JKQ
PJKROMKN RV PJK LQU#51 $P MN TRNNMX[K PR LMN\KOS P_R LMNPMS\P POKSLN MS JR_ TN
PJK VMONP POKSLB QYPRSRWU _QN OQSPKL PR PJK JYWQS TNU\JK# &JK NK\RSL
TJUNMR[R^UB \RSNMLKOMS^ PJK WMSL Q SKYOR[R^M\Q[ RO^QS SRP LMVVKOKSRO^QSMNW# &JMN POKSL _QN OKTOKNKSPKL XU NY\J MSV[YKSPMQ[ N\MKSPMN
_MPJ PJKMO NPYLMKN RV TJUNMR[R^UB OKV[KcR[R^UB QSL \RSLMPMRSMS^#
&JK [QPPKO WRLK[ _QN Q[NR TOKZQ[KSP MS 4RZMKP 1QOcMNP TNU\JR[R^U
_QN \JQ[[KS^KL XU 3KZ :U^RPNdUB Q URYS^ TNU\JR[R^MNP QSL Q VROWKO [MPKO
PRLQU QN PJK VROKOYSSKO RV \R^SMPMZK TNU\JR[R^UB JK QO^YKL PJQP PJK JM
QOK YQ[MPQPMZK[U LMVVKOKSP VORW PJK [R_KO TJUNMR[R^M\Q[ TOR\KNNKN
50 hQ\d +JKSB 4RZMKP 2OP QSL 2OPMNPN f3RSLRS; &JK 0M[RP 0OKNNB 3PL#B "D=@51 8RO PJK JMNPROU RV 4RZMKP TNU\JR[R^U MS PJK "D-ENB $ JQZK \RSNY[PKL )Q0NU\JR[R^U; 2 +OMPM\Q[ 6MNPROU f+QWXOML^KB 1QNN#; ?QNM[ ?[Q\d_K[[B "D,Dg0NU\JR[R^U MS *PRTMQ; &R_QOL Q 4R\MQ[ 6MNPROU RV 4RZMKP 0NU\JR[R^U f+QW0OKNNB "D,=g#
-
8/13/2019 Lev Manovich The engeneering of vision
26/211
MSZKNPM^QPMZK QTTORQ\JKN# $S JMN VQWRYN QLLOKNN PR PJK 4K\RSL 'YNNM
+RS^OKNNB :U^RPNdU LK\[QOKL JYWQS \RSN\MRYNSKNN PR XK Q VYSLQWKSPQ[
TNU\JR[R^U RV XKJQZMROB \[QMWMS^ PJQP MP \QSSRP XK YSLKONPRRL PJORY^J
4M^SMVM\QSP[UB PJK PYOSMS^ TRMSP RV :U^RPNdUHN \QOKKO VORW [MPKOQO
"D-= LMNNKOPQPMRS 0NU\JR[R^U RV 2OP# &JORY^J PJK QSQ[UNMN RV 6QW[KP :U
LKWRSNPOQPK PJQP QOP MN Q TORLY\P RV PJK \QTQ\MPMKN RV PJK NTK\MVM\Q
KWRPMRSB QSL NUWXR[M\ OKTOKNKSPQPMRS#
+OY\MQ[ VRO :U^RPNdUHN PJKROU _QN PJK NPYLU RV PJK VROWQ[ RO^QSM
###KZKOU _ROd RV QOP MN \RSNMLKOKL PR XK Q NUNPKW RV NPMWY[MB _JM\J QMSPKSPMRSQ[[U MS ROLKO PR \QYNK QS QKNPJKPM\ OKQ\PMRS# &JMN _QU _K OKOKQ\PMRS _JM[K QSQ[UbMS^ PJK NPOY\PYOK RV PJK NPMWY[M###&JK ^KSKOQ[ LMNYWWQOMbKL MS PJK VR[[R_MS^ VROWY[Q; VORW PJK VROW RV PJK QOP _ROd PJQSQ[UNMN RV MPN K[KWKSPN QSL NPOY\PYOK PR PJK OK\RSNPOY\PMRS RV PJK QLMN\RZKOU RV MPN ^KSKOQ[ [Q_N#52
$S :U^RPNdUHN VROWY[Q PJK ^MZKS _QN PJK KcMNPMS^ _ROdN RV QOP QSL PJK Y
QKNPJKPM\ OKQ\PMRS# 2N _K JQZK Q[OKQLU NKKSB VRO PJK QOPMNPNB LKNM^
PMWK PJK VROWY[Q _QN OKZKONKL# $V VRO PJK TNU\JR[R^MNP :U^RPNdUB ZMOKNKOZRMO RV dSR_[KL^K QXRYP PJK JYWQS WMSLB QOPMNPNB RS PJK \RSPOQ
RXaK\PMZK TNU\JR[R^M\Q[ dSR_[KL^K MS ROLKO PR \OKQPK ZMNYQ[ _ROdN _JM\
LKPKOWMSKL OKNTRSNKN MS PJK ZMK_KO#
+RSPKWTROQOU TNU\JR[R^MNPN >> PJK NYTTROPKON RV 0QZ[RZ QSL ?KdJ
QSL URYS^KO TNU\JR[R^MNPN NY\J QN :U^RPNdU QSL 2# 3YOMQ RS PJK RPJKO JQS
_JKPJKO PJK WMSL \RY[L XK OKLY\KL PR PJK [Q_N RV TJUNMR[R^U# 4MWM[QO[UB
MS TOQ\PM\K LOK_ RS PJKNK P_R Q[PKOSQPMZK TNU\JR[R^M\Q[ WRLK[N# 4KO^K
^ORYSL JMN VM[WWQdMS^ WKPJRLN MS LMVVKOKSP TNU\JR[R^M\Q[ PJKROMKN
$S RSK RV JMN [QPKNP _OMPPKS _ROdN .MNKSNPKMS NYWWKL YT JMN _RO
52 3KZ :U^RPNdUB 0NMdJR[R^MaQ $NdYNNPZQ f0NU\JR[R^U RV QOPg f1RN\R_; "D
-
8/13/2019 Lev Manovich The engeneering of vision
27/211
$ SKZKO MSPKSLKL PR FOKV[K\PF PJK KcMNPMS^ OKQ[MPU# $ JQL RSK PQNd >> Y>> PR QVVK\P PJK VKK[MS^N QSL PJRY^JPNB PR MSV[YKS\K PJK TNU\JK QSL PR NJPJK ZMK_KO MS PJK LKNMOKLB OK`YMOKLB QSL \JRNKS LMOK\PMRS#53
2[PJRY^J .MNKSNPKMSHN ^RQ[ OKWQMSKL PJK NQWKB PJK WKQSN RV Q\JMKZM
\RS\KMZKL RV LMVVKOKSP[U PJORY^JRYP JMN [MVK#
(S PJK RSK JQSLB .MNKSNPKMS LKZK[RTKL PJK \RS\KTP RV FMSPK[[K\PYQ[
Q TYOK[U MSPK[[K\PYQ[ OKNTRSNK# &JK ^RQ[ RV \MSKWQB MS PJMN ZMK_B _Q
LMQ[K\PM\Q[ OKQNRSMS^# &JK NPOY\PYOK RV PJK VM[W MPNK[V _QN \RS\KMZK
ZMNYQ[ VROW _MPJ WRSPQ^K XKMS^ PJK WKQSN RV OKTOKNKSPMS^ PJK LMQ[K\RSPOQNP QSL aYcPQTRNMPMRS RV MWQ^KN# &JMN TOKR\\YTQPMRS RV .MNKSN
ZMNYQ[MbQPMRS RV PJK _ROd RV PJK MSPK[[K\P \Y[WMSQPKL MS JMN TORaK\P P
1QOcHN +QTMPQ[#54
(S PJK RPJKO JQSLB .MNKSNPKMSHN NK\RSL MWTROPQSP \RS\KTP LKZK[RT
2PPOQ\PMRSN PQdKN PJK ZMK_KONH TJUNMR[R^M\Q[ OKQ\PMRS QN Q TRMSP RV55 .MNKSNPKMS XQNK
JMN \RS\KTP RS PJK TNU\JR[R^M\Q[ PJKROMKN RV 3YL_M^ C[Q^KN QSL GM[[MQW 56 2\\ROLMS^ PR
C[Q^KNB MS Q JYWQS XKMS^ KWRPMRSQ[ NPQPKN QOK KcTOKNNKL PJORY^J XR
MSNMNPKL PJQP JYWQS KcTOKNNMZMPU MN \JQOQ\PKOMbKL XU Q YSM`YK `YQ
RV RSK TKONRS QOK MSZR[YSPQOM[U OKTKQPKL XU PJK RXNKOZKO# hQWKNH
\QYNQ[[U OKZKONKL# 6K TRNPY[QPKL PJQP KWRPMRSN _KOK PJK KVVK\P RV WY
LRKN SRP \OU XK\QYNK JK MN NQLB XYP RSK XK\RWKN NQL LYK PR \OUMS^# .M
PJKROMKN; PJK KWRPMRSQ[ NPQPK RV PJK Q\PRO POQSN[QPKN MSPR JMN WYN\Y
53 nPL# MS 5Y# 2# :QNM[MKZQB F.MNKSNPKMS; CRSPNKTPNMaQ H2^OKNNMZSR^R\RS\KTP RV HQ^^OKNNMZK QOPHgB CMSRZKL\JKNdMaK IQTMNdM 9 f"D,Dg; -EA#54 $ _M[[ OKPYOS PR .MNKSNPKMSHN FMSPK[[K\PYQ[ WRSPQ^KF MS \JQTPKO -#55 4KO^KM .MNKSNPKMSB F1RSPQbJ QPOQdPNMRSRZF f1RSPQ^K RV QPPOQ\PMRS56 ([^Q ?Y[^QdRZQB F4KO^KM .MNKSNJPKMS M K^R HTNMdJR[R^M\JKNdMU ?KO[M TNMdJRQSQ[MbRW M NPOYdPYOSRU TNMdJR[R^MKUF f4KO^KM .MNKSNPKMS QS XKP_KKS TNU\JRQSQ[UNMN QSL NPOY\PYOQ[ TNU\JR[R^UgB CMSRZKL\JKNdMK IQ
-
8/13/2019 Lev Manovich The engeneering of vision
28/211
WRZKWKSPN QOK MSZR[YSPQOM[U OKTKQPKL XU PJK ZMK_KO \QYNMS^ JMW P
&JK MWTROPQSP MNNYKB PJKSB _QN PJK POQMSMS^ RV Q\PRON MS NMWY[QPM
KcTOKNNMRSN MS ROLKO PR TORLY\K Q LKNMOKL KWRPMRSQ[ OKNTRSNK MS
PR LKZK[RT Q \R[[K\PMRS RV KWRPMRSQ[ NPMWY[M _JM\J _RY[L XK NPOYS^ PR^K
FWRSPQ^K RV QPPOQ\PMRSN#F &JK VM[W XK\RWKN Q N\OMTP RV PJK KWRPMRS
&JK P_R \RS\KTPN >> PJK MSPK[[K\PYQ[ WRSPQ^K QSL WRSPQ^K RV QPPOQ\P
NYWWMPN MS .MNKSNPKMSHN MSPK[[K\PYQ[ \QOKKO _JKOK PJK RTTRNMS^ PKS
\RS\KOSMS^ PJK WRLKN RV \MSKWQPM\ MSV[YKS\K RS PJK ZMK_KO \QS XK \[KQO
PJK PMWK PJKU NKKW PR JQZK XKKS MSPKOP_MSKLB QTTKQOMS^ NMWY[PQSK\RS\KTPMRS RV \MSKWQPM\ KVVK\PMZMPU# 4MWM[QO[UB MS PJK \Y[PYOQ[ MWQ
PKSLKS\MKN QTTKQO PR XK OYSSMS^ NMLK XU NMLK# $N PJKOK Q WMSLB Q N
\R^SMPMZK QTTQOQPYNB _MPJ RTKOQPMRSQ[ [Q_N SRP OKLY\MX[K PR NMWT[K
XKJQZMRO XK \RSPOR[[KL XU QVVK\PMS^ PJK RO^QSMNW PJORY^J Q NKP RV TOK
NPMWY[Me
&JMN NK\RSL TRNMPMRS OK\KMZKL MPN KcPOKWK K[QXROQPMRS MS PJK
.WWQSYK[ .S\JWKSB QS KQO[U 4R\MQ[MNP OKZR[YPMRSQOU#57 .S\JWKSHN FPJKROU RV SK_ XMR[R^UF
XQNKL RS 0QZ[RZMQS OKV[KcR[R^U QSL TORTRNKL Q TYOK[U TOR[KPQOMQS \Y
\RSLMPMRSKL OKV[KcKNB _MPJRYP PJK SK\KNNMPU RV \RSZKSPMRSQ[ [QS^YQ^K
TOR[KPQOMQS [QS^YQ^K _RY[L \RSNMNP RV \RSLMPMRSKL ^OYSPN QSL ^KNPYO
\Y[PYOK RV XRYO^KRMN NR\MKPU#
2[[ MS Q[[B PJK \R>KcMNPKS\K RV PJK P_R N\JRR[N MS 4RZMKP TNU\JR[R^U [K
KcMNPKS\K RV PJK P_R dMSLN RV WRLK[N RV QOPMNPM\ QVVK\PMZMPU; QVVK\P
\RWWYSM\QPMS^ MLKQN QSL XUTQNNMS^ \RSN\MRYNSKNN Q[PR^KPJKO# &JMN
MSNPQS\KB MS PJK VR[[R_MS^ NPQPKWKSP VORW F%K_ 2OPMNPM\ 0OR^OQW RV
57 hROQZNdUB 'YNNMQS 0NU\JR[R^UB -"-#
-
8/13/2019 Lev Manovich The engeneering of vision
29/211
"D-9; F2OP NJRY[L XK\RWK PJK SK\KNNQOU TQOP RV KZKOULQU [MVK XRPJ MS M
VROWN fTRNPKOB QLZKOPMNKWKSPB Q^MPQPMRSQ[ PJKQPKOB \MSKWQg QSL
fTNU\JRTJUNM\Q[ \Y[PYOKB RO^QSMbQPMRS RV WQNN JQTTKSMS^NB TOR\KNNM
\RSNPOY\PMRS RV PJMS^Ng#F58 &JK RTTRNMPMRS FOKTOKNKSPQPMRSQ[F >> FRO^QSMbMS
RV QVVK\PMZMPU; QVVK\PMS^ PJK WMSL QSL QVVK\PMS^ PJK XRLU#
&JKNK LMVVKOKSP WRLK[N RV QVVK\PMZMPU _KOK Q[NR YNKL PR YSLK
K[KWKSPN _JM\J _KOK XKMS^ FMNR[QPKLF QSL FTYOMVMKLF MS PJK [QXROQP
K[KWKSPN \RY[L JQZK QVVK\PKL PJK ZMK_KO MS WROK PJQS RSK _QU# %R [RS^K
KWRPMRSQ[ NPQPKNB QN MS PJK POQLMPMRS RV KcTKOMWKSPQ[ TNU\JR[R^U Q_KOK SR_ OK>MSPKOTOKPKL QN \QTQX[K RV \QOOUMS^ \RWT[Kc WKNNQ^KN QL
NMWT[K NM^SQ[N LKNM^SKL PR POM^^KO TJUNMR[R^M\Q[ QSL XKJQZMROQ[ OK
$ JQZK LMN\YNNKL LMVVKOKSP WRLK[N RV QVVK\PMZMPU _JM\J YSLKO[MSKL
RV Q ZMNYQ[ \RLK# ?YP _JQP dMSL RV \RLK \QS XK VROWKL VORW NY\J K[KWKSP
4KWMRPM\MQS 3YMN 0OMKPR LMNPMS^YMNJKL XKP_KKS \RLKN _MPJ QS59 2
\RLK _MPJ QOPM\Y[QPMRS \RSNMNPN RV Q SYWXKO RV K[KWKSPN \RWXMSKL PR
KcQWT[KN QOK JYWQS [QS^YQ^KB T[QUMS^ \QOLNB QSL WQOMPMWK V[Q^ \RLK
RV PJKNK \RLKN MN PJQP PJKU Q[[R_ VRO PJK ^KSKOQPMRS RV Q [QO^K RO KZKS
VORW Q NWQ[[ NKP RV K[KWKSPN# 8RO MSNPQS\KB MS PJK \QNK RV JYWQS [QS^Y
^KSKOQPK QS MSVMSMPK SYWXKO RV NKSPKS\KN# $S \RSPOQNPB MS \RLKN _MP
WQSU WKQSMS^N QN K[KWKSPN# 8RO KcQWT[KB MS PJK [QS^YQ^K RV V[R_KONB
58 1QPNQB 4RZKPNdRK MNdYNNPZR bQ "@ [KPB -
-
8/13/2019 Lev Manovich The engeneering of vision
30/211
LMNPMS\P WKQSMS^ fVRO MSNPQS\KBFOKL ORNKF q FZM\PROU MN URYONFg] Q
\OKQPK QSU SK_ WKQSMS^N#
$S ZMK_ RV PJMN LMNPMS\PMRSB PJK OKNKQO\J MSPR ZMNYQ[ K[KWKSPN
QOPM\Y[QPMRS QN _K[[ QN Q \RLK _MPJRYP QOPM\Y[QPMRS# $S RPJKO _ROLNB M
K[KWKSPN MS P_R _QUN; QN \QOOUMS^ Q \RWT[KPK WKNNQ^K fQ ZKOXQ[ WKQS
TQOPM\Y[QO XKJQZMROQ[ OKNTRSNKgB RO QN aYNP Q TQOP RV PJK WKNNQ^KB
\RWXMSKL _MPJ RPJKO _ROLN PJORY^J ^OQWWQO#
&JK QOPMNPM\ POQLMPMRS RV ZMNYQ[ QPRWMNWB VORW ?[QS\ PR CQSL
VMONP MSPKOTOKPQPMRS# $S PJKMO _OMPMS^NB ?[QS\B 6KSOUB QSL 4KYOQP \NPOQM^JP [MSKN _MPJ LMVVKOKSP KWRPMRSN NY\J QN ^QMKPU RO NQLSKNN#
`YKNPMRSSQMOKB \RWTM[KL MS "D-E _JM[K JK _QN Q\PMZK MS $%CJ*CB Q[NR M
\RSNMLKOKL PJK K[KWKSPN PR LMOK\P[U \ROOKNTRSL PR KWRPMRSN RO ZKOX
Q POMQS^[K >> LR URY VKK[ PJQP MP MN WRZMS^B _JKOKB LR URY NKK MP QN W
NKSNQPMRS VORW Q N`YQOK NMWM[QO PR PJK NKSNQPMRS VORW Q [KWRS] _JQ
> Q POMQS^[K RO Q N`YQOK#F60
2 \RLK _MPJRYP QS QOPM\Y[QPMRS OK`YMOKN QN WQSU NM^SN QN PJKOK
PJKOKVROK MN SRP KVVM\MKSP# 5KPB MP MN PJMN MSKVVM\MKS\U _JM\J WQd
\RWWYSM\QPMZK NMPYQPMRSN VQ\KL XU QOPMNPN QSL LKNM^SKON MS PJK K
&OQVVM\ NM^SNB PJK [QXK[N RS MSNPOYWKSP TQSK[NB POQLKWQOdN JQL PR
OK\R^SMbQX[K XU QS YSPOQMSKL KUK# %RP NYOTOMNMS^[UB PJK LKNM^SKON
NMWT[K QXNPOQ\P VROWN# &JYNB MS "DEDB _JKS 1RSLOMQS QSL CQSLMSNdU
VMONP QXNPOQ\PMRSNB PJK VMONP $SPKOSQPMRSQ[ +RSVKOKS\K RS PJK 'K^Y[
60 nPL# MS CJQS>1Q^RWKLRZB F$%CJ*CBF 9=
-
8/13/2019 Lev Manovich The engeneering of vision
31/211
T[Q\K MS 0QOMN# 8R[[R_MS^ MPN OK\RWWKSLQPMRSNB MS PJK "D"EN>-ENB YSM
WQMS ORQL NMPYQPMRSN _KOK LKZK[RTKL QSL KWT[RUKL#61
8RO PJK 4RZMKP FTNU\JR>KS^MSKKONBF PJK SRPMRS RV Q ZMNYQ[ \RLK _
\ROOK[QPKN KQ\J WKNNQ^K _MPJ Q NKTQOQPK NM^SB JQL Q TQOPM\Y[QO QPPO
TNU\JR[R^MKN RV 0QZ[RZ QSL ?KdJPKOKZ TRTY[QOMbKL PJK SRPMRS RV LMOK\P
PJORY^J \RSLMPMRSKL OKV[KcKN# 4MWT[K ZMNYQ[ VROWN \RY[L JQZK Q\PKL Q
FPJK TOR[KPQOMQS bRWXMKF QN PJK [M^JPN QSL _JMNP[KN Q[OKQLU \RSPOR[[K
[QXROQPROU# $S PJMN MSPKOTOKPQPMRSB PJK LM\PMRSQOU RV ZMNYQ[ K[KW
WKQSMS^N RO KWRPMRSN XYP Q NKP RV \RWWQSLN >> TOKZMRYN[U [KQOSKL _JQP PJK QYPJRO RV PJK F.S^MSKKOMNWF TQTKO NKKWN PR JQZK MS WMSL _JK
_JKOK FZMNYQ[ NKSNQPMRSN QN NY\J _M[[ \RS\KOPKL[U NJQTK PJK JYWQS XKM
$S RPJKO _ROLNB aYNP QN PJK WRPROMNPN MS PJK "D-EN _KOK XK^MSSMS^ PR W
POQVVM\ NM^SNB [KQOSMS^ JR_ PR OKNTRSL PR PJKW QYPRWQPM\Q[[U fPRLQUB
\RWK PR KcTKOMKS\K \RSLMPMRSMS^ PJORY^J Q ZMNYQ[ \RLKgB QOPMNPN PRRd
\RSPOR[[MS^ PJK WQNNKN PJORY^J ZMNYQ[ \RWWYSM\QPMRS#
5KPB _JM[K NYMPQX[K VRO \RWWYSM\QPMRS RV XQNM\ KWRPMRSQ[ NPQP
NPMWY[MB PJK \RLK _MPJRYP QOPM\Y[QPMRS MN SRP TOQ\PM\Q[ VRO \RWWYSM
SYWXKO RV WKNNQ^KN# $V ZMNYQ[ [QS^YQ^K MN PR \RWTKPK _MPJ Q ZKOXQ[
MPB ZMNYQ[ VROWN JQZK PR XK MSPKOTOKPKL QN K`YMZQ[KSPN RV [KPPKON
NYTT[KWKSPKL XU ^OQWWQOB PJK OY[KN RV JR_ PJKNK ZMNYQ[ F_ROLNF QOK
NKSPKS\KN#
$SLKKLB \RSPKWTROQOU LKXQPKN RS _JKPJKO NY\J QSMWQ[N QN LR[TJM
JYWQS [QS^YQ^K \KSPKO QORYSL PJK QPPKWTPN PR PKQ\J PJKW PR YNK ZMNYQ
61 2#4# 4QOLQORZB F@EEE [KP KZR[YPNMM LRORbSR^R bSQdQF f@EEE UKQON RVNM^SgB &KdJSM\JKNdQUQ .NPKPMdQ D f"D,=g; "=>"D#
-
8/13/2019 Lev Manovich The engeneering of vision
32/211
KQNU PR POQMS QSMWQ[N PR OKNTRSL PR ZMNYQ[ VROWN QN LMNPMS\P WKN
Q \MO\[K WKQSN FaYWTBF QSL NR RS# &JK `YKNPMRS MN _JKPJKO QSMWQ[N \QS
PR^KPJKO PR VROW SK_ WKNNQ^KNB PJYN POKQPMS^ PJK MSLMZMLYQ[ NUWXR
\RWT[KPK WKNNQ^KN# 2P [KQNP Q VK_ OKNKQO\JKON JQZK \[QMWKL PJQP PJKU
PR LR NRB PJYN PKQ\JMS^ PJKW Q ZMNYQ[ \RLK _MPJ QOPM\Y[QPMRS#
GJQP QXRYP JYWQSNe &JK MLKQ RV OKT[Q\MS^ TQOPM\Y[QO ZKOXQ[ [QS^
ZMNYQ[ [QS^YQ^K >> WROK KVVM\MKSPB \QTQX[K RV OKQ\JMS^ SK_ WQNNKN R
FTOR[KPQOMQSN RV PJK _JR[K _RO[LF f*#4#4#'#g _QN RVPKS KcTOKNNKL MS PJK
TQOPM\Y[QOB _QN NKKS QN PJK TOMWK \QSLMLQPK VRO Q ZMNYQ[ .NTKOQSPR7OMVVMPJ NQML; F2 TM\PYOK MN PJK YSMZKONQ[ NUWXR[B QSL Q TM\PYOK PJ
[QS^YQ^K# 1RZMS^ TM\PYOKNB NRWKRSK NY^^KNPNB HWM^JP JQZK NQZKL PJK
RV ?QXK[ _QN XYM[P#HF62 1MOMQW 6QSNKS _OMPKN QXRYP PJK WKPQTJRO RV VM[W QN
PJK *#4#;
7OMVVMPJ TQOPM\MTQPKL MS PJK _MLKNTOKQL \K[KXOQPMRS RV VM[W QN Q SQ\\RWTQSMKL MPN VROWQPMRS QN QS MSNPMPYPMRS# *NKL XU aRYOSQ[MNPNB
\[KO^UB TORLY\KONB QSL MSLYNPOMQ[ QTR[R^MNPN Q[MdKB PJK WKPQTJRO RV VLOK_ RS Q ZQOMKPU RV LMN\RYONKN f.S[M^JPKSWKSPB SMSKPKKSPJ>\KSPYOU TWM[[KSSMQ[MNWB PJK .NTKOQSPR WRZKWKSPB QSL PJK ^OR_MS^ QLZKOPMNMSQ\\ROLMS^[U XKP_KKS YPRTMQS QSL PRPQ[MPQOMQS MWT[M\QPMRSN#63
6R_KZKOB MP _QN Q\ORNN PJK 2P[QSPM\B MS PJK *#4#4#'#B _JKOK PJK \RWTQOMN
ZKOXQ[ [QS^YQ^K _QN KcT[ROKL WRNP NUNPKWQPM\Q[[U XU :M\PRO 4Jd[RZNdU
PJKROMNPN QNNR\MQPKL _MPJ PJK NR>\Q[[KL VROWQ[MNP N\JRR[ QN _K[[ QN XU
NY\J QN .MNKSNPKMSB :NKZR[RL 0YLRZdMSB QSL 3KZ CY[KNJRZ# $S PJKMO _OM
62 nPL# MS 1MOMQW 6QSNKSB F&JK 6MKOR^[UTJ QSL PJK GJROK; )#G# 7OMVVMP4RYPJ 2P[QSPM\ nYQOPKO[U ,,B SR# - f"D,Dg; 9
-
8/13/2019 Lev Manovich The engeneering of vision
33/211
VOK`YKSP \RWTQOMNRSN RV Q NJRP QSL Q _ROLB RO Q NK`YKS\K QSL Q NKSPKS
Q F^OQWWQO RV VM[W#F64
+QS _K VMSL NMWM[QO dMSLN RV QSQ[R^MKN TORTRNKL VRO PJK K[KWK
QN PJK QOPMNPN _KOK \RWVROPQX[K _MPJ LMVVKOKSP WYPYQ[[U Kc\[YNMZK W
K`YQ[[U QP KQNK _MPJ P_R \RSPOQLM\PROU WRLK[N RV Q \RLK# $V PJK ZMNYQ[
XK \QTQX[K RV \QOOUMS^ \RWT[KPK WKNNQ^KNB PJKU _KOK Q[NR PJRY^JP RV Q
WKNNQ^K# &JYNB QOP JMNPROMQS 4#(# CJQS>1Q^RWKLRZ _OMPKN QXRYP PJK $
TRMSP _QN PR LMN\RZKO \KOPQMS TOMWQOU K[KWKSPN RV QOPMNPM\ KcTOKN
NM^SMVM\QPMRS QSL YSLKONPRRL QN QS Q[TJQXKP RV QOPMNPM\>\RWTRNMP65
GJQP _K LRSHP VMSL MS PJK "D-ENB JR_KZKOB MN K`YQ[[U NKOMRYN PJM
RV Q NPM[[ MWQ^K# $P _QN RS[U MS PJK "D
-
8/13/2019 Lev Manovich The engeneering of vision
34/211
PRB MS WU ZMK_B MN PJK SK_ NR\MQ[ OR[K RV ZMNMRS QN PJK WKLMYW RV W
Q\`YMOKL MS PJK KQO[MKO LK\QLKN RV PJMN \KSPYOU#
&JK QPPKWTPN PR OQPMRSQ[MbK ZMNMRS MS PJMN OR[KB PR \RS\KMZK R
VYS\PMRS MSLKTKSLKSP[U RV ZKOXQ[ [QS^YQ^K QSL _JM\J \QS XK KVVK\PMZK M
NMPYQPMRSN \OKQPKL XU WRLKOSMbQPMRS JQZK \KSPKOKL QORYSL PJK `YKN
RV ZMNYQ[ \RWWYSM\QPMRS# &JMN `YKNP OKQ\JKN MPN \Y[WMSQPMRS MS PJK
MSNPMPYPKN MS 4RZMKP 'YNNMQ MS PJK "D-ENB _JKOK QOPMNPN \R[[QXROQPK
PR MNR[QPK PJKNK K[KWKSPN QSL NPYLU PJKMO KVVK\PMZKSKNN#
&JK NKQO\J VRO PJK KNNKSPMQ[ K[KWKSPN RV KQ\J QOP _JM\J TOKR\\YTM\KSPYOU \Y[PYOK MN YNYQ[[U NKKS MS PJK \RSPKcP RV QOPMNPM\ WRLKOSMNW
PJK \RSPKcP RV PJK OJKPROM\ RV PJK TYOMPU RV WKLMYW# $SLKKLB KNTK\MQ
POMKL PR OKLY\K KZKOU WKLMYW PR MPN YSM`YK `YQ[MPMKN# &R LR NRB PJ
\RS\KSPOQPKL RS PJK WQPKOMQ[ K[KWKSPN PJRY^JP PR XK YSM`YK PR KQ\J WKL
'YNNMQS VYPYOMNPNB _KOK KcTKOMWKSPMS^ _MPJ NRYSLN] VM[WWQdKON T
\MSKWQ _QN WRZKWKSP QSL PKWTROQ[ OJUPJW f8OKS\J VM[W PJKROU RV PJK "D67 RO WRSPQ^K
fCY[KNJRZHN ORYT MS 'YNNMQg] QSL TQMSPKON _KOK KcT[ROMS^ TYOK \R[RO
VR[[R_MS^ NPQPKWKSP WQLK MS "D-= XU hKQS .TNPKMSB Q 8OKS\J QZQSP>^QOL
PJKROKPM\MQSB MN PUTM\Q[ RV WRLKOSMNP OJKPROM\ RV TYOMPU] \RYSP[KN
PJK TQ^KN RV QZQSP>^QOLK TYX[M\QPMRSN RV PJK PMWK;
8RO KZKOU QOP XYM[LN MPN VROXMLLKS \MPUB MPN R_S Kc\[YNMZK LRWQMSBPR QSUPJMS^ PJQP LRKN SRP XK[RS^# 2NPRSMNJMS^ PR OK[QPKB [MPKOQPYOK WY[MPKOQOU] PJK PJKQPKOB PJKQPOM\Q[] TQMSPMS^B TM\PROMQ[] QSL PJK \MSKW
VOKKMS^ MPNK[V VORW WQSU RV MPN OKTOKNKSPQPMRSQ[ QSL SQOOQPMZK \RRV PJK SQWK PYOSN MPN XQ\d RS PJRNK P_MNPN QSL PYOSN RV T[RP _JM\J [KQL P
67 4KK KNTK\MQ[[U hKQS .TNPKMSB F(S +KOPQMS +JQOQ\PKOMNPM\N RV 0JRPR^l&JKROU QSL +OMPM\MNWB KL# 'M\JQOL 2XK[ f0OMS\KPRS; *SMZKONMPU RV 0OM9",] 7KOWQMSK )Y[Q\B F2KNPJKPM\NB (XNPQ\[KNB $SPK^OQ[ +MSl^OQTJMKBF MS+OMPM\MNWB "; 9,D>9DA#
-
8/13/2019 Lev Manovich The engeneering of vision
35/211
RV PJK [RNP POKQNYOK###&JK \MSKWQ WYNP NKKd PR XK\RWKB ^OQLYQ[[U QSL\MSKWQPM\] PR KWT[RUB MS RPJKO _ROLNB RS[U TJRPR^KSM\ K[KWKSPN#68
5KPB QN PJMN \JQTPKO JQN NY^^KNPKLB WROK _QN QP NPQdK MS PJK `YKNP VR
K[KWKSPNF PJQS aYNP PJK LKWQSL VRO TYOMPU RV WKLMYW# GJM[K WQSU QO
WROK OM\J QKNPJKPM\ K[KWKSPNF f6KSOUgB POUMS^ PR WQdK PJKMO QOP MSP
RPJKON _K[\RWKL PJK RTTROPYSMPU PR PQdK PJKMO QOP PR PJK NPOKKPN# 8RO
ZMNYQ[ K[KWKSPN JQN TORZMLKL JRTK VRO PJK \OKQPMRS RV Q VY[[U OQPMR
\RWWYSM\QPMRS#
&JK LOKQW PR OQPMRSQ[MbK \RWWYSM\QPMRS _QN SRP YSM`YK PR PJMN
VRO Q YSMZKONQ[ [QS^YQ^K ^R XQ\d PR PJK NKZKSPKKSPJ \KSPYOU# )KN\QOPKN
RV Q YSMZKONQ[ [QS^YQ^K NJRY[L XK \RWTRNKL RV TOMWMPMZK K[KWKSPN#
PJKNK K[KWKSPNB RSK \QS ^KSKOQPK FQS MSVMSMPU RV LMVVKOKSP _ROLN#F69 $S PJK KQO[U KM^JPKKSPJ
\KSPYOU 3KMXSMb RYP[MSKL Q [QS^YQ^K MS _JM\J ^OQWWQPM\Q[ QSL [R^M\Q[
PJYN WQdMS^ TRNNMX[K PJK QYPRWQPMRS RV PJMSdMS^# &JK XQNM\ K[KWKSP
\JQOQ\PKON OKTOKNKSPMS^ YSQWXM^YRYN[U Q [MWMPKL SYWXKO RV K[KWK
PJK MSZKSPROU RV PJKNK \RS\KTPN FPJK Q[TJQXKP RV JYWQS PJRY^JP#F &JORY^ TOMWMPMZK \RS\KTPN _RY[L XK \RWXMSKL PR VROW QSU \RWT[Kc MLKQ#70 &JK TORTRNQ[ RV Q YSMZKO
[QS^YQ^K \RWTRNKL VORW ^OQTJM\ NUWXR[N QSL PJKOKVROK NYMPQX[K RS[U
_MPJ PJK VMONP TYOK TQNM^OQTJU fF_OMPMS^ VRO Q[[Fg MSZKSPKL XU hRNKT71
6R_KZKOB YSPM[ PJK P_KSPMKPJ \KSPYOU PJKNK OKWQMSKL MNR[QPKL TJM[RN
NMS^[K MSLMZMLYQ[N# GMPJ PJK OMNK RV WQNN \RWWYSM\QPMRSNB PJK VQS
[QS^YQ^K QPPQMSN SK_ NM^SMVM\QS\KB KcPKSLMS^ MSPR PJK OKQ[W RV ZMNM
68 $XML#B 9"=>"@#69 nPL# MS GMSVOMKL %rPJB 6QSLXRRd RV 4KWMRPM\N f?[RRWMS^PRS QSL $SLM*SMZKONMPU 0OKNNB "DDEgB -A-#70 $XML#B -A=#71 $XML#B -
-
8/13/2019 Lev Manovich The engeneering of vision
36/211
_MPSKNN QOK NUNPKWQPM\ QSL KcPKSNMZK QPPKWTPN PR KNPQX[MNJ VY[[U
WQNN \RWWYSM\QPMRS# 2P PJK NQWK PMWKB PJK NPYLMKN RV XKJQZMRO QS
XKJQZMROMNW QSL OKV[KcR[R^UB [KQL PR SK_ MSPKOTOKPQPMRSN RV PJK VY
ZMNYQ[ .NTKOQSPR# %RP RS[U _RY[L PJKU XK \QTQX[K RV \RWWYSM\QPMS^ MLK
MSPK[[K\PB XYP PJKU _RY[L Q[NR LMOK\P[U \RSPOR[ XKJQZMRO XUTQNNMS^ PJK
WQdMS^ TRNNMX[K QS MSPKOSQPMRSQ[ FTNU\JRTJUNM\Q[ \Y[PYOK#F
-
8/13/2019 Lev Manovich The engeneering of vision
37/211
$S PJK NMcPJ 1KLMPQPMRS )KN\QOPKN LKVMSKL WQS FQN Q PJMS^ PJQP PJMSdNBF PR _JRW
SQPYOQ[[U# $WQ^MSQPMRSB RS PJK RPJKO JQSLB OK`YMOKN Q NTK\MQ[ KVVRO
Q JYWQS XKMS^# )MNPMS^YMNJMS^ XKP_KKS MWQ^MSQPMRS QSL TYOK MSPK[
LKWRSNPOQPKL PJK MSVKOMROMPU RV ZMNMRS PR OKQNRSMS^;
8RO KcQWT[KB _JKS $ MWQ^MSK Q POMQS^[K $ SRP RS[U \RS\KMZK fMSPK[[M^Rg PJQP MP MN Q VM^YOK\RWTOKJKSLKL XU PJOKK [MSKNB XYP QP PJK NQWK PMWK Q[NR $ [RRd YTRS fMS TOKNKSP XU PJK TR_KO QSL MSPKOSQ[ QTT[M\QPMRS RV WU WMSL fQ\MK WKSPMMWQ^MSMS^# ?YP MV $ LKNMOK PR PJMSd RV Q \JM[MQ^RSB $ MSLKKL OM^JP[U \R\RWTRNKL RV Q PJRYNQSL NMLKNB QN KQNM[U QN $ \RS\KMZK PJQP Q POMQS^[KPJOKK NMLKN] XYP $ \QSSRP MWQ^MSK PJK PJRYNQSL NMLKN RV Q \JM[MQ^RS QNPOMQS^[KB SROB NR PR NTKQdB ZMK_ PJKW QN TOKNKSP o_MPJ PJK KUKN RV WU72
$SLKKLB JR_ \QS JYWQSN TRNNMX[U OKQNRS PJORY^J ZMNYQ[ OKTOKNKSPQPM
\QTQX[K RV OKTOKNKSPMS^ KSKOQ[ \RS\KTPN PR XK^MS _MPJe $S &OKQPMNK +
6YWQS CSR_[KL^KB 7KRO^K ?KOdK[KU MSNMNPKLB VRO MSNPQS\KB PJQP MP M
MWQ^K RV QS MLKQB NY\J QN FWQSBF QN Q ^KSKOQ[MPU] MP MN RS[U TRNNMX
WQSB XYP SRP WQS QN NY\J# &JMSdMS^ LKQ[N _MPJ KSKOQ[MPMKN QSL LRKN
PJMS^N# $V Q TJM[RNRTJKO POMKN PR OKQNRS QXRYP PJK SQPYOK RV FWQSBF
_RY[L WMN[KQL PJK OKQNRSMS^ TOR\KNN#73
&JK TJM[RNRTJM\Q[ QO^YWKSPN Q^QMSNP ZMNYQ[ OKQNRSMS^ NPM[[ \RSP
PJKU QOK RYP RV NPKT _MPJ PJK WRLKOS TORLY\PMZK YNK RV ZMNMRS; SRP RS
72 'KSl )KN\QOPKNB F1KLMPQPMRSN RS PJK 8MONP 0JM[RNRTJUBF MS &JK 'QPMRf7QOLKS +MPUB %5; )RYX[KLQU i +RWTQSUB "D
-
8/13/2019 Lev Manovich The engeneering of vision
38/211
PJMSdMS^BF FPJMSdMS^ PJORY^J MWQ^KNBF KP\# JQZK XK\RWK OKNTK\PQX[K Q74 XYP
PJKU QOK Q[NR TYP MSPR TOQ\PM\K LQM[U PJORY^J SK_ PK\JSM`YKN QSL PK\JSR
OKTOKNKSPQPMRS# GJM[K )KN\QOPKN PJRY^JP PJQP MP _QN MWTRNNMX[K fQSL
MWQ^MSK PJK PJRYNQSLN RV NMLKN RV Q \JM[MQ^RSB PRLQU N\MKSPMNPN NP
\RWTYPKO MWQ^MS^ XOMS^N XKVROK PJKMO KUKN SRP RS[U \JM[MQ^RSN XYP
LMWKSNMRSNB RXaK\PN \RWTRNKL SRP VORW PJRYNQSLN XYP VORW WM[[MRS
OKTOKNKSPMS^ _KQPJKO NUNPKWNB LMVVOQ\PMRS TQPPKOSNB QPRWM\ NYOV
MS\RS\KMZQX[K PR PJK XQOK MWQ^MSQPMRS fVM^# @g#75 F4\MKSPMVM\ ZMNYQ[MbQPMRSF MN PJK SQ
VMK[L _JM\J \[QMWN PR POQSNVROW PJK SQPYOK RV N\MKSPMVM\ OKQNRSMS^ WQPJKWQPM\N#
3MdK_MNKB ?KOdK[KUHN MSNMNPKS\K PJQP MWQ^KN \QSSRP \RSZKU FWQ
NYTKONKLKL# 4MS\K PJK "D^Q[Q\PM\ VQWK#
&JK MWQ^KN RV ^KSKOQ[ RO QXNPOQ\P \RS\KTPN \QS XK KS\RYSPKOKL SR
WMNNMRSN XYP RS .QOPJB KZKOULQU QSL KZKOU_JKOKB MS SYWKORYN [R^RP
74 2N _MPSKNNKLB VRO MSNPQS\KB XU NY\J PMP[KN QN &JMSdMS^ .UK f0QY[ C[Kf'YLR[V 2OSJKMWg#75 .cQWT[KN RV N\MKSPMVM\ ZMNYQ[MbQPMRSN TOKNKSPKL QP PJK 4JR_\QNK Q4$77'206 HD- 8MSQ[ 0OR^OQW f%K_ 5ROd; &JK 2NNR\MQPMRS VRO +RWTYPMS^ 1Q99>=E#
-
8/13/2019 Lev Manovich The engeneering of vision
39/211
MSNPQS\KB MS NUWXR[N _JM\J LMNPMS^YMNJ WKSHN VORW _RWKSHN [QZQPRO
RV YSMWQ^MSQX[K LQPQ NKPN# 6R_KZKOB PJKNK KcQWT[KN LR SRP PK[[ YN QS
RV PJK SK_ VYS\PMRS RV ZMNMRS MS WRLKOSMPU# 2VPKO Q[[B VRO \KSPYOMKN
QN ZMNYQ[MbQPMRSN RV PJK JR[U NPROMKN# 1M\JQK[ ?QcQSLQ[[ \MPKN Q [QPK
NYWWQOMbKN PJMN TYOTRNK RV MWQ^KN;
CSR_ PJQP PJKOK _KOK PJOKK OKQNRSN VRO PJK MSNPMPYPMRS RV MWQ^KN MSMSNPOY\PMRS RV NMWT[K TKRT[KB XK\QYNK PJKU QOK MSNPOY\PKL XU PJKW QPJK WUNPKOU RV PJK MS\QOSQPMRS QSL PJK KcQWT[KN RV PJK 4QMSPN WQU XK PJORY^J XKMS^ TOKNKSPKL LQM[U PR RYO KUKN# &JMOLB PR Kc\MPK VKK[MS^NQORYNKL WROK KVVK\PMZK[U XU PJMS^N NKKS PJQS XU PJMS^N JKQOL#76
&JKOKVROKB _JQP MN LMVVKOKSP QXRYP PJK WRLKOS VYS\PMRS RV ZMNMRS
PR OKTOKNKSP QXNPOQ\P \RS\KTPN \RS\OKPK[U# GJQP MN LMVVKOKSP MN PJK M
MWQ^KNB PJK MLKQ YSPJMSdQX[K VRO )KN\QOPKN RO ?KOdK[KU# &JYNB PJK V
MN XQNKL RS PJK QNNYWTPMRS PJQP ZMNYQ[ RXNKOZQPMRS RV \RWTYPKO ^K
TOR\KNNKN [KQLN PR N\MKSPMVM\ XOKQdPJORY JN RPJKO_MNK MWTRNNMX[K
GM[[MQW ?KSNRS TORTRNK PJQP FYNMS^ Q \RWTYPKO NMWY[QPMRS###KZKS Q
\JKWMNPOU WM^JP XK QX[K PR LKLY\K XKSbKSKHN NPOY\PYOKF fQ OKVKOKS\K
LMN\RZKOU RV PJK WR[K\Y[QO NPY\PYOK RV XKSbKSK NYTTRNKL[U WQLK QVPK
Q NSQdK XMPMS^ MPN R_S PQ[Kg#77 4MWM[QO[UB hQORS 3QSMKOB RSK RV PJK WRNP ZMNMX
OKNKQO\JKONsTORWRPKON RV ZMOPYQ[ OKQ[MPUB WQMSPQMSN PJQP ZMOPYQ
NUWXR[M\ \RWWYSM\QPMRSBF PJK \RWWYSM\QPMRS RV MLKQN QSL QO^YWKSP78
8MSQ[[UB Q TORWMSKSP \R^SMPMZK TNU\JR[R^MNP 0JM[MT hRJSNRS>3QMOL \[Q
76 1M\JQK[ ?QcQSLQ[[B 0QMSPMS^ QSL .cTKOMKS\K MS 8MVPKKSPJ +KSPYOU $PQ*SMZKONMPU 0OKNNB "DA-gB ="#77 'M\JQOL 1QOd 8OMKLJRVV QSL GM[[MQW ?KSNRSB &JK 4K\RSL +RWTYPKO 'KZR:MNYQ[MbQPMRS fG#6# 8OKKWQS QSL +RWTQSUB "DD"gB "9#78 4KKB VRO MSNPQS\KB &MWRPJU )OY\dOKUB F'KZKS^K RV PJK %KOLN# 2S $SPK3QSMKOBF 2VPKOMWQ^K f1QU "DD"g; @>D#
-
8/13/2019 Lev Manovich The engeneering of vision
40/211
OKQNRSMS^ PQdKN T[Q\K PJORY^J MWQ^KN; _JKS _K QOK KS^Q^KL MS OKQNRSM
WRLK[ RV Q NMPYQPMRS _JM\J OKTOKNKSPN MPN KNNKSPMQ[ VKQPYOKN MS P79
?KVROK MP XK\QWK TRNNMX[K PR NKSL 3KRSQOLRHN MWQ^KN PR OKWRPK \R
OKTOKNKSP FJYWQSMPUBF XKVROK N\MKSPMNPN Q\\KTPKL PJQP \RWTYPKO>Q
LOQWQPM\Q[[U NTKKL YT N\MKSPMVM\ OKQNRSMS^B XKVROK TNU\JR[R^MNPN
JYWQSN MN Q WQPPKO RV WQSMTY[QPMS^ WKSPQ[ MWQ^KNB Q TORVRYSL \JQS
PR_QOL ZMNMRS JQL PR PQdK T[Q\K# &JMN \JQS^K R\\YOOKL XKP_KKS PJK ",AEN
3R^M\Q[ PJMSdMS^ KSPQM[N PJK OKTOKNKSPQPMRS RV QXNPOQ\P MLKQN OK[QPMRSN XKP_KKS PJKW# )YOMS^ PJMN TKOMRLB 7Q[PRSB :KSSB 8OKYLB .MN
ZMNMRS PR YNK VRO XRPJ TYOTRNKN# 1ROK MWTROPQSP[UB VRO PJK VMONP P
KcT[M\MP aYNPMVM\QPMRSN VRO PJK ZKOU SRPMRS RV OKQNRSMS^ PJORY^J ZM
$S ",AA 7Q[PRSHN \RWTRNMPK TROPOQMPN ZMNYQ[MbKL YSMZKONQ[ JYW
:KSS WQLK TYX[M\ Q WKPJRL VRO NR[ZMS^ TORX[KWN MS [R^M\ XU YNMS^ ^OQ
$S &JK $SPKOTOKPQPMRS RV )OKQWNB TYX[MNJKL MS "DEEB 4M^WYSL 8OKYL L
PJKROU RV JR_ QXNPOQ\P SRPMRSN QSL [R^M\Q[ VROWN \QS XK ZMNYQ[MbKL fN
.MNKSNPKMS TORTRNKL PJQP VM[W \QS XK YNKL FPR KS\RYOQ^K QSL LMOK\P P
fNK\PMRS =g#
&JKNK LMVVKOKSP WRLK[N RV JR_ ZMNMRS \QS XK YNKL MS OKQNRSMS^
PJK OKZKONQ[ RV QPPMPYLK PR_QOLN PJK MSQLK`YQ\U RV ZMNMRS# &JK NK\R
MSLYNPOMQ[ NR\MKPUB PJK \RS\KOS _MPJ PJK KVVM\MKS\U RV PJK WMSL RZKO_
KVVM\MKS\U RV PJK XRLU# %R_B PJK `YKNPMRSN RV JR_ MSVROWQPMRS \QS XK
QSL TOR\KNNKL WROK KVVM\MKSP[U ^MZK LMOK\PMRS PR PJK NPYLU RV PJK W
79 0JM[MT hRJSNRS>3QMOLB 1KSPQ[ 1RLK[N; &R_QOLN Q +R^SMPMZK 4\MKS\K RVQSL +RSN\MRYNSKNN f+QWXOML^K; +QWXOML^K *SMZKONMPU 0OKNNB "D,9g#
-
8/13/2019 Lev Manovich The engeneering of vision
41/211
OKTOKNKSPQPMRSN MS WKSPQ[ TOR\KNNKN# +R^SMPMZK N\MKSPMNPNB QWR
VORW PJMN SK_ TKONTK\PMZKB QSL PJKU TRNPY[QPK PJK \KSPOQ[MPU RV ZMNY
OKQNRSMS^B XK\QYNK RV PJKMO KVVM\MKS\U fNK\PMRSN < QSL Ag#
&R XK QX[K PR QTTOK\MQPK PJK SRZK[PU RV PJK WRLKOS TQOQLM^W RV ZMNY
LMN\YNNMS^ PJK \[QNNM\ TJM[RNRTJM\Q[ TRNMPMRSN RS PJK OK[QPMRSNJMT X
1QSU TJM[RNRTJKON PJRY^JP ZMNMRS PR XK YSNYMPQX[K VRO OKQNRSMS^B VPJK JMNPROU RV TJM[RNRTJUB OKQNRS _QN \[RNK[U QNNR\MQPKL _MPJ [R^M\# $
VROWQ[MbQPMRS XU 7KRO^K ?RR[K QSL 7RPP[RX 8OK^K MS PJK SMSKPKKSPJ \K
MSPR Q NRTJMNPM\QPKL XOQS\J RV WQPJKWQPM\NB PRLQU NKKWMS^[U OKWRZ
LMN\RYONKB ROM^MSQ[[U MP _QN \RS\KMZKL XU 2OMNPRP[K QN Q NUNPKWQP
_JM\J OQPMRSQ[ LKXQPKN NJRY[L XK \RSLY\PKL#80 &JKOKVROKB MP _QN 2OMNPRP[K _JR ROM^M
POQLMPMRS RV LMN\YNNMS^ JYWQS OKQNRSMS^ QSL [R^M\ MSPKO\JQS^KQX[U#
OKQNRS QN FPJQP VQ\Y[PU _JKOKXU WQS MN NYTTRNKL PR XK LMNPMS^YMNJK
MN KZMLKSP JK WY\J NYOTQNNKN PJKW#F +[QMWMS^ PJQP PJK JM^JKNP ROLKO
LMN\RZKOMS^ QSL VMSLMS^ RYP RV TORRVNBF 3R\dK _OMPKN;
4KSNK QSL MSPYMPMRS OKQ\J XYP Q ZKOU [MPP[K _QU# &JK ^OKQPKNP TQOP RVLKLY\PMRSN QSL MSPKOWKLMQPK MLKQN; QSL MS PJRNK \QNKN _JKOK _K QOK VRV dSR_[KL^KB QSL PQdK TORTRNMPMRSN VRO POYK _MPJRYP XKMS^ \KOPQMS PJVMSL RYPB KcQWMSKB QSL \RWTQOK PJK ^ORYSLN RV PJKMO TORXQXM[MPU#81
80 2SPRSU 8[K_B KL#B 2 )M\PMRSQOU RV 0JM[RNRTJU f3RSLRS; 0QS ?RRdN 3PL#B "D81 hRJS 3R\dKB 2S .NNQU +RS\KOSMS^ 6YWQS *SLKONPQSLMS^B KL# 2#4# 0OMS^[K+[QOKSLRS 0OKNNB "D-=gB ?RRd $:B +J# "A#71 " =//H I,/%/>&%/ " I,*#J
-
8/13/2019 Lev Manovich The engeneering of vision
42/211
&JK K`YQPMRS RV OKQNRS _MPJ [R^M\ TKONMNPKL [QPK MSPR PJK P_KSPM
QNNYWKL PJQP PJK VMSQ[ NPQ^K MS PJK LKZK[RTWKSP RV JYWQS PJRY^JP TOR\K
[R^M\ QSQ[UNMN# .`YQ[[UB 3KZM>4POQYNNHN XMSQOU RTTRNMPMRSN QSL 7OK
XQNKL RS NPOMTTKL LR_S VROWQ[ [R^M\# &JMN [R^M\ MN TRNPY[QPKL QN PJK
WMSLF f3KZM>4POQYNNg RO PJK NPOY\PYOK RV Q[[ NM^SMVM\QPMRS f7OKMWQ82 (S[U MS PJK [QNP LK\QLKN
JQZK \R^SMPMZK TNU\JR[R^MNPN LMN\RZKOKL PJQP JYWQS aYL^WKSPN LR SRP
TORXQXM[MPMKN QSL PKSL PR M^SROK MSVROWQPMRS QXRYP PJK TOMRO TO83 PJQP OQPJKO
PJQS JQZMS^ NRWK YSMVROW F[Q_N RV PJRY^JPBF JYWQSN KWT[RU Q ZQOMKPU
JKYOMNPM\N] QSL PJQP MS ^KSKOQ[ PJK SROWQPMZK OY[KN RV [R^M\ LR SRP LK84
6R_KZKOB PJK MLKQ RV Q NKTQOQPMRS XKP_KKS [R^M\ QN Q SROWQPMZK RO T
JYWQS OKQNRSMS^B _JM\J \QS XK LKN\OMXKL QSL NPYLMKL KWTMOM\Q[[U QSL
NPOM\P OY[KN RV [R^M\B MN `YMPK OK\KSPB QSL _RY[L XK YSMWQ^MSQX[K VR85
&JKOKVROKB MS \[QNNM\Q[ TJM[RNRTJU PR OKQNRS MN PR \QOOU RYP [R^
\QS RSK TRNNMX[U OKQNRS PJORY^J MWQ^KNe 6R_ \QS RSK OKTOKNKSP ZMNYQ
82 GJQP MN LMVVKOKSP QXRYP OKQNRS QN MWQ^MSKL XU 3KZM>4POQYNN QSLMN MPN SK_ MSLYNPOMQ[ KVVM\MKS\U; PJK \RS\KTP RV XMSQOU RTTRNMPMRS1$&B PJK XMOPJT[Q\K RV MSVROWQPMRS PJKROU _JM\J LKWRSNPOQPKL PJQP XMK\RSRWM\Q[ RV Q[[# 2\\ROLMS^ PR 7KRVVOKU 4QWTNRSB F_JQP [KL hQdRXNRS PR TQOQWKPKON QOK HXMSQOUH NKKWN PR JQZK XKKS PJK WQPJKWQPM\Q[ SRPMWROK KVVM\MKSP _JKS MP YNKN RS[U MSLKTKSLKSP XMSQOU \JRM\KN#F 7KRV3MS^YMNPM\N f4PQSVROLB +2; 4PQSVROL *SMZKONMPU 0OKNNB "D,EgB -@E#83 7M[[MQS +RJKSB &JK 0NU\JR[R^U RV +R^SMPMRSB -SL KL# f3RSLRS QSL %K_ 5R0OKNNB "D,9gB "DE#84 1M\JQK[ $# 0RNSKOB QSL 7ROLRS 3# 4JY[WQSB F+R^SMPMZK 4\MKS\KBF MS &JK.cTKOMWKSPQ[ 0NU\JR[R^UB KL# .[MRP 6KQONP f6M[[NLQ[KB %h; 3Q_OKS\K .O[XQ0YX[MNJKONB "DADgB 9D9#85 2 OK\KSP LM\PMRSQOU RV TJM[RNRTJU NPM[[ K`YQPKN PJMSdMS^ _MPJ [R^M\; FPJKROKPM\Q[ \RSPKWT[QPMRS LMOK\PKL PR_QOL NRWK RXaK\P _MPJ Q ZMK_ PR\RS\[YNMRS] RO fXg TOQ\PM\Q[ LK[MXKOQPMRS LMOK\PKL PR_QOL NRWK RXaK\LK\MNMRS PR Q\P#F 8[K_B 2 )M\PMRSQOU RV 0JM[RNRTJUB 9@-# .WTJQNMN WMSRV TJM[RNRTJU MN K`YQ[[U \QPK^ROM\Q[; FTQOPM\Y[QO PJRY^JPN JQZK NRWK dMWQU XK \QPK^ROM\Q[B JUTRPJKPM\Q[B LMNaYS\PMZKB YSMZKONQ[B TQOPM\Y[KL#B .S\U\[RTKLMQ RV 0JM[RNRTJU f%K_ 5ROd; 1Q\WM[[QSB "D
-
8/13/2019 Lev Manovich The engeneering of vision
43/211
RPJKO [R^M\Q[ \RSNPQSPNe 6R_ PR OKTOKNKSP POYPJ QSL VQ[NMPUe 6R_ PR LMN
^KSKOQ[e
'KQNRSB RV \RYONKB \QSSRP TOR\KKL _MPJRYP PJK OQ_ WQPKOMQ[NB \R[[
6R_KZKOB PJK OR[K RV ZMNMRS MN [MWMPKL PR PJK TQNNMZK QSL YSMSPK[[M
fNKSNQPMRSNgB [QPKO PR XK MSPKOTOKPKL XU OKQNRS# .cTKOMWKSPQ[ TNU
KWTMOM\MNP TJM[RNRTJU MS PJK SMSKPKKSPJ \KSPYOUB QZK QLLMPMRSQ[ N
JMKOQO\JU XU TORZMLMS^ Q PRTR[R^M\Q[ N\JKWK; PJK RYPNMLK _RO[L KSPKON
KUKN QSL PJKS MN \QOOMKL PJORY^J ZMNYQ[ TQPJ_QUN MSNMLK PJK JKQLB PR
WKSPQ[ VQ\Y[PMKN#F .ZKS PRLQUB TNU\JR[R^M\Q[ PKcPXRRdN QOK RO^QSMbKLMSJKOMPKL VORW KWTMOM\MNP TJM[RNRTJU; PJKU NPQOP _MPJ \JQTPKON RS N
NKSNKNg QSL KSL _MPJ \R^SMPMRS fPJMSdMS^B WKWROUB PKcP \RWTOKJKSNMR
&JKNK QOK NRWK RV PJK _QUN MS _JM\J TJM[RNRTJU JQN LKWRPKL ZMNMRS MS
OKTOKNKSP [R^M\Q[ VROWN] MP \QSHP KSKOQ[MbK] MPN RS[U aRX MN PR \R[[K
SKKLN#86 6R_KZKOB PJMN TJM[RNRTJM\Q[ POQLMPMRS MN \RYSPKOXQ[QS\KL QSL Y
8ROB _JM[K NYXROLMSQPMS^ ZMNMRS PR OKQNRSB TJM[RNRTJKON Q[NR RVPK
XROS RV ZMNMRS# 1ROKRZKOB MP \QS XK NQML PJQP PJKU \RY[L RS[U \RS\KMZK
8RO MSNPQS\KB _JM[K MS PKOWN RV PJK PKWTROQ[MPU RV KZKOULQU W
NKOZKN OKQNRSB MPN PQNd XKMS^ NMWT[U PJK \R[[K\PMRS RV LQPQ VRO OKQ
WY\J [RS^KO PKWTROQ[MPU RV TJU[R^KSKPM\ LKZK[RTWKSP RV PJK JYWQS OQ\K
TRNPY[QPKL QN OKQNRSHN ROM^MS# $S TQOPM\Y[QOB 3R\dKB 6KOLKOB :M\RB
PJQP QXNPOQ\P \QPK^ROMKN RV [QS^YQ^K KZR[ZKL VORW \RS\OKPK ZMNYQ[ fQ
3R\dK; F$ LRYXP SRP XYPB MV _K \RY[L POQ\K PJKW o_ROLNp PR PJKMO NRYO\KN
86 $S JMN )R_S\QNP .UKNB YSQZQM[QX[K PR WK QP PJK PMWK RV PJMN _OMPMS^OR[K RV ZMNMRS MS WRLKOS 8OKS\J TJM[RNRTJU# 1QOPMS hQUB )R_S\QNP .UKN:MNMRS MS &_KSPMKPJ>\KSPYOU 8OKS\J &JRY^JP f?KOdK[KU; &JK *SMZKONMPU"DD9g#
-
8/13/2019 Lev Manovich The engeneering of vision
44/211
[QS^YQ^KNB PJK SQWKN _JM\J NPQSL VRO PJMS^N PJQP VQ[[ YSLKO RYO NKSNKN
VORW NKSNMX[K MLKQN#F87 %MKPbN\JK; F.ZKOUPJMS^ _JM\J WQdKN WQS NPQSL RYP MS OK
QSMWQ[ LKTKSLN RS PJMN VQ\Y[PU RV ZR[QPM[MbMS^ PJK \RS\OKPK WKPQTJRO
OKNR[ZMS^ TKO\KTPMRS MSPR QS MLKQ#F88 :M\R; F$P MN SRPK_ROPJU PJQP MS Q[[ [QS^YQ^KN PJK
RV PJK KcTOKNNMRSN OK[QPMS^ PR MSQSMWQPK PJMS^N QOK VROWKL XU WKP
MPN TQOPN QSL VORW PJK JYWQS NKSNKN QSL TQNNMRSN#F89
:M\RHN MLKQNB MS TQOPM\Y[QOB JQZK XKKS OK\KSP[U OKZMZKL MS PJK
3QdRVV# 3QdRVV QO^YKN PJQP WRNPB MV SRP Q[[B QXNPOQ\P NKWQSPM\ \RS\KT
OKQNRSMS^ QOK XQNKL RS WKPQTJROM\Q[ WQTTMS^ RV NTQPMQ[ \RS\KTPN fN_JR[KB QSL RPJKONg _JM\J QOK MSJKOKSP[U WKQSMS^VY[ PR JYWQS XKMS^N NM
3MdK :M\R XKVROK JMWB 3QdRVV \JQ[[KS^KN PJOKK POQLMPMRSQ[ JMKOQ
QSL QXNPOQ\P PJRY^JPB XKP_KKS ZMNMRS QSL OKQNRSMS^B QSL XKP_KKS [MP
WKQSMS^N# $S \RSPOQNP PR PJK RXaK\PMZMNP>\RWTYPQPMRSQ[ TQOQLM^WB _
2S^[R>2WKOM\QS TJM[RNRTJU RV [QS^YQ^K QSL \R^SMPMZK N\MKS\KB MS _JM\J P
\RS\KTPYQ[MbKL QN PJK Q[^ROMPJWM\ WQSMTY[QPMRS RV NUWXR[N WKQSMS^
\[QMWN PJQP MS PJMSdMS^ _K TORaK\P PJK NPOY\PYOKN RV RYO NKSNROU QSL X
87 nPL# MS &bZKPQS &RLRORZB &JKROMKN RV PJK 4UWXR[ f$PJQ\Q; +ROSK[[ *SM-9A#88 8OMKLOM\J %MKPbN\JKB F(S &OYPJ QSL 8Q[NMPU MS PJKMO *[POQWROQ[ 4KS0JM[RNRTJU QSL (PJKO .NNQUN f%K_ 5ROd; &JK 1Q\WM[[QS +RWTQSUB "D-=gB ","89 &JRWQN 7RLLQOL ?KO^MS QSL 1Qc 6QOR[L 8MN\JB &JK %K_ 4\MKS\K RV 7MQWf$PJQ\Q; +ROSK[[ *SMZKONMPU 0OKNNB "D
-
8/13/2019 Lev Manovich The engeneering of vision
45/211
NMPYQPMRSN#90 &JK NKWQSPM\N RV SQPYOQ[ [QS^YQ^K MN XYM[P YTRS PJK WKQSMS
_JM\J QOK PJK ^KSKOQ[MbQPMRSN RV _JQP 3QdRVV \Q[[N RYO FXQNM\ JYWQS KcT
RYO XRLMKN] RYO XRLMKN \RSNMNP RV TQOPN _JM\J QOK [MSdKL# &JKOKVRO
NMPYQPMRSN MS PKOWN RV \RSPQMSKON fVRO MSNPQS\KB QS KSROWRYN SYW QSL
RYPgB TQOP>_JR[K OK[QPMRSN fLMZRO\K MN NT[MPPMS^ YTg QSL [MSdN f_K WQ
OK[QPMRSNg# 8RO 3QdRVVB WKPQTJRON NY\J QN PJKNK QOK SRP PJK Kc\KTPMR
90 7KRO^K 3QdRVVB F+R^SMPMZK 3MS^Y
:KONYN ==s=@ f"D,"@=#
-
8/13/2019 Lev Manovich The engeneering of vision
46/211
_JM\J MSZR[ZKN PJK KcPKSNMRS RV PJK XRLM[U QSL NKSNROU KcTKOMKS\K PR
\RS\KTPN# ?K\QYNK NTQPMQ[ fWROK TOK\MNK[UB PRTR[R^M\Q[g OK[QPMRSN QO
KcTKOMKS\KB NTQPMQ[ WKPQTJRON QOK QP PJK \ROK RV PJK NKWQSPM\N RV JY
^RQ[NB WRZMS^ RYPB _Q[dMS^ RZKO QS KSKWUB KP\# %RP RS[U LRKN PJK NKWQ
PYOS RYP PR XK XQNKL RS NTQPMQ[ WKPQTJRON XYP QXNPOQ\P OKQNRS MPNK
NTQPMQ[[U OKTOKNKSPKL MSVROWQPMRS; FSQPYOQ[ [QS^YQ^K OKQNRSMS^ W
YS\RSN\MRYN QSL QYPRWQPM\ MWQ^K>XQNKL TOR\KNNKN NY\J QN NYTKOMW
PJKWB VR\YNMS^ RS TQOP RV PJKWB KP\#F91 $S VQ\PB OKQNRS MN Q NTK\MQ[ \QNK RV WROK ^K
RTKOQPMRSN _JM\J QOK SKKLKL VRO TKO\KTPMRS; F2XNPOQ\P OKQNRSMS^ MNOKQNRSMS^# $WQ^K>XQNKL OKQNRSMS^ MN VYSLQWKSPQ[ QSL QXNPOQ\P OK
OKQNRSMS^ YSLKO Q WKPQTJROM\Q[ TORaK\PMRS PR QS QXNPOQ\P LRWQMS#F92
GMPJ PJMN \[QMWB 3QdRVV POQSN\KSLN PJK KQO[MKO ZMK_N RV 3R\dKB :
Q\\ROLMS^ PR _JRW QXNPOQ\P OKQNRS TJU[R^KSKPM\Q[[U KZR[ZKL VORW ZMNM
NY^^KNP PJQP QXNPOQ\P \RS\KTPN JQZK KZR[ZKL VORW FNKSNMX[K MLKQNF f3
f%MKPbN\JKg# $P MN YMPK LMVVKOKSP PR NPQOP _MPJ PJK QNNYWTPMRSB QN
QOK SRPJMS^ XYP Q [MWMPKL NKP RV ZMNYQ[ fWROK TOK\MNK[UB PRTR[R^M\Q
TQOP>_JR[Kg KcPKSLKL MSPR PJK QXNPOQ\P LRWQMS#
6KOK PJK WRLKOS RXNKNNMRS _MPJ PJK ZMNYQ[MbQPMRS RV OKQNRSMS
XOKQd _MPJ PJK POQLMPMRSQ[ \RS\KTPYQ[MbQPMRS RV PJK OK[QPMRS XKP_KK
_OMPKON NY\J QN 3QdRVV RO hRJSNRS>3QMOLB \[QMW MN PJQP PJKOK MN RS[U
RTKOQPMRSNB _JM\J OKQNRS QSL ZMNMRS NJQOK# &JKNK RTKOQPMRSN QOK V
OKQNRS XROOR_N PJKNK RTKOQPMRSN] MP LRKN SRP MSZKSP QSU RV MPN R_S#
91 $XML#B "=D#92 7KRO^K 3QdRVVB F&JK $SZQOMQS\K 6UTRPJKNMN; $N 2XNPOQ\P 'KQNRS ?QNK+R^SMPMZK 3MS^YMNPM\N "B SR# " f"DDEgB
-
8/13/2019 Lev Manovich The engeneering of vision
47/211
hRJSNRS>3QMOL JQN TORTRNKL PJQP _JKS _K QOK KS^Q^KL MS OKQNRSMS
WKSPQ[ WRLK[ RV Q NMPYQPMRS _JM\J OKTOKNKSPN MPN KNNKSPMQ[ VKQPYO
OK[QPMRSN#93 &JK \RS\[YNMRS PJKS NMWT[U \QS XK FOKQL RVVF VORW PJK OKTOKNK
JR_ \QS _K NKK PJK POYPJ RV Q WRLYN TRSKSN; F$V / MN QS 2B QSL MV Q[[ 2HN Q
GK \RSNPOY\P Q WKSPQ[ WRLK[; / MN MSNMLK 2] 2 MN MSNMLK ?# $V PJK WRLK[
PJK OM^JP \RS\[YNMRS MN MSZQOMQX[U QOOMZKL QP# 2\\ROLMS^ PR hRJSNRS>3
93 0JM[MT hRJSNRS>3QMOLB 1KSPQ[ 1RL&R_QOLN Q +R^SMPMZK 4\MKS\K RV 3QS^YQ^KB $SVKOKS\KB QSL +RSN\MRYNSK
+QWXOML^K *SMZKONMPU 0OKNNB "D,9g#
-
8/13/2019 Lev Manovich The engeneering of vision
48/211
-
8/13/2019 Lev Manovich The engeneering of vision
49/211
QXNKS\K RV NKSNQPMRSB NR MP MN NMWY[QPKL PR Q\PMRS _JKS R\\YTMKL _M95 8RO ?KOdK[KU QSL
6YWK PJMSdMS^ MSZR[ZKL Q NK`YKSPMQ[ NKOMKN RV MWQ^KN] PJKNK MWQ^K
PJK WMSL PR WRZK VORW RSK MWQ^K PR QSRPJKO# 'KQNRS _QN K`YQPKL _MPJ
Q[[ RXaK\PN RV PJRY^JP [QML RYP XKVROK MP# 2N NYWWQOMbKL XU hRSQPJQS
?YP _JKPJKO MP MN ?KOdK[KUHN LMZMSK NM^SN RV 7RL QOOQUKL RS Q LMQTJQHMWTOMSPKLH RS Q _JMPK TQ^KB RO 3KMXSMbHN K[QNPM\ N\OKKSB PJK KM^JPYSMVMKL NTQ\K RV ROLKO###RS _JM\J \RSPKSPN RV PJK _RO[L \QS XK NPYLMKL QPKOWN RV Q WY[PMPYLK RV OK[QPMRSNJMTN# $S 'ROPUHN _ROLNB F$P MN QN MYSLKO PJK ^QbK RV PJK YSX[MSdMS^ .UK RV PJK 1MSL###F96
95 nPL# MS hKQS 1QPPKO 1QSL[KO QSL 7KRO^K 1QSL[KOB KLN#B &JMSdMS^; 8ORW7KNPQ[P f%K_ 5ROd; hRJS GM[KU i 4RSNB $S\#B "D
-
8/13/2019 Lev Manovich The engeneering of vision
50/211
$P _QN 6KMLK^^KO _JRB MS GJQP MN +Q[[KL &JMSdMS^eB MSNMNPKL RS PJ
GKNPKOS TJM[RNRTJU fXRPJ KTMNPKWR[R^U QSL RSPR[R^Ug VORW 0[QPR PR 6K^97
F&JK 7OKKdN###\RS\KMZKL dSR_[KL^K QN Q dMSL RV NKKMS^ QSL ZMK_MS^###?
TOKNKS\K QSL TKOWQSKS\KB HNKKMS^H MN KNTK\MQ[[U QTP PR NKOZK QN QS
97 1QOPMS 6KMLK^^KOB GJQP MN +Q[[K&JMSdMS^e f%K_ 5ROd; 6QOTKO i 'R_B 0YX[MNJKONB
"D
-
8/13/2019 Lev Manovich The engeneering of vision
51/211
_JQP MN TOKNKSP QSL _JQP MN TKOWQSKSP#F98 8RO 0[QPRB ?KMS^ MN MLKQB TOKNKSP QN RYP
QTTKQOQS\K# 6R_KZKOB Q[OKQLU MS 0[QPR PJK NKKLN RV PJK NT[MP XKP_KKS
MWT[QSPKL; ?KMS^ MN TOKNKS\K XYP QP PJK NQWK PMWK MN _JQP WQS XOMS
WRWKSP RSB MLKQ MN ^OQLYQ[[U POQSNVROWKL MSPR TKO\KTPMRS QSL OKTOKNKSP
6KMLK^^KOB \JQOQ\PKOMbKN PJK +QOPKNMQS \R^MPR# )KN\QOPKN [QML Q SK_
PJMSdMS^ NYXaK\PB XYP PJK \KOPMPYLK RV PJK \R^MPR LKOMZKN VORW MPN Z
\R^MPQPMR WKQSN :RO>NPK[[YS^B M#K# FPJK XOMS^MS^>XKVROK>MPNK[V QS
QSL WQLK HZMNMX[KH MS PJK _MLKNP NKSNK#F99
$SLKKLB +QOPKNMQS OQPMRSQ[MPU MN XQNKL RS PJK SRPMRS RV Q NYXRXNKOZMS^ JMWNK[V \RSPKWT[QPMS^ PJK NYXaK\P# &JMN MN PJK TOM\K )KN\Q
\RSLKWSQPMRS RV MWQ^KN QSL MWQ^MSQPMRS MS OK[QPMRS PR OKQNRS; JK
ZMNYQ[ PKOWN# ?KVROK F$ PJMSd PJKOKVROK $ QWF \RWKN F$ NKK PJKOKVRO
98 nPL# MS ?RO\J>hQdRXNRSB &JK 2XNR[YPK 1QNPKOB
@9#99 nPL# MS $XML#B @=#
-
8/13/2019 Lev Manovich The engeneering of vision
52/211
3MdK 4MQWKNK P_MSNB ZMNMRS QSL OKQNRS QOK MSNKTQOQX[K MS \[QNNM
MS Q \RWT[Kc SKP_ROd RV LKTKSLKS\MKNB RS[U Q VK_ RV _JM\J JQZK XKKS LMN
RSK JQSLB ZMNMRS MN XYP Q NKOZQSP RV OKQNRSB YSQX[K PR OKTOKNKSP [R
\RS\KTPN QSL PJKOKVROKB \[KQO[U YSNYMPQX[K VRO OKQNRSMS^# (S PJK RPJK
OKZKS^KB \RSNMNPKSP[U N[MTTMS^ MS QN PJK TJU[R^KSKPM\ ROM^MS RV OKQ
WKPQTJRON MS _JM\J RTKOQPMRSN RV OKQNRS QOK \RS\KMZKL#
'K^QOL[KNN RV _JKPJKO 6KMLK^^KOHN XOM[[MQSP Q\\RYSP RV NRWK RV P
OKTOKNKSPN Q XOKQd _MPJ PJMN \[QNNM\Q[ POQLMPMRS RO MN NPM[[ Q TQOP Q^K# :MNMRS QSL OKQNRS QOK SR [RS^KO PJRY^JP RV QN QSPQ^RSMNPN] RS PJK
OKQNRSMS^F MN SR_ PQdKS VRO ^OQSPKL QSL KZKS TORWRPKL QN Q SK_ JM^J[U
LK\MNMRS WQdMS^ QSLsRO TORTQ^QSLQB NYMPQX[K VRO PJK Q^K RV WQNN W
MSLYNPOMQ[MbKL N\MKS\KB QSL XYOKQY\OQ\U# 6KMLK^^KO MN Q \RSPKWTRO
_MPJ 4PQ[MSHN T[QSN PR MSLYNPOMQ[MbK 'YNNMQ RZKOSM^JPB LOKQWN RV P
PJMSdKON XU TQNNMS^ PJKW PJORY^J PJK LQOdSKNN RV NTK\MQ[ MS\YXQPRON
JRYNKNB PJYN NJROPKSMS^ PJK LYOQPMRS RV PJK [KQOSMS^ TOR\KNN PR JRYON
\RSPKWTROQOU RV ?KSaQWMS _JR _QSPN PR PKQ\J 7KOWQS _ROdKON LMQ[K\PM\
_MPJRYP QSU KcPKOSQ[ QMLN fNY\J QN VM[Wg >> XU NMWT[U aYcPQTRNMS^ MW
VQNJMRSB MS PJK WMSL# 8MSQ[[UB 6KMLK^^KOHN URYS^KO \RWTQPOMRPB 'YL
WRNP RYPNTRdKS \JQWTMRS RV PJMSdMS^ MS MWQ^KNB QO^YMS^ PJQP QOPMN
?1 K*%3$ =* L/M&4$@ 2/## -#' N-4$
-
8/13/2019 Lev Manovich The engeneering of vision
53/211
XQNMN RV Q[[ KLY\QPMRSB NMS\K Q[[B KZKS PJK WRNP QXNPOQ\P OKQNRSMS^B
MSVROWQPMRS MS ZMNYQ[ VROW#100
&JK NM^SN RV PJK QOOMZQ[ RV PJK SK_ Q^K RV ZMNYQ[ OKQNRSMS^ NPQO
LK\QLKN RV PJK SMSKKPKKSPJ \KSPYOU# $S ",,E .S^[MNJ [R^M\MQS hRJS :KSS TYX
PJK )MQ^OQWWQPM\ QSL 1K\JQSM\Q[ 'KTOKNKSPQPMRS RV 0ORTRNMPMRSN QSL101 &JK
100
4KK 2OSJKMWB F2 0[KQ VRO :MNYQ[
&JMSdMS^#F101 1QOPMS 7QOLSKOB 3R^M\Q[ 1Q\JMSKN QSL )MQ^OQWNB -SL KL# f+JM\Q^R; &JK+JM\Q^R 0OKNNB "D,-gB 9-#
-
8/13/2019 Lev Manovich The engeneering of vision
54/211
QOPM\[K TOKNKSPKL Q WKPJRL PR YNK ^OQTJM\ LMQ^OQWN PR OKTOKNKSP \RW
NRRS XK\QWK PJK NPQSLQOL VRO [R^M\MQSN# :KSSHN WKPJRL SRP RS[U WQLK
OY[KN RV MSVKOKSPMQ[ [R^M\ MS ZMNYQ[ VROWN] XYP WY\J WROK MWTROPQ
QYPRWQPM\Q[[U XU NMWT[U LOQ_MS^ TM\PYOKN fVM^#
-
8/13/2019 Lev Manovich The engeneering of vision
55/211
7Q[PRS SRP RS[U \[QMWKL PJQP FPJK MLKQ[ VQ\KN RXPQMSKL XU PJK WKP
TROPOQMPYOK QTTKQO PR JQZK Q ^OKQP LKQ[ MS \RWWRS _MPJ###NR>\Q[[KL Q
TORTRNKL PR OKSQWK QXNPOQ\P MLKQN F\YWY[QPMZK MLKQN#F $S \RSPOQNP
MWTKOVK\P QTTQOQPYN VRO PJK K[QXROQPMRS RV ^KSKOQ[ MLKQNBF 7Q[PRS
TJRPR^OQTJNB _JM\JB XKMS^ WK\JQSM\Q[ QSL TOK\MNKB _KOK WY\J WROK OK[M
QXNPOQ\P OKTOKNKSPQPMRSN#104
GMPJ JMN TJRPR^OQTJNB 7Q[PRS SRP RS[U TORTRNKL PJQP YSMZKONQ[N W
PJORY^J ^KSKOM\ MWQ^KN] JK Q\PYQ[[U RXaK\PMVMKL QSL WQPKOMQ[MbKL PJK
\RS\OKPK VROW; PJKU \RY[L SR_ XK PRY\JKLB \RTMKLB VQXOM\QPKLB WY[PMT[$V :KSSHN QSL 7Q[PRSHN MSZKSPMRSN RZKOPYOSKL PJK POQLMPMRSQ[ \[
RV ZMNYQ[ OKQNRSMS^B PJKU LML PJQP SRP PJORY^J SK_ TJM[RNRTJM\Q[ QO^YW
RV Q[[ XU MSZKSPMS^ SK_ _QUN PR YNK MP# &JK [QPPKO MSZKSPKL Q SK_ ZMNY
YSMZKONQ[N PJORY^J \RWTRNMPK TJRPR^OQTJN# &JK VROWKO MSPORLY\KL Q
_QU PR KWT[RU ZMNYQ[ OKTOKNKSPQPMRSNB XKPPKO UKPB Q SK_ ^OQTJM\ NM
NM^SMVU SRP QSU \RS\OKPK RXaK\PNB XYP [R^M\Q[ VROWN#105
$S KVVK\PB :KSSHN PK\JSM`YK QSL 7Q[PRSHN PK\JSR[R^UB _JM\J ^QZK [R^M
QXNPOQ\P MLKQN WQPKOMQ[ PQS^MX[K VROWB KcPKOSQ[MbKL OKQNRSMS^# G
Q YSM`YK[U MSLMZMLYQ[ NPQPKB SR_ XK\QWK TQOP RV Q TYX[M\ NTJKOK# *SR
TOR\KNNKN QSL OKTOKNKSPQPMRSN _KOK PQdKS RYP RV MSLMZMLYQ[ JKQLN
104 nPL# MS $XML#B @"#105 $ NJRY[L \[QOMVU PJK LMNPMS\PMRS XKP_KKS PJK PKOWN ZMNYQ[ PK\JSM`YQN PJKU QOK YNKL MS PJMN \JQTPKO# ?U FPK\JSM`YKNF RV ZMNYQ[ OKTOKNKS^OQTJM\ QSLsRO TM\PROMQ[ NM^SMVUMS^ NUNPKWN _JM\J LR SRP LKTKSL MS QWKLMYW RO PK\JSR[R^M\Q[ XQNK# 8RO KcQWT[KB .Y[KOHN LMQ^OQWN \QS XK WKPQ[B KSKOQPKL _MPJ \RWTYPKO OQTJM\NB KP\# &JK PKOW FZMNYQ[ PK\JSOKTOKNKSPQPMRSQ[ LKZM\KNB _JM\J LR LKTKSL RS PJK TQOPM\Y[QO PK\JSR[R^_RY[L XK JQOL RO MWTRNNMX[K PR Q\JMKZK _MPJRYP MP# &JK KcQWT[KN MS\[NJRPN MS VM[WB _JM\J QOK RS[U TRNNMX[K ^MZKS Q NK`YKS\K RV MWQ^KN MS TORaK\PROB ZMLKR PQTK T[QUKO RO \RWTYPKO# 7Q[PRSHN \RWTRNMPK TJRPR^PK\JSR[R^UB LKTKSLKSPB XRPJ MS MPN LKNM^S QSL MPN QOPMVQ\PNB RS TQOP
-
8/13/2019 Lev Manovich The engeneering of vision
56/211
TJRPR^OQTJN QSL RPJKO ZMNYQ[ VROWN# %R_ PJKU \RY[L XK LMN\YNNKL MS T
PKQ\JMS^ QSL TORTQ^QSLQB NPQSLQOLMbKLB QSL WQNN>LMNPOMXYPKL# GJQ
GJQP _QN YSM`YK XK\QWK WQNN>TORLY\KL# GJQP _QN JMLLKS MS QS MSLMZM
NJQOKL#
GK NJRY[L SRP XK NYOTOMNKLB PJKSB PJQP PJK OKZR[YPMRSQOU SK_ WKLMYW
NR\MKPU TQO Kc\K[[KS\K >> \MSKWQ >> _QN MWWKLMQPK[U TOR\[QMWKL PR XKKcPKOSQ[MbQPMRS RV TOMZQPK WKSPQ[ VYS\PMRSN QSL NPQPKN# $S "D"< 6Y^R
0NU\JR[R^U QP 6QOZQOL *SMZKONMPU QSL RSK RV PJK VRYSLKON RV PJK VMK[L
TNU\JR[R^UB TYX[MNJKL &JK 8M[W; 2 0NU\JR[R^M\Q[ 4PYLUB PRLQU \QSRSMbKL
B1 OI& $/-), $,/ P&%J/% $& $,*#J '*-4/)$*)-44;1O
-
8/13/2019 Lev Manovich The engeneering of vision
57/211
PJKROKPM\Q[ POKQPWKSPN RV \MSKWQ#106 2\\ROLMS^ PR 1mSNPKOXKO^B PJK KNNKS\K RV PJK SK
[MKN MS MPN QXM[MPU PR OKTORLY\KB RO FRXaK\PMVUF ZQOMRYN WKSPQ[ V
TJRPRT[QU RXKUN PJK [Q_N RV PJK WMSL OQPJKO PJQS PJRNK RV PJK RYPKO _RO107 $S \RSPOQNP PR PJK
PJKQPKOB _JKOK PJK Q\PMRS MN \RSNPOQMSKL XU PJK [MWMPQPMRSN RV TJUN
QOXMPOQOM[U MPN WQPKOMQ[B \[RNK[U QTTORcMWQPMS^ V[QNJKN RV WKWR
106
6Y^R 1mSNPKOXKO^B &JK 0JRPRT[QU0NU\JR[R^M\Q[ 4PYLU f%K_ 5ROd; )# 2T[[KPRS i +R#B "D"
-
8/13/2019 Lev Manovich The engeneering of vision
58/211
RPJKO WKSPQ[ Q\PN# 8RO MSNPQS\KB _JM[K MS PJKQPKO KZKSPN JQZK PR VR[[R
PR PJK TOR^OKNNMRS RV PMWKB MS VM[W PJK Q\PMRS \QS NYLLKS[U aYWT XQ\
RV MWQ^MSQPMRS#
1mSNPKOXKO^ _QN SRP \RSPKSP PR TRMSP RYP PJK QSQ[R^U XKP_KKS VM[W
QNPRYSLMS^ QSQ[UNMNB JK \ROOK[QPKL PJK WQMS \MSKWQPM\ PK\JSM`YKN PR
NY\J QN QPPKSPMRS QSL WKWROUB RSK>PR>RSK# 8RO KcQWT[KB MS PJK \[RNK>
WMSL _QSPN PR LMNOK^QOL JQN XKKS NYLLKS[U XQSMNJKL VORW RYO NM^JP
QSQ[R^RYN PR JR_ RYO QPPKSPMRS NK[K\PN Q TQOPM\Y[QO RXaK\P VORW PJK KS
F\YP>XQ\dF PK\JSM`YK RXaK\PMVMKN PJK WKSPQ[ VYS\PMRS RV WKWROU#F$S XRPJ \QNKNBF 1mSNPKOXKO^ _ORPKB FPJK Q\P _JM\J MS PJK ROLMSQO
MS RYO WMSL Q[RSK MN JKOK MS PJK TJRPR^OQTJU TORaK\PKL MSPR PJK TM\PY108 &JK
TNU\JR[R^M\Q[ [QXROQPROU XK\QWK MSLMNPMS^YMNJQX[K VORW PJK WRZMK
KcTKOMWKSPQ[ TNU\JR[R^U >> VORW PJK \MSKWQPR^OQTJKOHN WQSYQ[# &JK W
N\OKKS] PJK MSNMLK XK\QWK PJK RYPNMLK#
1mSNPKOXKO^ QLWMOKL PJK TR_KO RV VM[W PR KcPKOSQ[MbK PJK VYS\P
&JK SKcP [R^M\Q[ NPKT _QN PQdKS XU Q 7KOWQS TNU\JR[R^MNP CYOP 3KZMS _JR
VMONP PR YNK VM[W MS JMN KcTKOMWKSPN# 6K _ORPK PJQP FVM\PMRS VM[W
TNU\JR[R^M\Q[ TOR\KNNKN VRO PJK ZMK_KO# 0NU\JR[R^M\Q[ fN\MKSPMVM\g VM
PJKNK TNU\JR[R^M\Q[ TOR\KNNKN \QS XK RXaK\PMVMKL#F109 4RZMKP TNU\JR[R^MNP 2#0# 3YOMQB _J
T[QSSKL PR KNPQX[MNJ Q TNU\JR[R^M\Q[ [QXROQPROU MS 1RN\R_ MS \RRTKOQP
2\QLKWUB Q\`YQMSPKL 3KZMS _MPJ .MNKSNPKMSB _JR QPPKSLKL PJK NJRRPMS^
QSL QLZMNKL JMW#110
108 $XML#B ="#109 nPL# MS ([^Q ?Y[^QdRZQB F4KO^KM .MNKSNJPKMS M K^R HTNMdJR[R^M\JKNdM TNMdJRQSQ[MbRW M NPOYdPYOSRU TNMdJR[R^MKUF f4KO^KM .MNKSNPKMS QS XKP_KKS TNU\JRQSQ[UNMN QSL NPOY\PYOQ[ TNU\JR[R^UgB CMSRZKL\JKNdMK IQ110 $XML#B "AA#
-
8/13/2019 Lev Manovich The engeneering of vision
59/211
&JK VM^YOK RV .MNKSNPKMS MN TQOPM\Y[QO[U MWTROPQSP XK\QYNK M
\RSSK\PMRS XKP_KKS PJK MSPKOKNP MS ZMNYQ[ OKQNRSMS^ QSL PJK OMNK RV
_JM\J VM[W _QN Q WQaRO ZKJM\[K# &JK KWKO^KS\K RV SK_ WQNN NR\MKPMKN
\KSPYOU LM\PQPKL PJK SK\KNNMPU PR \RWWYSM\QPK MLKR[R^M\Q[ \RS\KTPN PR
_KOK RVPKS M[[MPKOQPK#111 $S PJK "D-EN .MNKSNPKMS XR[L[U \RS\KMZKL Q N\OKKS QLQT
+QTMPQ[ QN Q _QU PR KVVM\MKSP[U XOMS^ QXRYP PJK TR[MPM\Q[ KS[M^JPKSW
KNTK\MQ[[U PJK TKQNQSPN _JR _RY[L SRP NMP PJORY^J Q TR[MPM\Q[ [K\PYOK XY
FSRZK[PUF RV Q WRZMK TORaK\PROB _RY[L \RWK PR NKK WRZMKNB OK^QOL[KN112
*STOK\KLKSPKL QN JMN TORaK\P _QNB MPN OQLM\Q[MNW [QU SRP RS[U MS PJK QXNPOQ\P SRPMRSN QSL [R^M\ RV +QTMPQ[ XYP MS PJK WKPJRL KWT[RUKLB _JM
_RY[L LMOK\P[U TORZRdK LMQ[K\PM\Q[ PJMSdMS^ MS QYLMKS\KN#113 hQ\`YKN 2YWRSP \RS\[YLKN PJQP V
.MNKSNPKMSB FPJK RXaK\P TOMZM[K^KL MS 1QOcHN _ROd MN SRP Q PJKROKPM
\RS\KTPN VORW +QTMPQ[# $P MN QP QSRPJKO [KZK[ KSPMOK[U PJQP .MNKSNPKM
1QOcMNP WKPJRL MPNK[V#F114 &JYN MP _QN SRP NMWT[U Q WQPPKO RV PJK WRLKOS OKLK
LMOK\PMRSN RV PJK "=D- NKOWRS; F###$WQ^KN RV PJK :MO^MS QSL PJK 4QMSPN
Q\\RYSP RV PJK M^SROQS\K RV NMWT[K TKRT[KB NR PJQP PJRNK _JR QOK SRP QX
\QS UKP [KQOS XU NKKMS^ PJK NQ\OQWKSPN RV RYO NQ[ZQPMRS QSL VQMPJ MS115 &JK ZMK_KON RV
+QTMPQ[ _KOK SRP RS[U PR [KQOS PJK N\OMTPYOKN RV PJK SK_ QPJKMNPM\ OK[M
TOR\KNN RV OKQNRSMS^#
111 8RO MSNPQS\KB Q\\ROLMS^ PR PJK "D-< \KSNYNB RYP RV KZKOU "BEEE \MPMb==@ _KOK [MPKOQPK# 0KPKO CKSKbB &JK ?MOPJ RV PJK 0ORTQ^QSLQ 4PQPK# 4R
1RXM[MbQPMRSB "D"A>"D-D f+QWXOML^K; +QWXOML^K *SMZKONMPU 0OKNNB112 CKSKbB &JK ?MOPJ RV PJK 0ORTQ^QSLQ 4PQPKB --E#113 &JK TMRSKKOMS^ _ROd RV 2SSKPPK 1M\JK[NRS _QN MWTROPQSP MS XOMS^M.MNKNPKMSHN +QTMPQ[ TORaK\P# 2SSKPPK 1M\JK[NRSB F'KQLMS^ .MNKSNPKMS- f"DA9,] (\PRXKO 9 f"DAAg; ,->,,#114 hQ\`YKN 2YWRSPB 1RSPQ^K .MNKSNPKMS f3RSLRS QSL ?[RRWMS^PRS; ?8$ 0YX$SLMQSQ *SMZKONMPU 0OKNNB "D,AgB "
-
8/13/2019 Lev Manovich The engeneering of vision
60/211
$P MN NM^SMVM\QSP PJQP PJK WRNP \QPK^ROM\Q[ NPQPKWKSP XU .MNKSN
FVM[WM\ OKQNRSMS^BF OKQNRSMS^ PJORY^J MWQ^KNB QTTKQON MS PJK \RSPK
NK`YKS\K dSR_S QN 8RO 7RL QSL +RYSPOU VORW (\PRXKO f"D-Dg;
1QMSPQMSMS^ PJK LKSRPQPMRS RV F7RLBF PJK MWQ^KN MS\OKQNMS^[U LMNQ^MSKZMPQX[U [KQLMS^ PR MSLMZMLYQ[ \RS\[YNMRSN QXRYP PJK SQPYOK RV Q[[ QPPKWTPKL PR Q\JMKZK Q TYOK[U MSPK[[K\PYQ[ OKNR[YPMRSB OKNY[PMS^ VOR TOK\RS\KTPMRS QSL Q ^OQLYQ[ LMN\OKLMPMS^ RV MPN TYOTRNKVY[ NPKTN#4PKT XU NPKT###TR_KO MN Q\\YWY[QPKL XKJMSL Q TOR\KNN PJQP \QS XK VROW[R^M\Q[ LKLY\PMRS###&JK \RSZKSPMRSQ[ LKN\OMTPMZK VROW VRO VM[W [KQLNdMSL RV VM[WM\ OKQNRSMS^# GJM[K \RSZKSPMRSQ[ VM[W LMOK\PN KWRPMRSNKS\RYOQ^K QSL LMOK\P PJK _JR[K PJRY^JP TOR\KNN QN _K[[#116
8QO VORW NMWT[U OKTOKNKSPMS^ 7RL RO LKMPMKNB QN PJKU LML VRO \KSP
SK_ VYS\PMRS >> PR TORZRdK QSL LMOK\P OKQNRSMS^B OKQNRSMS^ RV Q TQOP
LMQ[K\PM\N#F $S Q\\ROLQS\K _MPJ MPN TOMS\MT[KNB QN \QSRSMbKL XU PJK RV
.MNKSNPKMS _QSPN PR TOKNKSP PJK ZMK_KO _MPJ PJK ZMNYQ[ K`YMZQ[KSPN R
PJK ZMK_KO \QS PJKS TOR\KKL PR QOOMZK QP NUSPJKNMNB M#K# PJK \ROOK\P \
.MNKSNPKMS#
F&JK \RSPKSP RV +20$&23 fMPN QMWg MN SR_ VROWY[QPKL; PR PKQ\J PJK _LMQ[K\PM\Q[[UBF .MNKSNPKMS _OMPKN KSPJYNMQNPM\Q[[U MS 2TOM[ RV "D-,#117 4\JRR[KL XU PJK VM[WB
ZMK_KON _RY[L XK\RWK NK[V>NYVVM\MKSP PJMSdKONB [KQOSMS^ PJK NdM[[ R
_RO[LBF KQ\J Q _Q[dMS^ \QWKOQB NSQTTMS^ TM\PYOKN RV ZMNYQ[ PJKNMN QS
QYPRWQPM\Q[[U KcK\YPMS^ \R^SMPMZK RTKOQPMRSN RV WRSPQ^KB PJMSdMS^
QSL KVVK\PMZK[U#
.MNKSNPKMS \[QMWN PJK OQLM\Q[ SRZK[PU RV JMN \RS\KTP RV FVM[WM\ O
116 4KO^KM .MNKSNPKMSB F2 )MQ[K\PM\Q[ 2TTORQ\J PR 8M[W 8ROWBF MS 8M[W 8&JKROUB KL# hQU 3KULQ f%K_ 5ROd; 6QO\RYOP ?OQ\K QSL GRO[LB "D=DgB
-
8/13/2019 Lev Manovich The engeneering of vision
61/211
&JK TOR\[QWQPMRS PJQP $HW ^RMS^ PR WQdK Q WRZMK RV 1QOcHN )QN CQTMPQ XK[MKZK PJQP PJK VM[WN RV PJK VYPYOK _M[[ XK VRYSL ^RMS^ MS PJMN LMOK\PJMS^N [MdK &JK $LKQ RV +JOMNPMQSMPU VORW PJK XRYO^KRMN TRMSP RV ZMPR LR _MPJ TJM[RNRTJU###PJK VMK[L MN QXNR[YPK[U YSPRY\JKL# &QXY[Q OQNQ118
5KPB .MSNPKMSHN PJKROU _QN SRP QS MNR[QPKL LKZK[RTWKSP# 1QSU MS PJK
NJQOKL Q NMWM[QO XK[MKV MS PJK \R^SMPMZK TR_KO RV SK_ ZMNYQ[ VROWN
"D-EN 2[KcQSLKO 'RL\JKSdR TORWRPKL PJK YNK RV WRSPQ^K NK`YKS\KN MS OQ
.MNKSNPKMSB JK NQ_ WRSPQ^K QN XKMS^ K`YMZQ[KSP PR FLMQ[K\PM\Q[F OKQ
MSLMZMLYQ[ MWQ^K \ROOKNTRSLKL PR Q NMS^[K \RS\KTPB QSL PJMSdMS^ _QN
_JKS Q SYWXKO RV MWQ^KN _KOK aYcPQTRNKL MS Q NKOMKN#119 GQ[PKO ?KSaQWMSHN SRPMRS RV
FLMQ[K\PM\Q[ NKKMS^BF \KSPOQ[ MS JMN YSVMSMNJKL 0QNNQ^KS>GKOd TORa
XYP _MPJMS Q NMS^[K VOQWKB NR PR NTKQd# F)MQ[K\PM\Q[ NKKMS^F _QN \RS\
PR ^OQNT PJK VROWN RV PJK TOKNKSP XU [RRdMS^ PR PJK TQNP QSL PR PJK VYP
aYcPQTRNMS^ PJKW MS PJK NQWK WKSPQ[ MWQ^K#120
118 1M\JK[NRSB F'KQLMS^ .MNKSNPKMSBF (\PRXKO -; -,#119 GJM[K QP VMONP 'RL\JKSdR TOQ\PM\KL aYcPQTRNMPMRS RV WQSU NKTQOQPVOQ^WKSPN _MPJMS PJK NTQ\K RV Q NMS^[K MWQ^KB QP PJK KSL RV PJK "D-EN J
WY[PM>TQ^K [QURYPN \RWTRNKL RV Q SYWXKO RV WROK FPOQLMPMRSQ[F TJRWRSPQ^K NK`YKS\K#120 (S ?KSaQWMSHN \RS\KTP RV FLMQ[K\PM\Q[ NKKMS^F NKK
4YNQS ?Y\d>1RONNB &JK )MQ[K\PM\N RV
-
8/13/2019 Lev Manovich The engeneering of vision
62/211
:KSSB 7Q[PRSB 1mSNPKOXKO^B .MNKSNPKMS# 3R^M\Q[ LMQ^OQWNB \RWTRNMPK
LKZM\KN RV \[RNK>YTB \YP>XQ\dB QSL WRSPQ^K# )MVVKOKSPB MS KVVK\PB QN
QOK NUWTPRWN RV Q NMS^[K NR\MQ[ MWQ^MSQOU QP _ROd; PR WQdK OKQNRSM
NQWK PMWK WROK \RSPOR[[QX[K XU KcPKOSQ[MbMS^ MP QSL OKSLKOMS^ MP Z
^[MWTNKL MS PJK SK_ PK\JSM`YKN RV ZMNYQ[ OKTOKNKSPQPMRSB NY\J QN :KS
PJK LKZK[RT