Link Analysis 1 Lecture 14: Link Analysis Web Search and Mining.
Modern Applications With Azure Search (Video link in description)
33
BUILDING MODERN WEB APPLICATIONS WITH AZURE SEARCH
-
Upload
loc-tan-vo -
Category
Software
-
view
74 -
download
0
Transcript of Modern Applications With Azure Search (Video link in description)
B U I L D I N G M O D E R N W E B A P P L I C A T I O N S W I T H
AZURE SEARCH
A G E N DA
INTRODUCTION DEMOINDE X
DEMOA P P LICAT IONS
W H O I S 1 2 7 . 0 . 0 . 1 ?
P E T E RLILLE VO LD@ O C C U L T O
LO C TA N VO
@ L O C T A N V O
WHAT?
WHY?
N O R M A L I Z E D D ATAOptimized forWrite Optimized forQuery?
Notsomuch…
C O N C E P T UA L LY
SEARCHINDEX
A P P
A P P
A P P
IaaS, PaaS, SaaS
IaaS (VMs)
PaaS
SaaS
Source: Mat Velloso, Microsoft, LEAP 2016
Azure SearchSearch asaService
The Index
• Simpletable structure defined byschema• Basicvalue types
• string,int,long,double,DateTimeOffset• GeographyPoint• Collectionof strings
• Norelationships• Upto1000fields perindex• 16MBperdocument• Scoringprofiles
• Give fieldsmoreweightwhen queried• Functions:boostweight byfreshness,magnitude,distance andtags
Free tier
• Oneservicepersubscription• Upto3indexes• Upto50MBstorage• Upto10.000documents• Shared resource environment
• Locked toone replica,one partition
• NoSLA• Price:0,-/SU
Basic tier
• 12servicespersubscription• Upto100 fields perindex• Upto5indexes• Upto2GBstorage• Upto1.000.000documents• Upto3replicas,1partition• SLAon queries with 2replicas• SLAon indexing with 3replicas• Price:610,-/SU
Standard tier
S1 S2 S3 S3HD
Servicespersub 12 6 6 6
Indexes 50 200 200 1000 prpartition
Storageper partition 25GB 100GB 200GB 200GB
Partitions perservice 12 12 12 3
Documents perpartition 15M 60M 120M 200Mor1000prindex
Replicas 12 12 12 12
Max SUspersub 36 36 36 36
Priceper SU 2028,- 8114,- 16227,- 16227,-
Replica1Partition 1• Inx-1• Inx-2
Partition 2• Inx-1• Inx-2
Replica2Partition 1• Inx-1• Inx-2
Partition 2• Inx-1• Inx-2
Replica 3Partition 1• Inx-1• Inx-2
Partition 2• Inx-1• Inx-2
Partitions, Replicas and Search Units
Replicas xPartitions =Search Units(SU)=Machines=BillableUnit
Partitions and Replica combos1Partition
2Partitions
3Partitions
4Partitions
6Partitions
12Partitions
1replica 1SU 2SU 3SU 4SU 6SU 12SU
2replicas 2SU 4SU 6SU 8SU 12SU 24SU
3replicas 3SU 6SU 9SU 12SU 18SU 36SU
4replicas 4SU 8SU 12SU 16SU 24SU -
5replicas 5SU 10SU 15SU 20SU 30SU -
6replicas 6SU 12SU 18SU 24SU 36SU -
12replicas 12SU 24SU 36SU - - -
Queries Per Second (QPS)
Free Basic S1 S2 S3 S3HD
QPSprreplica Bingo ~3 ~15 ~60 ~60 >60
MaxQPS Random ~9 ~180 ~720 ~720 >720
Indexers
• Enable populating indexes without code• Pulldatainfrom• Azure SQLDatabase• DocumentDB• Blob andTable Storage
• Multipleindexers write into on index• Scheduleindexing on demand orrecurring• Minimum15minintervals
Blob Storage Indexer
• ReadmetadataANDcontent fromknown filetypes• Filetypessupported• PDF,HTML,XML,ZIP,EML,TXT,JSON,CSV• DOCX/DOC,XLSX/XLS,PPTX/PPT,OutlookMSG• «OneDocument perfile»• Indexing JSONarrays:«one document perobject»
• Supportscontent-specific metadata(author,title,..)• Automaticincremental index anddeletion
Architectural Patterns
S E R V I C E P E R T E N A N T
p r od
q a
t e s t
Search Service
Search Service
Search Service
S H A R E D S E R V I C E PAT T E R N
p r od
q a
t e s t
Search Service
S H A R E D I N D E X PAT T E R N
T-1Search Service
T-2
$filter:tenant eq 1
$filter:tenant eq 2
$filter:tenant eq ‘ ’
THE DEMOS
INDEXING
DEMO GHOST
Search Traffic Analytics
R E S O U R C E S
§ Azure Search Documentationhttps://azure.microsoft.com/en-us/documentation/services/search/
§ Azure Search Rest Service APIhttps://msdn.microsoft.com/en-us/library/azure/dn798927.aspx
§ Query Syntaxeshttps://msdn.microsoft.com/library/azure/dn798920.aspxhttps://msdn.microsoft.com/library/azure/mt589323.aspx
§ ODATA Filter Expressionshttps://msdn.microsoft.com/library/azure/dn798921.aspx
§ Architectural Patternshttps://blogs.technet.microsoft.com/privatecloud/2014/12/02/modern-datacenter-architectural-patterns-azure-search-tier/
