MarkLogic - Open Analytics Meetup
-
Upload
open-analytics -
Category
Technology
-
view
420 -
download
1
Transcript of MarkLogic - Open Analytics Meetup
![Page 1: MarkLogic - Open Analytics Meetup](https://reader035.fdocuments.in/reader035/viewer/2022062703/5550fccbb4c90501448b4ca4/html5/thumbnails/1.jpg)
Enabling Information Discovery by Unifying Search and Data ManagementAmir Halfon, CTOGlobal Financial Services
![Page 2: MarkLogic - Open Analytics Meetup](https://reader035.fdocuments.in/reader035/viewer/2022062703/5550fccbb4c90501448b4ca4/html5/thumbnails/2.jpg)
Slide 2
Some Recent History
1994: First full text web search engines become available
1998: Google is founded 2003-2004: GFS, MapReduce and BigTable
whitepapers 1999-2005: Lucene, Nutch and Hadoop
![Page 3: MarkLogic - Open Analytics Meetup](https://reader035.fdocuments.in/reader035/viewer/2022062703/5550fccbb4c90501448b4ca4/html5/thumbnails/3.jpg)
Slide 3
Some Not So Recent History
1960s: Navigational and hierarchical databases (IMS, IDMS)
1970s: Edgar Codd introduces the relational database model; System R, INGRESS, and Oracle follow
1980s: Object databases and ORM tools 2000s: NoSQL databases
![Page 4: MarkLogic - Open Analytics Meetup](https://reader035.fdocuments.in/reader035/viewer/2022062703/5550fccbb4c90501448b4ca4/html5/thumbnails/4.jpg)
Slide 4
What if the Two Shall Meet?
SEARCHDATABASE
![Page 5: MarkLogic - Open Analytics Meetup](https://reader035.fdocuments.in/reader035/viewer/2022062703/5550fccbb4c90501448b4ca4/html5/thumbnails/5.jpg)
Slide 5
Schema-Agnostic, Hierarchical Data Model
TradeCashflows
PaymentDate
NetPayment
PayerParty Receive
rParty
Payment
Amount
tradeId
PartyIdentifie
r
PartyReferenc
e
currency
amount
![Page 6: MarkLogic - Open Analytics Meetup](https://reader035.fdocuments.in/reader035/viewer/2022062703/5550fccbb4c90501448b4ca4/html5/thumbnails/6.jpg)
Slide 6
Vs. the Relational Approach
![Page 7: MarkLogic - Open Analytics Meetup](https://reader035.fdocuments.in/reader035/viewer/2022062703/5550fccbb4c90501448b4ca4/html5/thumbnails/7.jpg)
Slide 7
Universal Index
Words and phrases... Semantic Web is a collaborative movement led by the World Wide Web Consortium (W3C) ...
Structure Label
Author Ing
Comp
ID Para
Org
Valuesname:sorbitoldate:2012-06-04company:Roche
Entities and positions... ACE inhibitors, since the risk of lithium toxicity is very high in such patients...
Geospatial<location> <lat>46.946584</lat> <lng>93.076172</lng></location>
Universal Index
![Page 8: MarkLogic - Open Analytics Meetup](https://reader035.fdocuments.in/reader035/viewer/2022062703/5550fccbb4c90501448b4ca4/html5/thumbnails/8.jpg)
Slide 8
Word txt
Use Case: 360 Degree Customer View
UNIFIED DATA
SEARCH
Load and index data “as is”
On-boarding docs, call center logs
PersonalConnections
CardsDDA Mortgages
![Page 9: MarkLogic - Open Analytics Meetup](https://reader035.fdocuments.in/reader035/viewer/2022062703/5550fccbb4c90501448b4ca4/html5/thumbnails/9.jpg)
Slide 9
Use Case: Fraud Prevention
Analytics
Profile Configuration
Profile Data Extracted from Claims
Provider and beneficiary profiles
![Page 10: MarkLogic - Open Analytics Meetup](https://reader035.fdocuments.in/reader035/viewer/2022062703/5550fccbb4c90501448b4ca4/html5/thumbnails/10.jpg)
Slide 10
Use Case: Regulatory Reporting
AUTOMATED LINKAGE
SEARCH; WORKLIST
Word
Pre-Trade Communication
s
TradeData
ReferenceData
![Page 11: MarkLogic - Open Analytics Meetup](https://reader035.fdocuments.in/reader035/viewer/2022062703/5550fccbb4c90501448b4ca4/html5/thumbnails/11.jpg)
Slide 11
What’s Next?
Semantic technology Even more power – graph traversal,
inference