Fineo Technical Overview - NextSQL for IoT
-
Upload
jesse-yates -
Category
Technology
-
view
118 -
download
0
Transcript of Fineo Technical Overview - NextSQL for IoT
![Page 1: Fineo Technical Overview - NextSQL for IoT](https://reader034.fdocuments.in/reader034/viewer/2022042723/5875ceef1a28ab8f438b4e3d/html5/thumbnails/1.jpg)
FineoTurn-key Big Datafor Enterprise IoT
![Page 2: Fineo Technical Overview - NextSQL for IoT](https://reader034.fdocuments.in/reader034/viewer/2022042723/5875ceef1a28ab8f438b4e3d/html5/thumbnails/2.jpg)
Fineo - Data Management Platform for IoT
NoSQL time-series database meets analytics warehouse
with native Business Intelligence integration and one-click ETL
Insights
10x lower cost100x more data
Scale
Grow easilyIterate faster
Faster adoptionLower complexity
Integration
![Page 3: Fineo Technical Overview - NextSQL for IoT](https://reader034.fdocuments.in/reader034/viewer/2022042723/5875ceef1a28ab8f438b4e3d/html5/thumbnails/3.jpg)
“Simple” Big Data Deployment
Web scale architecture is hard. Supporting data scientists is even harder. Security/compliance is terrible. ETL is the worst. Integration is horrendous.
Web
ser
ver t
ier
UserC
achi
ng
ETL
AnalystData ScientistSecurity/AuditingStreaming
Data Warehouse
Hadoop
NoSQL SparkHive
Buffer
Realtime
![Page 4: Fineo Technical Overview - NextSQL for IoT](https://reader034.fdocuments.in/reader034/viewer/2022042723/5875ceef1a28ab8f438b4e3d/html5/thumbnails/4.jpg)
![Page 5: Fineo Technical Overview - NextSQL for IoT](https://reader034.fdocuments.in/reader034/viewer/2022042723/5875ceef1a28ab8f438b4e3d/html5/thumbnails/5.jpg)
● Growing time-series (event) data, but RDBMS does not scale○ Need low-latency access to recent data
● Data warehousing overhead (real-time database to analytics store)○ Increasingly complex with new/evolving data sources○ Many places to find “answers”
● Big Data implementation○ Hard to find people to manage & implement○ Fragmented, weak security story
● NoSQL integration○ NoSQL != no schema, but missing tools to leverage flexibility○ Does not play nice with rest of the enterprise
Enterprise Data Challenges
![Page 6: Fineo Technical Overview - NextSQL for IoT](https://reader034.fdocuments.in/reader034/viewer/2022042723/5875ceef1a28ab8f438b4e3d/html5/thumbnails/6.jpg)
Solution
Painless Petabytes
BI IntegrationOne-ClickETL Tools
Instant Data Science
Built in Security & Compliance
A data platform that actively helps you
So you can focus on turning data into information
![Page 7: Fineo Technical Overview - NextSQL for IoT](https://reader034.fdocuments.in/reader034/viewer/2022042723/5875ceef1a28ab8f438b4e3d/html5/thumbnails/7.jpg)
Using Fineo
● Simple integration○ Dashboard for viz. management○ Intuitive REST + SDKs○ Handle any shape of data○ SQL + BI integration (JDBC/ODBC)
● Seamless Scalability○ Transparently handle traffic spikes○ Dynamic query optimization
● Built-in Security○ SSL○ Strong Authentication + Authorization○ Audit in-platform with SQL
![Page 8: Fineo Technical Overview - NextSQL for IoT](https://reader034.fdocuments.in/reader034/viewer/2022042723/5875ceef1a28ab8f438b4e3d/html5/thumbnails/8.jpg)
How does it work?
![Page 9: Fineo Technical Overview - NextSQL for IoT](https://reader034.fdocuments.in/reader034/viewer/2022042723/5875ceef1a28ab8f438b4e3d/html5/thumbnails/9.jpg)
Fineo Internals
● Service Layer○ SSL + Authentication + Authorization○ Native native BI integration
● Next-Generation Compute Layer○ Infinitely scalable writes to cloud-scale buffer○ Staged pipelines for scale, flexibility and safety○ Dynamic query planning, optimization & execution
● Smart Storage Layer○ Flexible schema evolution○ Row-based database for real-time data access○ Columnar storage for analytics/data science
Built for the cloud, by Big Data experts
![Page 10: Fineo Technical Overview - NextSQL for IoT](https://reader034.fdocuments.in/reader034/viewer/2022042723/5875ceef1a28ab8f438b4e3d/html5/thumbnails/10.jpg)
Fineo Internals
Web Servers
Execution Servers
Execution Tree
NoSQL
Next-Gen Compute
Smart Storage
SecureService
S3
ArchiveErrors Query
Stage Backup
Batch Process
Schema Store
Stream Processing
Cloud-Scale Buffer
![Page 11: Fineo Technical Overview - NextSQL for IoT](https://reader034.fdocuments.in/reader034/viewer/2022042723/5875ceef1a28ab8f438b4e3d/html5/thumbnails/11.jpg)
“What I would want to build, given the time - it’s the ‘right thing’”
- Sean-Michael Lewis, CTO Cortex Intel
Architecture Advantages
● Seamless scalability● Native BI connectors make integration easy● Best resources selected for each query● Integrated schema for flexibility● Backups for every stage - at least 10 copies of data!
![Page 12: Fineo Technical Overview - NextSQL for IoT](https://reader034.fdocuments.in/reader034/viewer/2022042723/5875ceef1a28ab8f438b4e3d/html5/thumbnails/12.jpg)
Fineo Internals - Stream Processing
Cloud BufferStream
Processors
Raw
Staged
DeviceEvents
Schema Application
Schema Store
Storage
NoSQL
S3
ArchiveErrors QuerySmart
Storage
![Page 13: Fineo Technical Overview - NextSQL for IoT](https://reader034.fdocuments.in/reader034/viewer/2022042723/5875ceef1a28ab8f438b4e3d/html5/thumbnails/13.jpg)
Stream Architecture Advantages
● Highly modular● Shadow validation on real data● NoSQL store ready for immediate query● Multi-tenant aware, single tenant capable● No-Ops => low downtime● Leveraged for auditing
![Page 14: Fineo Technical Overview - NextSQL for IoT](https://reader034.fdocuments.in/reader034/viewer/2022042723/5875ceef1a28ab8f438b4e3d/html5/thumbnails/14.jpg)
Flexible Schema Evolution
● Store data before creating schema○ Define the data model once you know what you need
● One-click mapping of fields to a single type○ New fields do not impact existing queries or require source systems to change
● Flexible event mapping○ Users only need to specify:
■ Target table■ Timestamp (human or machine-readable)
Temperature Temp tmp
temp
SELECT temp FROM devices
![Page 15: Fineo Technical Overview - NextSQL for IoT](https://reader034.fdocuments.in/reader034/viewer/2022042723/5875ceef1a28ab8f438b4e3d/html5/thumbnails/15.jpg)
Flexible Schema Advantages
● Makes NoSQL viable for average user● Existing queries don’t change when adding schema● Resilient to ‘fat finger’ mistakes● Easy evolution of existing data● Only add schema when you need it● ETL is a click, not a job
![Page 16: Fineo Technical Overview - NextSQL for IoT](https://reader034.fdocuments.in/reader034/viewer/2022042723/5875ceef1a28ab8f438b4e3d/html5/thumbnails/16.jpg)
Integrated Security
● Supports single tenant deployment● Natively multi-tenant
○ Segregated columnar storage○ Push-down filters per-tenant○ Tenant validation at all entry points
● All usage tracked in platform○ User events generate data points○ Use SQL to audit your usage
● API Keys, User/Device ACLs○ Strong authentication & authorization
![Page 17: Fineo Technical Overview - NextSQL for IoT](https://reader034.fdocuments.in/reader034/viewer/2022042723/5875ceef1a28ab8f438b4e3d/html5/thumbnails/17.jpg)
What is Fineo?
● Simple, easy to use APIs● Scalable read/write● Integrated schema management● Multi-tenant, time-series data organization● Transparent, varied types of data stores● Logical recombination of data + schema● Distributed query optimization & execution
![Page 18: Fineo Technical Overview - NextSQL for IoT](https://reader034.fdocuments.in/reader034/viewer/2022042723/5875ceef1a28ab8f438b4e3d/html5/thumbnails/18.jpg)
Why Fineo?
Rapid deployment, integration and evolution
Big Data expertise at startup prices
Integrated security & audit tools
10x faster on 100x more data