Accelerate Data Loading for Big Data Analytics...Enabling Live Reporting on NonStop Data 20 HP...
Transcript of Accelerate Data Loading for Big Data Analytics...Enabling Live Reporting on NonStop Data 20 HP...
Attunity Click-2-Load for HP Vertica
Accelerate Data Loading for Big Data Analytics
Menachem Brouk, Regional Director - EMEA
Agenda
» Attunity update
» Solutions for :
1. Big Data Analytics
2. Live Reporting
3. Migration
4. Modernization
5. Mobile Integration
» Summary, Q&A,
2
3
Real-time information availability where & when needed
Focused on data and content, databases and files
For enterprise, big data, and cloud environments
Our Mission
Make Data Available Where and When Needed improving Business Intelligence, Operations & Processes
Global NASDAQ:ATTU 120+ Employees
2000+ Customers
Financial Services
Trusted by leading companies worldwide and half of the Fortune 100
Manufacturing / Industrials Government Health Care
Technology / Telecommunications Other Industries
4
Go-to-Market Partners
Partner of Choice to Technology Leaders
Strategic Partners
OEM Partners
Technology Partners
System Integrator & Consulting Partners
Trusted by leading global partners
5
» Working with HP since the 90’s
» Supports data on all HP platforms (BCS + ISS)
» CI Ready
» System Integration & Distribution Agreement with HP
» Focused on growth areas such as Big Data (HP HAVEn/Vertica)
Attunity is a Strategic HP Partner
6
Attunity Customers on HP NonStop (sample)
Financial Services
Many customers cross industries and geographies
Healthcare Other Manufacturing/Supply Chain
7
Agenda
» Attunity update
» Solutions for :
1. Big Data Analytics
2. Live Reporting
3. Migration
4. Modernization
5. Mobile Integration
» Summary, Q&A,
8
STRUCTURED SEMI-STRUCTURED UNSTRUCTURED
Any Data Any Time Any Where
High Performance Lower Total Cost Quick Time to Value
Delivering Data for Big Data Analytics
WHERE DATA RESIDES
9
C-Level / Management
Line of Business
Analyst
Data Warehouse
BI/Analytics Server
Hadoop / HDFS
Cloud
WHERE DATA NEEDS TO BE
ANALYTICS VALUE BIG DATA
CRM
ERP
Content Management
Web Logs
HR Systems
Example Sources
APPLICATIONS
Sensors
OTHER
AND MORE…
Common Pains with Traditional ETL
Takes too long
Costs too much
Lack of developer resources
Not real-time
Hard to maintain
Accelerate Data Loading
Quick setup with end-to-end automation
Fast loading with optimized integration
High throughput with Turbo-Stream CDC
The Better Way To Get Data Into HP Vertica
Data Value
Fast. Easy. Optimized.
More Data
Less Time
Less Cost
• Easy, no development, no complexity
• Fully automated, end to end
• Fast, high performance integration
• Real-time CDC
• Significantly lower cost
Attunity Click-2-Load for HP Vertica
Monitoring and Control. Complete Confidence at a Glance.
Turbo-Stream CDC and Optimizations for loading HP Vertica High performance, low-latency, low-impact, and scalability
Zero Footprint Architecture. Nothing to install on source database server for Oracle and SQL Server
Click-2-Load. Drag. Drop. Done.
Complete, Heterogeneous Data Loading/Replication. Automating Schema Generation, Full Load, and Change Data Capture (CDC)
14
Attunity Click-2-Load for HP Vertica
15
Web-based Designer and Management Console
Replication Server
In Memory Stream Processing
Persistent Store
Source Database
Transaction Log
Data / Metadata
Data / Metadata
CDC
Bulk Loader
Stream Loader
Bulk Reader Transform
Filter
HP Vertica Optimized Integration • Oracle
• SQL Server • DB2 • DB2 for iSeries • DB2 for z/OS • Sybase • HP NonStop SQL • ODBC
Attunity Click-2-Load for HP Vertica TurboStream CDC
16
In Memory Stream Processing
TurboStream CDC
Transactional CDC Transactions applied in real-time, in order
High-Volume CDC
Staging Table
Vertica Database
CDC SQL ‘COPY
LOCAL’
CDC
SQL n 2 1
SQL SQL
Consolidation of change records to minimize transactions applied to target
R1 R1 R2 R1 R2
R1 R2
Agenda
» Attunity update
» Solutions for :
1. Big Data Analytics
2. Live Reporting
3. Migration
4. Modernization
5. Mobile Integration
» Summary, Q&A,
19
Enabling Live Reporting on NonStop Data
20
HP NonStop SQL Server (or other RDBMS)
Direct, SQL-based real-time access
Replicate a sub-set of data for query offloading
Virtual views, joining data across sources
NonStop SQL
Enscribe
SQL Server
Oracle
Excel, Crystal Reports, Business Objects, Cognos, Tableau, JasperSoft, QlikView, …
SQL/MP Enscribe
Hundreds of files & tables
Attunity ODBC
Direct SQL access
Federated views
HP NonStop Itanium
Customer: Nebraska Medical Center Live Reporting with HP NonStop Data
22
Agenda
» Attunity update
» Solutions for :
1. Big Data Analytics
2. Live Reporting
3. Migration
4. Modernization
5. Mobile Integration
» Summary , Q&A
23
Agenda
» Attunity update
» Solutions for HP NonStop:
1. Big Data Analytics
2. Live Reporting
3. Migration
4. Modernization
5. Mobile Integration
» Summary , Q&A
25
Enable Modernization and SOA Extend across technologies and platforms
26
SQL/MP
HP NonStop
Enscribe
OSS
Guardian
Pathway Services
Windows, UNIX, Linux
Develop new apps in OSS using Java, C++ Enable 3rd party apps to run on OSS
Build composite apps in modern dev tools Integrate NonStop using modern SOA & EDA tools
Java .NET 3GL
Java 3GL
ESB BPM
Web Services
SOA
Make NonStop data accessible via SQL & XML Wrap Pathway as reusable services
Universal Connectivity
Comprehensive NonStop Connectivity Single install. Single design tool. Flexible licensing.
Attunity Enscribe SQL/MP SQL/MX with
MP tables SQL CLIENTS: Client Platforms ODBC - 32bit Windows + + +
Linux + + + Solaris + + + IBM AIX + + + HP-UX (RISC) + + + HP-UX (Integrity) + + +
ODBC - 64bit Windows + + + Linux + + + Solaris + + + IBM AIX + + + HP-UX (RISC) + + + HP-UX (Integrity) + + +
JDBC Linux/UNIX/Win + + +
HP NonStop - OSS + + +
ADO.NET Windows + + +
OLEDB Windows + + +
PLUS: XML Data Services + + + Data Federation On Platform + + + Data Federation Cross Platform + + + 29
Customer: US Foods Build SOA across HP Nonstop and IBM Mainframe
SQL/MP Enscribe
HP NonStop
Direct SQL access
Federated views
DB2 VSAM
IBM Mainframe
Direct SQL access
Federated views
Virtual SOA layer Common and uniform access
Customer: Shenzhen Stock Exchange Modernize trading applications with .NET & Java
HP NonStop
Enscribe
Guardian
Windows
VB.NET
JDBC ADO.NET
Enscribe Enscribe (stock data)
Secure, encrypted communications
Hierarchical metadata Native connectivity
Relational schema SQL data access
Java Apps
» Improve broker & investor productivity with modern apps
» Rapid development while data is reliably managed on NonStop
31
Agenda
» Attunity update
» Solutions for :
1. Big Data Analytics
2. Live Reporting
3. Migration
4. Modernization
5. Mobile Integration
» Summary, Q&A,
33
Enable Mobile Apps and Integration Leverage middleware to enable seamless access
34
SQL/MP
HP NonStop (Guardian)
Enscribe Pathway Services
Windows, UNIX, Linux Build applications that service mobile applications (native or web)
Java .NET
Web Services
Make NonStop data accessible via SQL & XML Wrap Pathway as reusable services
Universal Connectivity
OSS
Java
Agenda
» Attunity update
» Solutions for :
1. Big Data Analytics
2. Live Reporting
3. Migration
4. Modernization
5. Mobile Integration
» Summary, Q&A,
35
Attunity & HP = Great Partnership
» Trusted Partner and Solution
» HP Partner for many years, with reseller agreement in place
» Used by many NonStop customers (e.g. US Foods, Raymond James)
» Global, NASDAQ traded, 120 people, 2000 customers worldwide
» Enable many solutions customers are looking for:
» Big Data Analytics
» Live Reporting
» Migration
» Modernization
» Mobile Integration
36