Real- Time Analytics – Process Automation
-
Upload
bsp-media-group -
Category
Technology
-
view
208 -
download
0
Transcript of Real- Time Analytics – Process Automation
![Page 1: Real- Time Analytics – Process Automation](https://reader034.fdocuments.in/reader034/viewer/2022052505/55516b35b4c905723b8b481a/html5/thumbnails/1.jpg)
This document is offered compliments of BSP Media Group. www.bspmediagroup.com
All rights reserved.
![Page 2: Real- Time Analytics – Process Automation](https://reader034.fdocuments.in/reader034/viewer/2022052505/55516b35b4c905723b8b481a/html5/thumbnails/2.jpg)
First National Bank – a division of FirstRand Bank Limited. An Authorised Financial Services and Credit Provider (NCRCP20).
Real-Time Analytics Process Automation
Nico Coetzee
![Page 3: Real- Time Analytics – Process Automation](https://reader034.fdocuments.in/reader034/viewer/2022052505/55516b35b4c905723b8b481a/html5/thumbnails/3.jpg)
Big Data
• Volume
• Amount of data
• Velocity
• speed of data in and out
• Variety
• Range of data types and sources
![Page 4: Real- Time Analytics – Process Automation](https://reader034.fdocuments.in/reader034/viewer/2022052505/55516b35b4c905723b8b481a/html5/thumbnails/4.jpg)
![Page 5: Real- Time Analytics – Process Automation](https://reader034.fdocuments.in/reader034/viewer/2022052505/55516b35b4c905723b8b481a/html5/thumbnails/5.jpg)
![Page 6: Real- Time Analytics – Process Automation](https://reader034.fdocuments.in/reader034/viewer/2022052505/55516b35b4c905723b8b481a/html5/thumbnails/6.jpg)
Volume
• Examples:
• User profile database
• Inventory
• Real Time Analytics Scenarios:
• Measure changes over time
• Assist ERP systems with automation (order
stock)
• Stock load balancing (automatically redistribute
stock from one area to another)
![Page 7: Real- Time Analytics – Process Automation](https://reader034.fdocuments.in/reader034/viewer/2022052505/55516b35b4c905723b8b481a/html5/thumbnails/7.jpg)
![Page 8: Real- Time Analytics – Process Automation](https://reader034.fdocuments.in/reader034/viewer/2022052505/55516b35b4c905723b8b481a/html5/thumbnails/8.jpg)
Velocity
• Examples:
• POS Transactions (think big national retailers)
• Logs (firewall logs)
• Real Time Analytics Scenarios
• Sudden unexpected patterns (a region
experiences an outage)
• Attacks and other anomalies that can be picked
up from logs
![Page 9: Real- Time Analytics – Process Automation](https://reader034.fdocuments.in/reader034/viewer/2022052505/55516b35b4c905723b8b481a/html5/thumbnails/9.jpg)
![Page 10: Real- Time Analytics – Process Automation](https://reader034.fdocuments.in/reader034/viewer/2022052505/55516b35b4c905723b8b481a/html5/thumbnails/10.jpg)
Variety
• Examples:
• End-to-end transaction flows through Web
logs, Application server logs and database logs
• Real Time Analytics Scenarios:
• Continues monitor response times (very handy
for Cloud type solution where decisions to start
more VM’s may be required)
• Context required for making intelligent
decisions, for example in anti-fraud systems
![Page 11: Real- Time Analytics – Process Automation](https://reader034.fdocuments.in/reader034/viewer/2022052505/55516b35b4c905723b8b481a/html5/thumbnails/11.jpg)
The “Missing” V’s
• Viability
• The secret is uncovering the latent, hidden
relationships among these variables.
• Value
• Remember: Correlation does not mean
causation
• Realistic scenarios: Was your marketing
campaign successful?
![Page 12: Real- Time Analytics – Process Automation](https://reader034.fdocuments.in/reader034/viewer/2022052505/55516b35b4c905723b8b481a/html5/thumbnails/12.jpg)
Technologies to Consider
• MongoDB
• NoSQL DB
• Distributed operations (Grid FS)
• Built-in Map-Reduce engine
• Syslog-ng
• Real time decisions on log events
• Granular control over log routing
• Rules based on regular expressions
![Page 13: Real- Time Analytics – Process Automation](https://reader034.fdocuments.in/reader034/viewer/2022052505/55516b35b4c905723b8b481a/html5/thumbnails/13.jpg)
The Future
• DevOps and Agile methodologies can
benefit from the inputs from real time Big
Data analytics
• Identified (potential) defects should naturally
flow back into the backlog.
• Infrastructure and resource management
![Page 14: Real- Time Analytics – Process Automation](https://reader034.fdocuments.in/reader034/viewer/2022052505/55516b35b4c905723b8b481a/html5/thumbnails/14.jpg)
Thank You