Improve the Health of Your Big Data
description
Transcript of Improve the Health of Your Big Data
![Page 1: Improve the Health of Your Big Data](https://reader033.fdocuments.in/reader033/viewer/2022060119/5590afe91a28abe4058b4576/html5/thumbnails/1.jpg)
QuerySurgeTM
Webinar:Improve the
Health of your Data
built by
Speakers
Laura PoggiDirector of Marketing
Bill HaydukFounder / CEO
Martin Henry-LesterProduct Specialist
the Data Testing solution for Big Data
![Page 2: Improve the Health of Your Big Data](https://reader033.fdocuments.in/reader033/viewer/2022060119/5590afe91a28abe4058b4576/html5/thumbnails/2.jpg)
built by
QuerySurge ™
about FACTS
Software:developers of QuerySurgeFounded: 1996
Locations:
New York (HQ), Atlanta, Philadelphia, Phoenix
Primary expertise:Software quality & testing services and solutions
Customer profile:Fortune 1000 & mid-size600+ customers
Strategic Partners:IBM, Microsoft, HP, Oracle, Teradata, HortonWorks
RTTS is the leading provider of software quality for critical business systems
QuerySurgeTMthe developers of
![Page 3: Improve the Health of Your Big Data](https://reader033.fdocuments.in/reader033/viewer/2022060119/5590afe91a28abe4058b4576/html5/thumbnails/3.jpg)
built by
QuerySurge ™
Current Data Trends
![Page 4: Improve the Health of Your Big Data](https://reader033.fdocuments.in/reader033/viewer/2022060119/5590afe91a28abe4058b4576/html5/thumbnails/4.jpg)
Data Impact in Business
Walmart handles > 1 million customer transactions every hour.
Facebook handles 40 billion photos from its user base.
Google processes 1 Terabyte per hour
Twitter processes 85 million tweets per day
eBay processes 80 Terabytes per day
built by
QuerySurge ™
![Page 5: Improve the Health of Your Big Data](https://reader033.fdocuments.in/reader033/viewer/2022060119/5590afe91a28abe4058b4576/html5/thumbnails/5.jpg)
“Data warehouses are more critical than ever to business operations. Their value keeps growing because they represent a company’s crown jewels.”
- Forbes
built by
QuerySurge ™
Current Data Trends
Data WarehousesTechnologies: traditional vendors Oracle, IBM, Microsoft, Teradata, SAP, other
![Page 6: Improve the Health of Your Big Data](https://reader033.fdocuments.in/reader033/viewer/2022060119/5590afe91a28abe4058b4576/html5/thumbnails/6.jpg)
built by
QuerySurge ™
Current Data Trends
“85% of data is coming from net-new data sources” (mobile, social media, web, etc.)- Hortonworks CEO Rob Bearden
“Analysts estimate enterprise data growth of 50x y-o-y through 2020” -Hadoop Summit 2014
Solution: Big DataTechnologies: Hadoop, NoSQL, In-Memory DB
Large Data growth
![Page 7: Improve the Health of Your Big Data](https://reader033.fdocuments.in/reader033/viewer/2022060119/5590afe91a28abe4058b4576/html5/thumbnails/7.jpg)
Relational DB & Data Warehousing
Source Data
@
BI, Analytics & Reporting
Ingestion
built by
QuerySurge ™
Sample Use Case: New Data Architecture
![Page 8: Improve the Health of Your Big Data](https://reader033.fdocuments.in/reader033/viewer/2022060119/5590afe91a28abe4058b4576/html5/thumbnails/8.jpg)
built by
QuerySurge ™
The Bad Side of Data
![Page 9: Improve the Health of Your Big Data](https://reader033.fdocuments.in/reader033/viewer/2022060119/5590afe91a28abe4058b4576/html5/thumbnails/9.jpg)
built by
QuerySurge ™
![Page 10: Improve the Health of Your Big Data](https://reader033.fdocuments.in/reader033/viewer/2022060119/5590afe91a28abe4058b4576/html5/thumbnails/10.jpg)
Strategic Decisions based on BI (may) = $competitive advantage$but…
Strategic Decisions based on Bad Data (will) = a loss of $millions$
“Poor data quality cost companies $8.2 million annually…25% reported that bad data was costing them more than $20 million every year…4% put the figure up to $100 million”
- Gartner survey
built by
QuerySurge ™
The Business Effect of Data
“Most companies estimate they're analyzing a mere 12% of the data they have.”- Forrester Research study
these companies are using BI to provide a competitive advantage…
![Page 11: Improve the Health of Your Big Data](https://reader033.fdocuments.in/reader033/viewer/2022060119/5590afe91a28abe4058b4576/html5/thumbnails/11.jpg)
built by
QuerySurge ™
The SolutionTest & Monitor
the Health of Your Datawith
QuerySurge
the Data Testing solution for Big Data
![Page 12: Improve the Health of Your Big Data](https://reader033.fdocuments.in/reader033/viewer/2022060119/5590afe91a28abe4058b4576/html5/thumbnails/12.jpg)
What is QuerySurge ™?
the collaborative Data Testing solution
that finds bad data & provides a holistic view
of your data’s healthData Testing
built by
the Data Testing solution for Big Data
![Page 13: Improve the Health of Your Big Data](https://reader033.fdocuments.in/reader033/viewer/2022060119/5590afe91a28abe4058b4576/html5/thumbnails/13.jpg)
Improve the Health of your Data
• Reduce your costs & risks
• Improve your data quality
• Accelerate your testing cycles
• Share information with your team
with QuerySurge ™ you can:
built by
QuerySurge ™
![Page 14: Improve the Health of Your Big Data](https://reader033.fdocuments.in/reader033/viewer/2022060119/5590afe91a28abe4058b4576/html5/thumbnails/14.jpg)
QuerySurge Finds Bad Data
SQL
SQL
SQL
SQL
SQL
SQL
QuerySurge pulls data from data sources QuerySurge pulls data from target data
store QuerySurge compares data quickly QuerySurge populates data widgets,
reports
How?
widgets, reports
built by
QuerySurge ™
![Page 15: Improve the Health of Your Big Data](https://reader033.fdocuments.in/reader033/viewer/2022060119/5590afe91a28abe4058b4576/html5/thumbnails/15.jpg)
QuerySurge™ Architecture
Web-based… Installs on...
Linux
Connects to…
…any JDBC compliant data source
built by
QuerySurge ™
![Page 16: Improve the Health of Your Big Data](https://reader033.fdocuments.in/reader033/viewer/2022060119/5590afe91a28abe4058b4576/html5/thumbnails/16.jpg)
the QuerySurge advantage
Automate the testing effort kickoff, tests, comparison, auto-emailed results
Speed up testing up to 1,000 x faster
Schedule test runs when you need them run immediately, periodically, or after an event
Test across different platforms data warehouse, Hadoop, NoSQL, database, flat file, XML
Collaborate Data Health dashboard, shared tests & reports
Verify more data verifies up to 100% of all data
built by
QuerySurge ™
![Page 17: Improve the Health of Your Big Data](https://reader033.fdocuments.in/reader033/viewer/2022060119/5590afe91a28abe4058b4576/html5/thumbnails/17.jpg)
Design Library• Create Query Pairs (source & target SQLs)
– Create by writing SQL– Create visually with Data Wizards
QuerySurge™ Modules
Scheduling Build groups of Query Pairs Schedule Test Runs
‒ Run now‒ Run every Friday at 11pm‒ Automatically run after ETL job
built by
QuerySurge ™
![Page 18: Improve the Health of Your Big Data](https://reader033.fdocuments.in/reader033/viewer/2022060119/5590afe91a28abe4058b4576/html5/thumbnails/18.jpg)
Deep-Dive Reporting Examine and automatically
email test results
Run Dashboard View real-time execution Analyze real-time results
QuerySurge™ Modules
built by
QuerySurge ™
![Page 19: Improve the Health of Your Big Data](https://reader033.fdocuments.in/reader033/viewer/2022060119/5590afe91a28abe4058b4576/html5/thumbnails/19.jpg)
New Module to Monitor your Data’s Health
built by
QuerySurge ™
Data Health Dashboard• view data reliability & pass rate
• add, move, filter, zoom-in on any data widget & underlying data
• verify build success or failure
![Page 20: Improve the Health of Your Big Data](https://reader033.fdocuments.in/reader033/viewer/2022060119/5590afe91a28abe4058b4576/html5/thumbnails/20.jpg)
built by
QuerySurge ™
individual Data Widgetsadd, drop, move, filter, print, zoom-in, zoom-out on
any widget & underlying data
New Module to Monitor your Data’s Health
![Page 21: Improve the Health of Your Big Data](https://reader033.fdocuments.in/reader033/viewer/2022060119/5590afe91a28abe4058b4576/html5/thumbnails/21.jpg)
built by
QuerySurge ™
Smith, Steve
more Data Widgetsadd, drop, move,
filter, zoom-in, zoom-out on any
widget & underlying data
New Module to Monitor your Data’s Health
![Page 22: Improve the Health of Your Big Data](https://reader033.fdocuments.in/reader033/viewer/2022060119/5590afe91a28abe4058b4576/html5/thumbnails/22.jpg)
Collaboration
Testers - functional testing - regression testing- result analysis
Developers / DBAs- unit testing- result analysis
Data Analysts- review, analyze data - verify mapping failures
Operations teams - monitoring- result analysis
Managers- oversight- result analysis
Share information on the health of your data
built by
QuerySurge ™
![Page 23: Improve the Health of Your Big Data](https://reader033.fdocuments.in/reader033/viewer/2022060119/5590afe91a28abe4058b4576/html5/thumbnails/23.jpg)
Contact us if your team would like:
(1) a Trial in the Cloud of QuerySurge, including self-learning tutorial that works with sample data for 3 days or
(2) a downloaded Trial of QuerySurge, including self-learning tutorial with sample data or your data for 15 days or
(3) a Proof of Concept of QuerySurge, including a kickoff & setup meeting and weekly meetings with our team of experts for 30 days
http://www.querysurge.com/compare-trial-options for more information, Go here
QuerySurge
built by
QuerySurge ™
TRIAL IN THE CLOUD
the Data Testing solution for Big Data