The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)
-
Upload
anand-bagmar -
Category
Data & Analytics
-
view
7.410 -
download
0
Transcript of The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)
![Page 1: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/1.jpg)
THE WHAT, WHY & HOW OF (WEB) ANALYTICS TESTING
Anand BagmarSoftware Quality Evangelist
![Page 2: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/2.jpg)
ABOUT ME
@BagmarAnand
about.me/anand.bagmar
![Page 3: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/3.jpg)
![Page 4: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/4.jpg)
Web Analytics
![Page 5: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/5.jpg)
WHAT IS WEB ANALYTICS?
![Page 6: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/6.jpg)
WHY DO WE NEED WEB ANALYTICS?
![Page 7: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/7.jpg)
![Page 8: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/8.jpg)
WEB ANALYTICS SOLUTIONS
Google Analytics
SiteCatalyst
AWStats
WebTrends
….
![Page 9: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/9.jpg)
Testing Web Analytics
![Page 10: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/10.jpg)
![Page 11: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/11.jpg)
![Page 12: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/12.jpg)
![Page 13: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/13.jpg)
TESTING AT THE REPORT LEVEL
Pros
¨ Ensure report is setup correctly
Cons
¨Licensing
¨Reports not yet setup
¨Validate all requests are sent / captured
![Page 14: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/14.jpg)
Biggest Problem
It is TOO LATE!
![Page 15: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/15.jpg)
The Solution
![Page 16: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/16.jpg)
![Page 17: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/17.jpg)
![Page 18: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/18.jpg)
![Page 19: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/19.jpg)
Web Analytics Testing Challenges
![Page 20: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/20.jpg)
MANUAL
![Page 21: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/21.jpg)
REPEATING OVER-AND-OVER AGAIN
![Page 22: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/22.jpg)
![Page 23: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/23.jpg)
The Automation Solution
![Page 24: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/24.jpg)
WAAT - Web Analytics Automation Testing
![Page 25: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/25.jpg)
WHAT DOES WAAT DO FOR ME?
q Plugs into existing Test Automation Frameworkq With minimal changes
q Web Analytic tool independentq UI Driver framework independentq Browser independent
![Page 26: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/26.jpg)
FLAVORS
![Page 27: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/27.jpg)
WAAT-JAVA
q Original flavorq Supports 2 plugins
q Omniture Debuggerq Proxy q HttpSnifferq JsSniffer
q Available on github
Will be eventually available as a Maven Dependency!
![Page 28: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/28.jpg)
WAAT-RUBY
q Ruby gem implemented over WAAT-Javaq Uses RJB – Ruby-Java-Bridgeq Supports 2 plugins
q HttpSnifferq JsSniffer
q Available on github and rubygems.org
Will be changing soon!
![Page 29: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/29.jpg)
WAAT-JAVA
q Original flavorq Supports 3 plugins
q Omniture Debuggerq HttpSnifferq JsSniffer
q Available on github
![Page 30: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/30.jpg)
WAAT-RUBY
q Ruby gem implemented over WAAT-Javaq Uses RJB – Ruby-Java-Bridgeq Supports 2 plugins
q HttpSnifferq JsSniffer
q Available on github and rubygems.org
![Page 31: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/31.jpg)
OMNITURE DEBUGGER
![Page 32: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/32.jpg)
OMNITURE DEBUGGER
Prosq OS independentq Run using the regular test-user
Consq Browser dependent – need to implement ScriptRunner
for the UI-driver in useq Web-Analytic solution dependent – Adobe Marketing
Cloud / Omniture SiteCatalyst
![Page 33: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/33.jpg)
HTTPSNIFFER
Prosq Web-analytic solution independentq Browser independentq UI-driver independent
Consq 3
rdparty libraries are OS Dependent
q HTTPs not supported out-of-the-boxq Run tests as ‘root’
![Page 34: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/34.jpg)
JSSNIFFER
Prosq Web-analytic solution independentq Browser independentq HTTPs supported out-of-the-boxq No dependency on any 3
rdparty library
Consq Need to write JavaScript to get the URL from the browserq UI-driver dependent
![Page 35: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/35.jpg)
@BagmarAnand #waat how can I contribute?
![Page 36: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/36.jpg)
PROXY DEBUGGER
Prosq Web-analytic solution independentq Browser independentq UI-driver dependentq HTTPs supported out-of-the-boxq No dependency on any 3
rdparty library
Consq Making it work for Mobile needs manual setup
![Page 37: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/37.jpg)
ARCHITECTURE
![Page 38: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/38.jpg)
Is that all to
Web Analytics?
![Page 39: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/39.jpg)
The new “kids” in town
IoT & Big Data
![Page 40: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/40.jpg)
Some popular use cases
https://www.kaaproject.org/iot-use-cases/
![Page 41: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/41.jpg)
IOT – INTERNET OF THINGS
Opportunity to
¨ Create new value propositions
¨ Be Innovative & Creative
![Page 42: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/42.jpg)
IOT – HOW TO DELIVER VALUE?
¨ Automate the manual processes
¨ Integrate data capabilities
¨ Collect – integrate from various sources
¨ Repeat collection – automate the collection
¨ Analyze – manual & machine learning
¨ Optimize / Pivot
¨ Repeat
![Page 43: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/43.jpg)
IOT – CHALLENGES
¨ Federated devices,
¨ Different types of networks
¨ Different communication channels
¨ Physical (hardware) & Virtual (software)
![Page 44: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/44.jpg)
IOT – BIGGER CHALLENGES
¨ Too many devices
¨ Lots of data
![Page 45: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/45.jpg)
BIG DATA …. IS GETTING BIGGER
¨ Volumes of data generated¨ A jet engine generates 1TB of data per flight.
¨ A large refinery generates 1TB of raw data per day.
¨ As cars get smarter, the number of sensors is projected to reach as many as 200 per car.
¨ Sensors of all types will generate immense amounts of data. In fact, analysts estimate that by 2020, 40 percent of all data will come from sensors.
¨ IoT leads to massive volumes of data
http://www.cisco.com/web/solutions/trends/iot/docs/iot-data-analytics-white-paper
![Page 46: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/46.jpg)
What does this mean for Testing?
![Page 47: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/47.jpg)
TESTING OPPORTUNITIES
¨ “Testing” of these new integrations & its value propositions
¨ Performance
¨ Reliability
¨ Security
https://www.wired.com/2017/03/medical-devices-next-security-nightmare/?mbid=social_twitter_onsiteshare
![Page 48: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/48.jpg)
TESTING OPPORTUNITIES ...
¨ Build capabilities (and tools) to validate –
¨ Data collection is working well
¨ From all sources
¨ Analyzing data, capturing patterns and trends
¨ Optimize business value
¨ Create new opportunities and value propositions
![Page 49: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/49.jpg)
@BagmarAnand
about.me/anand.bagmar
THANK YOU
![Page 50: The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)](https://reader031.fdocuments.in/reader031/viewer/2022030317/58705d551a28aba2118b6eb5/html5/thumbnails/50.jpg)
RESOURCES
¨ https://github.com/anandbagmar/waat
¨ https://github.com/anandbagmar/waat-ruby
¨ http://essenceoftesting.blogspot.in/search/label/waat
¨ http://www.cisco.com/web/solutions/trends/iot/docs/iot-data-analytics-white-paper
¨ http://www.dezyre.com/article/how-big-data-analysis-helped-increase-walmart-s-sales-turnover/109