Post on 04-Jun-2020
28-04-2016
Testing challenges in IoT
| 28-04-2016 | Ovidiu Ursachi, Ralf Mack | © For public use Global Testing Practice
Atos – Global Testing Services
Ralf MACK Senior Test Consultant
Ovidiu URSACHI Senior Test Consultant
2
| 28-04-2016 | Ovidiu Ursachi, Ralf Mack | © For public use Global Testing Practice
Overview
3
IoT versus traditional IT
IoT cases
Integration and Interoperability
Maintainability
Usability
Security
| 28-04-2016 | Ovidiu Ursachi, Ralf Mack | © For public use Global Testing Practice
IoT vs „traditional“ IT
4
| 28-04-2016 | Ovidiu Ursachi, Ralf Mack | © For public use Global Testing Practice
IoT case: R-Link for Renault Connected Vehicle
Solution
▶ Create an open and flexible back-end platform including AppStore, M2M, in-car & web payment
▶ Integrate B2C services & many service/Content providers
▶ Interface with RSA IT for end-to-end process handing and existing telematics system
▶ Develop In-car Apps and context-aware services
Benefits
▶ Multiple-sales channel handling maximizing revenues
▶ Deployment underway in 40 countries, 50 planned
▶ Fast Time to Market for integration of third-parties
▶ Future-proof solution (multi-device, multi-connectivity)
▶ Context-aware innovative services (Low Fuel)
Business challenges
▶ Connecting cars to cloud services for mid/high range cars
▶ Supply Infotainment & Connected Navigation apps
▶ Integrate a complex eco-system of business partners around a new business model and in-dash Tablet
5
| 28-04-2016 | Ovidiu Ursachi, Ralf Mack | © For public use Global Testing Practice
IoT case: Bosch Siemens Home Appliances – Home Connect
Business challenges
▶ Consolidate his premium positioning
▶ Increase his knowledge and loyalty on their clients
▶ Develop a « Service oriented » business model
▶ Propose a service with a complete data privacy
▶ Improvement maintenance and appliances efficiency
Solution
▶ A worldwide platform handling various brand & products
▶ Offering secured data flows between the consumers (smartphones, tablets, laptop) and their appliances
▶ Via ADSL box of the customer
▶ Integrated with CRM & e-commerce solutions
▶ Coupled with a contextualization data engine to seize « big data » opportunities
Benefits
▶ Service Launched at IFA 2014 (Start of Sales Dec. 2014)
▶ Expected volumes: 230 millions always on appliances in 2030
6 6
| 28-04-2016 | Ovidiu Ursachi, Ralf Mack | © For public use Global Testing Practice
Interoperability and Integration
7
Device
• Different suppliers
Communi-cation
• Physical layer
• Network layer
• Transport layer
Gateway
Backend
Analytics
• Business Intelligence
• Automate Operation
Endpoint
• Apps
• Mobile devices
• M2M
Integration on different levels
▶ Gaps in functional specifications and standards
▶ Complex End-to-End chain with many variables
Increased need for Interoperability and Integration testing
| 28-04-2016 | Ovidiu Ursachi, Ralf Mack | © For public use Global Testing Practice
Maintainability – test IoT persistency Focus on Consumer Goods
8
Consumer good category
Speciality Shopping Convenience
e.g. luxury brands very expensive, brand loyality
e.g. TV, cameras fairly expensive,
infrequent purchase
less expensive,
frequent purchase
Maintenance category
Corrective
Perfective
Adaptive
Preventive / Predictive
Patching, Security
Enhancements over multitude of devices
Adoptions to changed environments
Reduction of future maintenance
SW change (DIY*)
HW change (DIY*)
Service technician
Automated or on request SW update by customer
Exchange of HW modules by customer
Exchange of HW by technician
Change type
*DIY – Do it yourself
| 28-04-2016 | Ovidiu Ursachi, Ralf Mack | © For public use Global Testing Practice
IoT Maintainability for durable consumer goods
Devices connected to IoT
• long live span of cars, dishwashers, fridges …
• regular new product releases and firmware / HW variants
Security issues
• found several times per year
• some fixes may need HW updates
Mobile Apps
• new versions released several times per year
9
uncountable number of
device variants How to ensure security across
device live span?
How to secure App interoperation with multiplicity
of existing devices?
Now … 20 years later
| 28-04-2016 | Ovidiu Ursachi, Ralf Mack | © For public use Global Testing Practice
IoT facets of design under test
10
UI / visual design
Platform design
Interusability Conceptual
model
Interaction design
Industrial design
Service design
Productisation
Most visible Least visible
Figure adapted from the book „Designed connected products“ by Rowland, C. et. al
| 28-04-2016 | Ovidiu Ursachi, Ralf Mack | © For public use Global Testing Practice
Privacy and security problems
11
Privacy problems
• data brokers
• de-anonymisation
• breaches
• eavesdropping
Security problems
• spoofing
• buffer overflow
• threats through APIs
• firewall bypass
• outdated software (maintainability)
• enrollment of devices
• DDoS amplifier
Tests
• check against best practices - policies
• check cryptography
• check resilience against unexpected
events and malicious spoofed packets
• work in fail-safe mode
• update flow and procedures
| 28-04-2016 | Ovidiu Ursachi, Ralf Mack | © For public use Global Testing Practice
Security – New challenges to be considered
12
Security
Concept
Penetration
Test Thingbots
Drones
Cross-device attacks
Cloud
Voice and video control
Backdoors
Server heartbleed
| 28-04-2016 | Ovidiu Ursachi, Ralf Mack | © For public use Global Testing Practice
Key messages
13
Integration and Interoperability
increasing tester Skills, exploding complexity, complex test infrastructure
Maintainability
long-term maintainability, device explosion, integrated E2E test automation
Usability
different over platforms, different contexts, distributed, industrial design influences
Security
Privacy issues, spoofing, thingbots, firewall bypassing, maintenance, cross-device attacks
Atos, the Atos logo, Atos Consulting, Atos Worldgrid, Worldline, BlueKiwi, Canopy the Open Cloud Company, Yunano, Zero Email, Zero Email Certified and The Zero Email Company are registered trademarks of Atos. February 2016. © 2016 Atos. Confidential information owned by Atos, to be used by the recipient only. This document, or any part of it, may not be reproduced, copied, circulated and/or distributed nor quoted without prior written approval from Atos.
Thanks
For more information please contact:
Ovidiu Ursachi, MBA, PMP Ralf Mack T: +49 211 399 48444 T: +49 211 39938855 M: +49 163 1661957 M: +49 177 2153647 ovidiu.ursachi@atos.net ralf.mack@atos.net