The next generation of testing tools for exchanges
-
Upload
iosif-itkin -
Category
Technology
-
view
495 -
download
0
Transcript of The next generation of testing tools for exchanges
![Page 1: The next generation of testing tools for exchanges](https://reader034.fdocuments.in/reader034/viewer/2022042716/55a5433f1a28abba478b45f3/html5/thumbnails/1.jpg)
The Next Generation of Testing Tools for Exchanges
Iosif Itkin Exactpro Systems 24 March 2015
![Page 2: The next generation of testing tools for exchanges](https://reader034.fdocuments.in/reader034/viewer/2022042716/55a5433f1a28abba478b45f3/html5/thumbnails/2.jpg)
Test Tools Typology
• Connectivity Testing
• Test Automation
• Load Testing
2
![Page 3: The next generation of testing tools for exchanges](https://reader034.fdocuments.in/reader034/viewer/2022042716/55a5433f1a28abba478b45f3/html5/thumbnails/3.jpg)
Generic Test Tools
• No Connectivity Layer
• No Session Layer
• No Framework for Messages
3
![Page 4: The next generation of testing tools for exchanges](https://reader034.fdocuments.in/reader034/viewer/2022042716/55a5433f1a28abba478b45f3/html5/thumbnails/4.jpg)
Trading Test Tool
4
![Page 5: The next generation of testing tools for exchanges](https://reader034.fdocuments.in/reader034/viewer/2022042716/55a5433f1a28abba478b45f3/html5/thumbnails/5.jpg)
Test Tools Evolution
5
Passive Testing – investigating the behavior of a system without affecting its operations
Generic
Trading
+Passive
![Page 6: The next generation of testing tools for exchanges](https://reader034.fdocuments.in/reader034/viewer/2022042716/55a5433f1a28abba478b45f3/html5/thumbnails/6.jpg)
Passive Testing
6
![Page 7: The next generation of testing tools for exchanges](https://reader034.fdocuments.in/reader034/viewer/2022042716/55a5433f1a28abba478b45f3/html5/thumbnails/7.jpg)
Test Tools Evolution
7
Passive Testing – invaluable for Client
onboarding and certification
Generic
Trading
+Passive
![Page 8: The next generation of testing tools for exchanges](https://reader034.fdocuments.in/reader034/viewer/2022042716/55a5433f1a28abba478b45f3/html5/thumbnails/8.jpg)
Ideal Passive Testing Tool
8
![Page 9: The next generation of testing tools for exchanges](https://reader034.fdocuments.in/reader034/viewer/2022042716/55a5433f1a28abba478b45f3/html5/thumbnails/9.jpg)
Production Monitoring System
9
![Page 10: The next generation of testing tools for exchanges](https://reader034.fdocuments.in/reader034/viewer/2022042716/55a5433f1a28abba478b45f3/html5/thumbnails/10.jpg)
Ideal Active Testing Tool
10
![Page 11: The next generation of testing tools for exchanges](https://reader034.fdocuments.in/reader034/viewer/2022042716/55a5433f1a28abba478b45f3/html5/thumbnails/11.jpg)
Production Algo Trading Engine
11
![Page 12: The next generation of testing tools for exchanges](https://reader034.fdocuments.in/reader034/viewer/2022042716/55a5433f1a28abba478b45f3/html5/thumbnails/12.jpg)
Test Tools Evolution
12
Testing at the
Confluence of Functional and Non-Functional
Generic
Trading
+Passive
Production
![Page 13: The next generation of testing tools for exchanges](https://reader034.fdocuments.in/reader034/viewer/2022042716/55a5433f1a28abba478b45f3/html5/thumbnails/13.jpg)
Test Tools Evolution
Generic
13
Trading
+Passive
Production
Mutated and Deformed
NextGeneration
![Page 14: The next generation of testing tools for exchanges](https://reader034.fdocuments.in/reader034/viewer/2022042716/55a5433f1a28abba478b45f3/html5/thumbnails/14.jpg)
14
Human Intelligence is Still Required
![Page 15: The next generation of testing tools for exchanges](https://reader034.fdocuments.in/reader034/viewer/2022042716/55a5433f1a28abba478b45f3/html5/thumbnails/15.jpg)
Build Software to Test Software
15
ClearTH:• Post-Trade testing tool• Verifies each stage of the DLC• Integrated schedule• Automated matrices• Can create multiple days test scenarios• Concurrent multiple tests• Integrated simulators• SWIFT ISO protocol support
Minirobots:• Executes multithreaded java code• Complexity of test algorithms is defined by the test developer• Supports multiple client fix connections, order entry and market data via FIX• Can use GUI to iterate through sent and received messages
Dolphin:• Model-based testing of market surveillance systems• Production-scale capacity and throughput• Interactive real-time alerts and reports
Shsha:• Post-transactional tool• Analyzes clients' activity and forecasts system response • Parses and displays logs in a user-friendly way• Parses messages and then puts each to a data base table where each column corresponds to each message field• Allows making summarized reports, etc• Easy to understand GUI
Load Injector:• Simulates multiple client connections with a specified load shape for each connection or a group of connections• Up to 75K messages / second from a single CPU core• Measures latencies in microsecond range• Performance test reports
Sailfish:• Can test Order Entry, Market Data and Post Trade connections in one test scenario• Each test scenario is independent• Allows running test scripts in any sequence• Simulation of multiple user connections• Server simulators• All messages are stored into a data base• Generates test reports
![Page 16: The next generation of testing tools for exchanges](https://reader034.fdocuments.in/reader034/viewer/2022042716/55a5433f1a28abba478b45f3/html5/thumbnails/16.jpg)
Thank You
16