SlideShare a Scribd company logo
Complex Post-Trade Systems, Requirements Traceability
and the Illusion of Control
Iosif Itkin, CEO and co-founder
Elena Treshcheva, Researcher
Exactpro Overview
● A specialist firm focused on functional and non-functional testing of
exchanges, clearing houses, depositories, trade repositories and other
financial market infrastructures.
● We provide software testing services for mission critical technology that
underpins global financial markets. Our clients are regulated by FCA, Bank of
England and their counterparts from other countries.
● We were part of the London Stock Exchange Group (LSEG) from May 2015
till January 2018. Exactpro management buyout from LSEG was successfully
completed in January 2018. We are headquartered in the UK and have
operations in the US, Georgia and Russia.
● Incorporated in 2009 with 10 people, our company has
experienced significant growth and is now employing
over 550 specialists.
We have a global Software Quality Assurance client network
Build Software to Test Software
Software Testing of Trading Systems
Trading systems have very
low latency (within hundreds
of microseconds) ,......have significant
throughput &
capacity,....
…and they should be resilient,
have the ability to recover from
outages and have no single
point of failure
Trading vs. Post-Trade
Extreme testing challenges in high
frequency trading systems pale in
comparison to those presented by the
post-trade infrastructures
Key Technical Challenges in Delivering Large Post-Trade Initiatives
Challenges:
A typical clearing system has
highly complex features requiring
high degree of accuracy and
skilled resources:
1. Reference data;
2. Risk management;
3. The schedule (explained
further in the presentation).
Key Technical Challenges in Delivering Large Post-Trade Initiatives (continued)
● The number of components of complex post trade
infrastructures is very high;
● Upstream and downstream systems dependency;
● The participant structure is very complex;
● Trade/Xfer/Position/Account life cycle;
● The number of Asset Classes may vary;
● The complexity of the Risk calculation process;
● Access via a set of API endpoints.
The challenges and their parameterizations lead to a significant
number of test scenarios.
A Complex Post-Trade System During the Process of its Replacement
Congruence bias
Confirmation
bias
Law of triviality
Zero-risk bias
Anthropocentric
thinking
Illusion of control
Cognitive Biases Affecting Software Testing
Salman, I. (2016). Cognitive biases in software quality and testing. Proceedings of
the 38th International Conference on Software Engineering Companion - ICSE ’16.
Pp. 823-826.
Mohanani, R., Salman, I., Turhan, B., Rodríguez, P., & Ralph, P. (2018).
Cognitive Biases in Software Engineering: A Systematic Mapping Study.
IEEE Transactions on Software Engineering
Congruence Bias
Direct
Testing
Indirect Testing Methods
Information
extraction and
Machine learning
End-to-End
Automated Test
Library
Whatever it
takes!
Test execution
data and log
analysis
Passive Testing
Whatever it
takes!
Anthropocentric bias
We should not
humanize computers.
Anthropocentric bias
They dislike it a lot!
Anthropocentric Bias: Testing a Mine-Defusing Robot
Anthropocentric Bias: Why We Treat Robots Like Humans
Darling, Kate and Nandy, Palash and Breazeal,
Cynthia “Empathic Concern and the Effect of
Stories in Human-Robot Interaction” (2015).
Proceedings of the IEEE International Workshop on
Robot and Human Communication (ROMAN),
2015. 6 p.
https://www.ted.com/talks/kate_darling_why_we_ha
ve_an_emotional_connection_to_robots
Anthropocentric Bias and Software Testing
Ruthless and Cold-Hearted
ClearTH - An Innovative Way to Test Post-Trade Systems
Law of Triviality (the Bike-Shed Effect)
What is the Difference Between a Problem and a Catastrophe?
Zero-Risk Bias
Test Management Systems and Requirements Traceability
The Illusion of Control
The Illusion of Control and Happiness
Sherman, G. D., Lee, J. J., Cuddy, A. J. C., Renshon, J., Oveis, C., Gross, J. J., &
Lerner, J. S. (2012). Leadership is associated with lower levels of stress.
Proceedings of the National Academy of Sciences, 109(44), 17903–17907.
Fenton-O’Creevy, M., Nicholson, N., Soane, E.,
& Willman, P. (2003). “Trading on illusions:
Unrealistic perceptions of control and trading
performance”. Journal of Occupational and
Organizational Psychology, 76(1), 53–68.
The Illusion of Control and Performance
Software testing is relentless
learning, continuous improvement
and keeping abreast of cutting-
edge technologies.
The research and development
team at Exactpro uses machine
learning methods of intellectual
data analysis to create next-
generation program analysis
tools.
We work in an agile environment
collaborating with a multinational
team of software developers.
R&D Case Study: Cradle Test Database for Machine Learning
Applications of the Proposed Approach:
https://unsplash.com/search/photos/san-francisco
The First IEEE International Conference on Artificial
Intelligence Testing (IEEE AITest 2019), April 4-9 2019,
San Francisco East Bay, CA, USA
User-Assisted Log Analysis for Quality
Control of Distributed Fintech Systems
Iosif Itkin, Anna Gromova, Anton Sitnikov, Rostislav Yavorskiy,
Evgenii Tsymbalov, Andrey Novikov and Kirill Rudakov.
EXTENT - Software Testing and Trading Technology Trends
September 17
Leadenhall Building,
London, 2019
Join us in discussing the newest fintech trends
and solutions to the challenges in mission-
critical trading and post trade systems!
EXTENT - Software Testing and Trading Technology Trends
September 17
Leadenhall Building,
London, 2019
Join us in discussing the newest fintech trends
and solutions to the challenges in mission-
critical trading and post trade systems!
Thank you! Questions?

More Related Content

PPT
QA Financial Singapore: Deliberate Practice of Software Testing in Agile World
PPT
Non-Functional Testing at London Stock Exchange
PDF
Testing the Intelligence of your AI
PPT
Innovation in Quality Assurance – What is the Impact on Trading technology?
PPT
Exactpro Systems High Level Overview January 2014
PPTX
Иосиф Иткин, Exactpro - TBA
PDF
EXTENT 2019: Exactpro Quality Assurance for Financial Market Infrastructures
PPTX
Technology Risk Modeling and Analysis Seminar - Exchange Trading
QA Financial Singapore: Deliberate Practice of Software Testing in Agile World
Non-Functional Testing at London Stock Exchange
Testing the Intelligence of your AI
Innovation in Quality Assurance – What is the Impact on Trading technology?
Exactpro Systems High Level Overview January 2014
Иосиф Иткин, Exactpro - TBA
EXTENT 2019: Exactpro Quality Assurance for Financial Market Infrastructures
Technology Risk Modeling and Analysis Seminar - Exchange Trading

Similar to QAFF Chicago 2019 - Complex Post-Trade Systems, Requirements Traceability and the Illusion of Control (20)

PPTX
Sibos 2017: Disruptive functional testing - the next frontier in post-trade s...
PPTX
Exactpro: Non-functional testing approach
PDF
20 Simple Questions from Exactpro for Your Enjoyment This Holiday Season
PPTX
EXTENT-2015: The Four Essential Elements of LSEG QA Solutions
PDF
Operational Resilience in Financial Market Infrastructures
PPT
Delivering Large Post-Trade Initiatives: Quality Assurance and Key Challenges
PPT
Vienna_Slides_v.15
PPTX
EXTENT-2017: Climbing Out of the Stability Sinkhole - Survivor’s Guide
PDF
UiPath Test Automation using UiPath Test Suite series, part 1
PPT
Iosif Itkin - Network models for exchange trade analysis
PDF
The Automation Firehose: Be Strategic and Tactical by Thomas Haver
PDF
Test Automation using UiPath Test Suite - Developer Circle Part-1.pdf
PDF
Guide to Successful AI.pdf
PDF
Continuous Delivery: The One Question You Must Answer
PDF
Rethinking Test Automation: The Case for Moving Beyond the User Interface
PDF
Defects mining in exchanges - medvedev, klimakov, yamkovi
PPT
EXTENT-2016: Managing QA for Complex Systems in Agile Development Framework
PPT
The Art Of Testing Trading Platforms From AppLabs
PDF
Career Choice for Graduates
PDF
DataArt Financial Services and Capital Markets
Sibos 2017: Disruptive functional testing - the next frontier in post-trade s...
Exactpro: Non-functional testing approach
20 Simple Questions from Exactpro for Your Enjoyment This Holiday Season
EXTENT-2015: The Four Essential Elements of LSEG QA Solutions
Operational Resilience in Financial Market Infrastructures
Delivering Large Post-Trade Initiatives: Quality Assurance and Key Challenges
Vienna_Slides_v.15
EXTENT-2017: Climbing Out of the Stability Sinkhole - Survivor’s Guide
UiPath Test Automation using UiPath Test Suite series, part 1
Iosif Itkin - Network models for exchange trade analysis
The Automation Firehose: Be Strategic and Tactical by Thomas Haver
Test Automation using UiPath Test Suite - Developer Circle Part-1.pdf
Guide to Successful AI.pdf
Continuous Delivery: The One Question You Must Answer
Rethinking Test Automation: The Case for Moving Beyond the User Interface
Defects mining in exchanges - medvedev, klimakov, yamkovi
EXTENT-2016: Managing QA for Complex Systems in Agile Development Framework
The Art Of Testing Trading Platforms From AppLabs
Career Choice for Graduates
DataArt Financial Services and Capital Markets
Ad

More from Iosif Itkin (20)

PDF
Foundations of Software Testing Lecture 4
PPTX
QA Financial Forum London 2021 - Automation in Software Testing. Humans and C...
PDF
Exactpro FinTech Webinar - Global Exchanges Test Oracles
PDF
Exactpro FinTech Webinar - Global Exchanges FIX Protocol
PDF
ClearTH Test Automation Framework: Case Study in IRS & CDS Swaps Lifecycle Mo...
PPTX
EXTENT Talks 2019 Tbilisi: Failover and Recovery Test Automation - Ivan Shamrai
PDF
EXTENT Talks QA Community Tbilisi 20 April 2019 - Conference Open
PDF
User-Assisted Log Analysis for Quality Control of Distributed Fintech Applica...
PDF
QA Community Saratov: Past, Present, Future (2019-02-08)
PDF
Machine Learning and RoboCop Testing
PDF
Behaviour Driven Development: Oltre i limiti del possibile
PDF
2018 - Exactpro Year in Review
PPTX
Exactpro Discussion about Joy and Strategy
PPTX
FIX EMEA Conference 2018 - Post Trade Software Testing Challenges
PDF
BDD. The Outer Limits. Iosif Itkin at Youcon (in Russian)
PPTX
Using Cluster Analysis for Characteristics Detection in Software Defect Reports
PPTX
EXTENT-2017: Testing in Distributed Ledger Systems
PPTX
EXTENT-2017: Independent QA in Agile
PDF
EXTENT-2017: Re-Engineering Capital Market Business Models to Use Different T...
PPTX
EXTENT-2017: Keep Investing in QA
Foundations of Software Testing Lecture 4
QA Financial Forum London 2021 - Automation in Software Testing. Humans and C...
Exactpro FinTech Webinar - Global Exchanges Test Oracles
Exactpro FinTech Webinar - Global Exchanges FIX Protocol
ClearTH Test Automation Framework: Case Study in IRS & CDS Swaps Lifecycle Mo...
EXTENT Talks 2019 Tbilisi: Failover and Recovery Test Automation - Ivan Shamrai
EXTENT Talks QA Community Tbilisi 20 April 2019 - Conference Open
User-Assisted Log Analysis for Quality Control of Distributed Fintech Applica...
QA Community Saratov: Past, Present, Future (2019-02-08)
Machine Learning and RoboCop Testing
Behaviour Driven Development: Oltre i limiti del possibile
2018 - Exactpro Year in Review
Exactpro Discussion about Joy and Strategy
FIX EMEA Conference 2018 - Post Trade Software Testing Challenges
BDD. The Outer Limits. Iosif Itkin at Youcon (in Russian)
Using Cluster Analysis for Characteristics Detection in Software Defect Reports
EXTENT-2017: Testing in Distributed Ledger Systems
EXTENT-2017: Independent QA in Agile
EXTENT-2017: Re-Engineering Capital Market Business Models to Use Different T...
EXTENT-2017: Keep Investing in QA
Ad

Recently uploaded (20)

PPTX
Tartificialntelligence_presentation.pptx
PPTX
A Presentation on Artificial Intelligence
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PDF
DASA ADMISSION 2024_FirstRound_FirstRank_LastRank.pdf
PDF
DP Operators-handbook-extract for the Mautical Institute
PDF
Encapsulation theory and applications.pdf
PDF
Hybrid model detection and classification of lung cancer
PPTX
Chapter 5: Probability Theory and Statistics
PDF
Heart disease approach using modified random forest and particle swarm optimi...
PDF
Transform Your ITIL® 4 & ITSM Strategy with AI in 2025.pdf
PDF
Zenith AI: Advanced Artificial Intelligence
PDF
WOOl fibre morphology and structure.pdf for textiles
PPTX
Group 1 Presentation -Planning and Decision Making .pptx
PDF
August Patch Tuesday
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PPTX
TLE Review Electricity (Electricity).pptx
PDF
Univ-Connecticut-ChatGPT-Presentaion.pdf
PDF
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
Tartificialntelligence_presentation.pptx
A Presentation on Artificial Intelligence
Digital-Transformation-Roadmap-for-Companies.pptx
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
DASA ADMISSION 2024_FirstRound_FirstRank_LastRank.pdf
DP Operators-handbook-extract for the Mautical Institute
Encapsulation theory and applications.pdf
Hybrid model detection and classification of lung cancer
Chapter 5: Probability Theory and Statistics
Heart disease approach using modified random forest and particle swarm optimi...
Transform Your ITIL® 4 & ITSM Strategy with AI in 2025.pdf
Zenith AI: Advanced Artificial Intelligence
WOOl fibre morphology and structure.pdf for textiles
Group 1 Presentation -Planning and Decision Making .pptx
August Patch Tuesday
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Building Integrated photovoltaic BIPV_UPV.pdf
TLE Review Electricity (Electricity).pptx
Univ-Connecticut-ChatGPT-Presentaion.pdf
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf

QAFF Chicago 2019 - Complex Post-Trade Systems, Requirements Traceability and the Illusion of Control

  • 1. Complex Post-Trade Systems, Requirements Traceability and the Illusion of Control Iosif Itkin, CEO and co-founder Elena Treshcheva, Researcher
  • 2. Exactpro Overview ● A specialist firm focused on functional and non-functional testing of exchanges, clearing houses, depositories, trade repositories and other financial market infrastructures. ● We provide software testing services for mission critical technology that underpins global financial markets. Our clients are regulated by FCA, Bank of England and their counterparts from other countries. ● We were part of the London Stock Exchange Group (LSEG) from May 2015 till January 2018. Exactpro management buyout from LSEG was successfully completed in January 2018. We are headquartered in the UK and have operations in the US, Georgia and Russia. ● Incorporated in 2009 with 10 people, our company has experienced significant growth and is now employing over 550 specialists.
  • 3. We have a global Software Quality Assurance client network
  • 4. Build Software to Test Software
  • 5. Software Testing of Trading Systems Trading systems have very low latency (within hundreds of microseconds) ,......have significant throughput & capacity,.... …and they should be resilient, have the ability to recover from outages and have no single point of failure
  • 6. Trading vs. Post-Trade Extreme testing challenges in high frequency trading systems pale in comparison to those presented by the post-trade infrastructures
  • 7. Key Technical Challenges in Delivering Large Post-Trade Initiatives Challenges: A typical clearing system has highly complex features requiring high degree of accuracy and skilled resources: 1. Reference data; 2. Risk management; 3. The schedule (explained further in the presentation).
  • 8. Key Technical Challenges in Delivering Large Post-Trade Initiatives (continued) ● The number of components of complex post trade infrastructures is very high; ● Upstream and downstream systems dependency; ● The participant structure is very complex; ● Trade/Xfer/Position/Account life cycle; ● The number of Asset Classes may vary; ● The complexity of the Risk calculation process; ● Access via a set of API endpoints. The challenges and their parameterizations lead to a significant number of test scenarios.
  • 9. A Complex Post-Trade System During the Process of its Replacement
  • 10. Congruence bias Confirmation bias Law of triviality Zero-risk bias Anthropocentric thinking Illusion of control Cognitive Biases Affecting Software Testing
  • 11. Salman, I. (2016). Cognitive biases in software quality and testing. Proceedings of the 38th International Conference on Software Engineering Companion - ICSE ’16. Pp. 823-826.
  • 12. Mohanani, R., Salman, I., Turhan, B., Rodríguez, P., & Ralph, P. (2018). Cognitive Biases in Software Engineering: A Systematic Mapping Study. IEEE Transactions on Software Engineering
  • 14. Indirect Testing Methods Information extraction and Machine learning End-to-End Automated Test Library Whatever it takes! Test execution data and log analysis Passive Testing Whatever it takes!
  • 15. Anthropocentric bias We should not humanize computers.
  • 17. Anthropocentric Bias: Testing a Mine-Defusing Robot
  • 18. Anthropocentric Bias: Why We Treat Robots Like Humans Darling, Kate and Nandy, Palash and Breazeal, Cynthia “Empathic Concern and the Effect of Stories in Human-Robot Interaction” (2015). Proceedings of the IEEE International Workshop on Robot and Human Communication (ROMAN), 2015. 6 p. https://www.ted.com/talks/kate_darling_why_we_ha ve_an_emotional_connection_to_robots
  • 19. Anthropocentric Bias and Software Testing
  • 21. ClearTH - An Innovative Way to Test Post-Trade Systems
  • 22. Law of Triviality (the Bike-Shed Effect)
  • 23. What is the Difference Between a Problem and a Catastrophe?
  • 25. Test Management Systems and Requirements Traceability
  • 26. The Illusion of Control
  • 27. The Illusion of Control and Happiness Sherman, G. D., Lee, J. J., Cuddy, A. J. C., Renshon, J., Oveis, C., Gross, J. J., & Lerner, J. S. (2012). Leadership is associated with lower levels of stress. Proceedings of the National Academy of Sciences, 109(44), 17903–17907.
  • 28. Fenton-O’Creevy, M., Nicholson, N., Soane, E., & Willman, P. (2003). “Trading on illusions: Unrealistic perceptions of control and trading performance”. Journal of Occupational and Organizational Psychology, 76(1), 53–68. The Illusion of Control and Performance
  • 29. Software testing is relentless learning, continuous improvement and keeping abreast of cutting- edge technologies. The research and development team at Exactpro uses machine learning methods of intellectual data analysis to create next- generation program analysis tools. We work in an agile environment collaborating with a multinational team of software developers. R&D Case Study: Cradle Test Database for Machine Learning
  • 30. Applications of the Proposed Approach: https://unsplash.com/search/photos/san-francisco The First IEEE International Conference on Artificial Intelligence Testing (IEEE AITest 2019), April 4-9 2019, San Francisco East Bay, CA, USA User-Assisted Log Analysis for Quality Control of Distributed Fintech Systems Iosif Itkin, Anna Gromova, Anton Sitnikov, Rostislav Yavorskiy, Evgenii Tsymbalov, Andrey Novikov and Kirill Rudakov.
  • 31. EXTENT - Software Testing and Trading Technology Trends September 17 Leadenhall Building, London, 2019 Join us in discussing the newest fintech trends and solutions to the challenges in mission- critical trading and post trade systems!
  • 32. EXTENT - Software Testing and Trading Technology Trends September 17 Leadenhall Building, London, 2019 Join us in discussing the newest fintech trends and solutions to the challenges in mission- critical trading and post trade systems!