Slide 10
Slide 10 text
Combinatorial testing
1
0
The number of unique connections in a network is n*(n-1)/2
• 6 Corda versions (3 Open Source, 3 Enterprise)
• 3 Token SDK versions, 2 Account SDK versions
• 5 CorDapps, each with 2 versions
• 4 Operating systems, 2 JVMs, 5 HSMs, 5 databases
• 14,400 Node configurations, 103,672,800 connections, ~1 billion testcases
• If 1 min to run a clean test, time to execute ~2,000 years
• Pairwise testing reduces to 34 configurations, 561 connections, ~4 days
• Two or more differences across Corda parameters reduces network density by 10%
• Parallelize across 20 machines to reduce to ~4 hours
• Bring up as a single network and run dirty tests