Automated testing with Erlang - these go to eleven -

Erlang is designed for building massively scalable and highly available soft real-time systems. Unsurprisingly , Erlang provides us with powerful libraries for automated testing of these type of systems. In this talk, we take a look at three of the popular automated testing libraries for Erlang, discuss their individual strengths and weaknesses and illustrate the importance of continuous integration by deploying sample automated tests to Travis-CI, a free continuous integration service for the open source community.

Talk objectives: Describe and explain popular Erlang automated testinging libraries (EUnit, QuickCheck, Common Test) and the advantages of continuous integration.

Target audience: Test-conscious Erlang programmers.

Presented at the Erlang Factory Lite 2012 London

Transcript

1. Automated Testing with Erlang “These go to eleven” 1 donderdag 8 november 12
2. • TTY-who? • Simple testing with EUnit • Smarter testing with QuickCheck • Heavy lifting with Common Test • Up and running quickly with Continuous Integration 2 donderdag 8 november 12
3. @wardbekker Ward Bekker 3 donderdag 8 november 12
4. 4 donderdag 8 november 12
5. 5 donderdag 8 november 12
6. 600k uniques p/day 6 donderdag 8 november 12
7. Djuke.it 7 donderdag 8 november 12
8. 8 donderdag 8 november 12
9. Ruby Developer 9 donderdag 8 november 12
10. EUG-NL Channel.me 10 donderdag 8 november 12
11. Text 11 donderdag 8 november 12
12. ravis 12 donderdag 8 november 12
13. • TTY-who? • Simple testing with EUnit • Smarter testing with QuickCheck • Heavy lifting with Common Test • Up and running quickly with Continuous Integration 13 donderdag 8 november 12
14. FAIL PASSED 14 donderdag 8 november 12
15. 15 donderdag 8 november 12
16. • Fishing • Fished • Fisher • Fish 16 donderdag 8 november 12
17. abattement abbe abbess abbey abbeys abbominable abbot abbots abatt abb abbess abbei abbei abbomin abbot abbot 17 donderdag 8 november 12
18. 18 donderdag 8 november 12
19. 19 donderdag 8 november 12
20. Who tests the tester? 20 donderdag 8 november 12
21. PASSED PASSED 21 donderdag 8 november 12
22. PASSED PASSED 22 donderdag 8 november 12
23. ∞ 23 donderdag 8 november 12
24. 24 donderdag 8 november 12
25. FAIL 25 donderdag 8 november 12
26. Who tests the tester? 26 donderdag 8 november 12
27. • TTY-who? • Simple testing with EUnit • Smarter testing with QuickCheck • Heavy lifting with Common Test • Up and running quickly with Continuous Integration 27 donderdag 8 november 12
28. Write a program that generates test cases! 28 donderdag 8 november 12
29. Quickcheck 29 donderdag 8 november 12
30. a + b = b + a 30 donderdag 8 november 12
31. a + (b + c) = (a + b) + c 31 donderdag 8 november 12
32. a + 0 = a 32 donderdag 8 november 12
33. -46000,-50987 -45737,463 -45515,-58059 -44556,74371 -44200,35406 -44088,48783 -43823,2764 -43200,28630 -42844,-51039 -42583,-16465 33 donderdag 8 november 12
34. •Number of tests cases - default 100 •Size 34 donderdag 8 november 12
35. 0,216,265,82,157,458,119,28 35 donderdag 8 november 12
36. [1,2,3] 00000000 00000001, 00000000 00000010, 00000000 00000011 1 2 3 36 donderdag 8 november 12
37. Elias Ɣ Encoding 00000000 00000001 00000000 00000010 00000000 00000011 11011 1 010 011 4 = 00100 9 = 0001001 37 donderdag 8 november 12
38. 38 donderdag 8 november 12
39. Bugs found Complexity EUnit Quickcheck 39 donderdag 8 november 12
40. • TTY-who? • Simple testing with EUnit • Smarter testing with QuickCheck • Heavy lifting with Common Test • Up and running quickly with Continuous Integration 40 donderdag 8 november 12
41. Erlang/OTP CT > 6 hours 41 donderdag 8 november 12
42. test_add_delete_index test_add_delete_document test_queries test_redundancy test_replication 42 donderdag 8 november 12
43. test_add_delete_index test_add_delete_document test_queries test_redundancy test_replication 43 donderdag 8 november 12
44. test_add_delete_index test_add_delete_document test_queries test_redundancy test_replication 44 donderdag 8 november 12
45. test_add_delete_index test_add_delete_document test_queries test_redundancy test_replication 45 donderdag 8 november 12
46. • TTY-who? • Simple testing with EUnit • Smarter testing with QuickCheck • Heavy lifting with Common Test • Up and running quickly with Continuous Integration 46 donderdag 8 november 12
47. Testing!! 47 donderdag 8 november 12
48. 48 donderdag 8 november 12
49. ravis 49 donderdag 8 november 12
50. ravis 50 donderdag 8 november 12
51. .travis.yml 51 donderdag 8 november 12
52. 52 donderdag 8 november 12
53. Build Environment • 32-bit Ubuntu Linux 12.04 • R14B02 upto R15B02 with Kerl • Rebar • Riak, MongoDB, MySQL, PostgreSQL • RabbitMQ, Memcached, Cassandra etc 53 donderdag 8 november 12
54. • Simple testing with EUnit • Smarter testing with QuickCheck • Heavy lifting with Common Test • Up and running quickly with Continuous Integration 54 donderdag 8 november 12
55. 55 donderdag 8 november 12