T testing for Dial 

David Winterbottom @codeinthehole /codeinthehole 

Tangent Labs @tangent_labs /tangentlabs 

django-oscar @django_oscar /tangentlabs/django-oscar 

No content

Nose Nose nose.readthedocs.org 

Django 

Dexterity 

Basics 

Run ALL the tests 

Run tests beneath path 

Run test module 

Run test class 

Run test method 

nosecomplete github.com/alonho/nosecomplete 

nosecomplete github.com/alonho/nosecomplete 

Stories 

Stories Work on a feature 

No content

https://github.com/asdfasdf/spec Custom test runner 

https://github.com/asdfasdf/spec Testing one module 

https://github.com/asdfasdf/spec Spec plugin https://github.com/bitprophet/spec 

https://github.com/asdfasdf/spec BDD-style output 

class TestASignedInUser(WebTestCase):! ! def setUp(self):! self.user = G(User)! self.order = factories.create_order(user=self.user)! ! def test_can_see_their_email_address_on_the_profile_page(self):! profile_page = self.app.get(! reverse('customer:summary'), user=self.user)! self.assertTrue(self.email in profile_page.content)! ! def test_can_update_their_name(self):! profile_form_page = self.app.get(! reverse('customer:profile-update'), user=self.user)! form = profile_form_page.forms['profile_form']! form['first_name'] = 'Barry'! form['last_name'] = 'Chuckle'! response = form.submit()! self.assertRedirects(response, reverse('customer:summary'))! ! # Reload user! user = User.objects.get(id=self.user.id)! self.assertEquals("Barry", user.first_name)! self.assertEquals("Chuckle", user.last_name)! 

class TestASignedInUser(WebTestCase):! ! def setUp(self):! self.user = G(User)! self.order = factoies.create_order(user=self.user)! ! def test_can_see_their_email_address_on_the_profile_page(self):! profile_page = self.app.get(! reverse('customer:summary'), user=self.user)! self.assertTrue(self.email in profile_page.content)! ! def test_can_update_their_name(self):! profile_form_page = self.app.get(! reverse('customer:profile-update'), user=self.user)! form = profile_form_page.forms['profile_form']! form['first_name'] = 'Barry'! form['last_name'] = 'Chuckle'! response = form.submit()! self.assertRedirects(response, reverse('customer:summary'))! ! # Reload user! user = User.objects.get(id=self.user.id)! self.assertEquals("Barry", user.first_name)! self.assertEquals("Chuckle", user.last_name)! System under test 

class TestASignedInUser(WebTestCase):! ! def setUp(self):! self.user = G(User)! self.order = factories.create_order(user=self.user)! ! def test_can_see_their_email_address_on_the_profile_page(self):! profile_page = self.app.get(! reverse('customer:summary'), user=self.user)! self.assertTrue(self.email in profile_page.content)! ! def test_can_update_their_name(self):! profile_form_page = self.app.get(! reverse('customer:profile-update'), user=self.user)! form = profile_form_page.forms['profile_form']! form['first_name'] = 'Barry'! form['last_name'] = 'Chuckle'! response = form.submit()! self.assertRedirects(response, reverse('customer:summary'))! ! # Reload user! user = User.objects.get(id=self.user.id)! self.assertEquals("Barry", user.first_name)! self.assertEquals("Chuckle", user.last_name)! Specification 

Use-cases Work on a new feature Refactor a feature 

https://github.com/nose attribs/spec 

nose.readthedocs.org/en/latest/plugins/attrib.html Run tagged tests 

from nose.plugins.attrib import attr! ! ! @attr('shipping')! class TestFreeShippping(TestCase):! ! def test_is_free_for_empty_basket(self):! ...! ! ! class TestFixedPriceShipping(TestCase):! ! @attr(slow=True)! def test_returns_fixed_price_for_basket(self):! ...! 

from nose.plugins.attrib import attr! ! ! @attr('shipping')! class TestFreeShippping(TestCase):! ! def test_is_free_for_empty_basket(self):! ...! ! ! class TestFixedPriceShipping(TestCase):! ! @attr(slow=True)! def test_returns_fixed_price_for_basket(self):! ...! Wrap a class 

from nose.plugins.attrib import attr! ! ! @attr('shipping')! class TestFreeShippping(TestCase):! ! def test_is_free_for_empty_basket(self):! ...! ! ! class TestFixedPriceShipping(TestCase):! ! @attr(slow=True)! def test_returns_fixed_price_for_basket(self):! ...! Wrap a method 

No content

Pattern match tests github.com/iElectric/nose-selecttests 

Use-cases Work on a new feature Refactor a feature Fix failing tests 

Fail fast 

Editor-friendly paths github.com/erikrose/nose-progressive 

PDB on failure 

Only re-run failed tests 

Use-cases Work on a new feature Refactor a feature Fix failing tests Ready to push? 

No content

No plugins 

Parallelise 

Speed 

0 4 8 12 16 20 24 Focus / flow / “zone” Test suite time (seconds) 

0 4 8 12 16 20 24 Focus / flow / “zone” Test suite time (seconds) Pre-commit hook? 

0 4 8 12 16 20 24 Focus / flow / “zone” Test suite time (seconds) 

0 4 8 12 16 20 24 Test suite time (seconds) 

No content

No content

Scam? blog.thecodewhisperer.com/2010/10/16/integrated-tests-are-a-scam/ 

import mock! from django.utils.functional import curry! ! no_database = curry(! mock.patch, 'django.db.backends.util.CursorWrapper',! Mock(side_effect=RuntimeError(! "Using the database is not permitted")))! ! ! @no_database()! class AUnitTest(TestCase):! ...! http://bit.ly/126vPrt 

import mock! from django.utils.functional import curry! ! no_database = curry(! mock.patch, 'django.db.backends.util.CursorWrapper',! Mock(side_effect=RuntimeError(! "Using the database is not permitted")))! ! ! @no_database()! class AUnitTest(TestCase):! ...! http://bit.ly/126vPrt Currying mock.patch! 

import mock! from django.utils.functional import curry! ! no_database = curry(! mock.patch, 'django.db.backends.util.CursorWrapper',! Mock(side_effect=RuntimeError(! "Using the database is not permitted")))! ! ! @no_database()! class AUnitTest(TestCase):! ...! http://bit.ly/126vPrt Wrap classes/methods 

http://bit.ly/156c48x Number of tests Seconds 

PASSWORD_HASHERS = ['django.contrib.auth.hashers.MD5PasswordHasher'] 

--processes=8 

http://bit.ly/2gZnhj Boy scout rule... 

Readability 

http://bit.ly/19ganRJ (Refactoring a Test) 

class TestBasket(TestCase):! ! def test_add_items(self):! # Create products! product_class = ProductClass(! name="Books", require_shipping=True)! product1 = Product.objects.create(title="My first book")! product2 = Product.objects.create(title="My second book")! partner = Partner.objects.create(name="Book Partner")! stockrecord1 = StockRecord(! price_excl_tax=D('12.00'), partner=partner)! stockrecord2 = StockRecord(! price_excl_tax=D('14.00'), partner=partner)! ! # Add to basket! basket = Basket()! basket.add(product1)! basket.add(product2)! ! total = basket.total_excl_tax! ! self.assertEqual(D('26.00'), total)! self.assertEqual(basket.num_lines, 2)! self.assertFalse(basket.is_empty)! 

class TestBasket(TestCase):! ! def test_add_items(self):! # Create products! product_class = ProductClass(! name="Books", require_shipping=True)! product1 = Product.objects.create(title="My first book")! product2 = Product.objects.create(title="My second book")! partner = Partner.objects.create(name="Book Partner")! stockrecord1 = StockRecord(! price_excl_tax=D('12.00'), partner=partner)! stockrecord2 = StockRecord(! price_excl_tax=D('14.00'), partner=partner)! ! # Add to basket! basket = Basket()! basket.add(product1)! basket.add(product2)! ! total = basket.total_excl_tax! ! self.assertEqual(D('26.00'), total)! self.assertEqual(basket.num_lines, 2)! self.assertFalse(basket.is_empty)! Bad naming 

class TestBasket(TestCase):! ! def test_add_items(self):! # Create products! product_class = ProductClass(! name="Books", require_shipping=True)! product1 = Product.objects.create(title="My first book")! product2 = Product.objects.create(title="My second book")! partner = Partner.objects.create(name="Book Partner")! stockrecord1 = StockRecord(! price_excl_tax=D('12.00'), partner=partner)! stockrecord2 = StockRecord(! price_excl_tax=D('14.00'), partner=partner)! ! # Add to basket! basket = Basket()! basket.add(product1)! basket.add(product2)! ! total = basket.total_excl_tax! ! self.assertEqual(D('26.00'), total)! self.assertEqual(basket.num_lines, 2)! self.assertFalse(basket.is_empty)! Heavy set-up 

class TestBasket(TestCase):! ! def test_add_items(self):! # Create products! product_class = ProductClass(! name="Books", require_shipping=True)! product1 = Product.objects.create(title="My first book")! product2 = Product.objects.create(title="My second book")! partner = Partner.objects.create(name="Book Partner")! stockrecord1 = StockRecord(! price_excl_tax=D('12.00'), partner=partner)! stockrecord2 = StockRecord(! price_excl_tax=D('14.00'), partner=partner)! ! # Add to basket! basket = Basket()! basket.add(product1)! basket.add(product2)! ! total = basket.total_excl_tax! ! self.assertEqual(D('26.00'), total)! self.assertEqual(basket.num_lines, 2)! self.assertFalse(basket.is_empty)! Noise 

class TestBasket(TestCase):! ! def test_add_items(self):! # Create products! product_class = ProductClass(! name="Books", require_shipping=True)! product1 = Product.objects.create(title="My first book")! product2 = Product.objects.create(title="My second book")! partner = Partner.objects.create(name="Book Partner")! stockrecord1 = StockRecord(! price_excl_tax=D('12.00'), partner=partner)! stockrecord2 = StockRecord(! price_excl_tax=D('14.00'), partner=partner)! ! # Add to basket! basket = Basket()! basket.add(product1)! basket.add(product2)! ! total = basket.total_excl_tax! ! self.assertEqual(D('26.00'), total)! self.assertEqual(basket.num_lines, 2)! self.assertFalse(basket.is_empty)! Unclear assertions 

class TestBasket(TestCase):! ! def test_add_items(self):! # Create products! product_class = ProductClass(! name="Books", require_shipping=True)! product1 = Product.objects.create(title="My first book")! product2 = Product.objects.create(title="My second book")! partner = Partner.objects.create(name="Book Partner")! stockrecord1 = StockRecord(! price_excl_tax=D('12.00'), partner=partner)! stockrecord2 = StockRecord(! price_excl_tax=D('14.00'), partner=partner)! ! # Add to basket! basket = Basket()! basket.add(product1)! basket.add(product2)! ! total = basket.total_excl_tax! ! self.assertEqual(D('26.00'), total)! self.assertEqual(basket.num_lines, 2)! self.assertFalse(basket.is_empty)! Sloppy coding 

class TestBasketTotal(TestCase):! ! def setUp(self):! self.basket = Basket()! ! def test_is_correct_after_adding_multiple_items(self):! products = [! factory.create_product(price_excl_tax=D('12.00')),! factory.create_product(price_excl_tax=D('14.00')),! ]! for product in products:! self.basket.add_product(product)! self.assertEqual(! D('12.00') + D('14.00'), self.basket.total_excl_tax)! 

class TestBasketTotal(TestCase):! ! def setUp(self):! self.basket = Basket()! ! def test_is_correct_after_adding_multiple_items(self):! products = [! factory.create_product(price_excl_tax=D('12.00')),! factory.create_product(price_excl_tax=D('14.00')),! ]! for product in products:! self.basket.add_product(product)! self.assertEqual(! D('12.00') + D('14.00'), self.basket.total_excl_tax)! Descriptive names 

class TestBasketTotal(TestCase):! ! def setUp(self):! self.basket = Basket()! ! def test_is_correct_after_adding_multiple_items(self):! products = [! factory.create_product(price_excl_tax=D('12.00')),! factory.create_product(price_excl_tax=D('14.00')),! ]! for product in products:! self.basket.add_product(product)! self.assertEqual(! D('12.00') + D('14.00'), self.basket.total_excl_tax)! Factory functions 

class TestBasketTotal(TestCase):! ! def setUp(self):! self.basket = Basket()! ! def test_is_correct_after_adding_multiple_items(self):! products = [! factory.create_product(price_excl_tax=D('12.00')),! factory.create_product(price_excl_tax=D('14.00')),! ]! for product in products:! self.basket.add_product(product)! self.assertEqual(! D('12.00') + D('14.00'), self.basket.total_excl_tax)! Intention revealing 

WebTest webtest.readthedocs.org/ def test_contact_us(self):! home = self.app.get('/')! ! # Fill in form! contact_us = home.click(linkid="contact_us_link")! form = contact_us.forms['profile_form']! form['name'] = 'Barry Chuckle'! form['query'] = 'To me?'! confirm = form.submit().follow()! ! self.assertTrue('Thanks Barry' in confirm.content)! 

No content

red green refactor 

failing test passing test clean test fast test 

no tests tests readable tests fast, readable tests 

•Test suite is there to help you •Make it clear and easy to read •Make it fast •Master your test runner TLDR 

•Write tests using the spec style •Use WebTest (not the Django client) Homework