Tweet
Tweet

Slide 1

Slide 1 text

@sigmavirus24 c u t t i n g Testing Applications that Use Requests o f f the Internet @sigmavirus24

Slide 2

Slide 2 text

@sigmavirus24 requests flake8 toolbelt urllib3 twine github3.py chardet sqlobject python-guide OpenStack

Slide 3

Slide 3 text

No content

Slide 4

Slide 4 text

@sigmavirus24 Why give this talk?

Slide 5

Slide 5 text

@sigmavirus24 Why give this talk?

Slide 6

Slide 6 text

@sigmavirus24 r e v i e w

Slide 7

Slide 7 text

@sigmavirus24 Unit of Code

Slide 8

Slide 8 text

@sigmavirus24 Unit Test

Slide 9

Slide 9 text

@sigmavirus24 Collaborators

Slide 10

Slide 10 text

@sigmavirus24 Isolation

Slide 11

Slide 11 text

@sigmavirus24 class Bar(object): def __init__(self): self.foo = Foo() def baz(self, *args): a = self.foo.fiz() # other stuff

Slide 12

Slide 12 text

@sigmavirus24 Integration Tests

Slide 13

Slide 13 text

@sigmavirus24 def get_resource( session, resource, params=None, headers=None):

Slide 14

Slide 14 text

@sigmavirus24 url = url_from(resource) kw = {‘headers’: headers, ‘params’: params} resp = session.get(url, **kw) if resp.ok: return resp resp.raise_for_status()

Slide 15

Slide 15 text

@sigmavirus24 Too Simple to Test?

Slide 16

Slide 16 text

@sigmavirus24 D O I T L I V E !

Slide 17

Slide 17 text

@sigmavirus24 session = Session() response = get_resource( session, ‘users’) assert response.ok

Slide 18

Slide 18 text

@sigmavirus24 Now do that 400 times

Slide 19

Slide 19 text

@sigmavirus24 Ratelimits

Slide 20

Slide 20 text

@sigmavirus24 ✓✓✓✓✓✓FFFFFFFFFFFFFFFFFFFFFF FFFFFFFFFFFFFFFFFFFFFFFFFFFFFF FFFFFFFFFFFFFFFFFFFFFFFFFFFFFF FFFFFFFFFFFFFFFFFFFFFFFFFFFFFF FFFFFFFFFFFFFFFFFFFFFFFFFFFFFF FFFFFFFFFFFFFFFFFFFFFFFFFFFFFF FFFFFFFFFFFFFFFFFFFFFFFFFFFFFF FFFFFFFFFFFFFFFFFFFFFFFFFFFFFF FFFFFFFFFFFFFFFFFFFFFFFFFFFFFF FFFFFFFFFFFFFFFFFFFFFFFFFFFFFF FFFFFFFFFFFFFFFFFFFFFFFFFFFFFF

Slide 21

Slide 21 text

@sigmavirus24 I m i t a t i o n i s t h e s i n c e r e s t f o r m o f F l a t t e r y

Slide 22

Slide 22 text

@sigmavirus24 responses httpretty requests-mock mock

Slide 23

Slide 23 text

@sigmavirus24 session = mock.Mock() get_resource(session, ‘users’)

Slide 24

Slide 24 text

@sigmavirus24 (session.get. assert_called_once_with( ‘https://api.’ ‘github.com/users’, headers=None, params=None, ))

Slide 25

Slide 25 text

@sigmavirus24 $ py.test mock_ex.py mock_ex.py ✓

Slide 26

Slide 26 text

@sigmavirus24 sess = mock.Mock() resp = mock.Mock() resp.ok = False get = sess.get get.return_value = resp

Slide 27

Slide 27 text

@sigmavirus24 get_resource(session, ‘users’) rfs = resp.raise_for_status assert rfs.called is True

Slide 28

Slide 28 text

@sigmavirus24 $ py.test mock_ex.py mock_ex.py ✓✓

Slide 29

Slide 29 text

@sigmavirus24 Mock

Slide 30

Slide 30 text

@sigmavirus24 Verbose

Slide 31

Slide 31 text

@sigmavirus24 Verbose

Slide 32

Slide 32 text

@sigmavirus24 P r e t e n d t o b e T h e N . S . A .

Slide 33

Slide 33 text

@sigmavirus24 vcr.py betamax

Slide 34

Slide 34 text

@sigmavirus24 vcr.py betamax

Slide 35

Slide 35 text

@sigmavirus24 vcr.py

Slide 36

Slide 36 text

@sigmavirus24 session = requests.Session() cassette = ‘vcrexample.yml’ with vcr.use_cassette(cassette): resp = get_resource( session, ‘users’) assert resp.ok users = resp.json() assert len(users) > 0

Slide 37

Slide 37 text

@sigmavirus24 session = requests.Session() cassette = ‘vcrexample.yml’ with vcr.use_cassette(cassette): resp = get_resource( session, ‘users’) assert resp.ok users = resp.json() assert len(users) > 0

Slide 38

Slide 38 text

@sigmavirus24 session = requests.Session() cassette = ‘vcrexample.yml’ with vcr.use_cassette(cassette): resp = get_resource( session, ‘users’) assert resp.ok users = resp.json() assert len(users) > 0

Slide 39

Slide 39 text

@sigmavirus24 $ py.test vcr_ex.py vcr_ex.py ✓

Slide 40

Slide 40 text

@sigmavirus24 betamax

Slide 41

Slide 41 text

@sigmavirus24 session = Session() rec = betamax.Betamax( session, cassette_library_dir=‘.’)

Slide 42

Slide 42 text

@sigmavirus24 with rec.use_cassette(‘betamax’): resp = get_resource( session, ‘users’) assert resp.ok users = resp.json() assert len(users) > 0

Slide 43

Slide 43 text

@sigmavirus24 $ py.test betmax_ex.py betamax_ex.py ✓

Slide 44

Slide 44 text

@sigmavirus24 self.session = Session() self.recorder = Betamax( session) self.recorder.use_cassette( cassette_name()) self.recorder.start()

Slide 45

Slide 45 text

@sigmavirus24 resp = get_resource( self.session, ‘users’) assert resp.ok users = resp.json() assert len(users) > 0

Slide 46

Slide 46 text

@sigmavirus24 self.recorder.stop()

Slide 47

Slide 47 text

@sigmavirus24 vcr.py betamax

Slide 48

Slide 48 text

@sigmavirus24 vcr.py betamax

Slide 49

Slide 49 text

@sigmavirus24 T h e r e a l i t y

Slide 50

Slide 50 text

@sigmavirus24 Two part solution

Slide 51

Slide 51 text

@sigmavirus24 Two part solution

Slide 52

Slide 52 text

@sigmavirus24 Mocking mock, requests-mock, responses, httpretty

Slide 53

Slide 53 text

@sigmavirus24 Integration betamax, vcr.py

Slide 54

Slide 54 text

@sigmavirus24 T h a n k y o u