Cutting off the Internet: Testing Applications that Use Requests

@sigmavirus24 c u t t i n g Testing Applications
that Use Requests o f f the Internet @sigmavirus24

@sigmavirus24 requests ﬂake8 toolbelt urllib3 twine github3.py chardet sqlobject python-guide
OpenStack

@sigmavirus24 Why give this talk?

@sigmavirus24 r e v i e w

@sigmavirus24 Unit of Code

@sigmavirus24 Unit Test

@sigmavirus24 Collaborators

@sigmavirus24 Isolation

@sigmavirus24 class Bar(object): def __init__(self): self.foo = Foo() def baz(self,
*args): a = self.foo.fiz() # other stuff

@sigmavirus24 Integration Tests

@sigmavirus24 def get_resource( session, resource, params=None, headers=None):

@sigmavirus24 url = url_from(resource) kw = {‘headers’: headers, ‘params’: params}
resp = session.get(url, **kw) if resp.ok: return resp resp.raise_for_status()

@sigmavirus24 Too Simple to Test?

@sigmavirus24 D O I T L I V E !

@sigmavirus24 session = Session() response = get_resource( session, ‘users’) assert
response.ok

@sigmavirus24 Now do that 400 times

@sigmavirus24 Ratelimits

@sigmavirus24 ✓✓✓✓✓✓FFFFFFFFFFFFFFFFFFFFFF FFFFFFFFFFFFFFFFFFFFFFFFFFFFFF FFFFFFFFFFFFFFFFFFFFFFFFFFFFFF FFFFFFFFFFFFFFFFFFFFFFFFFFFFFF FFFFFFFFFFFFFFFFFFFFFFFFFFFFFF FFFFFFFFFFFFFFFFFFFFFFFFFFFFFF FFFFFFFFFFFFFFFFFFFFFFFFFFFFFF FFFFFFFFFFFFFFFFFFFFFFFFFFFFFF FFFFFFFFFFFFFFFFFFFFFFFFFFFFFF
FFFFFFFFFFFFFFFFFFFFFFFFFFFFFF FFFFFFFFFFFFFFFFFFFFFFFFFFFFFF

@sigmavirus24 I m i t a t i o n
i s t h e s i n c e r e s t f o r m o f F l a t t e r y

@sigmavirus24 responses httpretty requests-mock mock

@sigmavirus24 session = mock.Mock() get_resource(session, ‘users’)

@sigmavirus24 (session.get. assert_called_once_with( ‘https://api.’ ‘github.com/users’, headers=None, params=None, ))

@sigmavirus24 $ py.test mock_ex.py mock_ex.py ✓

@sigmavirus24 sess = mock.Mock() resp = mock.Mock() resp.ok = False
get = sess.get get.return_value = resp

@sigmavirus24 get_resource(session, ‘users’) rfs = resp.raise_for_status assert rfs.called is True

@sigmavirus24 $ py.test mock_ex.py mock_ex.py ✓✓

@sigmavirus24 Mock

@sigmavirus24 Verbose

@sigmavirus24 P r e t e n d t o
b e T h e N . S . A .

@sigmavirus24 vcr.py betamax

@sigmavirus24 vcr.py

@sigmavirus24 session = requests.Session() cassette = ‘vcrexample.yml’ with vcr.use_cassette(cassette): resp
= get_resource( session, ‘users’) assert resp.ok users = resp.json() assert len(users) > 0

@sigmavirus24 $ py.test vcr_ex.py vcr_ex.py ✓

@sigmavirus24 betamax

@sigmavirus24 session = Session() rec = betamax.Betamax( session, cassette_library_dir=‘.’)

@sigmavirus24 with rec.use_cassette(‘betamax’): resp = get_resource( session, ‘users’) assert resp.ok
users = resp.json() assert len(users) > 0

@sigmavirus24 $ py.test betmax_ex.py betamax_ex.py ✓

@sigmavirus24 self.session = Session() self.recorder = Betamax( session) self.recorder.use_cassette( cassette_name())
self.recorder.start()

@sigmavirus24 resp = get_resource( self.session, ‘users’) assert resp.ok users =
resp.json() assert len(users) > 0

@sigmavirus24 self.recorder.stop()

@sigmavirus24 vcr.py betamax

@sigmavirus24 T h e r e a l i t
y

@sigmavirus24 Two part solution

@sigmavirus24 Mocking mock, requests-mock, responses, httpretty

@sigmavirus24 Integration betamax, vcr.py

@sigmavirus24 T h a n k y o u

Cutting off the Internet: Testing Applications ...

Cutting off the Internet: Testing Applications that Use Requests

Transcript

More Decks by Ian Cordasco

Other Decks in Programming

Featured