Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Programação Assíncrona com Asyncio
Search
Allisson Azevedo
March 25, 2017
Technology
0
64
Programação Assíncrona com Asyncio
Palestra ministrada no PythonDay Campina Grande 2017
Allisson Azevedo
March 25, 2017
Tweet
Share
More Decks by Allisson Azevedo
See All by Allisson Azevedo
Crawleando sites com NodeJS
allisson
0
140
Introdução a linguagem Go
allisson
0
240
Docker + Django
allisson
5
540
Construindo um micro framework web em Python
allisson
0
200
Consumindo API's OAuth{1,2} com Python
allisson
1
140
Tarefas assíncronas com django e celery
allisson
1
23k
Deploy completo de uma aplicação Django
allisson
6
390
Desenvolvimento Web com Django
allisson
0
130
Otimizando sites com o nosql redis
allisson
4
130
Other Decks in Technology
See All in Technology
MUGA - Bodyless Immersion
takuro_nakajima
PRO
0
1.5k
Autonomous Database Cloud 技術詳細 / adb-s_technical_detail_jp
oracle4engineer
PRO
13
35k
オブザーバビリティの Primary Signals
onk
PRO
0
520
20240416_devopsdaystokyo
kzkmaeda
1
150
反実仮想機械学習とは何か
usaito
PRO
3
450
ログラスにおけるコード品質でビジネスに貢献する仕組み・カルチャー / A system and culture that contributes to business through code quality in Loglass
yoshikiiida
11
1.6k
Why we expect the Microservices
shkitayama
2
320
Four keys改善の取り組み事例紹介
sansantech
PRO
2
220
人間の尊厳、幸福、アクセシビリティ / 第116回「WEB TOUCH MEETING」アクセシビリティSP
nulabinc
PRO
2
160
PHP"オレ"カンファレンスの告知
ysknsid25
0
240
4年前、あるじゃん老害エンジニアLT合戦に登壇、米国西海岸コンピュータ歴史博物館体験記の続編
toshi_atsumi
0
180
キャラクター制御のためのプロンプト術 for LINE Bot
uezo
0
490
Featured
See All Featured
Building Flexible Design Systems
yeseniaperezcruz
318
37k
Testing 201, or: Great Expectations
jmmastey
27
6.3k
Creatively Recalculating Your Daily Design Routine
revolveconf
209
11k
Optimizing for Happiness
mojombo
369
69k
Fashionably flexible responsive web design (full day workshop)
malarkey
397
65k
Fantastic passwords and where to find them - at NoRuKo
philnash
35
2.5k
Facilitating Awesome Meetings
lara
40
5.6k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
18
1.7k
Put a Button on it: Removing Barriers to Going Fast.
kastner
58
3k
Debugging Ruby Performance
tmm1
69
11k
GraphQLの誤解/rethinking-graphql
sonatard
49
9.2k
Thoughts on Productivity
jonyablonski
57
3.8k
Transcript
PROGRAMAÇÃO ASSÍNCRONA COM ASYNCIO PythonDay Campina Grande 2017 Allisson Azevedo
1
ALLISSON AZEVEDO allissonazevedo.com youtube.com/user/allissonazevedo github.com/allisson twitter.com/allisson linkedin.com/in/allisson/ allisson.github.io/slides/
[email protected]
2
THE C10K PROBLEM Como lidar com 10k conexões simultâneas http://www.kegel.com/c10k.html
3
CONCORRÊNCIA Asynchronous I/O O exemplo do garçom Não confundir com
paralelismo 4
PROGRAMAÇÃO SÍNCRONA import time import requests from github import REPOS,
ACCESS_TOKEN start = time.time() for repo_url in REPOS: response = requests.get(repo_url, params={'access_token': ACCESS repo_info = { 'name': response['name'], 'full_name': response['full_name'], 'stargazers_count': response['stargazers_count'] } print(repo_info) end = time.time() print('Tempo de execução={:.2f} segundos'.format(end - start)) 5
PROBLEMAS COM PROGRAMAÇÃO SÍNCRONA Uma requisição http por vez 6
CONCORRÊNCIA USANDO THREADS import time import threading import queue import
requests from github import REPOS, ACCESS_TOKEN def grab_data_from_queue(): while not q.empty(): repo_url = q.get() response = requests.get(repo_url, params={'access_token' repo_info = { 'name': response['name'], 'full_name': response['full_name'], 'stargazers_count': response['stargazers_count'] } 7
PROBLEMAS COM THREADS Consumo de recursos Global Interpreter Lock (GIL)
8
CONCORRÊNCIA USANDO PROCESS import time import multiprocessing import requests from
github import REPOS, ACCESS_TOKEN def grab_data_from_queue(): while not q.empty(): repo_url = q.get() response = requests.get(repo_url, params={'access_token' repo_info = { 'name': response['name'], 'full_name': response['full_name'], 'stargazers_count': response['stargazers_count'] } print(repo_info) 9
PROBLEMAS COM PROCESS Consumo de recursos 10
CONCORRÊNCIA USANDO CONCURRENT.FUTURES import time from concurrent import futures import
requests from github import REPOS, ACCESS_TOKEN def get_repo_info(repo_url): response = requests.get(repo_url, params={'access_token': ACCESS repo_info = { 'name': response['name'], 'full_name': response['full_name'], 'stargazers_count': response['stargazers_count'] } print(repo_info) 11
PROBLEMAS COM CONCURRENT.FUTURES ThreadPoolExecutor - usa threads ProcessPoolExecutor - usa
process 12
ASYNCHRONOUS I/O COM PYTHON Twisted Tornado Eventlet Gevent Asyncio 13
ASYNCIO Python 3.4+ Tulip PEP-3156 14
HELLO WORLD import asyncio async def hello_world(): print('Hello World!') loop
= asyncio.get_event_loop() loop.run_until_complete(hello_world()) 15
HELLO WORLD COM TASKS import asyncio async def hello_world(name): print('Hello
World, {}!'.format(name)) loop = asyncio.get_event_loop() tasks = [] for name in ('fulano', 'cicrano', 'beltrano'): task = asyncio.ensure_future(hello_world(name)) tasks.append(task) loop.run_until_complete(asyncio.wait(tasks)) 16
CONCORRÊNCIA USANDO ASYNCIO import time import asyncio import aiohttp from
github import REPOS, ACCESS_TOKEN async def get_repo_info(repo_url): async with aiohttp.ClientSession() as session: async with session.get(repo_url, params={'access_token': ACC response_data = await response.json() repo_info = { 'name': response_data['name'], 'full_name': response_data['full_name'], 'stargazers_count': response_data['stargazers_count' } print(repo_info) 17
AIO LIBS https://github.com/aio-libs https://github.com/python/asyncio/wiki/ThirdParty 18
PACO import time import paco import aiohttp from github import
REPOS, ACCESS_TOKEN async def get_repo_info(repo_url): async with aiohttp.ClientSession() as session: async with session.get(repo_url, params={'access_token': ACC response_data = await response.json() repo_info = { 'name': response_data['name'], 'full_name': response_data['full_name'], 'stargazers_count': response_data['stargazers_count' } print(repo_info) 19
AIOHTTP from aiohttp import web async def handle(request): return web.json_response({'message':
'Hello World'}) app = web.Application() app.router.add_get('/', handle) web.run_app(app, host='127.0.0.1', port=8080) 20
SANIC from sanic import Sanic from sanic.response import json app
= Sanic() @app.route('/') async def test(request): return json({'message': 'Hello World'}) if __name__ == '__main__': app.run(host='127.0.0.1', port=8080) 21
AIOREDIS import asyncio import aioredis loop = asyncio.get_event_loop() async def
main(): redis = await aioredis.create_redis(('localhost', 6379), loop=lo await redis.set('key', 'hello world') val = await redis.get('key') print(val) redis.close() await redis.wait_closed() loop.run_until_complete(main()) 22
AIOMCACHE import asyncio import aiomcache loop = asyncio.get_event_loop() async def
main(): mc = aiomcache.Client('127.0.0.1', 11211, loop=loop) await mc.set(b'key', b'hello world') value = await mc.get(b'key') print(value) loop.run_until_complete(main()) 23
AIOPG import asyncio import aiopg from speakers import SPEAKERS dsn
= 'dbname=pythonday user=pythonday password=pythonday host=127. async def get_pool(): return await aiopg.create_pool(dsn) async def create_table(): pool = await get_pool() async with pool.acquire() as conn: async with conn.cursor() as cur: await cur.execute('DROP TABLE IF EXISTS speakers') 24
AIOPG SQLALCHEMY import asyncio from aiopg.sa import create_engine import sqlalchemy
as sa from speakers import SPEAKERS metadata = sa.MetaData() speakers_table = sa.Table( 'speakers', metadata, sa.Column('id', sa.Integer, primary_key=True), sa.Column('name', sa.String(255)) ) async def get_engine(): return await create_engine( 25
PYTEST-ASYNCIO import pytest import aiohttp from github import REPOS, ACCESS_TOKEN
async def get_repo_info(repo_url): async with aiohttp.ClientSession() as session: async with session.get(repo_url, params={'access_token': ACC response_data = await response.json() return { 'name': response_data['name'], 'full_name': response_data['full_name'], 'stargazers_count': response_data['stargazers_count' } 26
PERGUNTAS? 27
OBRIGADO! 28