$30 off During Our Annual Pro Sale. View Details »

Scale Agnostic Python

Sean T Allen
August 17, 2017
Programming
0
160

Scale Agnostic Python

Presented to the NYC Python meetup August 17, 2017

Sean T Allen

August 17, 2017
Tweet

More Decks by Sean T Allen

See All by Sean T Allen
On Deny Capabilities for Safe, Fast Actors
seantallen
1
80
Data corrupting architectures we know and love - VelocityConf San Jose 2019
seantallen
1
91
Data corrupting architectures we know and love
seantallen
0
94
Scale-Independent Python
seantallen
2
200
Pat Helland and Me: How to Build Stateful Distributed Applications That Can Scale Almost Infinitely - Velocity NY October 2018
seantallen
0
66
Adventures in Cgo Preformance
seantallen
0
540
Pat Helland and me: A talk about “Life Beyond Distributed Transactions: An Apostate’s Opinion”
seantallen
0
490
Pat Helland and me: How to build stateful distributed applications that can scale almost infinitely - Salesforce July 2018
seantallen
0
160
Pony: How I learned to stop worrying and embrace an unproven technology - OSCON 2018
seantallen
0
310

Other Decks in Programming

See All in Programming
MTDDC Meetup TOKYO 2023
chinen
1
190
How to Be a Responsible Open Source Citizen
ivargrimstad
0
1.2k
Spring + Localstack : usando aws de forma gratuita
kamilahsantos
2
110
Git 和 DevOps - 在混亂的流星群開發流程中找到小確幸
eddie
1
860
TypeScript_コンパイラの内側に片足を入れる
ryounasso
0
170
Bun がメジャーリリースされたけど、本当にBun はNode.js に取って代わるのか？をAWS Lambda で検証してみた
smt7174
1
1.8k
Developing a Vim plugin with Ruby
okuramasafumi
0
210
JSConfjp2023 Storybook駆動開発の再現性と効率化
kinocoboy2
1
1.9k
集団意思決定の落とし穴と誰も望まない技術的負債
h0r15h0
0
2k
DMMプラットフォームにおけるコード品質を改善する取り組みの理想と現実
pospome
3
1.7k
ABEMA モバイルアプリにおける 「アーキテクチャ」 / ABEMA Mobile Architecture (CA.swift #18)
akkyie
1
240
非同期ツールキット「Vert.x」のご紹介
masatoshiitoh
0
120

Featured

See All Featured
How STYLIGHT went responsive
nonsquared
89
4.5k
How GitHub (no longer) Works
holman
299
140k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
danielanewman
219
21k
Producing Creativity
orderedlist
PRO
336
38k
Atom: Resistance is Futile
akmur
257
24k
Making Projects Easy
brettharned
105
5.2k
The Straight Up "How To Draw Better" Workshop
denniskardys
226
130k
Building Applications with DynamoDB
mza
87
5.3k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
226
16k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
113
17k
How to name files
jennybc
59
87k
Music & Morning Musume
bryan
38
5.2k

Transcript

  1. SCALE AGNOSTIC PYTHON
    HOW TO SCALE YOUR PYTHON APPLICATION WITHOUT ANY CODE CHANGES*

    View Slide

  2. SEAN T. ALLEN
    VP OF ENGINEERING AT SENDENCE
    AUTHOR OF “STORM APPLIED”
    @SEANTALLEN

    View Slide

  3. SCALE AGNOSTIC COMPUTING

    View Slide

  4. THE PROBLEM
    THE LITTLE APPLICATION
    THAT COULD…
    UNTIL IT COULDN’T.

    View Slide

  5. Scaling an application from “little data” to “a little
    more data” to “big data” is hard.

    View Slide

  6. OPTIONS

    View Slide

  7. Rewrite the application
    Rewrite to scale across
    multiple processes

    Example: “multiprocessing”
    Python library

    View Slide

  8. Run more versions
    Smart loader to load data in.
    Perhaps via a job queue like
    Celery.

    View Slide

  9. Go scale agnostic
    Write you application against
    a scale agnostic API that runs
    on a scale aware platform

    View Slide

  10. SENDENCE
    WALLAROO
    SCALE AGNOSTIC
    COMPUTING FOR PYTHON

    View Slide

  11. Sendence Wallaroo
    Simple Scale Agnostic API

    Managed in-memory state

    Guaranteed Message Processing

    View Slide

  12. “We handle the hard infrastructure plumbing so
    you don’t have to.”
    – The Wallaroo Team

    View Slide

  13. LEARN MORE…
    sendence.com
    Sendence Engineering on Twitter: @SendenceEng
    Pat Helland’s “Life Beyond Distributed Transactions”

    View Slide