Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Scale Agnostic Python

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for Sean T Allen Sean T Allen
August 17, 2017
Programming
0
260

Scale Agnostic Python

Presented to the NYC Python meetup August 17, 2017

Avatar for Sean T Allen

Sean T Allen

August 17, 2017
Tweet

More Decks by Sean T Allen

See All by Sean T Allen
On Deny Capabilities for Safe, Fast Actors
Avatar for Sean T Allen seantallen
1
140
Data corrupting architectures we know and love - VelocityConf San Jose 2019
Avatar for Sean T Allen seantallen
1
130
Data corrupting architectures we know and love
Avatar for Sean T Allen seantallen
0
140
Scale-Independent Python
Avatar for Sean T Allen seantallen
2
250
Pat Helland and Me: How to Build Stateful Distributed Applications That Can Scale Almost Infinitely - Velocity NY October 2018
Avatar for Sean T Allen seantallen
0
110
Adventures in Cgo Preformance
Avatar for Sean T Allen seantallen
0
690
Pat Helland and me: A talk about “Life Beyond Distributed Transactions: An Apostate’s Opinion”
Avatar for Sean T Allen seantallen
0
720
Pat Helland and me: How to build stateful distributed applications that can scale almost infinitely - Salesforce July 2018
Avatar for Sean T Allen seantallen
0
190
Pony: How I learned to stop worrying and embrace an unproven technology - OSCON 2018
Avatar for Sean T Allen seantallen
0
550

Other Decks in Programming

See All in Programming
例外処理とどう使い分ける？Result型を使ったエラー設計 #burikaigi
Avatar for Takuma Kajikawa kajitack
16
5.9k
余白を設計しフロントエンド開発を 加速させる
Avatar for karacoro / からころ tsukuha
7
2.1k
AI 駆動開発ライフサイクル(AI-DLC):ソフトウェアエンジニアリングの再構築 / AI-DLC Introduction
Avatar for kanamsasa kanamasa
11
6.1k
Implementation Patterns
Avatar for Denys Poltorak denyspoltorak
0
270
ZJIT: The Ruby 4 JIT Compiler / Ruby Release 30th Anniversary Party
Avatar for Takashi Kokubun k0kubun
1
390
組織で育むオブザーバビリティ
Avatar for ryotaro kobayashi ryota_hnk
0
160
Unicodeどうしてる？ PHPから見たUnicode対応と他言語での対応についてのお伺い
Avatar for てきめん tekimen youkidearitai
PRO
1
1k
IFSによる形状設計／デモシーンの魅力 @ 慶應大学SFC
Avatar for がむ gam0022
1
280
KIKI_MBSD Cybersecurity Challenges 2025
Avatar for ikema ikema
0
1.3k
フルサイクルエンジニアリングをAI Agentで全自動化したい 〜構想と現在地〜
Avatar for Kaito Minatoya kamina_zzz
0
390
公共交通オープンデータ × モバイルUX 複雑な運行情報を 『直感』に変換する技術
Avatar for Tsubasa SEKIGUCHI tinykitten
PRO
0
200
OCaml 5でモダンな並列プログラミングを Enjoyしよう!
Avatar for Haochen Kotoi-Xie haochenx
0
100

Featured

See All Featured
How to audit for AI Accessibility on your Front & Back End
Avatar for davetheseo davetheseo
0
150
Making the Leap to Tech Lead
Avatar for Ryan Cromwell cromwellryan
135
9.7k
Effective software design: The role of men in debugging patriarchy in IT @ Voxxed Days AMS
Avatar for Kenny Baas-Schwegler baasie
0
210
BBQ
Avatar for Matthew Crist matthewcrist
89
10k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
Avatar for Chris Coyier chriscoyier
508
140k
Design of three-dimensional binary manipulators for pick-and-place task avoiding obstacles (IECON2024)
Avatar for konakalab konakalab
0
340
Agile that works and the tools we love
Avatar for Rasmus Luckow-Nielsen rasmusluckow
331
21k
The Curious Case for Waylosing
Avatar for Cassini Nazir cassininazir
0
230
Context Engineering - Making Every Token Count
Avatar for Addy Osmani addyosmani
9
640
Code Reviewing Like a Champion
Avatar for maltzj maltzj
527
40k
Leadership Guide Workshop - DevTernity 2021
Avatar for David Neal reverentgeek
1
190
How People are Using Generative and Agentic AI to Supercharge Their Products, Projects, Services and Value Streams Today
Avatar for Helen Beal helenjbeal
1
100

Transcript

  1. SCALE AGNOSTIC PYTHON HOW TO SCALE YOUR PYTHON APPLICATION WITHOUT

    ANY CODE CHANGES*

  2. SEAN T. ALLEN VP OF ENGINEERING AT SENDENCE AUTHOR OF

    “STORM APPLIED” @SEANTALLEN

  3. SCALE AGNOSTIC COMPUTING

  4. THE PROBLEM THE LITTLE APPLICATION THAT COULD… UNTIL IT COULDN’T.

  5. Scaling an application from “little data” to “a little more

    data” to “big data” is hard.

  6. OPTIONS

  7. Rewrite the application Rewrite to scale across multiple processes Example:

    “multiprocessing” Python library

  8. Run more versions Smart loader to load data in. Perhaps

    via a job queue like Celery.

  9. Go scale agnostic Write you application against a scale agnostic

    API that runs on a scale aware platform

  10. SENDENCE WALLAROO SCALE AGNOSTIC COMPUTING FOR PYTHON

  11. Sendence Wallaroo Simple Scale Agnostic API Managed in-memory state Guaranteed

    Message Processing

  12. “We handle the hard infrastructure plumbing so you don’t have

    to.” – The Wallaroo Team

  13. LEARN MORE… sendence.com Sendence Engineering on Twitter: @SendenceEng Pat Helland’s

    “Life Beyond Distributed Transactions”