Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Scale Agnostic Python

Avatar for Sean T Allen Sean T Allen
August 17, 2017
Programming
0
250

Scale Agnostic Python

Presented to the NYC Python meetup August 17, 2017

Avatar for Sean T Allen

Sean T Allen

August 17, 2017
Tweet

More Decks by Sean T Allen

See All by Sean T Allen
On Deny Capabilities for Safe, Fast Actors
Avatar for Sean T Allen seantallen
1
120
Data corrupting architectures we know and love - VelocityConf San Jose 2019
Avatar for Sean T Allen seantallen
1
120
Data corrupting architectures we know and love
Avatar for Sean T Allen seantallen
0
120
Scale-Independent Python
Avatar for Sean T Allen seantallen
2
240
Pat Helland and Me: How to Build Stateful Distributed Applications That Can Scale Almost Infinitely - Velocity NY October 2018
Avatar for Sean T Allen seantallen
0
96
Adventures in Cgo Preformance
Avatar for Sean T Allen seantallen
0
670
Pat Helland and me: A talk about “Life Beyond Distributed Transactions: An Apostate’s Opinion”
Avatar for Sean T Allen seantallen
0
690
Pat Helland and me: How to build stateful distributed applications that can scale almost infinitely - Salesforce July 2018
Avatar for Sean T Allen seantallen
0
180
Pony: How I learned to stop worrying and embrace an unproven technology - OSCON 2018
Avatar for Sean T Allen seantallen
0
530

Other Decks in Programming

See All in Programming
iOSエンジニア向けの英語学習アプリを作る！
Avatar for yukawashouhei yukawashouhei
0
190
作って理解するGOCACHEPROG / Go Conference 2025(Workshop)
Avatar for mazrean mazrean
0
100
はじめてのDSPy - 言語モデルを『プロンプト』ではなく『プログラミング』するための仕組み
Avatar for Masahiro Nishimi masahiro_nishimi
2
520
詳しくない分野でのVibe Codingで困ったことと学び/vibe-coding-in-unfamiliar-area
Avatar for shibayu36 shibayu36
3
5.1k
あなたとKaigi on Rails / Kaigi on Rails + You
Avatar for Hiroshi Shimoju shimoju
0
160
Pull-Requestの内容を1クリックで動作確認可能にするワークフロー
Avatar for Atsuya Sato natmark
2
510
Things You Thought You Didn’t Need To Care About That Have a Big Impact On Your Job
Avatar for Holly Cummins hollycummins
0
230
Devoxx BE - Local Development in the AI Era
Avatar for Kevin Dubois kdubois
0
130
チームの境界をブチ抜いていけ
Avatar for tokai235 tokai235
0
180
Cursorハンズオン実践！
Avatar for Ikko Eltociear Ashimine eltociear
2
1.1k
Range on Rails ―「多重範囲型」という新たな選択肢が、複雑ロジックを劇的にシンプルにしたワケ
Avatar for RIZAPテクノロジーズ rizap_tech
0
6.6k
Building, Deploying, and Monitoring Ruby Web Applications with Falcon (Kaigi on Rails 2025)
Avatar for Samuel Williams ioquatix
4
2.2k

Featured

See All Featured
Product Roadmaps are Hard
Avatar for C. Todd Lombardo iamctodd
PRO
54
11k
We Have a Design System, Now What?
Avatar for Morgane Peng morganepeng
53
7.8k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
Avatar for Sam Stephenson sstephenson
162
15k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
Avatar for panda_program panda_program
115
20k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
Avatar for Irina Nazarova irinanazarova
9
980
Speed Design
Avatar for Sergey Chernyshev sergeychernyshev
32
1.2k
Designing Experiences People Love
Avatar for Jonathan Moore moore
142
24k
BBQ
Avatar for Matthew Crist matthewcrist
89
9.8k
Rails Girls Zürich Keynote
Avatar for Gregor Martynus gr2m
95
14k
The World Runs on Bad Software
Avatar for Brandon Keepers bkeepers
PRO
72
11k
10 Git Anti Patterns You Should be Aware of
Avatar for Lemi Orhan Ergin lemiorhan
PRO
657
61k
Visualization
Avatar for Eitan Lees eitanlees
149
16k

Transcript

  1. SCALE AGNOSTIC PYTHON HOW TO SCALE YOUR PYTHON APPLICATION WITHOUT

    ANY CODE CHANGES*

  2. SEAN T. ALLEN VP OF ENGINEERING AT SENDENCE AUTHOR OF

    “STORM APPLIED” @SEANTALLEN

  3. SCALE AGNOSTIC COMPUTING

  4. THE PROBLEM THE LITTLE APPLICATION THAT COULD… UNTIL IT COULDN’T.

  5. Scaling an application from “little data” to “a little more

    data” to “big data” is hard.

  6. OPTIONS

  7. Rewrite the application Rewrite to scale across multiple processes Example:

    “multiprocessing” Python library

  8. Run more versions Smart loader to load data in. Perhaps

    via a job queue like Celery.

  9. Go scale agnostic Write you application against a scale agnostic

    API that runs on a scale aware platform

  10. SENDENCE WALLAROO SCALE AGNOSTIC COMPUTING FOR PYTHON

  11. Sendence Wallaroo Simple Scale Agnostic API Managed in-memory state Guaranteed

    Message Processing

  12. “We handle the hard infrastructure plumbing so you don’t have

    to.” – The Wallaroo Team

  13. LEARN MORE… sendence.com Sendence Engineering on Twitter: @SendenceEng Pat Helland’s

    “Life Beyond Distributed Transactions”