Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Scale Agnostic Python

Avatar for Sean T Allen Sean T Allen
August 17, 2017
Programming
310
0

Scale Agnostic Python

Presented to the NYC Python meetup August 17, 2017

Avatar for Sean T Allen

Sean T Allen

August 17, 2017

More Decks by Sean T Allen

See All by Sean T Allen
On Deny Capabilities for Safe, Fast Actors
Avatar for Sean T Allen seantallen
1
190
Data corrupting architectures we know and love - VelocityConf San Jose 2019
Avatar for Sean T Allen seantallen
1
180
Data corrupting architectures we know and love
Avatar for Sean T Allen seantallen
0
180
Scale-Independent Python
Avatar for Sean T Allen seantallen
2
300
Pat Helland and Me: How to Build Stateful Distributed Applications That Can Scale Almost Infinitely - Velocity NY October 2018
Avatar for Sean T Allen seantallen
0
140
Adventures in Cgo Preformance
Avatar for Sean T Allen seantallen
0
740
Pat Helland and me: A talk about “Life Beyond Distributed Transactions: An Apostate’s Opinion”
Avatar for Sean T Allen seantallen
0
780
Pat Helland and me: How to build stateful distributed applications that can scale almost infinitely - Salesforce July 2018
Avatar for Sean T Allen seantallen
0
220
Pony: How I learned to stop worrying and embrace an unproven technology - OSCON 2018
Avatar for Sean T Allen seantallen
0
600

Other Decks in Programming

See All in Programming
ソフトウェアラスタライザ
Avatar for Fadis fadis
1
800
Snowflakeで業務アプリを作ろう。 Snowflakeのアプリ機能解説&実践ガイド
Avatar for Ayumu Yamaguchi ayumu_yamaguchi
1
230
Foundry Localでエージェント開発
Avatar for 瀬尾佳隆 seosoft
0
170
AIを上手に使っていこうとしたら越境せざるを得なくなった話 〜実践1年で見えた境界を越えなければならない理由と進め方〜 / Crossing borders with AI
Avatar for TomoyaKitaura tomoyakitaura
4
1.1k
アクセシビリティから考える情報設計
Avatar for high-g high_g_engineer
0
350
Swift愛好会100回記念 第1回を振り返る
Avatar for jollyjoester jollyjoester
0
120
Webの地図
Avatar for Yosuke Furukawa yosuke_furukawa
PRO
6
4.1k
DroidKaigi 2026 「個人開発という実験場: Android エンジニアが手にする4つの自由」
Avatar for SlashNephy slashnephy
0
230
Can LLMs Replicate 4 Years of Compose Migration? Exploring the boundaries of automation with 279 XML files from a real product
Avatar for makun makun
0
130
『寄り添うラジオ』をAIで作る 体験価値から逆算した、会話しないUXと品質設計
Avatar for テオリア・テクノロジーズ theoriatec2024
3
150
数年滞っていたダークモード対応をおよそ2週間で完了させる
Avatar for Kazuki Chigita chigichan24
0
700
Building an Out-of-Order CPU
Avatar for Latte72 latte72
1
750

Featured

See All Featured
Building Experiences: Design Systems, User Experience, and Full Site Editing
Avatar for Michelle Schulp Hunt marktimemedia
0
600
The Anti-SEO Checklist Checklist. Pubcon Cyber Week
Avatar for Ryan Jones ryanjones
0
230
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
Avatar for Stéphanie Walter stephaniewalter
287
14k
Are puppies a ranking factor?
Avatar for Jono Alderson jonoalderson
2
3.9k
Gemini Prompt Engineering: Practical Techniques for Tangible AI Outcomes
Avatar for Mfonobong Umondia mfonobong
2
520
Designing Experiences People Love
Avatar for Jonathan Moore moore
143
24k
Practical Tips for Bootstrapping Information Extraction Pipelines
Avatar for Matthew Honnibal honnibal
25
2.1k
Kristin Tynski - Automating Marketing Tasks With AI
Avatar for Tech SEO Connect techseoconnect
PRO
0
510
Context Engineering - Making Every Token Count
Avatar for Addy Osmani addyosmani
9
1.1k
Agile that works and the tools we love
Avatar for Rasmus Luckow-Nielsen rasmusluckow
331
22k
Marketing Yourself as an Engineer | Alaka | Gurzu
Avatar for Gurzu gurzu
0
300
職位にかかわらず全員がリーダーシップを発揮するチーム作り / Building a team where everyone can demonstrate leadership regardless of position
Avatar for MADOX madoxten
69
65k

Transcript

  1. SCALE AGNOSTIC PYTHON HOW TO SCALE YOUR PYTHON APPLICATION WITHOUT

    ANY CODE CHANGES*

  2. SEAN T. ALLEN VP OF ENGINEERING AT SENDENCE AUTHOR OF

    “STORM APPLIED” @SEANTALLEN

  3. SCALE AGNOSTIC COMPUTING

  4. THE PROBLEM THE LITTLE APPLICATION THAT COULD… UNTIL IT COULDN’T.

  5. Scaling an application from “little data” to “a little more

    data” to “big data” is hard.

  6. OPTIONS

  7. Rewrite the application Rewrite to scale across multiple processes Example:

    “multiprocessing” Python library

  8. Run more versions Smart loader to load data in. Perhaps

    via a job queue like Celery.

  9. Go scale agnostic Write you application against a scale agnostic

    API that runs on a scale aware platform

  10. SENDENCE WALLAROO SCALE AGNOSTIC COMPUTING FOR PYTHON

  11. Sendence Wallaroo Simple Scale Agnostic API Managed in-memory state Guaranteed

    Message Processing

  12. “We handle the hard infrastructure plumbing so you don’t have

    to.” – The Wallaroo Team

  13. LEARN MORE… sendence.com Sendence Engineering on Twitter: @SendenceEng Pat Helland’s

    “Life Beyond Distributed Transactions”