Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Scale Agnostic Python

Avatar for Sean T Allen Sean T Allen
August 17, 2017
Programming
310
0

Scale Agnostic Python

Presented to the NYC Python meetup August 17, 2017

Avatar for Sean T Allen

Sean T Allen

August 17, 2017

More Decks by Sean T Allen

See All by Sean T Allen
On Deny Capabilities for Safe, Fast Actors
Avatar for Sean T Allen seantallen
1
190
Data corrupting architectures we know and love - VelocityConf San Jose 2019
Avatar for Sean T Allen seantallen
1
180
Data corrupting architectures we know and love
Avatar for Sean T Allen seantallen
0
180
Scale-Independent Python
Avatar for Sean T Allen seantallen
2
300
Pat Helland and Me: How to Build Stateful Distributed Applications That Can Scale Almost Infinitely - Velocity NY October 2018
Avatar for Sean T Allen seantallen
0
140
Adventures in Cgo Preformance
Avatar for Sean T Allen seantallen
0
740
Pat Helland and me: A talk about “Life Beyond Distributed Transactions: An Apostate’s Opinion”
Avatar for Sean T Allen seantallen
0
780
Pat Helland and me: How to build stateful distributed applications that can scale almost infinitely - Salesforce July 2018
Avatar for Sean T Allen seantallen
0
210
Pony: How I learned to stop worrying and embrace an unproven technology - OSCON 2018
Avatar for Sean T Allen seantallen
0
600

Other Decks in Programming

See All in Programming
AIは賢い。でも実行環境は？ CLIおじさんがAI時代に伝えたいこと ~ CLIおじさんがAI時代に伝えたいこと ~
Avatar for curekoshimizu curekoshimizu
1
160
Can LLMs Replicate 4 Years of Compose Migration? Exploring the boundaries of automation with 279 XML files from a real product
Avatar for makun makun
0
130
AI駆動開発にグラフDBを重ねてみた
Avatar for Satoshi Kaneyasu satoshi256kbyte
2
760
PyConJP2026_wat_Python × Signal Processing: How to Draw Pictures with Sound Using Spectrogram Art
Avatar for wat wat
0
680
Vibes Containers 〜AIで変わるコンテナ設計と運用〜
Avatar for Tetsuya Kikuchi tkikuc
2
500
不幸な GC
Avatar for Chen chencmd
0
890
信頼性の目標を誰も求めてない
Avatar for Shuma shubox
0
490
AI に Inclusive UI を書かせよう — Design Rules Skill で Compose UI を作り直す
Avatar for テオリア・テクノロジーズ theoriatec2024
1
460
LLMは4年分のCompose移行を再現できるのか？実プロダクト279件のXMLで探る自動化の境界線
Avatar for makun makun
0
440
Gmail/Google DriveをトリガーにAIエージェントを動かそう！ / Run AI agents with Gmail/Google Drive as triggers!
Avatar for Har1101 har1101
3
470
Go を使い始めて 2 ヶ月の学び / My first two months with Go
Avatar for Daisuke Garaike contour_gara
0
420
ALB ログから Trace を気合で繋げる技術
Avatar for Hayato Kawai fohte
7
880

Featured

See All Featured
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
Avatar for Sam Stephenson sstephenson
162
16k
Tell your own story through comics
Avatar for letsgokoyo letsgokoyo
1
1.1k
Future Trends and Review - Lecture 12 - Web Technologies (1019888BNR)
Avatar for Beat Signer signer
PRO
0
3.7k
Stewardship and Sustainability of Urban and Community Forests
Avatar for Eric Wiseman pwiseman
0
510
Mobile First: as difficult as doing things right
Avatar for Swwweet swwweet
225
10k
Accessibility Awareness
Avatar for Sarah Abderemane sabderemane
1
200
Balancing Empowerment & Direction
Avatar for Lara Hogan lara
6
1.3k
The State of eCommerce SEO: How to Win in Today's Products SERPs - #SEOweek
Avatar for Aleyda Solis aleyda
2
11k
Game over? The fight for quality and originality in the time of robots
Avatar for Wayne Barker wayneb77
1
270
Site-Speed That Sticks
Avatar for Harry Roberts csswizardry
13
1.5k
The Organizational Zoo: Understanding Human Behavior Agility Through Metaphoric Constructive Conversations (based on the works of Arthur Shelley, Ph.D)
Avatar for Dr. Kim W Petersen kimpetersen
PRO
0
440
Chasing Engaging Ingredients in Design
Avatar for Sebastian Deterding codingconduct
0
300

Transcript

  1. SCALE AGNOSTIC PYTHON HOW TO SCALE YOUR PYTHON APPLICATION WITHOUT

    ANY CODE CHANGES*

  2. SEAN T. ALLEN VP OF ENGINEERING AT SENDENCE AUTHOR OF

    “STORM APPLIED” @SEANTALLEN

  3. SCALE AGNOSTIC COMPUTING

  4. THE PROBLEM THE LITTLE APPLICATION THAT COULD… UNTIL IT COULDN’T.

  5. Scaling an application from “little data” to “a little more

    data” to “big data” is hard.

  6. OPTIONS

  7. Rewrite the application Rewrite to scale across multiple processes Example:

    “multiprocessing” Python library

  8. Run more versions Smart loader to load data in. Perhaps

    via a job queue like Celery.

  9. Go scale agnostic Write you application against a scale agnostic

    API that runs on a scale aware platform

  10. SENDENCE WALLAROO SCALE AGNOSTIC COMPUTING FOR PYTHON

  11. Sendence Wallaroo Simple Scale Agnostic API Managed in-memory state Guaranteed

    Message Processing

  12. “We handle the hard infrastructure plumbing so you don’t have

    to.” – The Wallaroo Team

  13. LEARN MORE… sendence.com Sendence Engineering on Twitter: @SendenceEng Pat Helland’s

    “Life Beyond Distributed Transactions”