Tweet
Tweet

Slide 1

Slide 1 text

SCALE AGNOSTIC PYTHON HOW TO SCALE YOUR PYTHON APPLICATION WITHOUT ANY CODE CHANGES*

Slide 2

Slide 2 text

SEAN T. ALLEN VP OF ENGINEERING AT SENDENCE AUTHOR OF “STORM APPLIED” @SEANTALLEN

Slide 3

Slide 3 text

SCALE AGNOSTIC COMPUTING

Slide 4

Slide 4 text

THE PROBLEM THE LITTLE APPLICATION THAT COULD… UNTIL IT COULDN’T.

Slide 5

Slide 5 text

Scaling an application from “little data” to “a little more data” to “big data” is hard.

Slide 6

Slide 6 text

OPTIONS

Slide 7

Slide 7 text

Rewrite the application Rewrite to scale across multiple processes Example: “multiprocessing” Python library

Slide 8

Slide 8 text

Run more versions Smart loader to load data in. Perhaps via a job queue like Celery.

Slide 9

Slide 9 text

Go scale agnostic Write you application against a scale agnostic API that runs on a scale aware platform

Slide 10

Slide 10 text

SENDENCE WALLAROO SCALE AGNOSTIC COMPUTING FOR PYTHON

Slide 11

Slide 11 text

Sendence Wallaroo Simple Scale Agnostic API Managed in-memory state Guaranteed Message Processing

Slide 12

Slide 12 text

“We handle the hard infrastructure plumbing so you don’t have to.” – The Wallaroo Team

Slide 13

Slide 13 text

LEARN MORE… sendence.com Sendence Engineering on Twitter: @SendenceEng Pat Helland’s “Life Beyond Distributed Transactions”