Presented to the NYC Python meetup August 17, 2017
SCALE AGNOSTIC PYTHONHOW TO SCALE YOUR PYTHON APPLICATION WITHOUT ANY CODE CHANGES*
View Slide
SEAN T. ALLENVP OF ENGINEERING AT SENDENCEAUTHOR OF “STORM APPLIED”@SEANTALLEN
SCALE AGNOSTIC COMPUTING
THE PROBLEMTHE LITTLE APPLICATIONTHAT COULD…UNTIL IT COULDN’T.
Scaling an application from “little data” to “a littlemore data” to “big data” is hard.
OPTIONS
Rewrite the applicationRewrite to scale acrossmultiple processesExample: “multiprocessing”Python library
Run more versionsSmart loader to load data in.Perhaps via a job queue likeCelery.
Go scale agnosticWrite you application againsta scale agnostic API that runson a scale aware platform
SENDENCEWALLAROOSCALE AGNOSTICCOMPUTING FOR PYTHON
Sendence WallarooSimple Scale Agnostic APIManaged in-memory stateGuaranteed Message Processing
“We handle the hard infrastructure plumbing soyou don’t have to.”– The Wallaroo Team
LEARN MORE…sendence.comSendence Engineering on Twitter: @SendenceEngPat Helland’s “Life Beyond Distributed Transactions”