Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Deploying Complex Applications on Docker using ...
Search
Andrew Kennedy
November 18, 2014
Technology
3
180
Deploying Complex Applications on Docker using Apache Brooklyn
Talk given at ApacheCon Budapest, Noveber 2014
Andrew Kennedy
November 18, 2014
Tweet
Share
More Decks by Andrew Kennedy
See All by Andrew Kennedy
Building a Blockchain Platform with Hyperledger Sawtooth and Seth
grkvlt
1
270
Building a Blockchain
grkvlt
1
110
Blockchain and Brooklyn
grkvlt
0
150
Hyperledger in Action
grkvlt
1
130
Keeping OpenShift Evergreen
grkvlt
0
120
Orchestrating the Blockchain Using Containers
grkvlt
0
170
Introducing Cloudsoft Container Service
grkvlt
0
62
Managing Blockchain Applications with Hyperledger and Docker on Cloudsoft AMP
grkvlt
0
320
Multi-Container Applications Spanning Docker, Mesos and OpenStack
grkvlt
2
810
Other Decks in Technology
See All in Technology
低レイヤを知りたいPHPerのためのCコンパイラ作成入門 完全版 / Building a C Compiler for PHPers Who Want to Dive into Low-Level Programming - Expanded
tomzoh
4
3.4k
LangChain Interrupt & LangChain Ambassadors meetingレポート
os1ma
2
260
Zephyr RTOSを使った開発コンペに参加した件
iotengineer22
1
180
Geminiとv0による高速プロトタイピング
shinya337
0
220
生成AI開発案件におけるClineの業務活用事例とTips
shinya337
0
200
Core Audio tapを使ったリアルタイム音声処理のお話
yuta0306
0
170
ハッカソン by 生成AIハッカソンvol.05
1ftseabass
PRO
0
170
GeminiとNotebookLMによる金融実務の業務革新
abenben
0
250
赤煉瓦倉庫勉強会「Databricksを選んだ理由と、絶賛真っ只中のデータ基盤移行体験記」
ivry_presentationmaterials
0
110
改めてAWS WAFを振り返る~業務で使うためのポイント~
masakiokuda
1
210
FrankenPHPでLaravelを動かしてみよう
yousaku
0
100
Node-RED × MCP 勉強会 vol.1
1ftseabass
PRO
0
180
Featured
See All Featured
Gamification - CAS2011
davidbonilla
81
5.3k
A Modern Web Designer's Workflow
chriscoyier
694
190k
The Invisible Side of Design
smashingmag
301
51k
Java REST API Framework Comparison - PWX 2021
mraible
31
8.7k
KATA
mclloyd
30
14k
Keith and Marios Guide to Fast Websites
keithpitt
411
22k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
31
2.4k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
46
9.6k
Facilitating Awesome Meetings
lara
54
6.4k
Why You Should Never Use an ORM
jnunemaker
PRO
58
9.4k
GraphQLの誤解/rethinking-graphql
sonatard
71
11k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
45
7.5k
Transcript
Clocker Deploying Complex Applica3ons on Docker using Apache
Brooklyn
Deploying Complex Applica1ons on Docker using Apache Brooklyn
Andrew Kennedy @grkvlt ApacheCon, November 2014 Budapest, Hungary
Introduc1on • Andrew Kennedy – SoHware Engineer
– Open Source – github.com/grkvlt • CloudsoH Corpora1on – ScoMsh (Bri1sh? European!) Company – We’re Hiring…
Introduc1on • Clocker – Docker – Apache
Brooklyn – Apache Jclouds – Weave • Demonstra1on • Roadmap
Clocker Project • What does it do? – Manages
Docker Infrastructure – Deploys Blueprints to Docker • What is it? – Brooklyn Applica1on – Brooklyn Loca1on
Docker • Popular – Huge Ecosystem – Growing
– Complex • Containers – Isola1on – Performance – Composable
Docker
Limita3ons… Docker Limita3ons
Docker Limita1ons • Mul1ple Hosts • Networking
– Same Issue – Communica1on Between Services • Orchestra1on and Clustering – Control of Containers – Container Management
Docker Limita1ons • Plugin API will Help •
Not standardized yet • Working on it… • Need to avoid lock-‐in • One size fits all is never good enough
Clocker Project • GitHub • Open Source
• Java • Recently Developed • S1ll Beta Status – 0.7.0-‐SNAPSHOT – Release 0.7.0 Tomorrow
Why Clocker • Docker Popularity – Solve Some Limita1ons
• Best of Breed Components • Brooklyn Integra1on – Virtual Machines too Coarse – Container to En1ty Mapping
Clocker Components • Apache Brooklyn – CloudsoH Product
– Open Source Java – Donated to the ASF – Incubator Status
Apache Brooklyn • Applica1on Management Pladorm • Autonomic
Compu1ng Principles • Deploy, Manage and Monitor Blueprints – Services (En11es) – State (Sensors) – Ac1ons (Effectors)
Brooklyn Blueprint id: nodejs-‐hello-‐world-‐application name: "Node.JS Hello World
Application" origin: "https://github.com/grkvlt/node-‐hello-‐world.git/" locations: -‐ jclouds:softlayer:ams01 services: -‐ serviceType: brooklyn.entity.webapp.nodejs.NodeJsWebAppService id: nodejs name: "Node.JS" brooklyn.config: gitRepoUrl: "https://github.com/grkvlt/node-‐hello-‐world.git" appFileName: app.js appName: node-‐hello-‐world
Apache Brooklyn • Deployment – Provisioning –
Loca1ons – Installa1on and Customiza1on • Packages, Scripts, Chef, SaltStack • Management – Policies • AutoScaling, Resilience, Performance, Access
Apache Jclouds • Java Cloud Library • API
Agnos1c – CloudStack, OpenStack, AWS EC2, GCE… • Create Virtual Machines – Return SSH Endpoint – Manage Proper1es
Apache Jclouds • Drivers for REST APIs •
Docker Driver – Wrifen by @turlinux • Virtual Container – Using SSH Daemon – Same Endpoint Type as VM – Composi1on on any Image or Dockerfile
Weave • SoHware Defined Networking – Ethernet Switch
– User Space – Docker Container • Sniffs Traffic on Host • Forwards over TCP
Weave
What is Clocker?
What is Clocker? • Brooklyn Applica1on – Docker Infrastructure
• Docker Engine • Docker Containers – Weave Infrastructure • Weave Container
What is Clocker? • Brooklyn Loca1on – Des1na1on
for Blueprints • Added Features – Create Containers – Provision Docker Hosts – Afach to Weave Network – Manage Applica1on
Clocker Architecture
Clocker Architecture
Clocker Features • Applica1on Deployment – Oasis CAMP
Blueprint – Same as Core Brooklyn • Mixed Des1na1ons – Some Virtual Machines – Some Bare Metal – Some Containers
Clocker Features • Applica1on Deployment – Oasis CAMP
Blueprint – Same as Core Brooklyn • Docker Extensions – Container or Image – Placement Strategy – Dockerfile URL
Clocker Placement • Demand Side – New Container
• Supply Side – Where? – Placement Strategy – Provisioning Strategy
Clocker Placement • Placement Strategies – Depth First
– Breadth First – CPU Usage – Affinity or An1 Affinity – Memory or CPU Core Availability
Clocker Placement • Provisioning Strategy – New Docker
Host Loca1on • Constraints – Docker Infrastructure Constraints – En1ty or Applica1on Constraints • User Defined Strategies • Intelligent Container Orchestra1on
Clocker Placement • Determinis1c • Simple – Predicate
and Comparator docker.container.strategies: -‐ $brooklyn:object: type: "brooklyn.location.docker.strategy.MaxContainersPlacementStrategy” brooklyn.config: maxContainers: 16 -‐ $brooklyn:object: type: "brooklyn.location.docker.strategy.CpuUsagePlacementStrategy” brooklyn.config: maxCpu: 0.75
Container Management • Sources – Docker Image Defini1on
– Docker Hub – Dockerfile – Brooklyn En1ty Defini1on • Create Image Automa1cally
Container Management id: dockerfile-‐mysql name: "Docker Hub MySQL
Application" origin: "https://registry.hub.docker.com/_/mysql/" locations: -‐ my-‐docker-‐cloud services: -‐ serviceType: brooklyn.entity.container.docker.application.DockerfileApplication id: mysql name: "MySQL" brooklyn.config: docker.dockerfile.url: file://Users/grkvlt/Git/docker-‐library/mysql/5.6/ env: MYSQL_ROOT_PASSWORD: "s3cr3t"
Container Management • Installa1on of Services – Defined
by Brooklyn or Dockerfile – Common to all En1ty Instances • Commit Image – Available for next En1ty • Push Image – Available for all Hosts
Networking • Shared Weave LAN – Common to All
Containers – Private (Link Local) Addresses • Clocker Controls IP Alloca1on – Applica1ons Segmented by CIDR • Docker Port Forwarding Access
Networking • S1ll First Steps… • Name Resolu1on
– BIND and DNSmasq – Needed for JMX et al • Enables Many More En11es • But Needs Tested!
Demonstra3on
None
None
None
Roadmap Now • Improvements To Networking – DNS and
DNSmasq Integra1on – Work in Progress • Befer GeMng Started – Self Hos1ng on Localhost – Brooklyn Dockerfile
Roadmap Soon • Befer Integra1on with Repositories – Docker
Hub, Ar1factory, Quay.io – Private Repositories • Easier Applica1on Defini1on – Open Standard? – Kubernetes Pods?
Roadmap Next • Integra1on – Google Kubernetes – ClusterHQ
Flocker – Ar1factory • Improvements – Bootstrapping
Summary • Clocker – Brooklyn + Docker + Jclouds
+ Weave • Solves – Docker Networking – Container Placement – Applica1on Defini1on
Audience Ques1ons? 1. Where do you see Docker networking
going? 2. What about orchestra1on? 3. What features would be most useful to enhance Docker usability?
Thanks! Ques1ons?
Web Resources http://clocker.io/ http://brooklyn.io/ http://docker.io/ http://github.com/zettio/weave/
http://abstractvisitorpattern.co.uk/