goodby-waiting-status-forever
by
Tatsuro Mitsuno
Link
Embed
Share
Beginning
This slide
Copy link URL
Copy link URL
Copy iframe embed code
Copy iframe embed code
Copy javascript embed code
Copy javascript embed code
Share
Tweet
Share
Tweet
Slide 1
Slide 1 text
© 2017 VASILY,Inc. શͯͷ“Waiting”Λ ੜ·ΕΔલʹফ͠ڈΓ͍ͨɻ Mesos Meetup Tokyo #3 2017/11/01 Wed. Tatsuro MITSUNO
Slide 2
Slide 2 text
© 2017 VASILY,Inc. ࣗݾհ ▸ Tatsuro Mitsuno / ޫ ୡ࿕ ▸ 2012/04 Yahoo Japan Corporation ▸ 2016/04 VASILY, Inc. ▸ Infrastructure Engineer ▸ Twitter GitHub Qiita: @kotatsu360 Icon illustrated by YOSHI https://ja-jp.facebook.com/yoshi.yone.7 Yukihiro "Matz" Matsumoto (VASILY technical advisor )
Slide 3
Slide 3 text
© 2017 VASILY,Inc. Mesos Meetup Tokyo #2 ʹͯ https://speakerdeck.com/kotatsu360/apache-mesos-with-amazon-ec2-spotfleet Apache Mesos ͱ Amazon EC2 SpotFleetͰߏங͞Εͨ ฐࣾͷΫϩʔϥʔج൫ʹ͍ͭͯ͝հ͠·ͨ͠ɻ
Slide 4
Slide 4 text
© 2017 VASILY,Inc. VASILYͷΫϩʔϥʔج൫ scaling request control SpotFleet Instance scaling request Lambda CloudWatch / CloudWatch Event update request
Slide 5
Slide 5 text
© 2017 VASILY,Inc. ຊͷςʔϚ Marathonͷ“Waiting”Λղܾ͢Δ ͜Ε
Slide 6
Slide 6 text
© 2017 VASILY,Inc. Waitingͱ ▸ Marathon͕λεΫʹඞཁͳϦιʔεΛ֬อͰ͖ͳ͍ঢ়ଶ ▸ ެࣜυΩϡϝϯτͷτϥϒϧγϡʔςΟϯάͷୈҰ߲ An app stays in “Waiting” forever ▸ ୭͕ૺ۰͢Δ ▸ ࣌ؒܦաͰղܾ͠ͳ͍ ▸ ղܾํ๏ɿෆ͍ͯ͠ΔϦιʔεΛಛఆͯ͠ɺՃɾ։์
Slide 7
Slide 7 text
© 2017 VASILY,Inc. Waitingͷ ▸ ͲͷϦιʔε͕ෆ͍ͯ͠Δ͔Θ͔Βͳ͍ɾɾɾ ▸ ϝϞϦɾCPUɾϙʔτɾetc,,, ▸ Mesos͕֬อՄೳͳϦιʔεશ͕ͯݪҼʹͳΓ͏Δ ▸ ͔͠͠ɺز͔ͭͷ͋Γ͕ͪͳύλʔϯʹྨՄೳ ▸ ຊ͝հ͢Δͷ࣮ࡍʹࢲ͕ૺ۰ͨ͠Waitingͱͦͷରࡦ
Slide 8
Slide 8 text
© 2017 VASILY,Inc. Waitingͦͷ1ɿΫϥελϦιʔεΓͯ·͔͢ʁ
Slide 9
Slide 9 text
© 2017 VASILY,Inc. Waitingͦͷ1ɿΫϥελϦιʔεΓͯ·͔͢ʁ ݪҼɿλεΫ͕͏Ϧιʔε > MesosΫϥελͷۭ͖Ϧιʔε ֬ೝɿλεΫ͕ඞཁͱ͢ΔϝϞϦCPUΛܭࢉͯ͠ɺMesos UIͰۭ͖Λ֬ೝ ରࡦɿMesosΫϥελΛ૿͢ɾλεΫͷׂྔΛݮΒ͢ λεΫA ϝϞϦ512M ϝϞϦ 2048M ʮ2560M֬อʯ ʮϝϞϦΒͳ͍ʯ λεΫA ϝϞϦ512M λεΫA ϝϞϦ512M λεΫA ϝϞϦ512M λεΫA ϝϞϦ512M λεΫAΛ5ݸ ϝϞϦ512M Waiting
Slide 10
Slide 10 text
© 2017 VASILY,Inc. Waitingͦͷ2ɿλεΫͷ੍ຬͨͯ͠·͔͢ʁ
Slide 11
Slide 11 text
© 2017 VASILY,Inc. Waitingͦͷ2ɿλεΫͷ੍ຬͨͯ͠·͔͢ʁ ݪҼɿ੍͖ͭλεΫͷ੍͕ຬͨͤͳ͍ ֬ೝɿλεΫͷ੍͕ຬͨ͞Ε͍ͯΔ͔ݟ͢ʢಛʹϢχʔΫ੍ʣ ରࡦɿϊʔυΛ૿͢ λεΫA ϝϞϦ512M λεΫA ϝϞϦ512M λεΫA ϝϞϦ512M λεΫA ϝϞϦ512M λεΫA ϝϞϦ512M λεΫBΛ5ݸ Constraints = hostname, unique Waiting ΤʔδΣϯτ ʮ1λεΫ/1ϗετʯ ʮϗετΓͳ͍ʯ ΤʔδΣϯτ ΤʔδΣϯτ ΤʔδΣϯτ
Slide 12
Slide 12 text
© 2017 VASILY,Inc. Waitingͦͷ2ѥछɿϦιʔεยدͬͯແ͍Ͱ͔͢ʁ ݪҼɿ੍͖ͭλεΫ͕͏Ϧιʔε>ಛఆϗετͷۭ͖Ϧιʔε ֬ೝɿλεΫ͕ಛఆͷϗετʹยدͬͯͳ͍͔ʢكͳঢ়گʣ ରࡦɿఆظతʹλεΫΛϦελʔτ͢Δɾ੍͖ͭλεΫΛेʹখ͘͢͞Δ λεΫA ϝϞϦ512M λεΫA ϝϞϦ512M λεΫBΛ2ݸ Constraints = hostname, unique Waiting ʮ1λεΫ/1ϗετʯ ʮ1ͰϝϞϦΓͳ͍ʯ ΤʔδΣϯτ ϝϞϦ༻ 90% ΤʔδΣϯτ ϝϞϦ༻ 20%
Slide 13
Slide 13 text
© 2017 VASILY,Inc. Waitingͦͷ3ɿϦιʔεͷ༻ڐՄ͋Γ·͔͢ʁ
Slide 14
Slide 14 text
© 2017 VASILY,Inc. Waitingͦͷ3ɿϦιʔεͷ༻ڐՄ͋Γ·͔͢ʁ ݪҼɿλεΫ͕͏ϙʔτͷ༻ڐՄ͕ͳ͍ ֬ೝɿλεΫ͕ಛผͳϦιʔεΛΘͳ͍͔֬ೝ ରࡦɿλεΫʹrequirePortsɺagentϓϩηεʹresourcesΦϓγϣϯΛՃ https://mesosphere.github.io/marathon/docs/troubleshooting.html#requiring-a-specific-host-port Waiting λεΫCΛ1ͭ ϗετϙʔτ80Λ༻ ʮ80ϙʔτʯ ʮڐՄແ͠ʯ σϑΥϧτઃఆͷ mesos-agentϓϩηε
Slide 15
Slide 15 text
© 2017 VASILY,Inc. Waitingͦͷ3ѥछɿطଘλεΫ͕ར༻͍ͯ͠·ͤΜ͔ʁ ݪҼɿ৽نλεΫ͕͍͍ͨϙʔτΛطଘλεΫ͕όΠϯυࡁΈ ֬ೝɿൃੜλΠϛϯάɻσϓϩΠ࣌ͳΒϙʔτ͕͔ͪ߹͍ͬͯΔՄೳੑ ରࡦɿupgradeStrategyͰɺminimumHealthCapacityͱmaximumOverCapacityʹ0Λࢦఆ ʢ৽نλεΫͷσϓϩΠલʹطଘλεΫ͕kill͞ΕΔʣ Waiting λεΫCΛ1ͭ ϗετϙʔτ80Λ༻ ʮ80ϙʔτʯ ʮ༻தʯ λεΫC ʢrunningʣ
Slide 16
Slide 16 text
© 2017 VASILY,Inc. ·ͱΊ ▸ λεΫ͕ඞཁͱ͢Δ֤छϦιʔε͕֬อͰ͖ͳ͍߹ɺWaitingʹͳΔ ▸ දతͳWaitingύλʔϯ ▸ ϝϞϦɾCPU͕Γͳ͍ ▸ ੍͕ຬͨͤͳ͍ ▸ ಛఆͷϦιʔεΛ͏ݖݶ͕ͳ͍ ▸ దͳϦιʔεͱಉ࣌ʹɺλεΫࣗମͷݟ͠ ▸ ੍ϗετϙʔτ͕ඞཁͳ͍λεΫͰ͋Εࣗવʹ͑Δ
Slide 17
Slide 17 text
© 2017 VASILY,Inc. We are Hiring https://www.wantedly.com/companies/vasily