Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Recap: KubeCon+CloudNativeCon 2021 NA / Kubernetes Meetup Tokyo #47

Recap: KubeCon+CloudNativeCon 2021 NA / Kubernetes Meetup Tokyo #47

Kubernetes Meetup Tokyo #47のRecapです
YouTube: https://youtu.be/fvxp8bUOgtI?t=1893
Event: https://k8sjp.connpass.com/event/229659/

Aya (Igarashi) Ozawa

November 26, 2021
Tweet

More Decks by Aya (Igarashi) Ozawa

Other Decks in Technology

Transcript

  1. Interesting Points Event-oriented Common Bug Patterns • ͸͡Ίͯίϯτϩʔϥ࣮૷ͯ͠ ͍ͨ࣌ʹ೰ΜͩΑ͏ͳɺϋϚΓ ͕ͪͳϙΠϯτ͕ύλʔϯͱ͠

    ͯݴޠԽ͞Ε͍ͯΔ • πʔϧΛ࢖Θͳͯ͘΋͓֮͑ͯ ͘ͱ࣮૷ͷ࣌ʹࢀߟʹͳΔ͸ͣ (Chaos tool) Inject Fault = Bug!! Find Diff
  2. Bug Pattern 2 Atomicity Violation https://github.com/rabbitmq/cluster-operator/issues/782 όάͷྫ: Reconcileͷ్தͰ༧ظͤ͵Τϥʔ ΍ఀࢭ͕ىͬͯ͜΋࠶։Ͱ͖ΔΑ ͏ʹ࣮૷͢Δ

    Reconcile͕׬ྃ͢Δલʹίϯτ ϩʔϥ͕ఀࢭͯ͠ɺϦιʔε͕த ్൒୺ͳঢ়ଶʹͳΔύλʔϯ 1. Extend PVC volume to 2Gi 2. Delete STS 3. Crash controller 4. restart controller 5. Create New STS reference 1Gi PVC
  3. Bug Pattern 3 Time Traveling https://jira.percona.com/browse/K8SPXC-716 HAߏ੒ͷΫϥελʹ͓͍ͯɺίϯ τϩʔϥͷ࠶ىಈ࣌ʹݹ͍Ϧιʔ εΛऔಘͯ͠όάʹͳΔύλʔϯ Ϧιʔεͷόʔδϣϯ΍ґଘؔ܎

    (OwnerReference)͕ਖ਼͍͔͠ͳͲ ॲཧલͷόϦσʔγϣϯʹ஫ҙ όάͷྫ: 1. Create Cluster w/ same ID 2. Receive old event Reference invalid STS...