月間数千億リクエストをさばく技術 (ArchitectureNight公開用)

by Kurochan

Slide 1

Slide 1 text

݄ؒ਺ઍԯϦΫΤετΛ͞͹ٕ͘ज़ גࣜձࣾαΠόʔΤʔδΣϯτΞυςΫຊ෦%ZOBMZTU  ࠇ࡚༏ଠ!LVSP@N

Slide 2

Slide 2 text

ࣗݾ঺հ w ࠇ࡚༏ଠ !LVSP@N w גࣜձࣾαΠόʔΤʔδΣϯτ  ΞυςΫຊ෦%ZOBMZTUόοΫΤϯυΤϯδχΞ w ೥৽ଔೖࣾ w ೖࣾҎདྷ%ZOBMZTUͷೖࡳ ഑৴ ܭଌ ूܭ෦෼ͷ։ൃ ΠϯϑϥΛ୲౰ w ˞ࡱӨ࿥Ի౤ߘېࢭͷϖʔδʹ͸ࠨ্ʹˣͷΞΠίϯΛೖΕͯ͋Γ·͢

Slide 3

Slide 3 text

%ZOBMZTUͱ͸

Slide 4

Slide 4 text

Πϯλʔωοτ޿ࠂͱ͸

Slide 5

Slide 5 text

αΠόʔΤʔδΣϯτʹ͓͚ΔΞυςΫ

Slide 6

Slide 6 text

35#ͷ͘͠Έ w 35#3FBM5JNF#JEEJOH 441 %41T

Slide 7

Slide 7 text

35#ͷ͘͠Έ w 8FCϖʔδ͕ϩʔυ͞Εɺ޿ࠂλά͕ൃՐ 441 %41T

Slide 8

Slide 8 text

35#ͷ͘͠Έ w ࿮৘ใ΍Ϣʔβ৘ใͱͱ΋ʹCJESFRVFTU͕͘Δ 441 %41T CJESFRVFTU

Slide 9

Slide 9 text

35#ͷ͘͠Έ w ೖࡳֹͱදࣔ͢Δ޿ࠂΛܾఆ 441 %41T "% "% "% CJESFRVFTU ԁ ԁ ԁ

Slide 10

Slide 10 text

35#ͷ͘͠Έ w 0QFO35#ͱ͍͏ϓϩτίϧͰೖࡳ 441 %41T "% "% "% ԁ ԁ ԁ

Slide 11

Slide 11 text

35#ͷ͘͠Έ w ೖࡳֹ͕Ұ൪ߴ͍ࣄۀऀ͕উར͢Δ 441 %41T "% "% "% ԁ ԁ ԁ XJO

Slide 12

Slide 12 text

35#ͷ͘͠Έ w 441ʹ޿ࠂΫϦΤΠςΟϒ͕ૹΒΕΔ 441 %41T "% "% "% ԁ ԁ ԁ "% XJO

Slide 13

Slide 13 text

35#ͷ͘͠Έ w 441ܦ༝Ͱམࡳͨ͠ࣄۀऀͷ޿ࠂ͕ల։͞ΕΔ 441 %41T "% "% "% ԁ ԁ ԁ "% XJO "%

Slide 14

Slide 14 text

35#ͷ͘͠Έ w ͜ΕΛߴ଎ʹ܁Γฦ͢ 441 %41T "% "% "% ԁ ԁ ԁ "% XJO "% औҾ͸NTҎ಺ʹ׬ྃ͠ͳ͚Ε͹ͳΒͳ͍

Slide 15

Slide 15 text

%ZOBMZTUͱ͸ w %ZOBNJD3FUBSHFUJOHGPS(BNFT w εϚϗήʔϜ޲͚޿ࠂ഑৴ϓϥοτϑΥʔϜ w τοϓηʔϧε!೔ຊͷεϚϗήʔϜͷதͰ΋ߴ͍γΣΞ w ೔ຊɺΞϝϦΧΛؚΉΧࠃʹ഑৴த w Ϣʔβ͝ͱʹ࠷దԽͨ͠޿ࠂΛ഑৴ IUUQXXXEZOBMZTUJP

Slide 16

Slide 16 text

޿ࠂΫϦΤΠςΟϒྫ ࡱӨ࿥Ի౤ߘېࢭ

Slide 17

Slide 17 text

݄ؒ਺ઍԯϦΫΤετΛ͞͹ٕ͘ज़

Slide 18

Slide 18 text

w "MM"84 w ओཁར༻ίϯϙʔωϯτ %ZOBMZTUͷΞʔΩςΫνϟ Amazon EC2 Amazon ECR Amazon ECS AWS Lambda Elastic Load Balancing Amazon S3 Amazon RDS Amazon DynamoDB Amazon ElastiCache Amazon Redshift Amazon CloudFront Amazon Route 53 AWS Direct Connect Amazon VPC Amazon CloudWatch AWS OpsWorks AWS Trusted Advisor IAM AWS Certificate Manager Amazon Athena Amazon EMR Amazon Kinesis AWS Data Pipeline Amazon SQS Amazon SNS Amazon SES Amazon WorkMail

Slide 19

Slide 19 text

%ZOBMZTUͷΞʔΩςΫνϟ w "MM"84 w BQOPSUIFBTU VTFBTUʹల։ w ౰ॳΑΓάϩʔόϧͳϓϩμΫτΛ໨ࢦ͍ͯͨ͠ͷͰ"84Λબ୒ w ໿ݸͷΞϓϦέʔγϣϯίϯϙʔωϯτͰߏ੒

Slide 20

Slide 20 text

%ZOBMZTUͷΞʔΩςΫνϟ ུ֓ BQOPSUIFBTU VTFBTU ೖࡳ഑৴ܥ ೖࡳ഑৴ܥ ܭଌܥ DBDIFDMVTUFS ूܭܥ DSPTTSFHJPOSFQMJDBUJPO DSPTTSFHJPOSFQMJDBUJPO DSPTTSFHJPOSFQMJDBUJPO ؅ཧը໘ DBDIFDMVTUFS όονܥ όονܥ

Slide 21

Slide 21 text

τϥϑΟοΫ֓گ ೔ຊͷೖࡳϦΫΤετඵ ΞϝϦΧͷೖࡳϦΫΤετඵ ೔ຊΞϝϦΧͷϨεϙϯελΠϜ NTFD

Slide 22

Slide 22 text

ͪͳΈʹ ࡱӨ࿥Ի౤ߘېࢭ ͋Δ೔ͷτϥϑΟοΫ

Slide 23

Slide 23 text

ͪͳΈʹ

Slide 24

Slide 24 text

ΠϯλʔωοττϥϑΟοΫ΋͍͍ͩͨ͜Μͳײ͡ IUUQXXXNGFFEDPKQTFSWJDFUSB⒏DIUNM

Slide 25

Slide 25 text

τϥϑΟοΫ֓گ w ͱ͋Δϲ݄ؒͷCJEϦΫΤετ਺ͷ߹ܭ

Slide 26

Slide 26 text

w DYMBSHF $( Y໿୆ ϐʔΫ 64 +1 w DΠϯελϯε˕ େྔͷτϥϑΟοΫΛड͚ΔͨΊʹ DBDIF 3%# TMBWF DBDIF 3%# TMBWF BQOPSUIFBTUB BQOPSUIFBTUD ,74 3%# NBTUFS BQOPSUIFBTU

Slide 27

Slide 27 text

4DBMBͱ͍͏બ୒ w %ZOBMZTUͰ͸΄΅શͯͷΞϓϦέʔγϣϯʹ4DBMBΛ࠾༻ w ΠϯλϏϡʔهࣄ͋Γ·͢ http://gihyo.jp/dev/serial/01/cyberagent/0063

Slide 28

Slide 28 text

4DBMBͱ͍͏બ୒ w 4DBMBΛબ୒ͨ͠ཧ༝ w νϟϨϯδ ࠓͱͳͬͯ͸ී௨ʁ w Մಡੑɺϝϯςφϯεੑ͕ߴ͍ w ϋΠύϑΥʔϚϯε w +BWBͷࢿ࢈͕࢖͑Δ w ΞυςΫελδΦ͸4DBMBͷ஌ݟͷմ X

Slide 29

Slide 29 text

4DBMBʹΑΔฒྻॲཧ w ฒྻॲཧ͕ॻ͖΍͍͢ w 'VUVSFͱ͍͏֓೦

Slide 30

Slide 30 text

4DBMBʹΑΔฒྻॲཧ w ฒྻॲཧ͕ॻ͖΍͍͢ w 'VUVSFͱ͍͏֓೦ w ྫ3%#͔Βෳ਺ͷςʔϒϧΛҾ͖ͭͭɺ%ZOBNP%#΋Ҿ͘ ಉ࣌ʹ໰͍߹Θͤͯ ฒྻʹϨεϙϯεΛड͚Δ NT NT NT ௚ྻॲཧNT  ฒྻॲཧNT

Slide 31

Slide 31 text

ϩά͸શͯ,JOFTJTʹྲྀ͢ w ೖࡳ΍ܭଌͷϩά͸શͯ,JOFTJT4USFBNTʹྲྀ͢ w 8"1αʔό͸ϨεϙϯεΛฦ͢͜ͱ͚ͩʹूத w ֦ுੑ΍଱ো֐ੑͷ޲্ %#VQEBUFDPOTVNFS MPHBSDIJWFDPOTVNFS VQEBUF BSDIJWF ,JOFTJT4USFBNT DPOTVNF QSPEVDFMPHT BQQTFSWFS %ZOBNP%# 4 1SPEVDFS 4USFBN $POTVNFS

Slide 32

Slide 32 text

1SPEVDFS w ΞϓϦέʔγϣϯαʔό͕ు͍֤ͨछϩάΛ,JOFTJTʹ౤͛Δ ,JOFTJT4USFBNT qVFOUQMVHJOLJOFTJT BQQTFSWFS 1SPEVDFS 4USFBN

Slide 33

Slide 33 text

,JOFTJT1SPEVDFS-JCSBSZ w ,1-ͰτϥϑΟοΫઅ໿ w ,JOFTJTͷ੍໿γϟʔυ͋ͨΓ SFDPSE165TFDPS.#T w ਺,#ͷϩάΛେྔʹసૹ͢Δʹ͸΋͍ͬͨͳ͍ w ,1-Ͱ,JOFTJTϨίʔυʹෳ਺ϝοηʔδΛ٧ΊࠐΉ QSPUPDPMCV⒎FST https://speakerdeck.com/kanny/logging-architecture-at-cookpad

Slide 34

Slide 34 text

$POTVNFS w ,JOFTJT͔ΒϨίʔυΛऔΓग़͢ w DPOTVNFSΛ૿΍ͤ͹εέʔϧΞ΢τՄೳ ,JOFTJT4USFBN BQQTFSWFS $POTVNFS 4USFBN %ZOBNP%#

Slide 35

Slide 35 text

,JOFTJT$POTVNFS-JCSBSZ w ,1-Ͱू໿ͨ͠ϨίʔυΛల։ͯ͘͠ΕΔ w XPSLFSຖͷ୲౰γϟʔυͷௐఀػೳ %ZOBNP%#Λར༻ ,JOFTJT4IBSET BQQTFSWFS $POTVNFS 4USFBN %ZOBNP%#

Slide 36

Slide 36 text

,JOFTJT$POTVNFS-JCSBSZ w ,1-Ͱू໿ͨ͠ϨίʔυΛల։ͯ͘͠ΕΔ w XPSLFSຖͷ୲౰γϟʔυͷௐఀػೳ %ZOBNP%#Λར༻ ,JOFTJT4IBSET BQQTFSWFS $POTVNFS 4USFBN %ZOBNP%# ো֐ൃੜ

Slide 37

Slide 37 text

,JOFTJT$POTVNFS-JCSBSZ w ,1-Ͱू໿ͨ͠ϨίʔυΛల։ͯ͘͠ΕΔ w XPSLFSຖͷ୲౰γϟʔυͷௐఀػೳ %ZOBNP%#Λར༻ ,JOFTJT4IBSET BQQTFSWFS $POTVNFS 4USFBN %ZOBNP%# ࣗಈ࠶ׂΓ౰ͯ

Slide 38

Slide 38 text

Ϣʔβσʔλͷѻ͍ w ޿ࠂ༻୺຤*% *%'" "EWFSUJTJOH*% ͱϢʔβσʔλͷ૊Έ߹Θͤ w ྫ࠷ޙʹϩάΠϯͨ͠೔࣌ˠະϩάΠϯظ͕ؒΘ͔Δ w ޿ࠂೖࡳ࣌ʹେྔʹSFBE͕͞ΕΔͷͰਫฏεέʔϧͯ͠ཉ͍͠ w Ϩίʔυ਺਺ඦԯϨίʔυ w αϯϓϧςʔϒϧ ௒؆ུԽ %&7*$&@*% "%7&35*4&3@*% %&7*$&@5:1& -"45@-0(*/@"5 015065@"5 ʜʜ %&7*$&@ "OESPJE ʜʜ %&7*$&@ "OESPJE ʜʜ %&7*$&@ J04 ʜʜ %&7*$&@ "OESPJE ʜʜ

Slide 39

Slide 39 text

Ϣʔβσʔλͷѻ͍ w ,74ͱͯ͠%ZOBNP%#Λ࠾༻ w )BTI,FZͱ3BOHF,FZΛ૊Έ߹ΘͤΔ w )BTI,FZͰҾ͚͹3BOHF,FZͰιʔτ͞Εͨෳ਺Ϩίʔυ͕ฦΔ %&7*$&@*% "%7&35*4&3@*% %&7*$&@5:1& -"45@-0(*/@"5 015065@"5 ʜʜ %&7*$&@ "OESPJE ʜʜ %&7*$&@ "OESPJE ʜʜ %&7*$&@ J04 ʜʜ %&7*$&@ "OESPJE ʜʜ )BTI,FZ 3BOHF,FZ

Slide 40

Slide 40 text

ϗοτύʔςΟγϣϯ໰୊ w ಛఆͷύʔςΟγϣϯʹΞΫηε͕ภΓɺύϑΥʔϚϯε͕ग़ͳ͍

Slide 41

Slide 41 text

ϗοτύʔςΟγϣϯ໰୊ w ,74ͷ໋॓ w ಛఆͷύʔςΟγϣϯʹ3FBE8SJUF͕ภΔͱੑೳ͕ग़ͳ͍ w ϗοτσʔλͱίʔϧυσʔλΛࠞͥͳ͍ w ৽͍͠σʔλΞΫηε͞Ε΍͍͢ ݹ͍σʔλΞΫηε͞Εʹ͍͘ w ରࡦ w σʔλ͕ొ࿥͞Εͨ࣌ظ͝ͱʹςʔϒϧΛ෼͚Δ w ҰఆظؒΞΫηε͞Εͳ͍σʔλ͸࡟আ͢Δ OPEF OPEF OPEF ৽͍͠σʔλ ݹ͍σʔλ ଟ͍ গͳ͍ ී௨ ΞΫηεྔ

Slide 42

Slide 42 text

%ZOBNP%#ͷΩϟογϡ w Ωϟογϡͷಋೖ w ϨΠςϯγͷ࡟ݮ w %ZOBNP%#3FBE$BQBDJUZͷ࡟ݮ w ϗοτύʔςΟγϣϯ໰୊ͷ؇࿨ w &MBTUJ$BDIF NFNDBDIFE Λ࠾༻ w γϯϓϧɾߴ଎ w ϚϧνεϨουͰಈ͘ w SܥΠϯελϯε͸ωοτϫʔΫଳҬ͕(CQT·ͰόʔετՄೳ w IUUQTEFWDMBTTNFUIPEKQDMPVEBXTFDSOFUXPSLJOH %ZOBNP%# NFNDBDIFE BQQ

Slide 43

Slide 43 text

%ZOBNP%#ͷΩϟογϡ w Ωϟογϡظ͕ؒ௕͍ͱϢʔβͷঢ়ଶมԽ͕͙͢ʹ൓ө͞Εͳ͍ w Ϣʔβͷঢ়ଶΛར༻ͨ͠޿ࠂ͕΢ϦͳͷͰଈ࣌൓ө͍ͤͨ͞ w %ZOBNP%#4USFBNT-BNCEB'VODUJPOͰΩϟογϡͷ࡟আ w %ZOBNP%#"DDFMFSBUPS͸ΫΤϦΩϟογϡ͸ࣗಈߋ৽͞Εͳ͍ w ݱঢ়͸ࣗલͰ࣮૷͢Δ͔͠ͳ͍ %ZOBNP%# 61%"5& %ZOBNP%#4USFBNT %&-&5&

Slide 44

Slide 44 text

w ϦΫΤετΛड͚͚ͨͩͰ͸μϝɺूܭ͕ඞཁ w ϩάͷྔ5#EBZ w "QBDIF4QBSLPO"NB[PO&.3 w ΫϥελίϯϐϡʔςΟϯάϑϨʔϜϫʔΫ w ෼ࢄڞ༗ϝϞϦϞσϧ w ϊʔυΛ૿΍͢͜ͱͰεέʔϧ͢Δ w 4QBSL.-JCͱ͍͏ػցֶशϥΠϒϥϦ΋ &.3$MVTUFS .BTUFS 4MBWF 4MBWF 4MBWF 4MBWF ϩάूܭ

Slide 45

Slide 45 text

ϩάूܭ w "QBDIF4QBSLPO&.3 w ෳࡶͳूܭॲཧ͕ॻ͚Δ w ྫ୯७ͳ࣌ؒY޿ࠂओͷ  ΫϦοΫ਺ूܭ 42-Ͱॻ͍ͨ৔߹ 4QBSLͰॻ͍ͨ৔߹

Slide 46

Slide 46 text

ϋΠύϑΥʔϚϯεͰ৴པੑͷඞཁͳ  γεςϜΛӡ༻͢ΔͨΊʹ

Slide 47

Slide 47 text

ͳͥ৴པੑ͕ٻΊΒΕΔͷ͔ w ҰൠతͳαʔϏε ϝσΟΞ ήʔϜ w αʔϏεఏڙ͕Ͱ͖ͳ͍ˠϢʔβͷ཭୤ ऩӹ௿Լ w ޿ࠂ഑৴αʔϏε w ޿ࠂ͕഑৴Ͱ͖ͳ͍ˠػձଛࣦ ޿ࠂओͷ཭୤ ऩӹ௿Լ w ޿ࠂ͕഑৴͞Εͳͯ͘΋Ϣʔβʹରͯ͠͸Өڹ͕ͳ͍ %ZOBMZTU Ϣʔβ ޿ࠂओ ൃ஫ ഑৴

Slide 48

Slide 48 text

ͳͥ৴པੑ͕ٻΊΒΕΔͷ͔ w αʔϏε͕੒௕͠ച্ͷن໛͕͕͖͋ͬͯͨˠച্ͷॏཁ౓͸มΘΒͳ͍ w ച্ສԁ೔Ͱ࣌ؒ഑৴ఀࢭສԁͷଛࣦ w ച্ ສԁ೔Ͱ࣌ؒ഑৴ఀࢭ ສԁͷଛࣦ w γεςϜن໛΋େ͖͘ͳΔͱ w ো֐ͷӨڹ΋େ͖͘ͳ͖ͬͯͨ w ҰํίετΧοτͷҖྗ΋େ͖͘ͳ͖ͬͯͨ

Slide 49

Slide 49 text

ߴ͍৴པੑ͸ઃܭ͕શͯ w ୯Ұো֐఺Λ࡞Βͳ͍ w Ϋϥ΢υΛ࢖ͬͯΔͳΒΫϥ΢υωΠςΟϒͳϕετϓϥΫςΟεʹدͤΔ w ΞϓϦ͸Ͱ͖Δ͚ͩεςʔτϨεʹ w εςʔτΛ࣋ͭ෦෼ΛϚωʔδυαʔϏεʹدͤΔ w ιϦϡʔγϣϯΞʔΩςΫτʹ૬ஊ͢Δ w ͱ͸͍͑ෆଌͷࣄଶ͸ى͜Δʜ w ෮چ؇࿨ͷͨΊͷखஈ͸༻ҙ͢Δ΂͖

Slide 50

Slide 50 text

؂ࢹ w %ZOBMZTUͰ͸؂ࢹʹ%BUBEPHΛར༻ w l%ZOBMZTU%BUBEPHzͰݕࡧ

Slide 51

Slide 51 text

؂ࢹ

Slide 52

Slide 52 text

؂ࢹ w ޿ࠂओ͝ͱͷ഑৴ϝτϦΫε

Slide 53

Slide 53 text

ϦΫΤετ͕٧·ͬͯ͠·ͬͨ࣌ w Ұ࣌తʹϨεϙϯε͕٧·Δͱʜ w αʔόʹϦΫΤετ͕ཷ·Δ w ಉ࣌ॲཧϦΫΤετ਺͕രൃ͢Δ w εϨουϓʔϧΛա৒ʹ࢖͏ w Ϩεϙϯε଎౓ͷେ෯ѱԽ w ॲཧΛ࢝Ί͔ͯΒҰఆ࣌ؒܦաͨ͠ॲཧΛதஅͯ͠ೖࡳ͠ͳ͍ w ೖࡳ͠ͳ͍)551 /P$POUFOU Λฦ͢ w 4DBMBͳΒͦ͏͍͏ॲཧ΋ॻ͖΍͍͢ʂ

Slide 54

Slide 54 text

ύϑΥʔϚϯεௐࠪ w :PVS,JU ঎༻+BWBϓϩϑΝΠϥ ΛѪ༻

Slide 55

Slide 55 text

ࠓޙ

Slide 56

Slide 56 text

ࠓޙ΍͍͖͍ͬͯͨ͜ͱ w 4DIFEVMFE4DBMJOH"VUP4DBMJOH w "LLB)551 w "LLB4USFBNΛར༻ͨ͠ॲཧ #BDL1SFTTVSFͱ͔ w Ωϟογϡ %#૚ͷ"VUP4DBMJOH w ϏϧυϦϦʔεͷߴ଎Խ w &&ςετͷಋೖ w ͳͲͳͲʜ

Slide 57

Slide 57 text

͋Γ͕ͱ͏͍͟͝·ͨ͠