Laravel Job Queueでバッチ運用した話

by Takayuki

Slide 1

Slide 1 text

Laravel Job QueueͰ όονӡ༻ͨ͠࿩ Laravel Job QueueͰ όονӡ༻ͨ͠࿩

Slide 2

Slide 2 text

3 όονӡ༻ͨ͠࿩ Agenda 2 Job Queueͱ͸ 1 ࣗݾ঺հ

Slide 3

Slide 3 text

1 ࣗݾ঺հ

Slide 4

Slide 4 text

4 ࣗݾ঺հ ◆໊લ ླ໦ ޹೭(Suzuki Takayuki) ◆ࣗݾ঺հ ɾ1990೥ɺਆಸ઒ݝੜ·Εɻ ɾࣾձਓʹͳ͔ͬͯΒɺϓϩάϥϛϯάΛ࢝ΊΔɻ ɾ2015೥ʹϑϧεϐʔυʹೖࣾ͠ɺ2017೥ʹϑϦʔϥ ϯεΛ΍ͬͨޙʹ2017೥11݄ʹԭೄͰىۀɻ ◆झຯ ίεϓϨɺԻָϥΠϒɺϚϥιϯେձʹग़Δɺ໺ٿ؍ ઓ ◆Twitter @kanbo0605

Slide 5

Slide 5 text

Slide 6

Slide 6 text

6 ࣗࣾWebαʔϏεͷ։ൃ ɾαʔϏε໊ Tadoru ɾγεςϜ֓ཁ Ϋϥ΢υιʔγϯά ΫϨδοτܾࡁ ͳͲ ɾ࢖͍ͬͯΔٕज़ ݴޠ : PHP,JavaScript ϑϨʔϜϫʔΫ: laravel5,Nuxt.jsͳͲ

Slide 7

Slide 7 text

2 Job Queueͱ͸

Slide 8

Slide 8 text

8 2 Job Queueͱ͸ δϣϒΩϡʔͱ͸δϣϒΛΩϡʔͰ؅ཧ͢ Δ΋ͷͰ͢ɻ Ωϡʔͱ͸FIFO(First In First Out)Λ࣮ݱ ͢Δσʔλߏ଄Ͱ͢ɻ Ωϡʔʹొ࿥͞ΕͨϞϊ͸ɺΩϡʔʹొ ࿥ͨ͠ॱʹॲཧ͞Ε·͢ɻ http://tech.voyagegroup.com/archives/495474.html

Slide 9

Slide 9 text

Slide 10

Slide 10 text

1 0

Slide 11

Slide 11 text

Slide 12

Slide 12 text

3 όονӡ༻ͨ͠࿩

Slide 13

Slide 13 text

1 3 γεςϜͷػೳཁ݅ ɾຖ೔ɺεΫϨΠϐϯάॲཧΛ࣮ߦ ɾεΫϨΠϐϯάͨ݁͠ՌΛGoogleεϓϨουγʔτʹॻ͖ࠐΉ ɾେྔͷॲཧ͕૸ΔͷͰɺPHPϝϞϦΤϥʔʹͳΔՄೳੑ͕ߴ͍ ɾεϓϨουγʔτͷ݁ՌΛຖ೔ɺόοΫΞοϓ͢Δ ɾεϓϨουγʔτͷ݁ՌΛຖ೔ɺϝʔϧͰૹΔ

Slide 14

Slide 14 text

1 4 શମߏ੒ εΫϨΠϐϯά αʔόαΠυ LaravelͷίϚϯ υΛ࣮ߦ औಘͨ͠σʔλΛ εϓϨουγʔτʹอଘ HTML DOM Perser ๭αΠτ εϓϨουγʔτ

Slide 15

Slide 15 text

cronͰຖே9࣌ʹ όον࣮ߦ Google ϫʔΧʔͰॱ࣮࣍ߦ εΫϨΠϐϯά ॲཧ GASͷAPIΛ࣮ߦ εΫϨΠϐϯά ͨ͠৘ใΛGASͷ ύϥϝʔλʹ֨ೲ Job εΫϨΠϐϯά ॲཧ GASͷAPIΛ࣮ߦ εΫϨΠϐϯά ͨ͠৘ใΛGASͷ ύϥϝʔλʹ֨ೲ Job Queue εΫϨΠϐϯά ॲཧ GASͷAPIΛ࣮ߦ εΫϨΠϐϯά ͨ͠৘ใΛGASͷ ύϥϝʔλʹ֨ೲ Job ϫʔΧʔ ࣮ߦ݁Ռͷ εςʔλε Λฦ٫ GASͷAPI Λ࣮ߦ εϓϨου γʔτॻ͖ ग़͠ Supervisor ϫʔΧʔ͕ࢮΜͩΒ ্ཱͪ͛௚͢ શମߏ੒ δϣϒΛ3ͭ࡞੒͠ ͨ৔߹

Slide 16

Slide 16 text

1 6 ࣮૷ͨ͠಺༰ ᶃεέδϡʔϥͷઃఆ ᶄόονίϚϯυΫϥεͷ࡞੒ ᶅδϣϒΩϡʔͷ࢓૊ΈΛ࣮૷ ᶆGASͰεϓϨουγʔτॻ͖ࠐΈͷॲཧΛ࣮૷ ᶇsupervisorͷઃఆ

Slide 17

Slide 17 text

1 7 ᶃεέδϡʔϥͷઃఆ Kernel.phpʹே9࣌ͰόονΛಈ ͘Α͏ʹઃఆ

Slide 18

Slide 18 text

1 8 ᶄόονίϚϯυΫϥεͷ࡞੒ ίϚϯυͰͷॲཧ ɾຊ೔෼ͷδϣϒΩϡʔΛ٧ΊΔ ɾલ೔෼ͷδϣϒͷ࣮ߦ݁ՌΛϝʔ ϧͰૹΔ

Slide 19

Slide 19 text

1 9 ᶅδϣϒΩϡʔͷ࢓૊ΈΛ࣮૷

Slide 20

Slide 20 text

2 0 ᶆGASͰεϓϨουγʔτॻ͖ࠐΈͷॲཧΛ࣮૷ PHP͔ΒύϥϝʔλΛऔಘ

Slide 21

Slide 21 text

2 1 ᶆGASͰεϓϨουγʔτॻ͖ࠐΈͷॲཧΛ࣮૷ ExcelϑΝΠϧΛ࡞੒ͯ͠ɺϝʔϧૹ৴

Slide 22

Slide 22 text

2 2 ᶆGASͰεϓϨουγʔτॻ͖ࠐΈͷॲཧΛ࣮૷ ExcelϑΝΠϧΛ࡞੒ͯ͠ɺGoogleυϥΠϒʹόοΫΞοϓ