吉祥寺.pm 16 LT
伱ؒՈ۩OSSͷ͢͢Ί@fujiwara2018.11.22 ٢ࣉ.pm16
View Slide
ࣗݾհ@fujiwaragithub.com/fujiwara
伱ؒՈ۩OSSͱΫϥυɺϚωʔδυαʔϏεͷ伱ؒΛຒΊΔͷϚωʔδυαʔϏε࠷ॳίΞػೳͰϦϦʔε͞Ε(ཁΛऔΓೖΕͳ͕Β) ঃʑʹػೳ͕૿͍͑ͯ͘αʔϏεؒͷ࿈ܞɺࠣͳศརػೳޙճ͠ʹ͞Ε͕ͪ ← 伱ؒ
伱ؒՈ۩Λࣗ࡞͢Δ伱ؒΛຒΊΔπʔϧɺϛυϧΣΞΛ։ൃͯ͠ӡ༻վળখ͘͞ɺదʹ൚༻తͳͷΛ࡞ΔຊՈ͕伱ؒΛຒΊͨΒࣺͯΒΕΔཻͰ࡞Δ
伱ؒͷྫRedshift ʹσʔλΛऔΓ͜ΉʹS3͔Βͷίϐʔ͕ඞਢ2012ʹϦϦʔεޙ͠Β͘S3͔ΒܧଓతʹऔΓ͜ΉϚωʔδυαʔϏεͳ͔ͬͨ
伱ؒՈ۩ͷྫRin github.com/fujiwara/RinRedshift data Importer by SQSmessaging.S3 Πϕϯτ௨Ͱ SQS ʹૹ৴SQS ͷϝοηʔδ͔Β Redshiftʹ copyͯ͠औΓࠐΈΛߦ͏πʔϧ2015.05 ʹ։ൃ
5ϲ݄ޙ 伱͕ؒຒ·ͬͨ2015.10 Kinesis Firehose ൃදͨͩ͠ Tokyo ʹདྷͨͷ 2017.07
Before / AfterFluentd ͔ΒϩάΛૹ৴㱺 S3 / Redshift ʹॱ࣍औΓ͜·ΕΔͱ͍͏ߏͦͷ··Ϛωʔδυʹ
OSS ͱͯ͠࡞ΔOSS ʹͯ͠͠·͏(ԾʹࣗΒ͔͠Θͳͯ͘)ͳͥࣾπʔϧͰͳ͘ OSS ?
OSS ͱͯ͠࡞Δཧ༝(1)υΩϡϝϯτΛॻ͘ؾʹͳΔREADME ͙Β͍ؤுͬͯॻ͘ϞνϕʔγϣϯʹͳΔ
OSS ͱͯ͠࡞Δཧ༝(2)աͳࣾࣄͷࠞೖΛ͙ʮࣾ/ͦͷϓϩδΣΫτҎ֎ʹҙຯ͕͋Δػೳͳͷ͔?ʯքΛݟۃΊΔ͜ͱͰকདྷ֎͘͢͠ͳΔઃܭ͕͖Ε͍ʹͳΔ
OSS ͱͯ͠࡞Δཧ༝(3)ຐվ൛͕૿৩͢ΔͷΛ͙ʮGitHubͰόΠφϦఏڙͯ͠ΔͷͰͦΕΛ͍ͬͯͩ͘͞ʯʮCPANϞδϡʔϧʹͳͬͯΔͷͰΠϯετʔϧ͍ͯͩ͘͠͞ʯಠཱͨ͠ύοέʔδʹͳͬͯͳ͍ͱίϐϖ͞ΕΔίϐϖޙʹվ͞ΕΔͱ৽ػೳόάϑΟοΫεैͰ͖ͳ͍