伱ؒՈ۩OSSͷ͢͢Ί @fujiwara 2018.11.22 ٢঵ࣉ.pm16

ࣗݾ঺հ @fujiwara github.com/fujiwara

伱ؒՈ۩OSSͱ͸ Ϋϥ΢υɺϚωʔδυαʔϏεͷ伱ؒΛຒΊΔ΋ͷ ϚωʔδυαʔϏε͸࠷ॳ͸ίΞػೳͰϦϦʔε͞Ε (ཁ๬ΛऔΓೖΕͳ͕Β) ঃʑʹػೳ͕૿͍͑ͯ͘ αʔϏεؒͷ࿈ܞɺࠣ຤ͳศརػೳ͸ޙճ͠ʹ͞Ε͕ͪ ← 伱ؒ

伱ؒՈ۩Λࣗ࡞͢Δ 伱ؒΛຒΊΔπʔϧɺϛυϧ΢ΣΞΛ։ൃͯ͠ӡ༻վળ খ͘͞ɺద౓ʹ൚༻తͳ΋ͷΛ࡞Δ ຊՈ͕伱ؒΛຒΊͨΒࣺͯΒΕΔཻ౓Ͱ࡞Δ

伱ؒͷྫ Redshift ʹσʔλΛऔΓ͜Ήʹ͸ S3͔Βͷίϐʔ͕ඞਢ 2012೥ʹϦϦʔεޙ͠͹Β͘ S3͔ΒܧଓతʹऔΓ͜Ή ϚωʔδυαʔϏε͸ͳ͔ͬͨ

伱ؒՈ۩ͷྫ Rin github.com/fujiwara/Rin Redshift data Importer by SQS messaging. S3 Πϕϯτ௨஌Ͱ SQS ʹૹ৴ SQS ͷϝοηʔδ͔Β Redshiftʹ copy ͯ͠औΓࠐΈΛߦ͏πʔϧ 2015.05 ʹ։ൃ

5ϲ݄ޙ 伱͕ؒຒ·ͬͨ 2015.10 Kinesis Firehose ൃද ͨͩ͠ Tokyo ʹདྷͨͷ͸ 2017.07

Before / After Fluentd ͔ΒϩάΛૹ৴㱺 S3 / Redshift ʹॱ࣍औΓ͜·ΕΔ ͱ͍͏ߏ଄͸ͦͷ··Ϛωʔδυʹ

OSS ͱͯ͠࡞Δ OSS ʹͯ͠͠·͏ (Ծʹࣗ෼Β͔͠࢖Θͳͯ͘΋) ͳͥࣾ಺πʔϧͰ͸ͳ͘ OSS ?

OSS ͱͯ͠࡞Δཧ༝(1) υΩϡϝϯτΛॻ͘ؾʹͳΔ README ͙Β͍͸ؤுͬͯॻ͘ϞνϕʔγϣϯʹͳΔ

OSS ͱͯ͠࡞Δཧ༝(2) ա౓ͳࣾ಺ࣄ৘ͷࠞೖΛ๷͙ ʮࣾ಺/ͦͷϓϩδΣΫτҎ֎ʹҙຯ͕͋Δػೳͳͷ͔?ʯ ੹೚෼ք఺ΛݟۃΊΔ͜ͱͰকདྷ֎͠΍͘͢ͳΔ ઃܭ͕͖Ε͍ʹͳΔ

OSS ͱͯ͠࡞Δཧ༝(3) ຐվ଄൛͕૿৩͢ΔͷΛ๷͙ ʮGitHubͰόΠφϦఏڙͯ͠ΔͷͰͦΕΛ࢖͍ͬͯͩ͘͞ʯ ʮCPANϞδϡʔϧʹͳͬͯΔͷͰΠϯετʔϧ͍ͯͩ͘͠͞ʯ ಠཱͨ͠ύοέʔδʹͳͬͯͳ͍ͱίϐϖ͞ΕΔ ίϐϖޙʹվ଄͞ΕΔͱ৽ػೳ΍όάϑΟοΫε௥ैͰ͖ͳ͍