ͭΒ͘ͳ͍"JSGMPXʹΉ͚ͯ .BDIJOF
-FBSOJOH
1SPEVDUJPO
1JUDI
 .BZ
UI
 ,FOKJ
:BNBVDIJ
!
-*/&
$PSQ 

ࣗݾ঺հ ,FOKJ
:BNBVDIJ
ࢁ಺ ݈ೋ • 4PGUXBSF
&OHJOFFS
!
-*/&
$MPWB 7"։ൃνʔϜ • Ի੠ೝࣝνʔϜ • ᑹܗจࣈͱ͔͕޷͖Ͱ͢ 

ࠓ೔࿩͍ͨ͜͠ͱ • ॴଐνʔϜͰͷ"JSGMPXΛ༻͍ͨ.-ϫʔΫϑϩʔ։ൃ ӡ༻ঢ়گ • ݱߦͷ"JSGMPX؀ڥͷ࣮૷ɾӡ༻ͷվળʹ޲͚ͯ ߦ͍ͬͯΔ಺༰ 

"HFOEB • ݱߦͷ"JSGMPX؀ڥ • ؀ڥվળʹ޲͚ͨऔΓ૊Έ • ΞʔΩςΫνϟվળ • %"(ʹର͢Δςετͷಋೖ 

ݱߦͷ"JSGMPX؀ڥ 

"JSGMPX • 044ͷXPSLGMPXΤϯδϯ • 1ZUIPOͰ%"( ༗޲ඇ८ճάϥϑ Ͱґଘ͢Δ5BTL܈ ͷؔ܎Λఆٛͯ͠XPSLGMPXΛ࣮૷ • ඪ४(6*͔ΒͰ͖ΔɾՄࢹԽͰ͖Δ߲໨͕ଟ͍ • 1MVHJOͰ(6*΋ؚΊ֦ͯு͕Ͱ͖ΔͷͰɺ ଍Γͳ͍ػೳ͕͋ͬͯ΋࠷ѱࣗ࡞Ͱ͖Δ 

ಋೖ·ͰͷܦҢ • ৽͘͠.-Ϟσϧͷσʔλ੔ܗʙQVCMJTI·ͰΛ แׅతʹ࣮૷͢ΔҊ͕݅ൃੜ • ཁ݅తʹґଘੑͷ͋Δ5BTLΛ૊Έ্࣮͛ͯ૷͢Δඞཁ ͕͋ΓɺXPSLGMPXΤϯδϯͷಋೖΛܾఆ 8PSLGMPXྫ • िͰSBXσʔλΛऔಘͯ͠੔ܗޙֶशʙධՁ • Ϟσϧͷ࣮૷͕มΘͬͯ΋ֶशʙධՁ • ϞσϧΛར༻͍ͯ͠Δπʔϧͷมߋ͕͋ͬͯ΋&&ͰධՁ 

ΞʔΩςΫνϟશମ PostgreSQL (Airflow Backend)

Workers Web Server Celery Scheduler Airflow Redis (Celery Broker) DAGs Playbooks Bucket Deployment 

ΞʔΩςΫνϟશମ PostgreSQL (Airflow Backend) Workers Web Server Celery Scheduler Airflow Redis (Celery Broker) DAGs Playbooks Bucket Deployment M G Q AD Q PS Q 

ΞʔΩςΫνϟશମ PostgreSQL (Airflow Backend)  Workers Web Server Celery Scheduler Airflow Redis (Celery Broker) DAGs Playbooks Bucket Deployment 

      

ΞʔΩςΫνϟશମ PostgreSQL (Airflow Backend)  Workers Web Server Celery Scheduler Airflow Redis (Celery Broker) DAGs Playbooks Bucket Deployment 
    

%"(ͷ࣮૷ͷجຊํ਑ • ֶश΍ධՁ͸࣮૷Λ%"(ʹॻ͔ͳ͍Α͏ʹ෼཭͠ɺ %"(Ͱ͸ͦΕΛ࣮ߦ͢Δ͚ͩʹ͢Δ • ۩ମతͳϩδοΫΛ֎ग़͢͠Δ͜ͱͰɺ 5BTL΍෼ذͷ਺͕গͳ͘ͳΓɺ؅ཧָ͕ʹͳΔ • ֶश΍ධՁࣗମΛผͰςετͰ͖Δ ࣮࣭ਓ ඇઐଐ Ͱͷ؅ཧͷͨΊͳΔ͚ͩ୯७ʹ 

ϏϧυʙධՁ·Ͱͷϑϩʔྫ ੔ܗ Models ֶश ධՁ ఆظతʹ SBXσʔλΛGFUDI ίʔυมԽʹUSJHHFS ࠷৽σʔλͰ ֶशΛUSJHHFS ֶशऴྃ࣌ʹUSJHHFS • ֶशɾධՁʹ͍ͭͯ͸ɺQPPMΛ͔࣮ͭͬͯߦϚγϯΛ %"(୯ҐͰࢦఆ ୆Ͱฒྻ࣮ߦ ݁Ռ௨஌ ϞσϧͷετΞ ߴεϖοΫϚγϯͰ࣮ߦ ʜ
%"( 

ݱߦͷ՝୊ • Ϧιʔε؅ཧͷίετ͕େ͖͍ ୆Ҏ্ͷ7.Πϯελϯε؅ཧ͕ඞཁͰɺ ֤Πϯελϯεͷঢ়ଶ͕Ұகͯ͠Δ͔΋ෆ҆ • %"(ͷ࣮ߦϚγϯࢦఆΛ΋ͬͱࡉ͔͘ߦ͍͍ͨ QPPM΍RVFVFͰ͋Δఔ౓࣮ݱՄೳ͕ͩɺϚγϯͷε ϖοΫʹ߹Θͤͨಈతͳࢦఆ͸͠ʹ͍͘ • %"(ʹ͍ͭͯςετίʔυ͕ͳ͘ɺ खܰͳϩʔΧϧςετ؀ڥ΋༻ҙ͠ʹ͍͘ 

ΞʔΩςΫνϟͷվળ 

վળ໨ඪ • ϚγϯϦιʔε؅ཧίετͷ࡟ݮ Πϯϑϥߏ੒ͷߋ৽΍ҡ࣋ΛͳΔ͚ͩϑϨʔϜϫʔΫʹ౤͛ ͍ͨ • ؀ڥͷ࠶ݱੑͷ޲্ ίϯςφʹΑΔߏ੒؀ڥ౷Ұ • ϩʔΧϧ։ൃ؀ڥͷߏங؆қԽ 

վળ໨ඪ • ϚγϯϦιʔε؅ཧίετͷ࡟ݮ Πϯϑϥߏ੒ͷߋ৽΍ҡ࣋ΛͳΔ͚ͩϑϨʔϜϫʔΫʹ౤͛ ͍ͨ • ؀ڥͷ࠶ݱੑͷ޲্ ίϯςφʹΑΔߏ੒؀ڥ౷Ұ • ϩʔΧϧ։ൃ؀ڥͷߏங؆қԽ è & 

,VCFSOFUFT • ίϯςφΦʔέετϨʔγϣϯϑϨʔϜϫʔΫ • Πϯϑϥߏ੒Λ:".-ͰએݴతʹఆٛՄೳ • "GGJOJUZͱ͍͏ػೳͰɺXPSLFSϚγϯͰͷ 1PE
ࠓճ͸࣮࣭ίϯςφ
࣮ߦΛࡉ͔͘ઃఆՄೳ • "JSGMPX΋࣮ߦ؀ڥͱͯ͠ެࣜରԠ • 
%"(


1PE
Ͱ࣮ߦ 

%SPOF • 044ͷ$*$%πʔϧ • ίϯςφϕʔεͰͷϏϧυɾσϓϩΠ͕લఏͰɺ ಋೖ΋ൺֱత؆୯ • ฐࣾͰͷඪ४πʔϧͰ΋͋ΔͨΊ࣮੷͕͋Δ ࢀߟ
IUUQTFOHJOFFSJOHMJOFDPSQDPNKBCMPHHPPTTDJUPPM ESPOFSFQMBDFTKFOLJOT • ίϯςφϏϧυͱ%"(ͷςετ ޙड़ ࣮ࢪʹར༻ 

໨ඪ PostgreSQL (Airflow Backend)

DAG Execution Pods Launches when DAG executes Web Server Kubernetes Cluster Store logs/training, evaluation data/models Docker Registry S3 like bucket Build Test Publish Deploy (Reload web server & scheduler images) Triggered by developer’s push Scheduler Airflow 

໨ඪ PostgreSQL (Airflow Backend)

DAG Execution Pods Launches when DAG executes Web Server Kubernetes Cluster Store logs/training, evaluation data/models Docker Registry S3 like bucket Deploy (Reload web server & scheduler images) Scheduler Airflow Build Test Publish Triggered by developer’s push ࣮ߦ୯Ґ͸7.Πϯελϯε͔Β1PEʹ %"(΋ؚΊͯ"JSGMPX͸શ෦ͭʹ 

໨ඪ PostgreSQL (Airflow Backend)

DAG Execution Pods Launches when DAG executes Web Server Kubernetes Cluster Store logs/training, evaluation data/models Docker Registry S3 like bucket Build Test Publish Deploy (Reload web server & scheduler images) Triggered by developer’s push Scheduler Airflow %"(΍%PDLFSGJMFʹมߋ͕͋Δ౓ʹ %SPOFͰϏϧυɾςετ࣮ߦ 

໨ඪ PostgreSQL (Airflow Backend)

DAG Execution Pods Launches when DAG executes Web Server Kubernetes Cluster Store logs/training, evaluation data/models Docker Registry S3 like bucket Deploy (Reload web server & scheduler images) Scheduler Airflow Build Test Publish Triggered by developer’s push Ϗϧυ͕੒ޭͨ͠Β ϨδετϦʹίϯςφΛొ࿥"JSGMPX
SFMPBE 

ΞʔΩςΫνϟมߋʹΑΔվળ • ϚγϯϦιʔε؅ཧίετ࡟ݮ • ݸʑͷ7.Πϯελϯεͷ໘౗Λݟͳͯ͘Α͘ͳͬͨ • 8FCTFSWFS
4DIFEVMFS
8PSLFS͸શͯಉ͡࢓༷ͷίϯς φͳͷͰɺ%PDLFSGJMFͭΛ؅ཧ͢Ε͹ྑ͘ͳͬͨ • ͍ͭͰʹ$FMFSZΛ΍ΊͨͷͰ3FEJT؅ཧ΋ͳ͠ʹ • ίϯςφϕʔεͷ؅ཧʹͳΓɺ؀ڥ࠶ݱੑ΋޲্ • .JOJLVCFΛར༻ͨ͠ϩʔΧϧͰͷ؀ڥ࠶ݱ΋ָʹ 

%"(ʹର͢Δςετͷಋೖ 

%"(ͷςετͰ΍Γ͍ͨ͜ͱ • ཧ૝తʹ͸FOEUPFOEͰ%"(ͷڍಈΛอূ͍ͨ͠ • ࠷௿Ͱ΋5BTL୯ҐͰͷςετ͸͍ͨ͠ ྫ ֶश%"(ʹ͍ͭͯ • &&ςετͰ͸ֶश։࢝τϦΨ σʔλ੔ܗऴྃɾϞσϧ ίʔυมߋ ͝ͱʹਖ਼͘͠ىಈ͢Δ͔ɺֶशͷ࠷ޙʹਖ਼͍͠ ϑΥʔϚοτͷϑΝΠϧ໊ͰϞσϧΛग़ྗ͢Δ͔ FUD • 5BTL୯ҐͰ͸ɺਖ਼͍͠όʔδϣϯͷίʔυΛDMPOFͯ͜͠ Α͏ͱ͍ͯ͠Δ͔ FUD 

΍Ζ͏ͱ͍ͯ͠Δ %"(ςετͷ֓ཁ • ࣮૷ͨ͠5BTL΍%"(Λ࣮ߦ͢ΔΑ͏ͳVOJUUFTUΛॻ ͍ͯ(JU)VCʹQVTI͕͋Δ౓ʹ࣮ߦ͢Δ • %SPOF্Ͱ.JOJLVCFͳͲΛ࢖ͬͯμϛʔͷLT؀ڥΛ ࢖ͬͨςετ͸؆୯ʹ͸Ͱ͖ͳͦ͞͏ Ͱ͖ͦ͏Ͱͨ͠Βڭ͍͑ͯͩ͘͞ 

ςετͷॻ͖ํ 5BTL • μϛʔͷ%"(ΦϒδΣΫτʹର৅ͷ5BTLΛొ࿥͠ɺ ͦΕΛ࣮ߦ͢Δ͜ͱͰςετՄೳ • 5BTL͕ར༻͍ͯ͠Δ֎෦"1*Λ.PDL͓ͯ͘͠ / / . /- . . . / ςετର৅ͷλεΫ μϛʔ%"(ΦϒδΣΫτ μϛʔ%"(ΦϒδΣΫτ ʹΑΔ5BTL࣮ߦͷྫ 

ςετͷॻ͖ํ && • "JSGMPXͷ%"(ͷ࣮ߦ࣌ͷ࣮ମͱͯ͠ %BH3VOΦϒδΣΫτΛੜ੒͢Δ • &&Ͱςετ͚ͨ͠Ε͹ɺ͜ͷ%BH3VOΦϒδΣΫτ ΛࣗલͰ࡞੒͢Ε͹Α͍ • "JSGMPXެࣜͷ%BH3VO5FTUʹଘࡏ͢Δ DSFBUF@EBH@SVOϔϧύʔؔ਺ͷ࣮૷͕ࢀߟʹͳΔ - 1/ - .1 .1 . /1 . 0