Speech Recognition recognized text list user’s speech data Ͷ͑ Clova, ࠓͷ৽॓ͷఱؾ? ݱࡏͷ৽॓ͷఱؾΕ (The weather of the present Shinjuku is sunny) ࠓͷ৽॓ͷ ఱؾ? 10
Place Shinjuku Time Present NLU Result NLU / DM recognized text list user’s speech data Speech Recognition recognized text list user’s speech data Ͷ͑ Clova, ࠓͷ৽॓ͷఱؾ? ݱࡏͷ৽॓ͷఱؾΕ (The weather of the present Shinjuku is sunny) ࠓͷ৽॓ͷ ఱؾ? 11
ࠓͷ৽॓ͷ ఱؾ? NLU / DM recognized text list user’s speech data Speech Recognition recognized text list user’s speech data Ͷ͑ Clova, ࠓͷ৽॓ͷఱؾ? ݱࡏͷ৽॓ͷఱؾΕ Key Value Domain Weather Intention Inform Main Goal General Place Shinjuku Time Present 12
NLU Result Key Value Domain Weather Intention Inform Main Goal General Place Shinjuku Time Present NLU Result NLU / DM recognized text list user’s speech data Speech Recognition recognized text list user’s speech data Ͷ͑ Clova, ࠓͷ৽॓ͷఱؾ? ݱࡏͷ৽॓ͷఱؾΕ ࠓͷ৽॓ͷ ఱؾ? 13
Weather web API generated text NLU Result NLU Result NLU / DM recognized text list user’s speech data Speech Recognition recognized text list user’s speech data Ͷ͑ Clova, ࠓͷ৽॓ͷఱؾ? generated text ࠓͷ৽॓ͷ ఱؾ? Key Value Domain Weather Intention Inform Main Goal General Place Shinjuku Time Present 14
evaluate the model • share the result to members • Implement API to use model • estimate machine resource • set machine resource • Implement client side • deploy to development environment • set endpoint for dev API • confirm it works expectedly • deploy to staging environment • set endpoint for staging API • QA • minor fix • fix some training data • train a new model • deploy a fixed model to staging environment • set endpoint for staging API • deploy to production environment • blue-green deployment • set endpoint for production API • AB Test • monitoring • trouble shooting • rollback • … 29
evaluate the model • share the result to members • Implement API to use model • estimate machine resource • set machine resource • Implement client side • deploy to development environment • set endpoint for dev API • confirm it works expectedly • deploy to staging environment • set endpoint for staging API • QA • minor fix • fix some training data • train a new model • deploy a fixed model to staging environment • set endpoint for staging API • deploy to production environment • blue-green deployment • set endpoint for production API • AB Test • monitoring • trouble shooting • rollback • … 40
evaluate the model • share the result to members • Implement API to use model • estimate machine resource • set machine resource • Implement client side • deploy to development environment • set endpoint for dev API • confirm it works expectedly • deploy to staging environment • set endpoint for staging API • QA • minor fix • fix some training data • train a new model • deploy a fixed model to staging environment • set endpoint for staging API • deploy to production environment • blue-green deployment • set endpoint for production API • AB Test • monitoring • trouble shooting • rollback • … 41 ɹɹɹɹ: AirflowͱRekcurdͰ ࣗಈԽ, ؆қԽ Ͱ͖ͨ෦