Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Services on AWS #jawsug yokohama

Services on AWS #jawsug yokohama

AWS, LTSV, fluentd, serverspec, Chef, capistrano, ZABBIX, Web Operation

kenjiskywalker

July 20, 2013
Tweet

More Decks by kenjiskywalker

Other Decks in Technology

Transcript

  1. KAYAC Services
    on AWS
    Saturday, July 20, 13

    View full-size slide

  2. Saturday, July 20, 13

    View full-size slide

  3. Saturday, July 20, 13

    View full-size slide

  4. Text
    Saturday, July 20, 13

    View full-size slide

  5. Tools
    - AWS new!
    - LTSV -new style log format
    - fluentd -events and logs collection tool
    - serverspec -RSpec tests for servers
    - Chef -infrastructure automation platform
    - capistrano -tool to execute commands in parallel
    - ZABBIX -monitoring tool
    Saturday, July 20, 13

    View full-size slide

  6. KAYAC Services
    on AWS
    Saturday, July 20, 13

    View full-size slide

  7. I will not talk
    about chef
    today
    Saturday, July 20, 13

    View full-size slide

  8. I will give a
    comprehensive
    talk on
    using AWS
    and other tools
    Saturday, July 20, 13

    View full-size slide

  9. SYSTEM
    Saturday, July 20, 13

    View full-size slide

  10. ELB VPC
    EC2 RDS
    S3 CW
    Saturday, July 20, 13

    View full-size slide

  11. SYSTEM
    Saturday, July 20, 13

    View full-size slide

  12. Tools
    - LTSV -new style log format
    - fluentd -collect events and logs tool
    - serverspec -RSpec tests for servers
    - Chef -infrastructure automation platform
    - capistrano -Tool to execute commands in a parallel
    - ZABBIX -monitoring and metrics check tool
    Saturday, July 20, 13

    View full-size slide

  13. LTSV
    Saturday, July 20, 13

    View full-size slide

  14. SYSTEM
    nginx new log format
    Saturday, July 20, 13

    View full-size slide

  15. Tools
    - AWS new!
    - LTSV -new style log format
    - fluentd -events and logs collection tool
    - serverspec -RSpec tests for servers
    - Chef -infrastructure automation platform
    - capistrano -tool to execute commands in parallel
    - ZABBIX -monitoring tool
    Saturday, July 20, 13

    View full-size slide

  16. fluentd
    Saturday, July 20, 13

    View full-size slide

  17. SYSTEM
    aggregate logs
    Saturday, July 20, 13

    View full-size slide

  18. Tools
    - AWS new!
    - LTSV -new style log format
    - fluentd -events and logs collection tool
    - serverspec -RSpec tests for servers
    - Chef -infrastructure automation platform
    - capistrano -tool to execute commands in parallel
    - ZABBIX -monitoring tool
    Saturday, July 20, 13

    View full-size slide

  19. server
    spec
    Saturday, July 20, 13

    View full-size slide

  20. chef
    meets
    serverspec
    Saturday, July 20, 13

    View full-size slide

  21. serverspec can
    execute chefs
    run_list
    Saturday, July 20, 13

    View full-size slide

  22. http://blog.kenjiskywalker.org/
    blog/2013/07/13/serverspec-chef-cookbook/
    Testing
    chef Cookbook
    by serverspec
    Saturday, July 20, 13

    View full-size slide

  23. SYSTEM
    running serverspec by cron
    Saturday, July 20, 13

    View full-size slide

  24. Tools
    - LTSV -new style log format
    - fluentd -collect events and logs tool
    - serverspec -RSpec tests for servers
    - Chef -infrastructure automation platform
    - capistrano -Tool to execute commands in a parallel
    - ZABBIX -monitoring and metrics check tool
    Saturday, July 20, 13

    View full-size slide

  25. SYSTEM VIEW
    No special
    settings are
    required on aws
    when you use chef
    Saturday, July 20, 13

    View full-size slide

  26. Tools
    - AWS new!
    - LTSV -new style log format
    - fluentd -events and logs collection tool
    - serverspec -RSpec tests for servers
    - Chef -infrastructure automation platform
    - capistrano -tool to execute commands in parallel
    - ZABBIX -monitoring tool
    Saturday, July 20, 13

    View full-size slide

  27. Tools
    - AWS new!
    - LTSV -new style log format
    - fluentd -events and logs collection tool
    - serverspec -RSpec tests for servers
    - Chef -infrastructure automation platform
    - capistrano -tool to execute commands in parallel
    - ZABBIX -monitoring tool
    Saturday, July 20, 13

    View full-size slide

  28. Github Flow
    pullreq pull
    SERVER
    PC
    deploy
    SERVERSERVER SERVER
    chef cookbook
    capistrano
    review / merge
    Saturday, July 20, 13

    View full-size slide

  29. SYSTEM
    git pull and deploy
    Saturday, July 20, 13

    View full-size slide

  30. Tools
    - AWS new!
    - LTSV -new style log format
    - fluentd -events and logs collection tool
    - serverspec -RSpec tests for servers
    - Chef -infrastructure automation platform
    - capistrano -tool to execute commands in parallel
    - ZABBIX -monitoring tool
    Saturday, July 20, 13

    View full-size slide

  31. SYSTEM
    monitoring
    Saturday, July 20, 13

    View full-size slide

  32. SYSTEM VIEW
    Saturday, July 20, 13

    View full-size slide

  33. KAYAC Services
    on AWS
    Saturday, July 20, 13

    View full-size slide

  34. SYSTEM
    Saturday, July 20, 13

    View full-size slide

  35. SYSTEM
    Same
    environment as
    on-premise
    Saturday, July 20, 13

    View full-size slide

  36. SYSTEM VIEW
    No special
    settings are
    required on aws
    when you use chef
    Saturday, July 20, 13

    View full-size slide

  37. enjoy
    chef on
    aws!
    Saturday, July 20, 13

    View full-size slide