Toward use of FaaS / #abejameetup

Innovation Meetup ~Startup Infrastructure~ の発表資料です
http://abeja-innovation-meetup.connpass.com/event/36707/

Transcript

1. Towards use of FaaS @tnir / @tn961ir Innovation Meetup -Infrastructure-
2. @tnir • Takuya Noguchi • ~ 20 yr of Digital Transformation & Local Business Management • GH: @tnir • Tw: @tn961ir • FB: takuya.noguchi.961 • Founder of Kamiyacho.k8s • Head of Local Business Unit • Member of iRidge Golf Club • Software/Infra Engineer/Corporate IT at iRidge, Inc.
3. iRidge
4. iRidge, Inc. • No.1 O2O solution company (est. 2008) • Made IPO in 2015 • 57 members (38 for eng, 13 for sales, 6 for corp) (as of Apr, 2016) • SaaS:Client-work=2:8 • Japan-UK Innovation Tech Awards 2015 • PyCon JP 2016 sponsorship via: IR Library 3Q2016
5. popinfo Solution • O2O platform SaaS w/iOS/Android SDK • 45M active users (Aug, 2016) via: IR Library 3Q2016
6. Eng. Env.
7. Team • No CTO • No CIO • No Infra/DevOps Engineer • Each dev responsible for productivity engineering
8. IT • No on-premise servers • Google Apps • Network/WiFi • Corporate Web site (WordPress) • Badget requests for employee PCs
9. 2013: Trac & Subversion • “Could you review the code on our Trac/SVN?” https://trac.edgewall.org/wiki/TracMercurial
10. 2013: BitBucket (.org) • Git & Mercurial • 5 members per project for free • Forced to be small project teams
11. 2014: GitLab • https://about.gitlab.com/ • OSS • Ruby on Rails-based application • Hard for developers to manage • Git codebase, CI/CD with pipelines
12. OSS Contribute • 63rd of 1000+ contributors https://github.com/ gitlabhq/gitlabhq/graphs/contributors • 13th of 100+ contributors (omnibus-gitlab)
13. Org. Size and Style • 500+ (code) projects, 150+ developers • a codebase for project (e.g., server-side, iOS/ Android apps)
14. Organization & Management • We want to employ “Microservices” but … • We’re changing our organization structure and management for our goal “Microservices”.
15. Containerize
16. Tests through CI/CD • 2012: Jenkins 1 • Non-clean environment • No Jenkins manager • 2013: private GitLab CI • No users’ integration • 2014: wrecker for Docker-based builds • Docker-based builds • 2015: integrated GitLab CI • Simplify developers’ settings with cost reduction
17. Cost for development • GH:E: 50,000 USD/yr+Infra • GitLab: 0 USD+Infra • Circle CI Enterprise: ???? USD/yr • GitLab CI: 0 USD • Docker Private Registry: ??? USD/yr • GitLab Private Registry: 0 USD • => saves cost for 1 eng
18. Operations Cost
19. Operations • Server resource cost • Code maintenance • New features for business
20. Servers • Had used AWS EC2 instances like on-premise. • t2 family with Autoscaling: not enough for ultra high peak/trough ratio • Are transiting to Docker with high density containers and/or Cloud-native architecture.
21. Migration to GCP • Cost reduction: • 100(AWS)=>8.888(GCP) • BigQuery for analysis/datalake platform • SQL & Low cost
22. Infrastructure as Code • Chef • Ansible (YAML) • CloudFormation (JSON) • Terraform
23. Containerize
24. Docker? • The most famous container technology • Started to use Docker technology in 2014. • Had many smaller projects to test Docker.
25. Docker stuffs • Fig (Docker Compose) • Docker Machine • CoreOS (???) • GKE (testing) • Kubernetes on EC2/AWS • Docker for mac (GA)
26. Docker operations • Monitoring • Munin 2 • Logging • logging driver: syslog
27. In-company education • “What is Docker?” • “How does it save my time?”
28. Serverless Architecture
29. Current Status • All apps deployed on VM instances • except for Google App Engine/Heroku • Next step • Dockerize all apps • Monitoring
30. Plans • Serverless Architecture • django-zappa • https://github.com/Miserlou/django-zappa • Monitoring for legacy systems • Munin 3 (delayed) • Prometheus 1.0
31. Key words • Management for rapid development • Containerize (Docker) • Serverless architecture (Django-zappa)
32. Enjoy The Rio 2016 Games!
33. Kamiyacho.k8s #7 • Register Now! • http://k7o-k8s.connpass.com/event/37310/
34. Wanted • https://iridge.jp/rec/ • https://www.wantedly.com/companies/iridge