Create Ticket on JIRA
Write code
Write Chef cookbook
Test on LAB
Create PR (Git-Flow)
Review
Slide 32
Slide 32 text
DEV FLOW
RELEASE FLOW
Slide 33
Slide 33 text
Assign release manager
Collect all JIRA tickets
Write internal blog
CanaryRelease
Release
Slide 34
Slide 34 text
1 release for 1 week
DEV (2day) , STG (2day) , PROD(3day)
Slide 35
Slide 35 text
HOW TO RELEASE?
= Chef + Capistrano
Slide 36
Slide 36 text
RELEASE 1 SERVER
Slide 37
Slide 37 text
Service-out
Run Chef solo
Run Serverspec
Service-in
Slide 38
Slide 38 text
Stop Load-Balancing
Disable Health Check
Stop monit
Service-out
Run Chef solo
Run Serverspec
Service-in
Start monit
Enable Health Check
Start Load-Balancing
Slide 39
Slide 39 text
/etc/service-out
/etc/service-in
Service-out
Run Chef solo
Run Serverspec
Service-in
Slide 40
Slide 40 text
Every server has same startup/stop scripts
= workflow is same
= automation is easy
Slide 41
Slide 41 text
RELEASE X SERVERS
Slide 42
Slide 42 text
cap service-in
cap service-out
cap setup-role
Service-out X servers
Run Chef solo X servers
Run Serverspec X servers
Service-in X servers
Slide 43
Slide 43 text
Role A
Role B
Role C
Operation
170.20.20.21.RoleA
170.20.20.22.RoleA
170.20.20.23.RoleA
170.20.20.24.RoleA
170.20.20.25.RoleA
170.20.20.26.RoleA
170.20.20.27.RoleA
VMLIST
Slide 44
Slide 44 text
cap service-out
170.20.20.21.RoleA
170.20.20.22.RoleA
170.20.20.23.RoleA
170.20.20.24.RoleA
170.20.20.25.RoleA
170.20.20.26.RoleA
170.20.20.27.RoleA
VMLIST
Operation
Role A
Role B
Role C
Parallel execution
Slide 45
Slide 45 text
cap setup-role
Operation
Parallel execution
170.20.20.21.RoleA
170.20.20.22.RoleA
170.20.20.23.RoleA
170.20.20.24.RoleA
170.20.20.25.RoleA
170.20.20.26.RoleA
170.20.20.27.RoleA
VMLIST
Role A
Role B
Role C
Slide 46
Slide 46 text
cap service-in
Role A
Role B
Role C
Operation
170.20.20.21.RoleA
170.20.20.22.RoleA
170.20.20.23.RoleA
170.20.20.24.RoleA
170.20.20.25.RoleA
170.20.20.26.RoleA
170.20.20.27.RoleA
VMLIST
Parallel execution
Slide 47
Slide 47 text
cap service-out
Operation
Parallel execution
170.20.20.31.RoleB
170.20.20.32.RoleB
170.20.20.33.RoleB
170.20.20.34.RoleB
170.20.20.35.RoleB
170.20.20.36.RoleB
170.20.20.37.RoleB
VMLIST
Role A
Role B
Role C
Slide 48
Slide 48 text
cap service-out
170.20.20.21.RoleA
VMLIST
Operation
Role A
Role B
Role C
Start from Canary
Slide 49
Slide 49 text
HOW TO DEV&OPS
INTERNAL PAAS
Slide 50
Slide 50 text
LOGGING
MONITORING
ALERT HANDLING
SUPPORT
IAAS
Slide 51
Slide 51 text
LOGGING
MONITORING
ALERT HANDLING
SUPPORT
IAAS
Slide 52
Slide 52 text
700GB/day logs
All logs produced in PaaS
Slide 53
Slide 53 text
LOGGING IN PAAS?
= Application logs + Component logs
Slide 54
Slide 54 text
APPLICATION LOG ?
= PaaS should provide user the way to debug
Slide 55
Slide 55 text
Instant logs
Midterm logs
Longterm logs
Real time
1-2 weeks
- 6 month
Slide 56
Slide 56 text
Router
API
Health
Check
Messaging
DBs
Apps
Instant log