Using AWS Lambda with Ruby on a large-scale system

Slide 1

Slide 1 text

64*/("84-".#%"8*5)36#: 0/"-"3(&4$"-&4:45&. -VLB)VBOH 4FOJPS#BDLFOE&OHJOFFS 4QMBTIUPQ*OD

Slide 2

Slide 2 text

ABOUT ME -VLB)VBOH  4FOJPS#BDLFOE%FWFMPQFS 4QMBTIUPQ*OD h3VCZ-PWFS h'VMMTUBDL%FWFMPQFS h1BTTJPOBUFBCPVUCVJMEJOHEJTUSJCVUFETZTUFN (JUIVC5XJUUFS!DPEJOHMVLB &NBJMTUFWFOIVBOH!TQMBTIUPQDPN Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 3

Slide 3 text

REMOTE DESKTOP SOFTWARE SOLUTIONS Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 4

Slide 4 text

CURRENTLY HAVE MORE THAN   20 MILLION USERS Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 5

Slide 5 text

ONLINE COMPUTERS > ? MILLION Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 6

Slide 6 text

I AM A DEVELOPER  IN BACK-END TEAM. Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 7

Slide 7 text

BACK-END = Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 8

Slide 8 text

BACK-END = + CURRENTLY Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 9

Slide 9 text

WHY AWS LAMBDA? Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 10

Slide 10 text

10 WHY AWS LAMBDA? WHEN SYSTEM BECAME LARGE, THERE ARE MANY PAIN POINTS TO SOLVE Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 11

Slide 11 text

SO I PREPARED THIS TALK TO INTRODUCE LARGE-SCALE SYSTEM.   AND POINT OUT THE PAIN POINTS. Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 12

Slide 12 text

HOW TO SOLVE PAIN POINTS VIA AWS LAMBDA Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 13

Slide 13 text

IN THIS TALK. I’ LL SHARE PRINCIPLES TO USE + Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 14

Slide 14 text

OUTLINE h*OUSPEVDUJPOUP"84-BNCEBBOE4FSWFSMFTT h*OUSPEVDUJPOUP-BSHFTDBMFTZTUFN h$IBMMFOHFTPG-BSHFTDBMFTZTUFN h)PX"84-BNCEBTPMWFUIFN h*T3BJMT"84-BNCEBNBLFTFOTF Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 15

Slide 15 text

INTRODUCTION TO AWS LAMBDA AND SERVERLESS Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 16

Slide 16 text

CORE OF SERVERLESS Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 17

Slide 17 text

MONOLITHIC Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 18

Slide 18 text

EVERY INSTANCE HAS FULL FEATURES MONOLITHIC Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 19

Slide 19 text

WHAT IS SERVERLESS? Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 20

Slide 20 text

SERVERLESS /orders Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 21

Slide 21 text

Monolithic Micro Service Function MONOLITHIC Micro Service Micro Service Micro Service Function Function Function Function Function Function Function Function MICRO SERVICE SERVERLESS Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 22

Slide 22 text

Ruby Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 23

Slide 23 text

28   GOOD NEWS Using AWS Lambda with Ruby on a large-scale system ,Luka Huang ©RubyConf TW 2019

Slide 24

Slide 24 text

29 Ruby

Slide 25

Slide 25 text

IF YOU ARE NOT USING AWS… Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 26

Slide 26 text

NO WORRIES Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 27

Slide 27 text

PROVIDERS SUPPORT SERVERLESS Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 28

Slide 28 text

Azure Cloud Function AWS Lambda Google Cloud Function DIFFERENT NAMES, SAME THING IBM OpenWhisk Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 29

Slide 29 text

LAMBDA EXECUTION MODEL Synchronous Asynchronous (Event) Stream-based Amazon API Gateway Amazon S3 Amazon SQS /orders Amazon DynamoDb Amazon   Kinesis If data changed Lambda function Lambda function Lambda service Lambda function Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 30

Slide 30 text

MODEL 1 - SYNCHRONOUS Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 31

Slide 31 text

SERVERLESS WEB APPLICATION /orders Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 32

Slide 32 text

VISIT /ORDERS PAGE GET /orders /orders Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 33

Slide 33 text

CREATE ORDER POST /order /order Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 34

Slide 34 text

MODEL 2 - ASYNCHRONOUS Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 35

Slide 35 text

EVENT DRIVEN Event Source Lambda function Services Node.js Python  Java C#  Golang Ruby!! Request to endpoints Changes in resource state Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 36

Slide 36 text

EVENT SOURCES THAT TRIGGER LAMBDA Data Stores Endpoints Conﬁguration Repositories Event / Message Service https://www.slideshare.net/BoazZiniman/introduction-to-serverless-computing-and-aws-lambda-ﬂoor28 Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 37

Slide 37 text

PROS OF SERVERLESS No Servers to provision or manage Scales with usage Never pay for idle Built-in availability and fault tolerance Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 38

Slide 38 text

WAYS TO DEVELOP LAMBDA WITH RUBY Using AWS Lambda with Ruby on a large-scale system ,Luka Huang ©RubyConf TW 2019

Slide 39

Slide 39 text

#1 VIA AWS WEB CONSOLE Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 40

Slide 40 text

WHEN CLICK ADD TRIGGER Click Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 41

Slide 41 text

SELECT EVENT SOURCE AS TRIGGER Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 42

Slide 42 text

A TRIGGER IS ADDED Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 43

Slide 43 text

LAMBDA FUNCTION WITH RUBY Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 44

Slide 44 text

TEST LAMBDA VIA EVENT Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 45

Slide 45 text

EXECUTION RESULT Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 46

Slide 46 text

#2 VIA AWS CLI Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 47

Slide 47 text

EDIT THE FUNCTION Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 48

Slide 48 text

ZIP IT Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 49

Slide 49 text

UPDATE LAMBDA VIA AWS CLI Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 50

Slide 50 text

TEST ON AWS CONSOLE Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 51

Slide 51 text

#3 VIA SERVERLESS FRAMEWORK Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 52

Slide 52 text

SERVERLESS The most popular Serverless framework Node.js Python  Java C#  Golang Ruby Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 53

Slide 53 text

RUBY ON JETS Serverless framework build by Ruby Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 54

Slide 54 text

#4 VIA TERRAFORM Infrastructure as code Lambda development + Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 55

Slide 55 text

INTRODUCTION TO LARGE- SCALE SYSTEM Using AWS Lambda with Ruby on a large-scale system ,Luka Huang ©RubyConf TW 2019

Slide 56

Slide 56 text

WHAT IS LARGE-SCALE SYSTEM? Using AWS Lambda with Ruby on a large-scale system ,Luka Huang ©RubyConf TW 2019

Slide 57

Slide 57 text

“IS DISTRIBUTED CRAWLER SYSTEM A KIND OF A LARGE-SCALE SYSTEM?” My friend ask me a question: Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 58

Slide 58 text

DDOS sites to get information Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 59

Slide 59 text

Also DDOS his Database Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 60

Slide 60 text

QPS is really high. So is it a large-scale system? Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 61

Slide 61 text

Crawler system could have some downtime. Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 62

Slide 62 text

Large-scale system must be reliable, right? Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 63

Slide 63 text

INTRODUCTION TO LARGE-SCALE SYSTEM Using AWS Lambda with Ruby on a large-scale system ,Luka Huang ©RubyConf TW 2019

Slide 64

Slide 64 text

A SIMPLE ARCHITECTURE Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 65

Slide 65 text

MAKE IT FASTER Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 66

Slide 66 text

CACHE! Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 67

Slide 67 text

MEMCACHED Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 68

Slide 68 text

AND FASTER Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 69

Slide 69 text

CDN Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 70

Slide 70 text

https://www.fourthwc.com/netsuite/2017/05/site-builder-site-secure-https-throughout.html Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 71

Slide 71 text

Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 72

Slide 72 text

DATABASE Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 73

Slide 73 text

Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 74

Slide 74 text

DB TOPIC 1 - READ REPLICA Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 75

Slide 75 text

Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 76

Slide 76 text

READ REPLICA TROUBLESHOOTING Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 77

Slide 77 text

READ REPLICA h8IFOEFMBZJTPDDVSSFE IPXUPIBOEMFJU h8IFOTIPVMEXFVTFNBTUFSJOTUFBESFBESFQMJDB h)PXEBUBCBTFJNQMFNFOUNBTUFSTMBWFTZOD Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 78

Slide 78 text

DB TOPIC 2 - HOT STANDBY Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 79

Slide 79 text

Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 80

Slide 80 text

DB TOPIC 3 - REDIS Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 81

Slide 81 text

Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 82

Slide 82 text

https://redislabs.com/blog/use-redis-enterprise-kubernetes-release-pivotal-container-service/ Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 83

Slide 83 text

Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 84

Slide 84 text

WORKER Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 85

Slide 85 text

Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 86

Slide 86 text

WORKER h%FMBZFEKPC %BUBCBTF MJOL h4JEFLJR1SP 3FEJT MJOL h4IPSZVLFO 424 MJOL h0UIFST Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 87

Slide 87 text

Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 88

Slide 88 text

PERFORMANCE TUNING FOR API SERVERS Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 89

Slide 89 text

Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 90

Slide 90 text

SPEED UP API h/FUGMJY'BTU+TPO"1*MJOL h3BJMT"1*MJOL h"DUJPO$POUSPMMFS.FUBM$VTUPN.JEEMFXBSF Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 91

Slide 91 text

us-west-1 us-east-1 Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 92

Slide 92 text

AUTO-SCALING Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 93

Slide 93 text

Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 94

Slide 94 text

Slide 95

Slide 95 text

Slide 96

Slide 96 text

Slide 97

Slide 97 text

Slide 98

Slide 98 text

Slide 99

Slide 99 text

INCREASE 500% IN 10 MINUTES Throughput Time Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 100

Slide 100 text

hFH4OBQVQDPODFSUUJDLFUT hFH4FSWJDFJTUFNQPSBSZEPXO h-PUTPGFOEQPJOUTXJMMSFUSZJOUIFTBNFUJNF INCREASE 500% IN 10 MINUTES Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 101

Slide 101 text

h&WFSZXIFSFNBLFZPVSTFSWJDFEPXO h%BUBCBTFMBZFS h"QQMJDBUJPOMBZFS h0UIFST BOTTLENECK Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 102

Slide 102 text

h&WFSZXIFSFNBLFZPVSTFSWJDFEPXO h%BUBCBTFMBZFS h"QQMJDBUJPOMBZFS h0UIFST BOTTLENECK is helpful Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 103

Slide 103 text

We want to get rid heavy-load API of our main service Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 104

Slide 104 text

Slide 105

Slide 105 text

A single purpose API still load all code of Rails. It is not efﬁcient. Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 106

Slide 106 text

Slide 107

Slide 107 text

h,FFQNBJOTFSWJDFSFMJBCMF h%FDPVQMJOHIFBWZMPBETFSWJDFT h&BTZUP0QT h&BTZUPTDBMF h,FFQBCBMBODFCFUXFFO%FWBOE0QT PRINCIPLES OF USING AWS LAMBDA Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 108

Slide 108 text

Slide 109

Slide 109 text

USE CASE 1 - UPLOAD FILE AND SEND NOTIFICATION Using AWS Lambda with Ruby on a large-scale system ,Luka Huang ©RubyConf TW 2019

Slide 110

Slide 110 text

Slide 111

Slide 111 text

DIRECTLY UPLOAD TO S3 ( ActiveStorage supports directly upload to S3. ) Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 112

Slide 112 text

Slide 113

Slide 113 text

Slide 114

Slide 114 text

Slide 115

Slide 115 text

Slide 116

Slide 116 text

Slide 117

Slide 117 text

Slide 118

Slide 118 text

Slide 119

Slide 119 text

Slide 120

Slide 120 text

Slide 121

Slide 121 text

WEBSOCKET IS A PAIN POINT h-POHDPOOFDUJPO h)BSEUPJNQMFNFOU h1FSGPSNBODFJOSVCZJTOPUHPPE Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 122

Slide 122 text

WEBSOCKET PERFORMANCE Both machines are bare metal 4ghz i7 4790Ks with 16GB of RAM Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 123

Slide 123 text

Slide 124

Slide 124 text

Slide 125

Slide 125 text

Slide 126

Slide 126 text

Slide 127

Slide 127 text

Slide 128

Slide 128 text

RUBY ON RAILS h3BQJEQSPUPUZQJOH h(SPXCVTJOFTTGBTU h#VTJOFTTSFRVJSFNFOUTJTBMXBZTDIBOHF 3BJMTJT HPPEBUIBOEMFJU h0QUJNJ[FGPSQSPHSBNNFSIBQQJOFTT Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 129

Slide 129 text

WHEN SYSTEM BECAME LARGE h0QTJTEJGGJDVMU h/FFENPSFFOHJOFFSTUPNBJOUBJOTZTUFN h*EMFTFSWFST XBTUFESFTPVSDFT h'BJMJOHPWFSJTBCJHQSPCMFN Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 130

Slide 130 text

AWS LAMBDA / SERVERLESS h4JNQMJGZUIFBSDIJUFDUVSF h'PDVTPOCVTJOFTTMPHJD h&BTZUPTDBMF h/FWFSQBZGPSJEMF h.PTUJNQPSUBOUTVQQPSU3VCZ Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019

Slide 131

Slide 131 text

IS RAILS + AWS LAMBDA MAKE SENSE ? + = :&4 Using AWS Lambda with Ruby on a large-scale system, Luka Huang ©RubyConf TW 2019