Upgrade to Pro — share decks privately, control downloads, hide ads and more …

AWS DynamoDB Accelerator (DAX) 101

3b36493b4296ebeb219bcd3ffab3aa2b?s=47 Kenju Wagatsuma
February 14, 2020
Programming
2
5.6k

AWS DynamoDB Accelerator (DAX) 101

Introduction to AWS DynamoDB Accelerator (DAX)

3b36493b4296ebeb219bcd3ffab3aa2b?s=128

Kenju Wagatsuma

February 14, 2020
Tweet

More Decks by Kenju Wagatsuma

See All by Kenju Wagatsuma
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
62
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
8
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
1
240
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
8.9k
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
3
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
8.4k
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
580
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
67
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
630

Other Decks in Programming

See All in Programming
438799c739f93d00abc30fa2da33c543?s=48 rukiadia
2
220
72a2082c6a4dd79ad68befb3db911616?s=48 mraible
PRO
2
890
23e7f90fa36af44f13000c1229240984?s=48 uri
1
180
6aaaf03c4f5c681d89c3078bd6070a6f?s=48 rumi_yamaguchi
0
940
8e8410eb785755ae2cb485f85dbab6e8?s=48 hiroga
2
290
Cb504213a5310e01faabbc0b3fca3d39?s=48 napple29
0
150
32dd2f225c04cdaaa43ce3e63f6b304f?s=48 ih6109
1
140
7988692211244373f0e84a922a1f4f78?s=48 inabajunmr
0
8.8k
Fa9a512d547f66e1733ef8c9fcbfd009?s=48 atsushikoga
0
360
Ea059a886741b21e8d1dd992129634f7?s=48 ytsuzaki
1
330
81190ba1ece00c93c5d9736c2940895c?s=48 tasugi
0
110
0187ef0e45a8d745eafc223cf2ebb90c?s=48 tosh7
0
110

Featured

See All Featured
C7393b7ba7ec9c8890dd77d209fbb3c9?s=48 maltzj
504
37k
56c4053438af8e8b90d6f53cbb7573be?s=48 jakevdp
778
200k
20bfe76b3d6105641f879fe45cfc9272?s=48 bkeepers
PRO
415
58k
462dad0dd24c568a32dcdb0ae895ae1b?s=48 rasmusluckow
318
19k
2f5463832ccb768ccb4a1ca3607c27ef?s=48 jacobian
261
20k
A60068bce2e73de3a37ca9d2dbe36092?s=48 bryan
105
11k
D09fad3e36ae6841f54820be0e907f7a?s=48 rocio
156
12k
Fde6c3a50ca518a909ef35c22c0ee0e4?s=48 destraynor
224
48k
78b475797a14c84799063c7cd073962f?s=48 holman
294
140k
B3d6434763caa0ef5dc4b792662c49f7?s=48 smashingmag
236
18k
Aff5641764408271f7bc398f2097edd0?s=48 denniskardys
223
120k
1b8ad785acdd1ce1c99914b1c2a4e10e?s=48 sugarenia
235
960k

Transcript

  1. DAX 101 1 2020/2/15 Kenju Wagatsuma

  2. DAX Wrap Up 2

  3. DAX is… DynamoDB-specific in-memory cache store 3

  4. [DAX] Glossary of Terms 4 5FSN %FTDSJQUJPO /PEFT "OPEFJTUIFNJOJNVNDPNQPOFOUGPSB%"9DMVTUFSl1SJNBSZOPEFzIBOEMFSFBE 

    XSJUFSFRVFTUTBOElSFQMJDBOPEFTzPOMZIBOEMFSFBESFRVFTUT $MVTUFST "DMVTUFSJTDPNQPTFEGSPN OPEFT 1BSBNFUFS(SPVQT :PVDBODIBOHF55-CZTFUUJOHDVTUPN1BSBNFUFS(SPVQT

  5. [DAX] Comparison to other cache store 5 %"9 &MBTUJDBDIFNFNDBDIFE JONFNPSZ

    .BOBHFE ✅ ✅  4IBSFEDBDIF ✅ ✅  #BDLFOEEBUBTPVSDF %ZOBNP%#POMZ BOZUIJOH .Z42- %JTL 31$ FUD .FUSJDT ✅ ✅  55- ⚠ HMPCBM55- ✅ ⚠ IBSEXPSLSFRVJSFE 1FSGPSNBODF ЖdNT dNT ЖdЖ

  6. [DAX] Single-leader Replication 6 +3 nodes for different Multi-A/Z for

    production Background replication (eventually consistent model) Single “primary node” handles all write requests

  7. Subnet C Subnet B DAX Cluster Subnet A [DAX] Single-leader

    Replication - Write 7 Primary Replica Replica

  8. DAX Cluster [DAX] Single-leader Replication - Write 8 Primary Replica

    Replica Application DynamoDB Table DynamoDB Table Write Read

  9. DAX Cluster [DAX] Single-leader Replication - Replicate 9 Primary Replica

    Replica Application DynamoDB Table DynamoDB Table Write Read

  10. DAX Cluster [DAX] Single-leader Replication - Read 10 Primary Replica

    Replica Application DynamoDB Table DynamoDB Table Write Read

  11. [DAX] Cache Algorithm 11 Least Recently Used (LRU) cache Negative

    cache also implemented Eviction happens when items are taken & cache is full Global Time-To-Live (TTL)

  12. [DAX] Item Cache / Query Cache 12 Item Cache Query

    Cache Operation GetItem / BatchGetItem Query / Scan Metrics ItemCacheHits/ItemCacheMisses QueryCacheHits/QueryCacheMisses ScanCacheHits/ScanCacheMisses

  13. [DAX] Write Strategy - Write-Through 13 #write #read Application DAX

    DynamoDB Application DAX DynamoDB

  14. [DAX] Write Strategy - Write-Around 14 #write #read Application DynamoDB

    Application DAX DynamoDB

  15. [DAX] Write Strategy 15 8SJUF5ISPVHI 8SJUF"SPVOE 1SPT 4ZODISPOJ[FEJUFNTCFUXFFO%"9 BOE%ZOBNP%# 8SJUFDBOTDBMF

    FHCVMLVQEBUF $POT ☹8SJUFPQFSBUJPOIBTPWFSIFBE ☹*UFNTDBOCFJODPOTJTUFOU JGPUIFS BQQXSJUFUP%ZOBNP%#EJSFDUMZ ☹&WFOUVBMMZ$POTJTUFOU JUFNTJO%"9 OPEFTDBOCFPVUEBUFE

  16. [DAX] Within VPC + Multi-A/Z 16

  17. [DAX] Limitation 17 Maximum nodes is 10 (1 primary node

    + ~9 replica nodes) Maximum nodes is 50 per Region. Maximum Parameter Groups is 20 per Region Maximum DAX Subnet Groups is 50 per Region. Maximum subnets per groups is 20.

  18. Monitoring 18

  19. [Monitoring] CloudWatch Metrics 19 NFUSJDT EFTDSJQUJPO $166UJMJ[BUJPO PG$16VUJMJ[BUJPOUTNBMMVTFW$16 ⚠:PVOFFEUPTDBMFVQJGUIJTNFUSJDTJTTBUVSBUFE *UFN$BDIF)JUT

    *UFN$BDIF.JTTFT $BMDVMBUF$BDIF)JU3BUJP  GSPNUIFTFNFUSJDT ⚠*UFN$BDIF2VFSZ$BDIF

  20. [Monitoring] CloudWatch Metrics 20 NFUSJDT EFTDSJQUJPO 5ISPUUMJOH3FRVFTU$PVOU PGSFRVFTUTUISPUUMFECZUIFOPEFPSDMVTUFS ⚠5ISPUUMFEBU%"95ISPUUMFEBU%ZOBNP%# 'BJMFE3FRVFTU$PVOU

    PGSFRVFTUTUIBUSFTVMUFEJOBOFSSPSSFQPSUFE ⚠&SSPS3FR$PVOU5ISPUUMFE 'BJMFE

  21. [Monitoring] CloudWatch Metrics 21 NFUSJDT EFTDSJQUJPO &WJDUFE4J[F ⚠*G$BDIF)JU3BUJP&WJDUFE4J[FJTHSPXJOH UIF XPSLJOHTFUNJHIUJODSFBTF4IPVMEDPOTJEFSTDBMFVQ

    $MJFOU$POOFDUJPOT PGTJNVMUBOFPVTDPOOFDUJPOTGSPNDMJFOUT ⚠$MJFOU$PO$PVOU㲈PG3VOOJOH5BTLT

  22. [Monitoring] Grafana 22

  23. [Monitoring] SLI/SLO 23

  24. Alerting 24

  25. [Alerting] CW Alarm - Infrastructure 25 CW Alarm SNS Topic

    Lambda Slack

  26. [Alerting] CW Alarm - CPUUtilization 26

  27. [Alerting] CW Alarm - Cache Hit Ratio 27 ItemCacheHitRatio =

    ItemCacheHits / ( ItemCacheHits + ItemCacheMisses )

  28. [Alerting] CW Alarm - Cache Hit Ratio 28

  29. [Alerting] DAX Events - Infrastructure 29 DAX Event SNS Topic

    Lambda Slack

  30. [Alerting] DAX Events - Infrastructure 30 failure/success in adding a

    node changes to the security groups