AWS DynamoDB Accelerator (DAX) 101

3b36493b4296ebeb219bcd3ffab3aa2b?s=47 Kenju Wagatsuma
February 14, 2020
Programming
1
4.1k

AWS DynamoDB Accelerator (DAX) 101

Introduction to AWS DynamoDB Accelerator (DAX)

3b36493b4296ebeb219bcd3ffab3aa2b?s=128

Kenju Wagatsuma

February 14, 2020
Tweet

More Decks by Kenju Wagatsuma

See All by Kenju Wagatsuma
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
1
190
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
8k
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
8.2k
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
540
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
40
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
560
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
170
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
2
920
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
310

Other Decks in Programming

See All in Programming
A6a5e01b331d18dbd9c5de1f2cc2879f?s=48 erukiti
2
340
1763273018a6f71ffe4162dd57b60a56?s=48 maryang
0
370
37618b4d60cf3d1f43f7196253264edc?s=48 numeroanddev
0
270
4131d2f57a0db2a2b4d9a62bd389fd44?s=48 tarcieri
0
250
A94b345fdc251ea9526e4709b5384b59?s=48 tsuyosh
0
200
35e08efcf39d692f540047fb756eb4e3?s=48 konifar
0
920
1a18bf1e50d7d2bdfe52a6c9fceec244?s=48 saiya_moebius
7
1.3k
F9e11bea0c22333596791dd0696f5d4f?s=48 daiksy
0
1.1k
B67d76d100e6dbb2ec11087c44d02fbf?s=48 takahiro901
0
170
933291444e456bfb511a66a2fa9c6929?s=48 j5ik2o
7
1.1k
8f1fde48dea93c5c3dd6c68c8b8cee92?s=48 kazutaka333
0
250
Af64bc38c0ffcfcabdf430759ee491ce?s=48 lovee
2
180

Featured

See All Featured
9952dfcd5d338f8a8e7175c8a8f65fb5?s=48 wjessup
333
15k
E13c31390e0369fcd5972292ce0e7b92?s=48 jnunemaker
40
4.3k
78b475797a14c84799063c7cd073962f?s=48 holman
458
270k
Fe6b81005d1553accd6b2a28f6a2bef1?s=48 phodgson
83
3.7k
9fa239b3154a0169d99ab7bf1422dd12?s=48 marcelosomers
221
14k
5ce91fa49a613cbc3e20d5f96856473f?s=48 edds
55
9.2k
20bfe76b3d6105641f879fe45cfc9272?s=48 bkeepers
407
57k
Fde6c3a50ca518a909ef35c22c0ee0e4?s=48 destraynor
144
19k
Af6a12710770ad9a7cfd08c97efd40d3?s=48 pedronauck
648
110k
11c84dff30266b907714802088852677?s=48 jasonvnalue
80
7.8k
3ab1249be442027903e1180025340b3f?s=48 reverentgeek
17
1.2k
06f8b41980eb4c577fa40c41d5030c19?s=48 keathley
12
420

Transcript

  1. DAX 101 1 2020/2/15 Kenju Wagatsuma

  2. DAX Wrap Up 2

  3. DAX is… DynamoDB-specific in-memory cache store 3

  4. [DAX] Glossary of Terms 4 5FSN %FTDSJQUJPO /PEFT "OPEFJTUIFNJOJNVNDPNQPOFOUGPSB%"9DMVTUFSl1SJNBSZOPEFzIBOEMFSFBE 

    XSJUFSFRVFTUTBOElSFQMJDBOPEFTzPOMZIBOEMFSFBESFRVFTUT $MVTUFST "DMVTUFSJTDPNQPTFEGSPN OPEFT 1BSBNFUFS(SPVQT :PVDBODIBOHF55-CZTFUUJOHDVTUPN1BSBNFUFS(SPVQT

  5. [DAX] Comparison to other cache store 5 %"9 &MBTUJDBDIFNFNDBDIFE JONFNPSZ

    .BOBHFE ✅ ✅  4IBSFEDBDIF ✅ ✅  #BDLFOEEBUBTPVSDF %ZOBNP%#POMZ BOZUIJOH .Z42- %JTL 31$ FUD .FUSJDT ✅ ✅  55- ⚠ HMPCBM55- ✅ ⚠ IBSEXPSLSFRVJSFE 1FSGPSNBODF ЖdNT dNT ЖdЖ

  6. [DAX] Single-leader Replication 6 +3 nodes for different Multi-A/Z for

    production Background replication (eventually consistent model) Single “primary node” handles all write requests

  7. Subnet C Subnet B DAX Cluster Subnet A [DAX] Single-leader

    Replication - Write 7 Primary Replica Replica

  8. DAX Cluster [DAX] Single-leader Replication - Write 8 Primary Replica

    Replica Application DynamoDB Table DynamoDB Table Write Read

  9. DAX Cluster [DAX] Single-leader Replication - Replicate 9 Primary Replica

    Replica Application DynamoDB Table DynamoDB Table Write Read

  10. DAX Cluster [DAX] Single-leader Replication - Read 10 Primary Replica

    Replica Application DynamoDB Table DynamoDB Table Write Read

  11. [DAX] Cache Algorithm 11 Least Recently Used (LRU) cache Negative

    cache also implemented Eviction happens when items are taken & cache is full Global Time-To-Live (TTL)

  12. [DAX] Item Cache / Query Cache 12 Item Cache Query

    Cache Operation GetItem / BatchGetItem Query / Scan Metrics ItemCacheHits/ItemCacheMisses QueryCacheHits/QueryCacheMisses ScanCacheHits/ScanCacheMisses

  13. [DAX] Write Strategy - Write-Through 13 #write #read Application DAX

    DynamoDB Application DAX DynamoDB

  14. [DAX] Write Strategy - Write-Around 14 #write #read Application DynamoDB

    Application DAX DynamoDB

  15. [DAX] Write Strategy 15 8SJUF5ISPVHI 8SJUF"SPVOE 1SPT 4ZODISPOJ[FEJUFNTCFUXFFO%"9 BOE%ZOBNP%# 8SJUFDBOTDBMF

    FHCVMLVQEBUF $POT ☹8SJUFPQFSBUJPOIBTPWFSIFBE ☹*UFNTDBOCFJODPOTJTUFOU JGPUIFS BQQXSJUFUP%ZOBNP%#EJSFDUMZ ☹&WFOUVBMMZ$POTJTUFOU JUFNTJO%"9 OPEFTDBOCFPVUEBUFE

  16. [DAX] Within VPC + Multi-A/Z 16

  17. [DAX] Limitation 17 Maximum nodes is 10 (1 primary node

    + ~9 replica nodes) Maximum nodes is 50 per Region. Maximum Parameter Groups is 20 per Region Maximum DAX Subnet Groups is 50 per Region. Maximum subnets per groups is 20.

  18. Monitoring 18

  19. [Monitoring] CloudWatch Metrics 19 NFUSJDT EFTDSJQUJPO $166UJMJ[BUJPO PG$16VUJMJ[BUJPOUTNBMMVTFW$16 ⚠:PVOFFEUPTDBMFVQJGUIJTNFUSJDTJTTBUVSBUFE *UFN$BDIF)JUT

    *UFN$BDIF.JTTFT $BMDVMBUF$BDIF)JU3BUJP  GSPNUIFTFNFUSJDT ⚠*UFN$BDIF2VFSZ$BDIF

  20. [Monitoring] CloudWatch Metrics 20 NFUSJDT EFTDSJQUJPO 5ISPUUMJOH3FRVFTU$PVOU PGSFRVFTUTUISPUUMFECZUIFOPEFPSDMVTUFS ⚠5ISPUUMFEBU%"95ISPUUMFEBU%ZOBNP%# 'BJMFE3FRVFTU$PVOU

    PGSFRVFTUTUIBUSFTVMUFEJOBOFSSPSSFQPSUFE ⚠&SSPS3FR$PVOU5ISPUUMFE 'BJMFE

  21. [Monitoring] CloudWatch Metrics 21 NFUSJDT EFTDSJQUJPO &WJDUFE4J[F ⚠*G$BDIF)JU3BUJP&WJDUFE4J[FJTHSPXJOH UIF XPSLJOHTFUNJHIUJODSFBTF4IPVMEDPOTJEFSTDBMFVQ

    $MJFOU$POOFDUJPOT PGTJNVMUBOFPVTDPOOFDUJPOTGSPNDMJFOUT ⚠$MJFOU$PO$PVOU㲈PG3VOOJOH5BTLT

  22. [Monitoring] Grafana 22

  23. [Monitoring] SLI/SLO 23

  24. Alerting 24

  25. [Alerting] CW Alarm - Infrastructure 25 CW Alarm SNS Topic

    Lambda Slack

  26. [Alerting] CW Alarm - CPUUtilization 26

  27. [Alerting] CW Alarm - Cache Hit Ratio 27 ItemCacheHitRatio =

    ItemCacheHits / ( ItemCacheHits + ItemCacheMisses )

  28. [Alerting] CW Alarm - Cache Hit Ratio 28

  29. [Alerting] DAX Events - Infrastructure 29 DAX Event SNS Topic

    Lambda Slack

  30. [Alerting] DAX Events - Infrastructure 30 failure/success in adding a

    node changes to the security groups