Pro Yearly is on sale from $80 to $50! »

AWS DynamoDB Accelerator (DAX) 101

3b36493b4296ebeb219bcd3ffab3aa2b?s=47 Kenju Wagatsuma
February 14, 2020
Programming
2
4.6k

AWS DynamoDB Accelerator (DAX) 101

Introduction to AWS DynamoDB Accelerator (DAX)

3b36493b4296ebeb219bcd3ffab3aa2b?s=128

Kenju Wagatsuma

February 14, 2020
Tweet

More Decks by Kenju Wagatsuma

See All by Kenju Wagatsuma
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
1
200
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
8.3k
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
8.2k
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
550
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
46
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
570
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
180
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
2
1k
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
340

Other Decks in Programming

See All in Programming
64c1a3841da6d254ac11d9d842e04ce4?s=48 dalinaum
1
560
911650d8fcd455d179e45b4bf6cb7219?s=48 masaykisano
0
310
0eba807ea367a2b648480d20f52d3af3?s=48 haco
0
220
7edddae207b212e5e035133d9eb10b82?s=48 russhwolf
1
190
3d6ace9554821d552146413bcdf874f6?s=48 trishagee
1
150
9f3a83db74bee75a64b5e6ed106a775c?s=48 twada
39
14k
B58b002245bdcc345dac78d426e6332b?s=48 junki555
5
2.1k
38de416c9984b22bff1d2b049c7d51a8?s=48 fossamagna
0
1.1k
83722380372c00bd75ac920f2089f6aa?s=48 zacky1972
0
200
C302e84057a922dce0ecbe80207e3fcc?s=48 mu_zaru
1
140
4ae5ae2c4411d41bd8c7e75830ed313d?s=48 myamagishi
1
230
B932b972f9334d4d333224468f3f84d9?s=48 yyh_gl
0
130

Featured

See All Featured
15f2b8221f247985a27a627d2ece72f0?s=48 pauljervisheath
195
15k
Dad095ea7038f89f760419ce475d5d14?s=48 michaelherold
225
8.4k
9cde37f47e4a800ea081ea42de8d749a?s=48 dougneiner
119
7.8k
E4f5d494ebdc9e7cce1aecf3ce3e8bc1?s=48 shpigford
366
42k
F383c6a4dc55e331bbe2987b622cee6b?s=48 stephaniewalter
258
11k
7cbd3f5f922d798cc312eaf596de7ae6?s=48 iamctodd
13
1.7k
Ba530e786553390f3fb271848485681c?s=48 3n
162
22k
D8fc2580cfaca035f666d9e4ee79a7f7?s=48 mongodb
23
3.7k
0c6fd6a08d0f898159cda7cafcacf07f?s=48 afnizarnur
176
14k
F57e2136eb9895eb95ff5dc8a1c02677?s=48 zakiwarfel
87
3.3k
56c4053438af8e8b90d6f53cbb7573be?s=48 jakevdp
773
200k
016edace78ffe826f2348d1e0c504afd?s=48 maggiecrowley
7
340

Transcript

  1. DAX 101 1 2020/2/15 Kenju Wagatsuma

  2. DAX Wrap Up 2

  3. DAX is… DynamoDB-specific in-memory cache store 3

  4. [DAX] Glossary of Terms 4 5FSN %FTDSJQUJPO /PEFT "OPEFJTUIFNJOJNVNDPNQPOFOUGPSB%"9DMVTUFSl1SJNBSZOPEFzIBOEMFSFBE 

    XSJUFSFRVFTUTBOElSFQMJDBOPEFTzPOMZIBOEMFSFBESFRVFTUT $MVTUFST "DMVTUFSJTDPNQPTFEGSPN OPEFT 1BSBNFUFS(SPVQT :PVDBODIBOHF55-CZTFUUJOHDVTUPN1BSBNFUFS(SPVQT

  5. [DAX] Comparison to other cache store 5 %"9 &MBTUJDBDIFNFNDBDIFE JONFNPSZ

    .BOBHFE ✅ ✅  4IBSFEDBDIF ✅ ✅  #BDLFOEEBUBTPVSDF %ZOBNP%#POMZ BOZUIJOH .Z42- %JTL 31$ FUD .FUSJDT ✅ ✅  55- ⚠ HMPCBM55- ✅ ⚠ IBSEXPSLSFRVJSFE 1FSGPSNBODF ЖdNT dNT ЖdЖ

  6. [DAX] Single-leader Replication 6 +3 nodes for different Multi-A/Z for

    production Background replication (eventually consistent model) Single “primary node” handles all write requests

  7. Subnet C Subnet B DAX Cluster Subnet A [DAX] Single-leader

    Replication - Write 7 Primary Replica Replica

  8. DAX Cluster [DAX] Single-leader Replication - Write 8 Primary Replica

    Replica Application DynamoDB Table DynamoDB Table Write Read

  9. DAX Cluster [DAX] Single-leader Replication - Replicate 9 Primary Replica

    Replica Application DynamoDB Table DynamoDB Table Write Read

  10. DAX Cluster [DAX] Single-leader Replication - Read 10 Primary Replica

    Replica Application DynamoDB Table DynamoDB Table Write Read

  11. [DAX] Cache Algorithm 11 Least Recently Used (LRU) cache Negative

    cache also implemented Eviction happens when items are taken & cache is full Global Time-To-Live (TTL)

  12. [DAX] Item Cache / Query Cache 12 Item Cache Query

    Cache Operation GetItem / BatchGetItem Query / Scan Metrics ItemCacheHits/ItemCacheMisses QueryCacheHits/QueryCacheMisses ScanCacheHits/ScanCacheMisses

  13. [DAX] Write Strategy - Write-Through 13 #write #read Application DAX

    DynamoDB Application DAX DynamoDB

  14. [DAX] Write Strategy - Write-Around 14 #write #read Application DynamoDB

    Application DAX DynamoDB

  15. [DAX] Write Strategy 15 8SJUF5ISPVHI 8SJUF"SPVOE 1SPT 4ZODISPOJ[FEJUFNTCFUXFFO%"9 BOE%ZOBNP%# 8SJUFDBOTDBMF

    FHCVMLVQEBUF $POT ☹8SJUFPQFSBUJPOIBTPWFSIFBE ☹*UFNTDBOCFJODPOTJTUFOU JGPUIFS BQQXSJUFUP%ZOBNP%#EJSFDUMZ ☹&WFOUVBMMZ$POTJTUFOU JUFNTJO%"9 OPEFTDBOCFPVUEBUFE

  16. [DAX] Within VPC + Multi-A/Z 16

  17. [DAX] Limitation 17 Maximum nodes is 10 (1 primary node

    + ~9 replica nodes) Maximum nodes is 50 per Region. Maximum Parameter Groups is 20 per Region Maximum DAX Subnet Groups is 50 per Region. Maximum subnets per groups is 20.

  18. Monitoring 18

  19. [Monitoring] CloudWatch Metrics 19 NFUSJDT EFTDSJQUJPO $166UJMJ[BUJPO PG$16VUJMJ[BUJPOUTNBMMVTFW$16 ⚠:PVOFFEUPTDBMFVQJGUIJTNFUSJDTJTTBUVSBUFE *UFN$BDIF)JUT

    *UFN$BDIF.JTTFT $BMDVMBUF$BDIF)JU3BUJP  GSPNUIFTFNFUSJDT ⚠*UFN$BDIF2VFSZ$BDIF

  20. [Monitoring] CloudWatch Metrics 20 NFUSJDT EFTDSJQUJPO 5ISPUUMJOH3FRVFTU$PVOU PGSFRVFTUTUISPUUMFECZUIFOPEFPSDMVTUFS ⚠5ISPUUMFEBU%"95ISPUUMFEBU%ZOBNP%# 'BJMFE3FRVFTU$PVOU

    PGSFRVFTUTUIBUSFTVMUFEJOBOFSSPSSFQPSUFE ⚠&SSPS3FR$PVOU5ISPUUMFE 'BJMFE

  21. [Monitoring] CloudWatch Metrics 21 NFUSJDT EFTDSJQUJPO &WJDUFE4J[F ⚠*G$BDIF)JU3BUJP&WJDUFE4J[FJTHSPXJOH UIF XPSLJOHTFUNJHIUJODSFBTF4IPVMEDPOTJEFSTDBMFVQ

    $MJFOU$POOFDUJPOT PGTJNVMUBOFPVTDPOOFDUJPOTGSPNDMJFOUT ⚠$MJFOU$PO$PVOU㲈PG3VOOJOH5BTLT

  22. [Monitoring] Grafana 22

  23. [Monitoring] SLI/SLO 23

  24. Alerting 24

  25. [Alerting] CW Alarm - Infrastructure 25 CW Alarm SNS Topic

    Lambda Slack

  26. [Alerting] CW Alarm - CPUUtilization 26

  27. [Alerting] CW Alarm - Cache Hit Ratio 27 ItemCacheHitRatio =

    ItemCacheHits / ( ItemCacheHits + ItemCacheMisses )

  28. [Alerting] CW Alarm - Cache Hit Ratio 28

  29. [Alerting] DAX Events - Infrastructure 29 DAX Event SNS Topic

    Lambda Slack

  30. [Alerting] DAX Events - Infrastructure 30 failure/success in adding a

    node changes to the security groups