Upgrade to Pro — share decks privately, control downloads, hide ads and more …

AWS DynamoDB Accelerator (DAX) 101

3b36493b4296ebeb219bcd3ffab3aa2b?s=47 Kenju Wagatsuma
February 14, 2020
Programming
2
4.8k

AWS DynamoDB Accelerator (DAX) 101

Introduction to AWS DynamoDB Accelerator (DAX)

3b36493b4296ebeb219bcd3ffab3aa2b?s=128

Kenju Wagatsuma

February 14, 2020
Tweet

More Decks by Kenju Wagatsuma

See All by Kenju Wagatsuma
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
1
210
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
8.4k
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
8.3k
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
560
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
48
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
590
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
190
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
2
1k
3b36493b4296ebeb219bcd3ffab3aa2b?s=48 kenju
0
350

Other Decks in Programming

See All in Programming
Bc7114ad3cf4d2d703dc71782e61ba43?s=48 alperhankendi
1
140
948c23c57a850629ff283f2a83088173?s=48 yotuba088
1
590
Dcbf2269af2483cabf43128ad1718c11?s=48 grapecity_dev
0
170
Cd34440e6c181704f318319e131af68d?s=48 naokioouchi
1
180
6c366ab6293eb42aec0e6f5f69b50882?s=48 ryokbt
2
280
6734b737614a599f9b899f190e413d2d?s=48 deepflow
5
1.5k
3009eedce0d0f7ae45987a7bd8f57b85?s=48 nkjzm
1
160
15934fa2aa7b2ce21f091e9b7cffa856?s=48 manfredsteyer
PRO
0
120
15934fa2aa7b2ce21f091e9b7cffa856?s=48 manfredsteyer
PRO
0
140
Ee398a67f5017cc2ad5c02d67d10e516?s=48 doyaaaaaken
0
790
Ec9c7f38de8068e3690b53e4d9bb609d?s=48 s103ng
0
240
32ae0ae04b5c4f1b29ee9e8826823fbc?s=48 joergneumann
0
120

Featured

See All Featured
F383c6a4dc55e331bbe2987b622cee6b?s=48 stephaniewalter
260
11k
9fa239b3154a0169d99ab7bf1422dd12?s=48 marcelosomers
221
15k
6bb82b13cda86d3b821fa44100335ddf?s=48 thoeni
4
590
Aff5641764408271f7bc398f2097edd0?s=48 denniskardys
220
120k
B83d5b590577969ee79a5ad845411a7d?s=48 ammeep
656
54k
A0517b08532aec8ab2aae3f65d40ad86?s=48 hannesfritz
28
950
5f83ef806155b403c3393160ce51f955?s=48 jlugia
217
16k
7c8469ee8c9e594c65c59b919626c08d?s=48 scottboms
251
11k
B3ace07412a5178ea778e7eec161fc0a?s=48 jcasabona
8
550
D47656e20ff5e42f125fc5ea0fd636c6?s=48 tmm1
61
9.2k
D83926c323d4f9289f947b4b4e76b939?s=48 jensimmons
207
10k
32de0bd2ba869609d26fd052a4622778?s=48 cromwellryan
104
6.1k

Transcript

  1. DAX 101 1 2020/2/15 Kenju Wagatsuma

  2. DAX Wrap Up 2

  3. DAX is… DynamoDB-specific in-memory cache store 3

  4. [DAX] Glossary of Terms 4 5FSN %FTDSJQUJPO /PEFT "OPEFJTUIFNJOJNVNDPNQPOFOUGPSB%"9DMVTUFSl1SJNBSZOPEFzIBOEMFSFBE 

    XSJUFSFRVFTUTBOElSFQMJDBOPEFTzPOMZIBOEMFSFBESFRVFTUT $MVTUFST "DMVTUFSJTDPNQPTFEGSPN OPEFT 1BSBNFUFS(SPVQT :PVDBODIBOHF55-CZTFUUJOHDVTUPN1BSBNFUFS(SPVQT

  5. [DAX] Comparison to other cache store 5 %"9 &MBTUJDBDIFNFNDBDIFE JONFNPSZ

    .BOBHFE ✅ ✅  4IBSFEDBDIF ✅ ✅  #BDLFOEEBUBTPVSDF %ZOBNP%#POMZ BOZUIJOH .Z42- %JTL 31$ FUD .FUSJDT ✅ ✅  55- ⚠ HMPCBM55- ✅ ⚠ IBSEXPSLSFRVJSFE 1FSGPSNBODF ЖdNT dNT ЖdЖ

  6. [DAX] Single-leader Replication 6 +3 nodes for different Multi-A/Z for

    production Background replication (eventually consistent model) Single “primary node” handles all write requests

  7. Subnet C Subnet B DAX Cluster Subnet A [DAX] Single-leader

    Replication - Write 7 Primary Replica Replica

  8. DAX Cluster [DAX] Single-leader Replication - Write 8 Primary Replica

    Replica Application DynamoDB Table DynamoDB Table Write Read

  9. DAX Cluster [DAX] Single-leader Replication - Replicate 9 Primary Replica

    Replica Application DynamoDB Table DynamoDB Table Write Read

  10. DAX Cluster [DAX] Single-leader Replication - Read 10 Primary Replica

    Replica Application DynamoDB Table DynamoDB Table Write Read

  11. [DAX] Cache Algorithm 11 Least Recently Used (LRU) cache Negative

    cache also implemented Eviction happens when items are taken & cache is full Global Time-To-Live (TTL)

  12. [DAX] Item Cache / Query Cache 12 Item Cache Query

    Cache Operation GetItem / BatchGetItem Query / Scan Metrics ItemCacheHits/ItemCacheMisses QueryCacheHits/QueryCacheMisses ScanCacheHits/ScanCacheMisses

  13. [DAX] Write Strategy - Write-Through 13 #write #read Application DAX

    DynamoDB Application DAX DynamoDB

  14. [DAX] Write Strategy - Write-Around 14 #write #read Application DynamoDB

    Application DAX DynamoDB

  15. [DAX] Write Strategy 15 8SJUF5ISPVHI 8SJUF"SPVOE 1SPT 4ZODISPOJ[FEJUFNTCFUXFFO%"9 BOE%ZOBNP%# 8SJUFDBOTDBMF

    FHCVMLVQEBUF $POT ☹8SJUFPQFSBUJPOIBTPWFSIFBE ☹*UFNTDBOCFJODPOTJTUFOU JGPUIFS BQQXSJUFUP%ZOBNP%#EJSFDUMZ ☹&WFOUVBMMZ$POTJTUFOU JUFNTJO%"9 OPEFTDBOCFPVUEBUFE

  16. [DAX] Within VPC + Multi-A/Z 16

  17. [DAX] Limitation 17 Maximum nodes is 10 (1 primary node

    + ~9 replica nodes) Maximum nodes is 50 per Region. Maximum Parameter Groups is 20 per Region Maximum DAX Subnet Groups is 50 per Region. Maximum subnets per groups is 20.

  18. Monitoring 18

  19. [Monitoring] CloudWatch Metrics 19 NFUSJDT EFTDSJQUJPO $166UJMJ[BUJPO PG$16VUJMJ[BUJPOUTNBMMVTFW$16 ⚠:PVOFFEUPTDBMFVQJGUIJTNFUSJDTJTTBUVSBUFE *UFN$BDIF)JUT

    *UFN$BDIF.JTTFT $BMDVMBUF$BDIF)JU3BUJP  GSPNUIFTFNFUSJDT ⚠*UFN$BDIF2VFSZ$BDIF

  20. [Monitoring] CloudWatch Metrics 20 NFUSJDT EFTDSJQUJPO 5ISPUUMJOH3FRVFTU$PVOU PGSFRVFTUTUISPUUMFECZUIFOPEFPSDMVTUFS ⚠5ISPUUMFEBU%"95ISPUUMFEBU%ZOBNP%# 'BJMFE3FRVFTU$PVOU

    PGSFRVFTUTUIBUSFTVMUFEJOBOFSSPSSFQPSUFE ⚠&SSPS3FR$PVOU5ISPUUMFE 'BJMFE

  21. [Monitoring] CloudWatch Metrics 21 NFUSJDT EFTDSJQUJPO &WJDUFE4J[F ⚠*G$BDIF)JU3BUJP&WJDUFE4J[FJTHSPXJOH UIF XPSLJOHTFUNJHIUJODSFBTF4IPVMEDPOTJEFSTDBMFVQ

    $MJFOU$POOFDUJPOT PGTJNVMUBOFPVTDPOOFDUJPOTGSPNDMJFOUT ⚠$MJFOU$PO$PVOU㲈PG3VOOJOH5BTLT

  22. [Monitoring] Grafana 22

  23. [Monitoring] SLI/SLO 23

  24. Alerting 24

  25. [Alerting] CW Alarm - Infrastructure 25 CW Alarm SNS Topic

    Lambda Slack

  26. [Alerting] CW Alarm - CPUUtilization 26

  27. [Alerting] CW Alarm - Cache Hit Ratio 27 ItemCacheHitRatio =

    ItemCacheHits / ( ItemCacheHits + ItemCacheMisses )

  28. [Alerting] CW Alarm - Cache Hit Ratio 28

  29. [Alerting] DAX Events - Infrastructure 29 DAX Event SNS Topic

    Lambda Slack

  30. [Alerting] DAX Events - Infrastructure 30 failure/success in adding a

    node changes to the security groups