LevelDB on S3 As A KVS

Transcript

1. LevelDB'on'S3'As'A'KVS

2. Who$am$I • Shunsuke)Aihara(@shunsukeaihara) • Ξυ΍ͬͯΔ • ܭࢉݴޠֶ • ը૾ॲཧɾԻ੠ॲཧɾݴޠॲཧͷϥΠ ϒϥϦ͍Ζ͍Ζॻ͍ͯΔ

   • h1ps:/ /bitbucket.org/aihara

3. ΞυαʔόΛϦϓϨΠεͨ͠ • Python(tornado)͔Βgo.+.kamiʹॻ͖׵͑ • όουϊ΢ϋ΢Λ՚ྷʹશճආ

4. 50ms%or%DieΛ્Ή΋ͷ 1. Redis 2. Redis 3. Redis 4. GIL 5.

   etc

5. ՄೳͳݶΓڞ༗DBΛ৮Βͳ͍ ΫϥελͷϝϯςͭΒ͍ Redis͸γϯάϧεϨου

6. ΞυḉͰRDB৮Δౕ͸ԿΛ΍ͬͯ΋μϝ

7. AWSͰҰ൪҆ఆ͍ͯ҆͠෼ࢄDB͸?

8. S3

9. S3ͷ࢖͍υίϩ • S3Λͦͷ··KVSͱͯ͠࢖͏ • ผͷαʔϏεͰ࣮ࢪ&/&݁ߏεέʔϧ • shard&keyͱ͔ࢦఆͰ͖Δ͚ͲΞυαʔόͰ͸ϨΠςϯγͷ໰ ୊͕ • S3্ʹϑΝΠϧDBΛ഑ஔ

   • ϑΝΠϧDBΛόϥϚΩ

10. LevelDBΛS3ʹ഑ஔ • Norikra(+(Redshi/(+(PythonΫϥελͰ౷ܭ৘ใ΍ɺλʔήςΟ ϯά৘ใΛ͍ΖΜͳϥΠϑαΠΫϧͰߋ৽ • MessagepackܗࣜͰɺLevelDBʹ์ΓࠐΉ • h=ps:/ /github.com/shunsukeaihara/goDleveldbDobjectstorage/ •

    ֎෦ެ։൛

11. goଆ࣮૷ • golevelΛར༻ • ىಈ࣌ʹLevelDBΛμ΢ϯϩʔυ • λΠϚʔͰఆظతʹ࠶μ΢ϯϩʔυ • ҰͭͷLevelDBϑΝΠϧ΁ͷΞΫηε͸ҰͭͷGorou-neͰ •

    ϑΝΠϧͷચ͍ସ͑ͳΜ͔΋ಛʹؾʹ͠ͳ͍

12. CommandύλʔϯͬΆ͍࣮૷ • get(unpack)/set/expireͱ͔ • ଎౓ΑΓ΋ChannelΛ༻͍ͨՄಡੑΛ • MessagepackΛUnpackͨ͠σʔλ͸ΦϯϝϞϦͰΩϟογϡ • RedisͬΆ͍ExpireΛ࣮૷ •

    Expire΋:merͱChannelͰ࣮૷

13. gcTick := time.NewTicker(10 * time.Second) defer gcTick.Stop() updateTick := time.NewTicker(time.Duration(ldb.dbConf.Options.UpdateInterval)

    * time.Second) defer updateTick.Stop() for { select { case cmd := <-ldb.get: cmd.result <- ldb.execGet(cmd) case <-ldb.reset: ldb.cache = map[string]*cachedItem{} case <-updateTick.C: ldb.mu.RLock() if !ldb.downloading { go ldb.download(ctx, true) } ldb.mu.RUnlock() case msg := <-ldb.switchDB: oldDB := ldb.db oldPath := ldb.dbpath ldb.db = msg.db ldb.dbpath = msg.dbpath oldDB.Close() os.RemoveAll(oldPath) case <-ldb.expire: ldb.simpleExpire(1) case <-gcTick.C: ldb.simpleExpire(1) case msg := <-ldb.exit: ldb.db.Close() os.RemoveAll(ldb.dbpath) ldb.cache = map[string]*cachedItem{} msg <- struct{}{} break } }

14. IFͱ͔ • ςΩτ΢ʹΦϨΦϨDSL͔ΒδΣωͬͯΔ func GetCandidate(ctx context.Context, key string) ([]*data.Candidate, bool)

    { ldb, ok := levelDBFromContext(ctx, candidateDBKey) if !ok { panic("no candidate db in context") } res, ok, _ := ldb.getCandidate(key) return res, ok } func (ldb *LevelDB) getCandidate(key string) ([]*data.Candidate, bool, bool) { cmd := NewDBGetCmd(key, data.UnmarshalCandidates, int64(ldb.dbConf.Options.CacheExpire)) ldb.get <- cmd r := <-cmd.result if !r.ok { return nil, false, false } return r.val.([]*data.Candidate), r.ok, r.hit }

15. ͦΕͰ΋RedisɾMemcache͕ඞཁͳॴ΋…… • Redisࣗମ͸ਨ௚෼ࢄ/ਫฏ෼ࢄ • RedisΫϥελʹରͯ͠΋LevelDBΞΫηεͱಉ༷ɺػೳຖʹ 1Goru2neΛׂΓ౰ͯ • MessagepackΛUnpackͨ͠σʔλ΋Ωϟογϡ • ͬͪ͜ʹ΋RedisͬΆ͍expireઓུΛ࣮૷

16. ݁Ռ • ςΩτ΢ʹॻ͍ͯे෼ૣ͍ • PythonͰॻ͍͍ͯͨαʔόͷ8ഒͷεϧʔϓοτ • 10ms-or-Die͙Β͍ͷ଎౓Ͱಈ࡞ • ܕ͕༗Δͷ͸େ෼خ͍͠ͱ͍͏ؾ࣋ͪ •

    ίʔυҾ͖ܧ͗࣌ͷܕͷ͋Γ͕ͨ͞