The Architect of Anjuke Inc.

安居客网站架构 - Think in LAMP 2012.6

Transcript

1. 安居客
   Think in LAMP - 2012.6
   网站架构
   

   View Slide

2. ,+^,,|;:':`.: ` ````
   .,,|,,|::..;: . :.. .
   ,,;qgWWggWHWMWWdWWWmdL... `
   ,,dBBBBgB$BH&BBBBBBBWB@BWBBW,+=:
   ,dBQQ&@BWWBBBB@0BBBWWW@WW@BBWB@WWBWq.
   ,dBB@WWBBB0WBWBBWWBWBBWBBBBWQHB@WB@B@WW0m+
   ,B@0WB@W@BB$BBBHWBBB@@WB@BBBBBW@WWWWWWWW@WWW
   ,M@BB@B000@0MBBBBBBBBBWBBBBBWBBW@WBBWWWWWWWWW@
   ,d&B0WBB@@#!^|J0BBBBBBB@WWBWBWBW@W@WWBWW@WWWWWWW
   .+BBBBW@D!^` .199BgBBBBWBBWBW@WWWW@@@BWWWWWWWW
   JWBBHB@^` 'J39BWBBBWWBBW@WBW@BBWW7WWWWWWW
   1MBBW@ +: `^I$BBBBBWWBBBWBWB@9@E$WWWWWW
   ,W0QW! +a|` .',;=JBWBWBBBBBB0WBWW+@;BWWWWWW
   ,WWB@ dBE,,ggdY .::+9BB@WBBBB0W0B9E+!dWWWWWWW
   B&B'+MBiBg^" ,||z40BBB0BBV^4W@T+!qWWWWWWWW
   '4E .31i$E+` .;JIIII4BQBWMHkJ@\'',dBBWWWWWWW
   Wg .'`` .,=,^^z=XIM0BBHMuBT:+dBB$@WWWWWWW
   $@! .;^;|;^IIII4sMWMjHBaQBBBBBWWWWWWWW
   ^ ..=|^,^;^^zIIUMMHoHW0BA6BHBWWWWWWWW
   .;,|^||||^^IIXVwHBH4H4BOBBWWWWWWWW@
   .,zad: .`|^;|^,=^z+IXHHBMBP44BBBB0WWWWWWWW
   ,qB0@9\ `;^^|==z^zIUHHH4BBhPBMMBBBWWWWWW@W
   ?9WWI|`.`|,|.`=|=zzzzIIUHMHHBNBB4WMMBBBBWWWWWWW
   JC+qdHQe1;==+z==IIVUHHHBUUBBBGoFMMM0BBWWWWWW
   XBBW@T:.;zzI^IIcUHQWB9UUUUBBIFYYMMBBBWWWWWW
   ,Q@',vz|,2=!=IIHWqNUBdddUUpBMMsMMMH0BBBWWWW
   ,IdW#,J|^|dQMHKBBUBBdOdBBDMzLMHoMBBBBBWWB
   ?9B@" .;zHHBdBBUO666OBBD#XXXLHMHwMBBB0WB
   ,^.,+dQHW%BdH9AHB0B00#1Iz1XIOMHtMMsY0BI
   3IWWgWBBBRBBB0BMO#V^|^|^1XLUMMsYHvMMW
   .,,+9@@@0@B00B0B8XIII!,,:|^=cUHHMU##XLHM
   ` 9J2BWOIIII^;;==zIUUvvLXrXcXHH
   ,dEJBBYHII^,|^IIrOMsCX1IIggdH
   ,r 0LJ3##IzIaaggggggWWBWWWWWWWW
   .` .dB@@W@WWWWWWWWWWW@W@W@W@WW@
   .s ,,,,,+. WB@BW@@@@@@WW@@W@@@W@W@W@W@
   .,,,,. .J! .,+gB&&&B$BW@@WW@B@@@@@W@W@@@W@@W@W@WW@@WWW
   @erning
   •ழ΁ʈ೻ࢪ
   •2008ϋ̋ɝτ֢܄
   •eBay CDC
   •35ʝ䝀
   

   View Slide

3. View Slide

4. •4㽗ၣ१ anjuke.com, aifang.com, haozu.com, jinpu.com
   •୅ਗᏐ͜ iOS, Android, Windows Phone
   •3ɷຬUV/˜
   •2ɷຬPV/˂
   •~150̨؂䕂ኜ，3㽗IDC
   •ڐ200Зʈ೻ࢪ
   

   View Slide

5. 㽢ʃՑɽ
   ɽߧʧୗτ֢܄ݖ࿴੽ʃՑɽٙᜊʷཀ೻
   

   View Slide

6. 1 2 3 4 5 6 7 8 9 10 11 12
   0
   500000
   1000000
   1500000
   2000000
   2500000
   10X
   200K 2M
   →
   DB
   Replication
   LIKE% ➡ SOLR
   V2
   Squid
   Memcached
   Distributed
   Images
   RabbitMQ
   DB Sharding
   1㽗IDC,2̨؂ਕኜ 2㽗IDC,17̨؂ਕኜ
   Linux Apache MySQL PHP
   

   View Slide

7. hᅰኽࢫ
   hฤ॰
   hᇠπ
   hྡ˪ӻ୕
   hऊࢹඟΐ
   

   View Slide

8. hᅰኽࢫ
   hฤ॰
   hᇠπ
   hྡ˪ӻ䕠
   hऊࢹඟΐ
   

   View Slide

9. ԟჿҢࡁ͜ɪSolrʔఱλə෗?
   

   View Slide

10. hɓක֐̥Ϟɓࡈ॰ˏג๕
    h॰ˏ஼နεৎԸ຾ߏɛ、ήྡ、ሞእ、ฤ॰౤ͪ
    h॰ˏٙ˖Ꮶᅰඎᄣɽװʱϓεࡈ
    hɓࡈၣ१ᜊމεࡈτ֢܄、ฌג、λॡ、ږ⧕、୅ਗ
    hุਕሜ዆॰ˏ຾੬ࠅࠠܔ
    h൳Ը൳εSolrٙྼԷცࠅ၍ଣ
    

    View Slide

11. ̙˸ІпஷཀWebޢࠦ௴ܔձ၍ଣSolr䕏Է
    Solr Cloud
    

    View Slide

12. ɓ㽗Serviceε㽗Instance
    

    View Slide

13. ίᇞݟ޶ձࡌҷschema
    

    View Slide

14. h77㽗ʔΝٙ॰ˏ
    h98㽗༶БʕٙSolr䕏Է
    h௅໇ί12̨يଣዚኜɪ
    hӊ˂ߒ8000ຬٙฤ॰
    ٤ඝٙSolr䕏Է̙˸ᎇࣛܲცʱৣ，ਗ࿒ሜ዆
    

    View Slide

15. hᅰኽࢫ
    hฤ॰
    hᇠπ
    hྡ˪ӻ䕠
    hऊࢹඟΐ
    

    View Slide

16. hӊ˂อɪෂ120ຬੵ๫˪
    hӊ˂ྡ˪ሗӋߒ1.4䖐ϣ
    hߒ4䖐ੵྡ˪，44TBπᎷ
    h௅໇ίዹͭٙIDC，40+PC̨؂䕂ኜ
    hCDN
    

    View Slide

17. hྡ˪ӻ䕠݅ᔊఊɦልᕏ
    hҢࡁٙҷி຾ዝəɟࡈචݬ
    htdocs/images ዹͭٙimg1~n ၾᏐ͜༆ᇩ ್Χ݊ͦۃٙӻ䕠
    hᅺࡘʷ؂ਕટɹ
    ዹͭஷٙ͜؂䕂；̙֛Ⴁ，νˉʂձ˥Ι
    hMogileFSЪމྡ˪πᎷ
    

    View Slide

18. hMogileFSԢڭπ˲̥ڭπࡡྡ
    Ңࡁӊੵྡ˪ڭπ2΅；͜กូٙSATA೷盘，XFS˖΁ӻ୕
    h˸ࡡྡٙʫ࢙hash࠽Ъމ˖΁Τ
    ͟׵ุਕٙᗫڷ，ҢࡁϞ൴ཀ60%ٙอɪෂྡ˪݊ࠠልٙ
    hᜑͪٙࣛࡉʑஈଣྡ˪
    уʲྡ͂˥Ι，ஈଣλٙྡ˪ίۃ၌ᇠπ
    h˕ܵεࡈၣ१
    Էνίτ֢܄ɪෂٙྡ˪，̙˸ίλॡၣ˸λॡٙˉʂձ˥Ι࢝ͪ
    hဲЧൈ৿ྡ˪ᗆй
    ί࿁อɪෂٙྡ˪͂ɪTag，̙͜ɲᗆйࠠልٙձ੭˥Ιٙྡ˪
    

    View Slide

19. h፯኿ᔊఊྼٙ͜˙ࣩ
    h஼Ӊҷආ，ʔ͜ɓӉՑЗ
    hᜫࠠልٙ௶ਗІਗʷ
    㽢ʃՑɽٙཀ೻ʕ
    

    View Slide

20. ᗫءක೯ձ಻༊
    ၣ१ٙݖ࿴ʔස݊வԬ͛ପᐑྤٙଡ଼΁
    

    View Slide

21. hක೯࣪ݖ
    h๕˾ᇁ၍ଣ
    h಻༊ᐑྤ
    

    View Slide

22. hක೯࣪ݖ
    h๕˾ᇁ၍ଣ
    h಻༊ᐑྤ
    

    View Slide

23. ๕˾ᇁٙو͉၍ଣ
    masterڭܵᖢ֛
    ධͦί΢Іٙfeature branchක೯
    ̌ঐ಻༊ஷཀܝmergeΫ˴ʍ
    紧ܢٙॹ௘ίrelease branchɪࡌҷ
    

    View Slide

24. ᕎ
    ᇞ
    ʈ
    Ъ
    

    View Slide

25. GitCorp
    

    View Slide

26. ڢ䅎Փ
    Code Review
    

    View Slide

27. hක೯࣪ݖ
    h๕˾ᇁ၍ଣ
    h಻༊ᐑྤ
    

    View Slide

28. h12-Factor App ѓൡҢࡁ
    ක䕆、಻༊、͛ପᐑྤ൳ટڐ൳λ
    hක䕆ᐑྤ.$username.dev.anjuke.com
    h಻༊ᐑྤ.$fp#.qa.anjuke.com
    h͛ପᐑྤ.anjuke.com
    

    View Slide

29. TiP
    Test in Production
    

    View Slide

30. hεو͉̺໇
    ዚኜɪΝࣛϞεࡈو͉ٙ˾ᇁ，͟ৣໄܸ׼Ꮠ༈༶Бࡳࡈو͉
    hܸ֛༶Бو͉
    ӊࡈɛ̙˸ܸ֛ʔΝٙو͉
    hܸ֛༶Бዚኜ
    ᒔ̙˸ܸ֛ሗӋໝίࡳ̨؂䕂ኜɪ
    hBetaձGA
    Ңࡁٙݖ࿴˕ܵί͛ପᐑྤj
    

    View Slide

31. m=app10-019, v=20120605_03
    hεو͉̺໇
    hܸ֛༶Бو͉
    hܸ֛༶Бዚኜ
    hBetaձGA
    ӊࡈɛ̙˸ܸ֛ʔΝٙو͉
    

    View Slide

32. m=app10-019, v=20120605_03
    hεو͉̺໇
    hܸ֛༶Бو͉
    hܸ֛༶Бዚኜ
    hBetaձGA
    ᒔ̙˸ܸ֛ሗӋໝίࡳ̨؂䕂ኜɪ
    

    View Slide

33. hεو͉̺໇
    hܸ֛༶Бو͉
    hܸ֛༶Бዚኜ
    hBetaձGA
    ί፬ʮ܃ʫ௅ᐼ݊Ꮄ΋ஞਪBetaو͉
    

    View Slide

34. ݖ࿴Ꮠ༈ܼ̍ක೯ձ಻༊
    

    View Slide

35. л͜ᅰỼձʈՈ
    ፅඎݖ࿴ٙࣖ؈，ЪމҷආٙԱኽ
    

    View Slide

36. hਿᓾ္ٙછ
    hІ່֛ٙజڌ
    h༉୚ٙᅰኽʱؓ
    h˕ุܵਕᅰኽDW/BI
    

    View Slide

37. cacti
    

    View Slide

38. ᅰኽࢫٙԴ͜฿ر
    

    View Slide

39. ᅰኽࢫٙ༉୚္છ
    

    View Slide

40. Memcached / Varnish
    

    View Slide

41. pyfisheyes֛Ⴁྡڌ
    

    View Slide

42. DW/BI 䣽䕂ʱؓʕː
    

    View Slide

43. ༉୚ʧୗɓࡈҢᙂ੻
    ܘϞจܠٙᅰኽ
    

    View Slide

44. PHPሗӋٙஈଣࣛගʱ̺
    hεᅰ͜䔚ٙᚤᏐ时䞯݊εˇ?
    h90%ٙ͜˒ᚤᏐࣛග݊εˇ?
    hՈ᜗Ցӊ㽗Controller
    

    View Slide

45. PHPሗӋٙ༉୚ઋر
    

    View Slide

46. View Slide

47. View Slide

48. View Slide

49. View Slide

50. View Slide

51. ᅰኽձʈՈܘϞᏍп
    ݖ࿴ٙணࠇࠅϽᅇᅰኽٙમණ
    

    View Slide

52. ܵᚃҷආ
    ఐϼᒮேStay hungry, Stay foolish
    

    View Slide

53. APS
    P2PٙऊࢹඟΐձମӉჃཀ೻ሜ͜
    ØMQ
    

    View Slide

54. ᐏ՟ਪᕚ༉୚ڦࢹ
    ᐏ՟޴ᗫਪᕚΐڌ
    ᐏ՟Ϋഈΐڌ
    10
    15
    30
    ഐҼ
    ක֐
    10+15+30=55 (ms)
    

    View Slide

55. ᐏ՟ਪᕚ༉୚ڦࢹ ᐏ՟޴ᗫਪᕚΐڌ
    ᐏ՟Ϋഈΐڌ
    10
    15
    30
    ഐҼ
    ක֐
    max(10+15, 30)=30 (ms)
    

    View Slide

56. hP2Pٙऊࢹ䕆৔
    hPHPٙମӉ˙جሜ͜
    hൈᏝٙऊࢹᐼᇞ
    PHP܄䔚၌ٙ4㽗Ռ数
    

    View Slide

57. ᐏ՟ਪᕚ༉୚ڦࢹ ᐏ՟޴ᗫਪᕚΐڌ
    ᐏ՟Ϋഈΐڌ
    10
    15
    30
    ഐҼ
    ක֐
    start_request()
    wait_for_replies()
    

    View Slide

58. ➡ ፯኿ᔊఊྼٙ͜˙ࣩ
    ➡ Νࣛᗫءක೯ձ಻༊
    ➡ л͜ᅰኽձʈՈ
    ➡ ܵᚃҷආ
    Ң࿁ၣ१ݖ࿴ٙ᜗ึ݊
    

    View Slide

59. Thanks
    zhang@erning.com
    

    View Slide