Exploring the Limits of Transfer Learning with Unified Text-to-Text Transformer

Exploring the Limits of Transfer Learning with Unified Text-to-Text Transformer

A42dd3541cd40296dcd8a5e6b4a01bef?s=128

Scatter Lab Inc.

May 22, 2020
Tweet

Transcript

  1. &YQMPSJOHUIF-JNJUTPG5SBOTGFS-FBSOJOH XJUIB6OJGJFE5FYUUP5FYU5SBOTGPSNFS ߅଻ള .-3FTFBSDI4DJFOUJTU 1JOHQPOH

  2. 0WFSWJFX 0WFSWJFX t&YQMPSJOHUIF-JNJUTPG5SBOTGFS-FBSOJOHXJUIB6OJGJFE5FYUUP5FYU5SBOTGPSNFSu 5ۄח੉ܴਵ۽ਬݺೣ  3BGGFMFUBM  (PPHMF  ֙ਘੌী"SYJWӝ੤

  3. ݾର ݾର  *OUSPEVDUJPO  55FYUUP5FYU5SBOTGFS5SBOTGPSNFS  &YQFSJNFOUT  1VUUJOH*U"MM5PHFUIFS

     3FGMFDUJPO
  4. *OUSPEVDUJPO *OUSPEVDUJPO

  5. *OUSPEVDUJPO 5SBOTGFS-FBSOJOHJO/-1 • ࠺૑ب೟णীӝ߈ೠ੹੉೟ण USBOTGFSMFBSOJOH ਷/-1ী௾CSFBLUISPVHIܳઁदೣ • ݽ؛ੌࠗী؀೧8PSE7FD (MPWF 'BTU5FYU

    • ੹୓ݽ؛ী؀೧6-.'JU #&35 (15 &-&$53"j • ݢ੷ۨ੉࠶੉হחষ୒௾ؘ੉ఠ۽঱যী؀ೠੌ߈੸ੋ૑ध LOPXMFEHF ܳ೟णೞҊ QSFUSBJOJOH  ڙڙ೧૓ݽ؛ਸۨ੉࠶੉੓חݾ಴UBTLী؀೧ള۲ೣ GJOFUVOJOH  • ৵ੜغחѪੌө  • Ѣ੄ ޖೠೠੋఠ֔ࣁ࢚ࣘ੄VTFSHFOFSBUFEUFYU 3FEEJU 8JLJ $PNNPO$SBXMj  • ೱ࢚ػDPNQVUBUJPOQPXFS .PPSFsTMBX  • ೱ࢚ػࣘب જ਷ࢿמਸਤೠݽ؛ҳઑ੄ઁউ 5SBOTGPSNFS  • ӝઓ੄3//҅ৌਬ׫ী࠺೧э਷নਸ೟णೡٸ؊ڙڙೞҊ э਷दрزউ؊݆਷নਸ೟णೣ
  6. 1SPCMFN5IFSBQJESBUFPGQSPHSFTT *OUSPEVDUJPO • 'JFME੄ߊ੹җೣԋ ࢎ੹೟णਸਤೠ݆ࣻ਷֤ޙٜ੉ݒੌ١੢ೣ • അઓೞחNFUIPETܳGPMMPXVQೞחѪઑରऔ૑ঋ਺ • пп੄NFUIPEоо૓DPOUSJCVUJPOਸڍয֬Ҋ࠺Үೞӝয۰਑ •

    ૒੽प೷ਸా೧Ѩૐೞݶغ૑ঋਸө  • ѐੋ੉ࠗ׸ೞӝীחࢎ੹೟णਸਤೠDPTUоցޖఀ • ೞա੄ࢎ੹೟णNFUIPEо঴݃ա׮নೠUBTLী؀೧જ਷૑प೷ೞӝয۰਑ • ੄ࢎѾ੿ਸਤೠप೷ਸݒߣೡࣻহ׮ݶ न܉ೡ݅ೠSFGFSFODF੄೙ਃࢿ੉ழ૗
  7. 4PMVUJPO6OJGJFE'SBNFXPSL $PPSEJOBUF%FTDFOU *OUSPEVDUJPO • ݢ੷׮নೠUBTLܳࣻ೯ೡࣻ੓חCBTFMJOFGSBNFXPSLٜܳ݅Ҋ 6OJGJFE'SBNFXPSL  • ৈ۞/-1UBTLܳUFYUUPUFYUഋక۽஖ജೣ •

    ೞա੄ݽ؛ਸݽٚUBTLীࢎਊೞҊ ؀नݽ؛੄ੑ୹۱ਸా೧UBTLܳݺदೣ • ࣇ౴ਸೞաঀ߄Լࠁݶࢲ ݽ؛੄ࢿמ੉যڌѱ߄Շח૑ঌইࠁ੗ $PPSEJOBUFEFTFDFOU  • ݽ؛ҳઑ &OD%FDWT%FDPOMZ ݾ੸ೣࣻ ؘ੉ఠࣇ 4DBMJOH١ • അप੸ਵ۽ݽٚ҃਋੄ࣻܳઑ೤೧ࢲೡࣻחহਵפӬ ࠺Ү੸௾झாੌ੄ࣇ౴ࠗఠೞաঀѾ੿ೞݶࢲ૓೯
  8. *OUSPEVDUJPO

  9. $POUSJCVUJPO *OUSPEVDUJPO • ৈ۞/-1UBTLܳࣻ೯ೡࣻ੓חೞա੄6OJGJFE'SBNFXPSLܳઁद • ৈ۞ࢎ੹೟णࣇ౴ٜ੉пUBTL੄ࢿמী޷஖ח৔ೱਸೞաೞաઑࢎೞҊҕਬ • о੢જ਷ࣇ౴ٜ݅ݽইࢲप೷ѐ઺ѐUBTLী؀೧405" • ؀ӏݽؘ੉ఠࣇ

    $ ߂೟णݽ؛ҕѐ
  10. 55FYUUP5FYU5SBOTGFS 5SBOTGPSNFS 55FYUUP5FYU5SBOTGFS5SBOTGPSNFS

  11. 5ݽ؛ҳઑ 55FYUUP5FYU5SBOTGFS5SBOTGPSNFS • ୭ઙ੸ੋݽ؛ҳઑחप೷ਸా೧଺਷PQUJNBMೠࣇ౴ਸࢎਊ೤פ׮ ই૒਷উঌ۰ષ  • ݾ੸ೣࣻ DPSSVQUFESBUF١بই૒਷޷੿ •

    пप೷ਸਤ೧ࢲחCBTFMJOFݽ؛ &OD%FD ਸࢎਊೞѢա ੉੹ীࢶఖೠPQUJNBMPQUJPOਸࢎਊ೤פ׮ • ೞ૑݅ҕా੸ਵ۽5FYUܳੑ۱߉Ҋ୹۱ೡࣻ੓যঠ೤פ׮ • ঱ઁա5SBOTGPSNFSӝ߈੄ҳઑܳࢎਊ೤פ׮ • &ODPEFS%FDPEFS %FDPEFSPOMZ 1SFGJY-.
  12. ࢎ੹೟ण௏ಌझ 55FYUUP5FYU5SBOTGFS5SBOTGPSNFS • $PMPTTBM$MFBO$PNNPO$SBXM $ ௏ಌझܳ࢜܂ѱઁद • )FVSJTUJDGJMUFSJOHਸా೧ӝઓ$PNNPO$SBXM੉о૓ޙઁ੼ਸ৮ചೣ • 0GGFOTJWFMBOHVBHF

    OPOFOHMJTI +BWBTDSJQUҙ۲ޙࢲઁѢ١ • 8FCFYUSBDUFEؘ੉ఠܳ୶о • ୨(#
  13. %PXOTUSFBN5BTLT 55FYUUP5FYU5SBOTGFS5SBOTGPSNFS • /-6ಣо#FODINBSLੋ(-6& TVQFS(-6& • 4FOUFODFQBJSTJNJMBSJUZ 454C 2" .VMUJ3$

    /-* $PSFGFSFODFSFTPMVUJPO 8/-* ١ • "CTUSBDUJWF4VNNBSJ[BUJPO • $//%BJMZ.BJM • .BDIJOF5SBOTMBUJPO • &OHMJTI(FSNBO 'SFODI 3PNBOJBO • 2VFTUJPO"OTXFSJOH • 42V"%
  14. *OQVUBOE0VUQVU'PSNBU 55FYUUP5FYU5SBOTGFS5SBOTGPSNFS • 5BTLTQFDJGJDTFRVFODFܳ*OQVUTFRVFODFখীࠢৈࢲݽ؛ীѱUBTLܳݺदೣ • t৔যীࢲೠҴয۽ߣ৉*UIJOLZPVutաחցܳࢤп೧u • $MBTTJGJDBUJPO • ޙઁܳ*OQVUਵ۽઱Ҋ

    Ӓী؀ೠMBCFMਸPVUQVUীࢲHSFFEZೞѱ٣௏٬ೞب۾೤פ׮ • tTUTCTFOUFODFয়ט j TFOUFODFযઁ j utu • 3FHSFTTJPOҗэ੉୹۱੉GMPBU੉ৈب ೞա੄ష௾ਵ۽୊ܻ • 'JOFUVOJOH੉غҊաݶ UBTLীݏ૑ঋחష௾੉٣௏٬غח҃਋חহ঻׮Ҋ೤פ׮ • (FOFSBUJPO • ੌ߈੸ੋࢤࢿݽ؛୊ۢള۲೤פ׮
  15. &YQFSJNFOUT &YQFSJNFOUT

  16. 3FDBQ֤ޙ੄ݾ಴ &YQFSJNFOUT • 5SBOTGPSNFS ӝ߈ ݽ؛੄ ੹੉ ೟ण 5SBOTGFS -FBSOJOH

    җ ҙ۲ػ ৈ۞ ప௼ץ ࢎ੉੄ FNQJSJDBMTVSWFZ • (-6& 42V"%э਷/-6UBTL ߣ৉ ਃড١੄/-(UBTL۽ಣо೤פ׮ ੌ࢚؀ചח9  • प೷ೞחղਊٜ • ݽ؛ҳઑ ݾ੸ೣࣻ • ؘ੉ఠࣇ௼ӝ߂ઙܨ • ള۲ߑߨ ബਯ੸ੋ4DBMJOHVQ • ݽٚઑ೤ਸ೧ࠅࣻחহਵפӬ ௾Ѣࠗఠೞաঀप೷ೞҊઁੌજ਷২࣌ਸࢶఖೣ
  17. &YQFSJNFOUT • &OD%FDܻ࠙ػҳઑੑ۱ష௾ՙܻחনߑೱBUUFOUJPO٣௏؊חੋ௏؊੄୹۱җ੉੹UJNFTUFQష௾ীBUUFOUJPO • -.ੑ୹۱द௫झܳೞա۽োѾ೧ࢲೞա੄٣௏؊ী֍Ҋ ঱ઁա੉੹UJNFTUFQష௾ী݅BUUFOUJPO • 1SFGJY-.ੑ۱द௫झܳনߑೱਵ۽ࠁ૑ޅೞח-BOHVBHF.PEFM੄ױ੼ਸࠁ৮ೞӝਤ೧ઁউػߑߨҳઑ੗୓ח -BOHVBHF.PEFMҗزੌೞ૑݅ BUUFOUJPONBTLܳా೧ੑ۱ష௾ՙܻחࢲ۽ܳࠅࣻ੓਺

    "ݽ؛ҳઑ
  18. &YQFSJNFOUT • %FOPJTJOH.BTLੌࠗܳാࣚ DPSSVQU दఅद௫झܳੑ۱ਵ۽֍Ҋ ാࣚػࠗ࠙ਸࠂਗ • -.द௫झղ੄ష௾ٜਸೞաঀ֍ਵݶࢲ ׮਺UJNFTUFQ੄ױযܳ৘ஏ "0CKFDUJWF%FOPJTJOHWT-.

  19. &YQFSJNFOUT • 1SFUSBJOJOH?TUFQ ?UPLFOTFR ?TFRCBUDI?UPLFO #  • #&35 #

    ա3P#&35B 5 ࠁ׮੘਷ؘ੉ఠࣇ • 'JOFUVOJOHݽٚUBTLܳ?TUFQزউള۲ೞҊ о੢ࢿמ੉જ਷୓௼ನੋ౟ࢎਊ • ޙઁ੼ҕ੿ೠಣоܳਤ೧ࢲחݽ؛௼ӝ 1 ৬҅࢑۝ . ੉زੌ೧ঠೣ • &OD%FDо 1 . ੌ҃਋-BOHVBHF.PEFM਷ 1 . ഑਷ 1 . ੉ؾפ׮ &OD%FDоܻ࠙غয੓਺  • فѐ׮࠺ҮೞҊ &OD%FDр੄౵ۄ޷ఠܳTIBSFೞחҳઑبೣԋ࠺Үೣ "5SBJOJOH%FUBJMT
  20. "3FTVMUT &YQFSJNFOUT • %FOPJTJOHPCKFDUJWFо-.PCKFDUJWFࠁ׮જ਷ࢿמਸࠁ੐ • &OD%FD1SFGJY-.-BOHVBHF.PEFMࣽਵ۽જ਷ࢿמਸࠁ੐ • ੑ۱द௫झܳনߑೱীࢲࠁחѱ઺ਃೞ૑ঋਸөࢤпؽ • &OD

    %FDр੄XFJHIUܳTIBSFೞחݽ؛ب୽࠙൤֫਷ࢿמਸࠁ੐ • ੑ۱୹۱ҙ҅ܳFYQMJDJUೞѱܻ࠙ೞחѪ੉઱ਃೞ૑ঋਸөࢤпؽ
  21. "%FOPJTJOH0CKFDUJWF୶оप೷ &YQFSJNFOUT • %FOPJTJOHPCKFDUJWFо-.PCKFDUJWFࠁ׮જ׮Ҋо੿ೞҊ ҙ۲WBSJBUJPOٜਸ୶оप೷೤פ׮ • ৽ଃ #&35୊ۢੌࠗష௾ਸ݃झఊೠ׮਺੉ܳࠂਗೞחPCKFDUJWFо-.੉աEFTIVGGMJOHࠁ׮؊֫਷ࢿמ • য়ܲଃ

    #&35TUZMF੄ࣁࠗ২࣌ FH TQBOױਤWTష௾ױਤ DPSSVQUJPO࠺ਯ١ ী؀೧प೷೧ࠁও૑݅  ੉ٜࢎ੉੄ਬ੄޷ೞѱର੉חաఋա૑ঋ਺
  22. #ࢎ੹ള۲ؘ੉ఠࣇ &YQFSJNFOUT • ࢎ੹೟णਊ௏ಌझ੄ઙܨীٮܲEPXOTUSFBNUBTL੄ࢿמ߸ചܳ࠙ࢳ೤פ׮ • प೷ೞח௏ಌझ • $ • $VGJMUFSFEIFVSJTUJD೙ఠ݂ਸೞ૑ঋ਷௏ಌझ

    • 3FBM/FXTMJLF׏झ௏ಌझ • 8FC5FYUMJLFۨ٪ӝ߈௏ಌझ • 8JLJQFEJBৡۄੋߔҗࢎ੹௏ಌझ • 8JLJQFEJB 5PSPOUP#PPL$PSQVT8JLJQFEJB੄TQFDJGJDೠౠࢿਸ৮ചೞӝਤ೧
  23. #प೷Ѿҗ &YQFSJNFOUT • ೙ఠ݂ೠ$௏ಌझоજ਷ࢿמਸࠁ੐ • ࢎ੹೟ण௏ಌझ৬UBTLبݫੋ੉࠺तೞݶ؊જ਷ࢿמਸࠁ੐ • 8JLJQFEJBӝ߈ݽ؛਷42V"%ীࢲࢿמ੉જҊ (-6&UBTL઺ੌࠗب࠺तೠ҃ೱਸࠁ੐ •

    ੉۞ೠഅ࢚ਸѐ੄ࢲ۽׮ܲҙ੼ীࢲࠅࣻ੓णפ׮ • *OEPNBJOؘ੉ఠীࢲࢎ੹೟णਸೞחѪ੉ࢿמೱ࢚ীب਑੉ػ׮ • पઁ۽֤ޙٜਸࠁݶ UBTLী߄۽GJOFUVOJOHೞӝ੹ী੉Ѧ۽ೠߣQSFUSBJOJOHೞݶࢿמ੉ೱ࢚ػ׮Ҋ ೤פ׮ • ੐੄੄࢜۽਍EPNBJO੉઱য઎ਸٸ ৈӝীࡅܰѱ੸਽ BEBQU ೞחੌ߈ചػࢎ੹೟णݽ؛੄ള۲
  24. #ؘ੉ఠࣇ௼ӝ &YQFSJNFOUT • ࢎ੹೟णؘ੉ఠࣇ੄௼ӝоઁೠػ࢚ടীࢲ ੉ܳSFQFBUೞח҃਋ী؀೧प೷೤פ׮ • ੹୓ؘ੉ఠ۽FQPDIWTؘ੉ఠ۽FQPDIWTOؘ੉ఠ۽OFQPDI • ؘ੉ఠࣇ੉઴যٜݶӒ݅ఀSFQFBU೧ࢲ ੹୓TUFQࣻחزੌೞѱ࠺Ү೤פ׮

  25. #प೷Ѿҗ &YQFSJNFOUT • ௾ؘ੉ఠܳೠߣࠁחѱо੢ࢿמ੉જणפ׮ • ੌ੿ࣻળө૑חৈ۞ߣࠁইبࢿמೞۅ੉Ѣ੄হणפ׮ • ߣ ੉࢚ ߈ࠂೞݶ

     ݽ؛੉ ള۲ ؘ੉ఠࣇ ੗୓ܳ ৻ਕߡ۰ࢲ 5SBJOJOH -PTTח ઴যٜҊ UBTLQFSGPSNBODFחәх೤פ׮ য়ߡೖ౴
  26. $'JOFUVOJOH4USBUFHZ &YQFSJNFOUT • ࢎ੹೟ण਷৮ܐػ࢚ടীࢲ पઁUBTLীযڌѱGJOFUVOJOHೞחѪ੉જਸө  • о૑ߑߨۿਸ࠺Ү೤פ׮ • "MMQBSBNFUFSTݽ؛੄ݽٚQBSBNFUFSܳGJOFUVOJOH

    • "EBQUFS MBZFST ࢎ੹ ೟णػ 5SBOTGPSNFSח GSFF[FೞҊ  ݽ؛ ղࠗ੄ GFFEGPSXBSE MBZFS ׮਺ী <E@NPEFM E@BEBQUFS>3F-6<E@BEBQUFS E@NPEFM>ഋక੄'FFE'PSXBSEMBZFSܳ୶оೠٍ੉Ѫ݅ ೟ण೤פ׮ • (SBEVBM6OGSFF[JOHо੢࢚ਤۨ੉যࠗఠର۹؀۽VOGSFF[F೤פ׮֫਷ۨ੉যੌࣻ۾t؏uੌ߈੸ੋ঱ য੸૑धਸߓ਍׮חо੿ীࢲ୹ߊ೤פ׮
  27. $'JOFUVOJOH4USBUFHZ &YQFSJNFOUT • ݽ؛੹୓ܳ߄۽GJOFUVOJOHೞחѱо੢ࢿמ੉જणפ׮ • ׮݅ࣘبஏݶীࢲחݽ؛੹୓ܳUVOJOHೞחѪ੉જ૑ঋणפ׮ • "EBQUFSMBZFS৬ҙ۲೧ࢲ MPXSFTPVSDFUBTL FH

    42V"% ח੉MBZFSରਗ੉੘ইبغ૑݅IJHISFTPVSDF UBTL FH .5 ח੉ѱ੘ਵݶGJOFUVOJOHࢿמ੉അ੷൤ڄয૘פ׮
  28. %4DBMJOH &YQFSJNFOUT • ࢿמਸৢܾࣻ੓חऔҊഛपೠߑߨ઺ೞաח ؊௾ݽ؛ਸ؊݆਷ؘ੉ఠ۽؊য়ۖزউ೟णೞחѪੑפ׮ • ೞ૑݅$PNQVUBUJPOSFTPVSDFחೠ੿غয੓ਵ޲۽ ৈ۞GBDUPS઺যוѪਸ঴݃աః਎૑Ѿ੿೧ঠ೤פ׮ • ੉৬ҙ۲೧֤ޙীࢲ؍૑ח૕ޙ਷׮਺җэणפ׮t਋ܻоॶࣻ੓ח҅࢑۝੉ߓ۽טযլ׮ݶ

    ੉ܳযڌѱ ࢎਊ೧ঠೡө u • ੉ ૕ޙী ؀೧ ࠁ׮ ੌ߈ചػ ׹ਸ ҳೞҊ੗ ೠ ֤ޙ ઺ ೞա۽ॄ  ੉੹ী ৢۄৡ 4DBMJOH MBXT GPS OFVSBM MBOHVBHFNPEFMTu ,BQMBO +BSFE FUBM੉੓णפ׮
  29. %3FTVMU &YQFSJNFOUT • טযդ҅࢑۝ਸݽ؛௼ӝী੹ࠗై੗ೞѢա ള۲झయࣻ৬زੌೞѱա־חѱо੢જ਷ࢿמਸࠁੑפ׮ • ݽ؛਷Ӓ؀۽فҊߓ஖௼ӝաള۲झయࣻܳטܻחѪبযו੿ب੄ࢿמೱ࢚ਸࠁੑפ׮ • ل׮ؘ੉ఠࣇ௼ӝܳߓ݅ఀטܻחബҗо੓णפ׮ •

    ৈӝࢲ઱੄ೡ੼਷ ೞա੄GBDUPSܳః਎ٸ׮ܲGBDUPSٜ਷੉۞ೠ࢚थ಩ীCPUUMFOFDL੉غ૑ঋਸ੿ب۽ח୽ ࠙൤ழঠೠ׮ח੼ੑפ׮ • ࢎ੹೟णݽ؛਷'SFF[FೞҊGJOFUVOJOH݅ৈ۞ߣ೧ࢲFOTFNCMFೞחѪبডр੄ࢿמೱ࢚੉੓णפ׮
  30. 1VUUJOHJU"MM5PHFUIFS 1VUUJOHJU"MM5PHFUIFS

  31. 1VUUJOHJU"MM5PHFUIFS 5$POGJHVSBUJPO • ૑Әө૑଺਷જ਷২ٜ࣌ਸӝ߈ਵ۽ݽ؛ਸ೟ण೤פ׮ • ੋ௏؊٣௏؊ҳઑ • %FOPJTJOHPCKFDUJWFష௾ઁѢಣӐӡ੉੄TQBOਸ݃झఊ • UPLFOTFR

    ?TFRCBUDI .TUFQUSJMMJPOష௾ • ѐ੄ݽ؛ࢎ੉ૉ • #BTF. • 4NBMM. • -BSHF. • &YUSFNFMBSHF# # • *OEJWJEVBM .VMUJUBTL۽GJOFUVOJOHೞҊ ઁੌજ਷ࢿמਸSFQPSU೤פ׮
  32. ઁݾఫझ౟ 3FTVMUT • 24ѐ ઺ 17ѐ taskী ؀೧ SOTA •

    GLUE, superGLUEী ؀೧ о੢ ֫਷ ࢿמ • ߣ৉ taskীࢲח ࢚؀੸ਵ۽ ծ਷ ࢿמ • Monolingual ࢎ੹೟ण ؘ੉ఠ + Scaling੄
 ઑ೤ਵ۽ח ই૒ ֫਷ ࢿמਸ ࠁ੉૑ ޅೣ.
  33. 3FGMFDUJPO 3FGMFDUJPO

  34. 3FGMFDUJPO 5BLFXBZT • 5BTLTQFDJGJDೞѱࠂ੟ೠݽ؛ҳઑহ੉ب TDBMF੉ழ૑ݶજ਷ࢿמਸࠁ੐ • &OD%FDҳઑоഅ੤ࣁ౴ীࢲо੢જ਷ࢿמ • زੌೠۨ੉য੄%FDPOMZী࠺೧ߓ੄ݽ؛ࢎ੉ૉܳо૑૑݅ ࠺तೠ$PNQVUBUJPODPTUܳо૗

    • &OD%FDр੄ਝ੉౟ܳҕਬೞݶ ݽ؛ࢎ੉ૉо۽઴ݶࢲࢿמೞۅب௼૑ঋ਺ • %FOPJTJOHPCKFDUJWFо-.ী࠺೧જ਷ࢿמ • ࢿמ݅Ҋ۰ೞݶ ݽ؛੹୓ܳೠߣীGJOFUVOJOHೞחѱо੢֫਷ࢿמਸࠁ੐ • ୶о੸ੋDPNQVUBUJPO੉оמೡٸ t௾ݽ؛ ੘਷ؘ੉ఠࣇu੉t੘਷ݽ؛ ௾ؘ੉ఠࣇuࠁ ׮જ਷ࢿמਸࠁ੐
  35. 3FGMFDUJPO 0VUMPPL  • ࢎपݽ؛੉௼ݶ؊ੜػ׮חѪ਷־ҳաࢤпೡࣻ੓׮ೞ૑݅੉ѱࠛоמೞ׮ݶ  • -PXSFTPVSDFMBOHVBHF ௾ݽ؛ਸ೟णೞѢաࢎਊೡࣻহਸٸ١١j •

    %JTUJMMBUJPO 1BSBNFUFS4IBSJOH 1SVOJOHী؀ೠোҳо҅ࣘ೙ਃೣ • ࠁ׮ബਯ੸ੋLOPXMFEHFFYUSBDUJPO • ઑѐ੄౵ۄ޷ఠܳࢎਊೞ૑ঋইب঱যী؀ೠੌ߈੸ੋ૑धਸੜߓ਎ࣻ੓חߑߨ੉೙ਃೞ׮ • അ੤੄EFOPJTJOHCBTFEPCKFDUJWF੉࢚੄ޖ঱оj • &-&$53"оೞա੄റࠁ۽ॄ঱әؽ
  36. 3FGMFDUJPO 0VUMPPL  • 5BSHFUUBTLޙ੢ٜਸࢎ੹೟ण௏ಌझীࢴযࢲള۲ೞݶࢿמ੉ೱ࢚ؽ • *OEPNBJOఫझ౟ܳ޷ܻ݅աחബҗܳӝ؀ೡࣻ੓਺ • %POsU4UPQ1SFUSBJOJOH"EBQU-BOHVBHF.PEFMTUP%PNBJOTBOE5BTLT "$-

    ীࢲࠁ׮ੜ࠙ ࢳ • بݫੋ UBTLр੄ਬࢎبীӝ߈ೠࢿמೱ࢚بӝ؀ೡࣻ੓਺ • -BOHVBHFBHOPTUJDNPEFMT • ৔যؘ੉ఠ۽݅ࢎ੹೟ण೧ࢲӒ۠૑ ߣ৉UBTLীࢲ405"ܳب׳ೞ૑ޅ೮਺ • &OHMJTI/BUVSBM-BOHVBHFੋؘ ੹୓੸ੋোҳزೱ਷Ӓۧ૑ঋ਺ • ঱যীޖҙೠױয੢ਸ݅٘חѪب൜޷۽਍઱ઁ
  37. ӝఋ • #BTFMJOFQFSGPSNBODF • .VMUJUBTL-FBSOJOH • ࢎ੹೟णदীUBTLؘ੉ఠبэ੉ॳݶࢿמ੉ೱ࢚ؽ • ؘ੉ఠࣇ௼ӝо׮ܲৈ۞UBTLܳೠߣী೟णೠ׮ݶ пUBTL੄ࢠ೒࠺ਯਸযڌѱઑ੺ೡ૑

    ޷୊׮ܖ૑ޅೠղਊٜ
  38. хࢎ೤פ׮✌ ୶о૕ޙژחҾӘೠ੼੉੓׮ݶ঱ઁٚইېোۅ୊۽োۅ઱ࣁਃ ߅଻ള .-3FTFBSDI4DJFOUJTU 1JOHQPOH  &NBJMDIBFIVO!TDBUUFSMBCDPLS