Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
不自然言語の自然言語処理: コード補完を支える最新技術
Search
takegue
October 09, 2020
Technology
920
1
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
不自然言語の自然言語処理: コード補完を支える最新技術
Sansan自然言語処理勉強会
https://sansan.connpass.com/event/190157/
takegue
October 09, 2020
More Decks by takegue
See All by takegue
つかわれるプラットフォーム 〜デザイン編〜@DPM#2
takegue
2
12k
カルチャーとエンジニアリングをつなぐ データプラットフォーム
takegue
4
6.6k
toC企業でのデータ活用 (PyData.Okinawa + PythonBeginners沖縄 合同勉強会 2019)
takegue
4
1.2k
Rettyにおけるデータ活用について
takegue
0
950
Sparse Overcomplete Word Vector Representations
takegue
0
260
Aligning Sentences from Standard Wikipedia to Simple Wikipedia
takegue
0
250
High-Order Low-Rank Tensors for Semantic Role Labeling
takegue
0
150
Dependency-based empty category detection via phrase structure trees
takegue
0
120
A simple pattern-matching algorithm for recovering empty nodes and their antecedents
takegue
0
160
Other Decks in Technology
See All in Technology
同じWAFが、攻撃の“形”は弾く── 正当な“形”の不正は通す
kuroneko13
0
250
Rust×eBPFでEDRっぽいものをつくる
sunlife3
1
280
AIに狂うスタートアップが、あえて「人との協働」に全振りした新卒エンジニア研修 / New Graduate Engineer Training at a Startup Accelerating AI Adoption
ohnoeight
0
160
My broken English still works: speaking at global OSS events
naruoga
0
120
Digitization部 紹介資料
sansan33
PRO
2
7.7k
도구에서 동료까지: 10년차 AI 스타트업의 AI 적응기
inureyes
PRO
1
290
コーチングの奥義 何もしないテクニック
jinwatanabe
0
140
SmartHR Engineering Team Deck
smarthr
1
3.1k
Bill One 開発エンジニア 紹介資料
sansan33
PRO
7
20k
属人化を叩き割れ!「制作加速」と「安定化」の矛盾を打破する:8年目プロダクトが辿り着いた「ミスが起こり得ない」アセット制作フローの全貌
gree_tech
PRO
0
120
ハーレムエンジニアリング
kazuma777777
0
190
2027年のMetricKit
kantacky
0
130
Featured
See All Featured
Sam Torres - BigQuery for SEOs
techseoconnect
PRO
0
500
Heart Work Chapter 1 - Part 1
lfama
PRO
8
36k
Mind Mapping
helmedeiros
PRO
1
320
Taking LLMs out of the black box: A practical guide to human-in-the-loop distillation
inesmontani
PRO
3
2.4k
Git: the NoSQL Database
bkeepers
PRO
432
67k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
35
3.8k
Build your cross-platform service in a week with App Engine
jlugia
234
19k
HTML-Aware ERB: The Path to Reactive Rendering @ RubyCon 2026, Rimini, Italy
marcoroth
3
460
What does AI have to do with Human Rights?
axbom
PRO
1
2.3k
From π to Pie charts
rasagy
0
310
Building a Scalable Design System with Sketch
lauravandoore
463
34k
Redefining SEO in the New Era of Traffic Generation
szymonslowik
1
390
Transcript
फ़ี !UBLFHVF ෆࣗવݴޠͷࣗવݴޠॲཧٕज़: ίʔυิΛࢧ͑Δ࠷৽ٕज़ Sansan ࣗવݴޠॲཧษڧձ (2020/10/09)
ͳͥίʔυิʁ ʢࣗ͜͜વݴޠॲཧษڧձͰʜʣ
5BC/JOF IUUQTXXXUBCOJOFDPN ΑΓχϡʔϥϧϞσϧΛར༻ͨ͠ίʔυิ
ίϯςΩετͷใ ˠܥྻ༧ଌͷͱͯͦ͠ͷ··ఆࣜԽՄೳ 5BC/JOF IUUQTXXXUBCOJOFDPN ΑΓχϡʔϥϧϞσϧΛར༻ͨ͠ίʔυิ
ͳͥίʔυิʁ z࣮༻తͳࣗવݴޠॲཧzͷ͍ํΛίʔυิͰֶͿ w ։ൃऀͷͨΊͷ*.&ࣗવݴޠॲཧٕज़͕ͦͷ··స༻Մೳͷ w ਫ਼ͪΖΜଈԠੑɺܰྔ͞ͱ͍ͬͨෳͷࢦඪͰ ߴ͍ਫ४Ͱͷୡ͕ٻΊΒΕΔ ˠτϐοΫࣗવݴޠॲཧͷਂֶशϞσϧͷ࣮༻ͷน ˠτϐοΫ3//ɺ$//ͦΕͱ5SBOTGPSNFSʁ w
نଇੑ͕ߴ͍ιʔείʔυ֤छ੩తղੳπʔϧͷൃୡͷഎܠ͕͋Δ ˠτϐοΫࣝϕʔεͦΕͱࣄྫϕʔεʁ
ۙʹ͓͚ΔίʔυิपΓͷݚڀ w ౷ܭϞσϧʹΑΔίʔυิ #SVDIFUBM w ϕΠδΞϯΞϓϩʔνʹΑΔίʔυิ 1SPLTDIFUBM ˠ&DMJQTF֦ுͱͯ͠ΈࠐΈ
w ݴޠϞσϧʹΑΔΞϓϩʔν w OHSBNϞσϧʹΑΔίʔυิ<)JOEMFFUBM> w ΩϟογϡܕݴޠϞσϧʹΑΔίʔυͷہॴར༻<'SBOLTFUBM> w ߏจҙຯղੳ݁Ռͷར༻<3BZDIFWFUBM> ΑΓ͍ҙຯͰͷίʔυར༻ͷݚڀ<"MMBNBOJTFUBM>Λࢀর
w .JDSPTPGUͷݚڀνʔϜʹΑΔ ίʔυิͷݚڀ 74$PEF֦ு7JTVBM4UVEJP*OUFMMJ$PEFͷதͷ w ਫ਼͚ͩͰͳ͘ଈԠੑ αΠζͷ ෳͷ؍ͰෳͷχϡʔϥϧϞ
σϧͷੑೳΛൺֱ w .#ͰNTͰ3FDBMM!Ͱ հ͢Δจ ֤छϞσϧͷৄࡉͳ࣮σϓϩΠϝϯτʹؔ͢ΔผγεςϜจͰհ͞Ε͍ͯΔ 4WZBULPWTLJZFUBM ,%%Λࢀর ҎޙਤࣜͳͲจதΑΓҾ༻͠·͢
࣮Ԡ༻ͷࣗવݴޠॲཧٕज़ ΤϯυϢʔβڥͰಈࣗ͘વݴޠॲཧΞϓϦέʔγϣϯͷน w ίʔυิΤϯυϢʔβڥͰϦΞϧλΠϜͰಈ࡞͢Δ w ༷ʑͳ࣮ߦڥͰɺ༷ʑͳϓϩδΣΫτͰͷಈ࡞ཁ w ݪଇ$16 (16͕͋Δ͜ͱظͰ͖ͳ͍
w ߴ͍ଈԠੑ w ϝϞϦ w ϓϥΠϕʔτˍΦϑϥΠϯϓϩϓϥΤλϦ w ͜ΕΒͷ݅Λߴ͍ਫ४Ͱୡ͢Δ͜ͱ͕ٻΊΒΕΔɻ
࣮Ԡ༻ͷࣗવݴޠॲཧٕज़ͷน
.# ࣮༻తͳϞσϧͷαΠζ
࣮Ԡ༻ͷࣗવݴޠॲཧٕज़ͷน ޠኮʹΑΔϞσϧαΠζͷӨڹ w ϞσϧͷύϥϝʔλʹޠኮͷӨڹେ͖͍ ޠኮY࣍ݩ w Ұൠతͳ*1"%*$ͷγεςϜࣙॻͰ.# ສऑΤϯτϦ
w NFDBCJQBEJDOFPMPHEͰ.# ສΤϯτϦݱࡏ w ϞσϧબॏཁͰ͋Δ͕ɺͦͦޠኮαΠζΛௐ͢Δඞཁ͕͋Δ w ྔࢠԽɺৠཹͱ͍ͬͨϞσϧͷޙॲཧख๏ 'FBUVSF)BTIJOHͱ͍ͬͨѹॖख๏͕ଘࡏ͢Δ ࠓճׂѪ
࣮Ԡ༻ͷࣗવݴޠॲཧٕज़ͷน ˠޠኮΛݮΒ͢Λߟ͑Δ w 50,&/ۭന͗͘ΓͰͦͷ··ར༻ w 46#50,&/TOBLF@DBTF$BNFM$BTFͳͲ໋໊׳शׂՄೳ w #ZUF1BJS&ODPEJOH #1& σʔλ͔ΒαϒτʔΫϯͷׂΛ֫ಘ
ޠኮΛઃఆՄೳ JFBSSBZ@JOOFS@QSPEVDUˠBSSBZ @ JO OOFS QSPE VDU w $)"3จࣈɻτʔΫϯྻΛ࣍ݩͷը૾ͱߟ͑ͯ$//͕ద༻Ͱ͖Δ
NT Ԡ࣌ؒͷ҆
࣮Ԡ༻ͷࣗવݴޠॲཧٕज़ͷน ੑೳͱϞσϧͷαΠζͷτϨʔυΦϑ w ۙͷಈσΧ͍΄Ͳ͍͍ެ։ࡁΈͷχϡʔϥϧݴޠϞσϧ w #&35 5SBOTGPSNFS ԯύϥϝʔλ (#ʙ
w Ϟσϧ͕େ͖͍ˠܭࢉίετߴ͍ˠ͘ͳΔ w TPGUNBYܭࢉ͕ॏ͍ w <:BPFUBM>ஈ֊తͳ༧ଌީิͷߋ৽ʹΑΓഒͷߴԽ
ͦͦ
ͦͦχϡʔϥϧϞσϧඞཁ͔ʁ
ͦͦχϡʔϥϧϞσϧඞཁ͔ʁ The right tools should be used for the right
job.
ͦͦχϡʔϥϧϞσϧඞཁ͔ʁ ίʔυิͰOHSBNϞσϧχϡʔϥϧϞσϧΑΓڧ͍ <)FMMFOEPPSOBOE%FWBOCV> Ϟσϧͷෳࡶ͞ ଈԠੑɺϞσϧͷαΠζ ͕ ૬ԠͷՁ͕͋Δͷ͔ΛΑۛ͘ຯ͠ͳ͚ΕͳΒͳ͍ ˠઃఆͷ࡞Γํ࣍ୈ The right
tools should be used for the right job.
ઃఆΛߟ͑Δ ࣝϕʔε͔ͦΕͱࣄྫϕʔε͔ ࣝϕʔεࣙॻنଇ֫ಘʹΑΔԋ៷తΞϓϩʔν ࣄྫϕʔεσʔλʹΑΔؼೲతΞϓϩʔν
ઃఆΛߟ͑Δ ࣝϕʔε͔ͦΕͱࣄྫϕʔε͔ ࣝϕʔεࣙॻنଇ֫ಘʹΑΔԋ៷తΞϓϩʔν ࣄྫϕʔεσʔλʹΑΔؼೲతΞϓϩʔν ˠ྆ํΈ߹Θͤͯ͑Δͷ͕ྑ͍ ίʔυิͷจ຺ͷ੩తղੳ 45"/ ͱ͍͏༗༻ͳࣝͷଘࡏ
ઃఆΛߟ͑Δ w &ODPEFSEFDPEFSͷΑ͏ͳग़ྗ͕ΫϥεʙޠኮͷྨΛΊΔ w ग़ྗۭ͕ؒૄɻֶशޮѱ͘༧ଌͷܭࢉίετߴ͍ w ੩తղੳπʔϧͱΈ߹ΘͤΔ͜ͱΛߟ͑ΔͱɺΧελϚΠζੑ͍ ˠฒͼସ͑ͱͯ͠ଊ͑͢ ੜܕΞϓϩʔν͔Βฒͼସ͑Ξϓϩʔν
ੜ͔Βฒͼସ͑ͷͨΊͷֶश ੩తղੳ 45"/ PSࣄྫϕʔε 70$"# χϡʔϥϧϞσϧ (36 $// 53"/4'03.&3 χϡʔϥϧϞσϧίϯςΩετͷຒΊࠐΈͱީิฒͼସ͑ͷΈ୲
ˠੑೳ͚ͩͰͳ͘ɺଈԠੑϞσϧͷܰྔԽʹߩݙ ޙड़
࣮ݧઃఆ σʔληοτ (JUIVC্ͷελʔͷ1ZUIPOϓϩδΣΫτ͔Β lzʹΑΔิҐஔΛऔಘ͠σʔληοτͷߏங ධՁ ϞσϧαΠζύϥϝʔλY'-0"5Ͱܭࢉ ̏ͭͷࢦඪ3FDBMM! 3FDBMM! .33ͰධՁ จࣈྻͷׂํ๏
& ɺީิϓϩόΠμ 1 ɺຒΊࠐΈํ๏ $ ͭͷΈ߹ΘͤͰͦΕͧΕϋΠύϥύϥϝʔλΛ̎෦୳ࡧ ϕʔεϥΠϯ45"/ͷީิͷ࠷සΛબ 50,&/ 45"/ʹ૬
࣮ݧ݁ՌϞσϧͷ֤छൺֱ
࣮ݧ݁ՌϞσϧͷ֤छൺֱ ੩తղੳ 45"/ ͔ͳΓڧ͍ ˠֶशࣄྫʹ͓͍ͯ45"/ͷͳ͍ͱ ੑೳ͕dQUམͪΔ ίϯςΩετใΛ͏͜ͱͰ ੑೳ͕ʙQUͷվળ
࣮ݧ݁ՌϞσϧͷ֤छൺֱ #1&ʙ46#50,&/$)"350,&/ ׂͷͨΊͷϝλσʔλͷอ࣋Λߟ͑Δͱɺ46#50,&/͕ແ
࣮ݧ݁ՌϞσϧͷ֤छൺֱ 3//WT$//WT53"/4'03.&3ʁ $)"3.#Ͱ༏ल .# .# #1& 46#50,&/ͷੑೳࠩΘ͔ͣ
࣮ݧ݁ՌϞσϧͷ֤छൺֱ 3//WT$//WT53"/4'03.&3ʁ ΦʔιυοΫεͳ3// (36 ͕όϥϯε͕औΕ࠷༏ΕΔ݁Ռ
࣮ݧ݁ՌϞσϧͷ֤छൺֱ 3//WT$//WT53"/4'03.&3ʁ $// 53"/4'03.&3ϞσϧαΠζʹͬͯϨΠςϯγ͕ஶ͘͠ѱԽ
࣮ݧ݁Ռ൚༻ੑͷධՁ ੩తղੳ 45"/ ͕ॏཁͳׂΛ͠Ί͍ͯΔ ࣄྫϕʔε 17"$# ͚ͩͰదͳิީิΛબͿ͜ͱࠔͰ͋Δ
·ͱΊ w ࣮༻తͳࣗવݴޠॲཧͷͱͯ͠ίʔυิͰͷऔΓΈΛհ w /-1ͱಉ༷ʹχϡʔϥϧݴޠϞσϧʹΑΔมԽ͕๚Ε͍ͯΔ w ੑೳ͚ͩͰͳ͘ଈԠੑϞσϧαΠζΛؑΈͨൺֱ࣮ݧ w ΦʔιυοΫεͳ3//5SBOTGPSNFS$//ΑΓ࣮༻త w
൚༻తͳѹॖख๏ࣝৠཹྔࢠԽΛར༻͢Δ͜ͱͰ͞ΒͳΔѹॖ͕Մೳ w ੩తղੳπʔϧͷॆ࣮ͷഎܠ͔Βࣗવݴޠॲཧ͔ΒΈͯࣔࠦత w ࣝͱσʔλͷΈ߹ΘͤΔͨΊͷઃఆΞʔΩςΫνϟ
ࢀߟจݙ 5BC/JOF5FBN5BC/JOFIUUQTUBCOJOFDPN7JTJUFE.BS +JBMJ:BPFUBM &OBCMJOH3FBMUJNF/FVSBM*.&XJUI*ODSFNFOUBM7PDBCVMBSZ4FMFDUJPO /""$- 4WZBULPWTLJZFUBM 'BTUBOE.FNPSZ&⒏DJFOU/FVSBM$PEF$PNQMFUJPO BS9JW 4WZBULPWTLJZFUBM 1ZUIJB"*BTTJTUFE$PEF$PNQMFUJPO4ZTUFN
,%% "MMBNBOJTFUBM "4VSWFZPG.BDIJOF-FBSOJOHGPS#JH$PEFBOE/BUVSBMOFTT "$.$PNQVUJOH4VSWFZT $463 4FCBTUJBO1SPLTDI +PIBOOFT-FSDI BOE.JSB.F[JOJ*OUFMMJHFOUDPEFDPNQMFUJPOXJUI#BZFTJBOOFUXPSLT"$.5SBOTBDUJPOTPO4PGUXBSF &OHJOFFSJOHBOE.FUIPEPMPHZ 504&. "CSBN)JOEMF &BSM5#BSS ;IFOEPOH4V .BSL(BCFM BOE1SFNLVNBS%FWBOCV0OUIFOBUVSBMOFTTPGTPGUXBSF*O1SPDFFEJOHTPGUIF *OUFSOBUJPOBM$POGFSFODFPO4PGUXBSF&OHJOFFSJOH *$4& $ISJTUJOF'SBOLT ;IBPQFOH5V 1SFNLVNBS%FWBOCV BOE7JODFOU)FMMFOEPPSO$BDIFDB"DBDIFMBOHVBHFNPEFMCBTFEDPEF TVHHFTUJPOUPPM*O1SPDFFEJOHTPGUIF*OUFSOBUJPOBM$POGFSFODFPO4PGUXBSF&OHJOFFSJOH *$4& 7FTFMJO3BZDIFW .BSUJO7FDIFW BOE"OESFBT,SBVTF1SFEJDUJOH1SPHSBN1SPQFSUJFTGSPNl#JH$PEFz*O1SPDFFEJOHTPGUIF 4ZNQPTJVNPO1SJODJQMFTPG1SPHSBNNJOH-BOHVBHFT 101- 1BWPM#JFMJL 7FTFMJO3BZDIFW BOE.BSUJO7FDIFW1)0(1SPCBCJMJTUJD.PEFMGPS$PEF*O1SPDFFEJOHTPGUIF*OUFSOBUJPOBM$POGFSFODF PO.BDIJOF-FBSOJOH *$.-