Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
An_Attention-Based_User_Behavior_Modeling_Frame...
Search
kishimoto
June 21, 2019
Research
1
2.2k
An_Attention-Based_User_Behavior_Modeling_Framework_for_Recommendation.pdf
kishimoto
June 21, 2019
Tweet
Share
More Decks by kishimoto
See All by kishimoto
LLMと検索エンジン・レコメンドエンジンの協調動作への歩み
kishimotobanana
1
640
ChatGPTを活用して対話的な ファッション検索サービスを作った話
kishimotobanana
0
190
LLMと自社データベースの協調動作による ファッションECへの応用
kishimotobanana
0
1.6k
マイクロアドにおけるCTR予測への取り組み
kishimotobanana
4
10k
Other Decks in Research
See All in Research
AI in Enterprises - Java and Open Source to the Rescue
ivargrimstad
0
610
2025/7/5 応用音響研究会招待講演@北海道大学
takuma_okamoto
1
220
Panopticon: Advancing Any-Sensor Foundation Models for Earth Observation
satai
3
220
Learning to (Learn at Test Time): RNNs with Expressive Hidden States
kurita
1
260
[CV勉強会@関東 CVPR2025] VLM自動運転model S4-Driver
shinkyoto
2
530
EOGS: Gaussian Splatting for Efficient Satellite Image Photogrammetry
satai
4
660
[論文紹介] Intuitive Fine-Tuning
ryou0634
0
130
Vision and LanguageからのEmbodied AIとAI for Science
yushiku
PRO
1
560
地域丸ごとデイサービス「Go トレ」の紹介
smartfukushilab1
0
110
VectorLLM: Human-like Extraction of Structured Building Contours via Multimodal LLMs
satai
4
320
大学見本市2025 JSTさきがけ事業セミナー「顔の見えないセンシング技術:多様なセンサにもとづく個人情報に配慮した人物状態推定」
miso2024
0
160
EarthSynth: Generating Informative Earth Observation with Diffusion Models
satai
3
370
Featured
See All Featured
Connecting the Dots Between Site Speed, User Experience & Your Business [WebExpo 2025]
tammyeverts
9
590
Learning to Love Humans: Emotional Interface Design
aarron
274
41k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
234
17k
Optimising Largest Contentful Paint
csswizardry
37
3.4k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
34
6.1k
Java REST API Framework Comparison - PWX 2021
mraible
33
8.9k
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
PRO
23
1.5k
Making the Leap to Tech Lead
cromwellryan
135
9.6k
The Cult of Friendly URLs
andyhume
79
6.6k
The Straight Up "How To Draw Better" Workshop
denniskardys
238
140k
Thoughts on Productivity
jonyablonski
70
4.9k
Large-scale JavaScript Application Architecture
addyosmani
514
110k
Transcript
"53BOL"O"UUFOUJPO#BTFE 6TFS#FIBWJPS.PEFMJOH'SBNFXPSL GPS3FDPNNFOEBUJPO 12 / 3/ 6 2 0 /6
6/ 2 0 2 1 # ( # )9 9
จͷ֓ཁ • "UUFOUJPOʹجͮ͘ϢʔβߦಈϞσϦϯάͱͦͷϨίϝϯυ λεΫͷԠ༻ΛఏҊ • 3//$//ϕʔεͷํ๏ΑΓֶशͷऩଋ͕ૣ͘ߴੑೳ • ͬ͘͟Γݴ͑5SBOTGPSNFSͷϨίϝϯυͷద༻ """* ஶऀΒژେֶͱ"MJCBCBͷάϧʔϓ
ಋೖ
*OUSPEVDUJPO • ϢʔβʔࣗͷߦಈʹΑΓදݱՄೳ • ୯ޠ͕ͦͷपғͷίϯςΩετͰදݱͰ͖Δ͜ͱͱಉ༷ • ߦಈܥྻΛΤϯίʔυ͢ΔͨΊʹ3//$//͕සग़ • 3//ฒྻԽࠔ͔ͭظͷґଘؔͷҡ࣋ࠔ •
$//ฒྻԽՄೳ͕ͩہॴతͳґଘ͔ؔ͠ҡ࣋ෆՄ • 3//$//ͱʹ͍ܥྻͱ͍ܥྻͷ྆ํ্ख͘ѻ͑ͳ͍ • ܥྻͷ͞ʹؔͳ͘ґଘؔΛҡ࣋Ͱ͖Δ"UUFOUJPO͕ొ • ୯ͳΔ"UUFOUJPOͩͱϕΫτϧͷ֤࣍ݩʹ͍ͭͯಉ͡ॏΈͰࢉ • ֤࣍ݩͷҟͳΔlҙຯzΛ্ख͘ѻ͑ͳ͍ .VMUJ)FBE"UUFOUJPOͷ༧ײ
ํ๏
4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL
4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL άϧʔϓ ʢ*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ
Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର *% ళ*% !" #$
4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL άϧʔϓ ʢ*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ
Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର *% ళ*% !" #$
4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL άϧʔϓ ʢ*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ
Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର *% ళ*%
4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL !"# άϧʔϓ
ʢ*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର *% ళ*%
4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL - άϧʔϓ ʢ*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ
τʔΫϯʣ Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର *% ళ*%
4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL άϧʔϓ ʢ*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ
Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର *% ళ*% -
4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL άϧʔϓ ʢ*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ
Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର *% ళ*% - DPODBU
4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL άϧʔϓ ʢ*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ
Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର *% ళ*% - - - - - - -
4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL άϧʔϓ ʢ*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ
Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର *% ళ*%
3BX'FBUVSF4QBDFT • ϢʔβʔͷߦಈΛ{", $, %}ͱͯ͠ఆࣜԽ • Ϣʔβʔ' = { ")
, $) , %) |+ = 1,2, … , /} • 'Λߦಈͷੑ࣭ʹΑΓҟͳΔάϧʔϓʹׂ " $ % ߦಈλΠϓ FH Ӿཡɺߪങɺ ߦಈΦϒδΣΫτ FH \*% ళ*%^ɺ\ݕࡧτʔΫϯ^ɺ ߦಈൃੜ࣌ͷλΠϜελϯϓ 0 = {123 , 124 , … , 125 } 123 ∩ 124 = 7 ' =∪9:9 5 129 άϧʔϓ ݕࡧ άϧʔϓ Ϋʔϙϯडཧ άϧʔϓ
#FIBWJPS&NCFEEJOH4QBDFT • άϧʔϓ!"#ʹ͓͍ͯ $% , '% , (% Λ&NCFEEJOH )#%
= +# ($% , '% , (% ) $% '% (% ී௨ʹ&NCFEEJOH ී௨ʹ&NCFEEJOHͯ݁͠߹ʢ \*% ళ*%^ͳͲෳଘࡏ͢ΔͷͰʣ ΧςΰϦԽͯ͠&NCFEEJOH ߦಈൃੜ࣌ͷλΠϜελϯϓ͔ΒϨίϝϯυ࣌·ͰͷܦաͷϨϯδ͝ͱʹΧςΰϦʹม 0, 1 , 1,2 , 2,4 , … , [24, 2456) 0 1 2 7 + 1
#FIBWJPS&NCFEEJOH4QBDFT !"# = %&'" (# + *((+!," - '!.+%/01%" /#
+ *((+!," 2(4# ) จͰՃࢉ͕ͩ ࣮Ͱ݁߹ ͜ͷϨΠϠʔͷ࠷ऴతͳग़ྗ 6 = {!89: , !89< , … , !89> } !89@ = .(A.4/# (!"# ) ֤άϧʔϓͰ!"#ͷϕΫτϧͷTIBQFҟͳΔ ಉ͡ಛྔͷ&NCFEEJOHڞ༗ ͨͩ࣌ؒ͠ͷ&NCFEEJOHڞ༗͠ͳ͍
-BUFOU4FNBOUJD4QBDFT • ֤ߦಈΛ,ݸͷજࡏతҙຯۭؒʹӨ • ͭ·Γ.VMUJ)FBE"UUFOUJPOΛߦ͏ • Ϣʔβʔͷߦಈ!Λάϧʔϓ͝ͱʹҟͳΔӨؔ"#$ Λ༻͍ͯ ݻఆͷϕΫτϧʹม •
4ΛͦΕͧΕͷજࡏతҙຯۭؒʹӨ % = '()'*+ , ("#. /01. , "#3 /013 , … , "#5 (/015 )) %7 = "87 (%) 5SBOTGPSNFSͷ .VMUJ)FBE"UUFOUJPOͷ9:ʹ૬
-BUFOU4FNBOUJD4QBDFT • !"# !$% จͰ୯ҰͷEFOTFMBZFSͰ׆ੑԽ͕ؔ3F-6 • ֤TIBQFΛཧ &'(( &) *'((
શߦಈ *% άϧʔϓ+ͷߦಈ ݻఆͷϕΫτϧͷ࣍ݩ ֤જࡏతҙຯۭؒͷ࣍ݩ *% = *'(( -
4FMG"UUFOUJPO-BZFS • ,ݸͷ֤જࡏతҙຯۭؒͰߦಈؒͷ4FMG"UUFOUJPO
4FMG"UUFOUJPO-BZFS • จͷهड़Ͱ !" = $%&'()*()(," , ,: /" ))
ۭؒ1ʹ͓͚Δ"UUFOUJPOXFJHIUϕΫτϧͷߦྻ ) ," , ,: /" = ," 2" ,3 ۭؒ1ʹ͓͚Δ"UUFOUJPOϕΫτϧͷߦྻ 4" = !" 567 (,) ࠷ऴతͳग़ྗ 4 = 589:; (<%=<)' > (4> , 4? , … , 4" )) Ͱ্࣮݁ہͬͯΔ͜ͱ 567 , 589:; TJOHMFEFOTFMBZFS XJUI3F-6
%PXOTUSFBN"QQMJDBUJPO/FUXPSL • ͜͜·ͰϢʔβʔߦಈϞσϧ͕ • ͜ͷจͰϨίϝϯυλεΫΛߟ͑Δ ͬͪ͜ଆͷ
%PXOTUSFBN"QQMJDBUJPO/FUXPSL • Ϩίϝϯυରͷߦಈͱ4FMG"UUFOUJPOޙͷߦಈؒͰ7BOJMMB "UUFOUJPO • ͭ·ΓϢʔβʔߦಈଆΛΤϯίʔμɺϨίϝϯυରߦಈଆΛ σίʔμͱߟ͑ͨ4PVSDF5BSHFU"UUFOUJPO Τϯίʔμ σίʔμ
%PXOTUSFBN"QQMJDBUJPO/FUXPSL • Ϩίϝϯυରߦಈͷ&NCFEEJOHͰ͋Δ!"ʹରͯ͠ɺ͜Ε· Ͱͱ΄΅ಉ͡ԋࢉΛߦ͏ • ݻఆϕΫτϧͷมͱ.VMUJ)FBE"UUFOUJPO ℎ" = %&' "
(!" ) *+ = %,- (ℎ" ) .+ = */01234 3 *+ , 6; 8+ %9- (6) :; " = %<=>?@@= (./A.31 B (.B , .C , … , .+ )) ߦಈάϧʔϓͷΠϯσοΫεͷஔ %<=>?@@= TJOHMFEFOTFMBZFS XJUI3F-6
%PXOTUSFBN"QQMJDBUJPO/FUXPSL • QPJOUXJTFͷ༧ଌϞσϧͰߦಈ!͕औΒΕΔ֬Λ༧ଌ • ଛࣦؔʹγάϞΠυͷΫϩεΤϯτϩϐʔ − # $,& '$ ()*+(-
ℎ$ , /& $ ) + 1 − '$ log(1 − +(- ℎ$ , /& $ )) - ϥϯΩϯάؔʢจͰ୯७ͳੵʣ
࣮ݧ
%BUBTFU • "NB[PO%BUBTFU • Ϣʔβʔͷʹର͢ΔϨϏϡʔσʔλ • ߦಈͷάϧʔϓ͚ͭͩʢάϧʔϓʣ • ಛྔϢʔβʔ*%ɺ*%ɺΧςΰϦ*%ɺλΠϜελϯϓ •
Ϣʔβͷߦಈ("# , "% , … , "' )͕͋Δͱֶͯ͠शɾςετσʔλҎԼ ("# ) "% ("# , "% ) ") ("# , "% , … , "'*% ) "'*# *OQVU QSFEJDU ֶश ςετ ("# , "% , … , "'*# ) "' *OQVU QSFEJDU ˞OFHBUJWFTBNQMF QPTJUJWFTBNQMFҎ֎ͷΛϥϯμϜͰબ
%BUBTFU • 5BPCBP%BUBTFU • "MJCBCB͕ӡӦ͢Δ&$αΠτͷϩά • ߦಈͷάϧʔϓͭʢɺݕࡧɺΫʔϙϯडཧʣ • άϧʔϓ •
*%ɺళ*%ɺϒϥϯυ*%ɺΧςΰϦ*%ɺλΠϜελϯϓ • ߦಈλΠϓӾཡɺϚʔΫɺߪೖ • ݕࡧάϧʔϓ • ݕࡧτʔΫϯɺλΠϜελϯϓ • ߦಈλΠϓͭ • Ϋʔϙϯडཧάϧʔϓ • Ϋʔϙϯ*%ɺళ*%ɺΫʔϙϯλΠϓɺλΠϜελϯϓ • ߦಈλΠϓͭ
$PNQFUJUPST)ZQFSQBSBNFUFST • $PNQFUJUPST • #13.'#BZFTJBO1FSTPOBMJ[FE3BOLJOH • #J-45. • #J-45. "UUFOUJPO
• $// 1PPMJOH • )ZQFSQBSBNFUFST • શͯͷ&NCFEEJOHͷ࣍ݩ • શͯͷӅΕͷ࣍ݩ • જࡏతҙຯۭؒͷۭؒʢ.VMUJ)FBEͷIFBEʣ • όοναΠζ • ਖ਼ଇԽFͷ-ϊϧϜ • 0QUJNJ[FS4(%ɺֶशΛ͔Β࢝ΊͯͰEFDBZ
&WBMVBUJPO.FUSJDT • BWFSBHFVTFS"6$ !"# = 1 "&'() * +∈-./01 1
2+ 3 2+ 4 * 5∈67 8 * 5∈67 9 :(<+,5 > <+,? )
3FTVMUTPO4JOHMFUZQF#FIBWJPS%BUBTFU • "NB[PO%BUBTFU "6$"53BOL͕࠷ྑ ࣌ؒͷΧςΰϦ͝ͱͷ7BOJMMB"UUFOUJPOXFJHIUͷฏۉ ͕࣌ؒܦա͢ΔʹͭΕXFJHIU͕খ͘͞ 3//$//ͷ༻͕ग़དྷ͍ͯΔ "53BOLֶ͕श͕ૣ͘ऩଋ
3FTVMUTPO.VMUJUZQF#FIBWJPS%BUBTFU • 5BPCBP%BUBTFU "53BOL͕ྑ͍͕ɺதͰશͯͷߦಈάϧʔϓΛ༻͍ͯ ߦಈϞσϦϯάΛߦͬͨϞσϧ "53BOLBMMPOF ͕࠷ྑ
$BTF4UVEZ • 4FMG"UUFOUJPOͱ7BOJMMB"UUFOUJPOͷޮՌΛ֬ೝ ߦಈ Ϩίϝϯυ ର
$BTF4UVEZ • 4FMG"UUFOUJPOͷޮՌ ಛఆͷྻʢ7BMVFʣ͕ߴ͍XFJHIU ๅੴಉ࢜Ͱਖ਼ํܗΛܗɺ͓ͦΒ͘ΧςΰϦͷྨࣅੑΛݟ͍ͯΔ
$BTF4UVEZ • 7BOJMMB"UUFOUJPOͷޮՌ ؔ͋Γͦ͏ͳߦಈͷΈڧௐ શͯͷߦಈͰฏۉత