Slide 4
Slide 4 text
モデル
4
The Power of PowerPoint - thepopp.com
Word
Embedding
Gated
GCN
Softmax
(negative
sampling)
𝑤"
𝑤#
𝑤$
𝑤%
𝑤&
ℎ"
(
ℎ#
(
ℎ$
(
ℎ%
(
ℎ&
(
ℎ"
"
ℎ#
"
ℎ$
(
ℎ%
(
ℎ&
(
ℎ)
*+" = 𝑓(Σ0∈2 3
𝑔567
* ×(𝑊567
* ℎ0
* + 𝑏567
* )
𝑔5=>
* = 𝜎( @
𝑊5=>
* ℎA
* + B
𝑏5=>
* )
𝑢, 𝑣, 𝑙A3
∈ 𝐺, 𝑁 𝑣 is neighbor of v
𝐸 = max(ΣMN"
O log 𝑃 𝑤M
𝑤"
M, 𝑤#
M, … , 𝑤2U
M )
𝑃 𝑤M
𝑤"
M, 𝑤#
M, … , 𝑤2U
M =
exp 𝑣XU
Y ℎM
Σ
MN"
O exp 𝑣X6
Y ℎM