Slide 6
Slide 6 text
式で書くと…
第16回最先端NLP勉強会
Figure 1: Proxy-tuning
weights, by steering it
“ anti-expert” (the sma
the expert and the ant
model, to guide it in the
scale. The logits show
LLA M A 2-7B (from top
Figure 1: Proxy-tuning “ tunes” a large
weights, by steering it using an “ expert
“ anti-expert” (the small model, untuned
the expert and the anti-expert is applied
Figure 1: Proxy-tuning “ tunes” a large pretrained model without ac
weights, by steering it using an “ expert” (a small tuned model) and
ポイント①
補正は毎時刻
必要
ポイント②
語彙の一致を
仮定
これのfinetuning
を
サボりたい