教師なし文埋め込み [Kiros+, 2015][Hill+, 2016][Logeswaran and Lee, 2018] ◦ 教師あり文埋め込み [Conneau+, 2017][Cer+, 2018][Reimers and Gurevych, 2019] ◦ 対照学習 [Giorgi+, 2021][Yan+, 2021][Gao+, 2021][Chuang+, 2022] • Representation Interpretability ◦ 埋め込みの構成性に関する研究 ▪ 単語埋め込み [Pennington+, 2014][Arora+, 2016][Ethayarajh+, 2019] ▪ 文埋め込み [Zhu and de Melo, 2020] ▪ 事前学習済みモデルの単語 /フレーズ埋め込み [Yu and Ettinger, 2020][Hupkes+, 2020] [Dankers+, 2022][Liu and Neubig, 2022] ◦ 文埋め込みからの言語生成 [Giorgi+, 2021][Wang+, 2021][Huang+, 2021][Wu and Zhao, 2022] 3