【論文紹介】Large Language Models Sensitivity to The Order of Options in Multiple-Choice Questions
社内論文読み会で使用した資料です。
元論文はこちらです。
Pezeshkpour, Pouya, and Estevam Hruschka. 2023. “Large Language Models Sensitivity to The Order of Options in Multiple-Choice Questions.” arXiv [cs.CL]. arXiv. http://arxiv.org/abs/2308.11483.
94%について、モデルがyesと答えた A) overpriced B) purchase C) expensive D) park E) buying Most items in retail stores are what even when they are on sale? 可能性の高い 回答候補