recording your question and again to stop. side, User ? Database - al Client mote Services and Worker Interface ؼُ٦وٝ؝ٝؾُذ٦ءّٝך⢽7J[8J[ ➂䊨濼腉ך➿ח➂ָ鋔鋙ꥺְָ罏佄䴂 Ύءأذيⰻ鿇 ך➂ָ㔐瘶 J. Bigham et al.: VizWiz: Nearly real-time answers to visual questions, In UIST, 2010. ِ٦ؠָ颵㉏䫎珲 ⢽չ؝٦ָٝⰅ 綸כוպ 5/15
㔐瘶罏 湱✼鐰⣣穠卓ַ姻׃ְ挿侧✮庠 Y. Baba and H. Kashima: Statistical quality estimation for general crowdsourcing tasks, In KDD, 2013. 挿 挿 挿 ぐ鐰⣣罏ך䱰挿穠卓ַ 鐰⣣罏ך腉⸂罋䣁׃ג挿侧✮庠 7/15
Sunahase, Y. Baba and H. Kashima, Pairwise HITS: Quality estimation from pairwise comparisons in creator-evaluator crowdsourcing process, In AAAI, 2017 瘶周" 瘶周# " " # # # " ? #ך挿侧 ぐ鐰⣣罏ך♧㼎嫰鯰穠卓ַ 鐰⣣罏ך腉⸂罋䣁׃ג挿侧✮庠 ♧㼎嫰鯰穠卓ַ姻׃ְ挿侧✮庠 10/15
չ挿侧ָ넝ְךח幐ֻׁׅպ We observe that sometimes there is inconsistency between a grade and a correction; for example, a grader provides a high grade with a submission but she corrects many errors. We observed the occasional inconsistency between a grade and the correction; for example, a grader provides a high grade for a submission, but many errors were corrected. 挿 T. Sunahase, Y. Baba and H. Kashima, Statistical modeling of peer correction and peer assessment, submitted. 䱰挿ה幐ך♧顐䚍ⵃ欽׃ג鐰⣣罏腉⸂䱿㹀 12/15
A. Taniguchi and S. Inoue, A method for automatic assessment of user-generated tests and its evaluation, In UbiComp/ISWC Adjunct, 2015. ،وبٝך،ؚٓ٘ٔ屎 崧㚖ד饯ֿ˘ "ؾٗٗحؕ #ػٗٗحؕ $هٗٗحؕ %لٗٗحؕ 欰䖝ָ㉏겗⡲䧭 ➭ך欰䖝ָ㔐瘶 欰䖝ָ✼ְח㉏겗⳿׃さֲהֹך⡲㉏腉⸂䱿㹀 13/15