-tap to begin recording your question and again to stop. side, User ? Database - Local Client Remote Services and Worker Interface 4UFQϢʔβ͕࣭Λߘ 4UFQγεςϜ෦ͷਓ͕ؒճ ίʔϯͷ؈ͲΕʁ Ұ൪ӈͷ؈Ͱ͢ 7 J. Bigham et al.: VizWiz: Nearly real-time answers to visual questions, In UIST, 2010.
YES YES YES NO YES NO YES YES YES YES NO ? ? ? ਖ਼ղ A. P. Dawid and A. M. Skene: Maximum likelihood estimation of observer error-rates using the EM algorithm, Journal of the Royal Statistical Society. Series C (Applied Statistics), 1979.
֬৴ͷճߟྀͯ͠ճऀͷ৴པੑͱਖ਼ղΛ༧ଌ͢Δ ճऀʹ֬৴ฉ͍ͯਖ਼ղ༧ଌʹ༻͍Δ 15 ΦʔετϥϦΞͷटγυχʔͰ͔͢ʁ ճʹࣗ৴͕͋Γ·͔͢ʁ ͍ ͍͍͑ ͍ ͍͍͑ S. Oyama, Y. Baba, Y. Sakurai, and H, Kashima: Accurate integration of crowdsourced labels using workers' self-reported confidence scores, In IJCAI, 2013.
ଞਓͷ͑Λͬͯղ͔ͤΔ 17 Figure 2. Crowdproof is a human-augmented proofreader. The drop-down explains the problem (blue title) and suggests Find Fix Verify J. Bigham et al.: Soylent: A word processor with a crowd inside, In UIST, 2010.
ଞਓͷ͑Λఏࣔ͠గਖ਼Λଅ͢ 18 αϯϑϥϯγείͷࣸਅΛબΜͰ͍ͩ͘͞ ͋ͳͨͷճ ଟܾ݁Ռ ͋ͳͨͷճ͕ؒҧ͍ͬͯΔͱࢥ͏߹గਖ਼͍ͯͩ͘͠͞ N. B. Shah and D. Zhou: No oops, you won’t do it again: Mechanisms for self-correction in crowdsourcing, In ICML, 2016.
ad to attract users time a user clicks on the ad and we record a conversion event, a the advertising system. This w the system to optimize the adv mizing the number of conversio contribution yield, instead of t the number of clicks. Although optimizing for conv Figure 1: Screenshot of the Quizz system. Intern Intern Fi healthline P. Ipeirotis and E. Gabrilovich: Quizz: targeted crowdsourcing with a billion (potential) users, In WWW, 2014.
23 contributed articles platform for viral collaboration that used recursive incentives to align the public’s interest with the goal of win- ning the Challenge. This approach was inspired by the work of Peter S. Dodds et al.5 that found that success in us- ing social networks to tackle widely distributed search problems depends on individual incentives. The work of Mason and Watts7 also informed the use of financial incentives to motivate crowdsourcing productivity. The MIT team’s winning strategy was to use the prize money as a finan- cial incentive structure rewarding not only the people who correctly located balloons but also those connecting the finder to the MIT team. Should the team win, they would allocate $4,000 in prize money to each balloon. They Figure 1. Locations in the DARPA Red Balloon Challenge. Figure 2. Example recursive incentive-structure process for the MIT team. J. Tang et al.: Reflecting on the DARPA red balloon challenge, In Communications of the ACM, 2011.
ׂΛूஂͰߦ͍େنͳΛղܾ͢Δ 27 ྫɿɹʮʰӕํศʱਖ਼͍͔͠ʁʯ͕ςʔϚͷখจࣥච ෦ʮӕΑ͘ͳ͍ʯͱ͍͏ஈམΛࣥච ෦ʮඞཁͳӕ͕͋Δʯͱ͍͏ஈམΛࣥච ʜ A. Kulkarni et al.: Collaboratively crowdsourcing workflows with Turkomatic, In CSCW, 2012.
ථͰ༏ྑݸମΛબൈ͠ ਓ͕ؒͦΕΛަࠥͯ࣍͠ੈͷݸମ Λੜ 4UFQબൈɾަࠥΛ܁Γฦ͢ ྫɿࢠڙ͚ͷҜࢠͷσβΠϯ L. Yu and J. V. Nickerson: Cooks or cobblers? crowd creativity through combination, In CHI, 2011.
babalablab
katiecoart
ryanjones
tamaranovitovic
elsirapls
jct
honnibal
inesmontani
tmiket
popppiees
livdayseo
aleyda
eileencodes
