JPA2018 Symposium - On the surveys and experiments using Web

Mainly focusing on pro side of the usage of crowdsourcing in psychological research

Transcript

1. (' %!"
   #$ &    
      !82  
   Web "# 
2. 2&  ☐ 6 ▶ 5 08 ')81 2 , 3 , ) 24 9 6 7 ) *+ %5( -4 "9 , 1$ /!
   0.#3 76
3.  
    ☐ 
    ,
4. 
     (Crowdsourcing) ☐ 
     ¥¥¥ 
    *
   Amazon
5. MTurk  ☐ M T ▶  Ὂ k ▶ M Ὂ Ὂ Professional Survey Taker  
   
   
6.   
     ☐ ,  
     (see Chandler & Shapiro, 2016; Paolacci & Chandler, 2014) US Europe Peer et al. (2017) Lutz (2016) Nishihara & Majima (unpublished) Majima, Nishiyama, Nishihara & Hata (2017); Majima (2017); JAPAN CW
7.  
     ☐ 75 , .1, -2 ,0 % ▶ CW:   ▶ Ὂ )% )( 6
8.  
     ☐ 21 07 ( ( ). (, ▶
9.  
     ☐ .)-) (1 ,)0 2 72 2 l > CW …  
    l < CW …  l = CW …  
10.  
      ☐ 7 C (, ).10 . .2  (CRT)   / 
      
    
11. ,-  +' ☐ ( 7 ; 2 1 2 7 ,2; 270 ) 2 ▶ S S a T S CF M V %*" ( .
    )! "    #& $
12. 
        ☐ ▶ ) . 0 ,2 & ( 1 ,5 & 7 & • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • 0 1000 2000 3000 4000 Survey1(52) Survey2(52) Survey Duration (sec) Sample CW UNIV 20h49m (n = 319) 1464h18m (n = 144) 19h41m (n = 338) 548h13m (n = 166) 
13. 
         ☐ 7 ▶ ) -, ( 0 1, 2 5 • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • 200 400 600 800 1000 Stroop Flanker Switch Simon Posner Experiments Duration (sec.) Sample CW UNIV 4h59m 582h42m 4h24m 637h35m 30h01m 682h50m 5h17m 582h46m 29h10m 596h34m
14. ☐  
      ,
15. . . ☐ 1: PM 7 J A 0 H ▶ 7 J A 0 H 7 J0 j c aghcUbdh e M CNNKM K J A HJ KC M ▶ k nsr t x 6 MC C 5 H K = MC Ὂ W o efbi 02 . 1CJ N (&&, Ὂ l y p Y 6J S N (&& Ὂ k z 3 N (&& Ὂ um 5 ; (&&+ ▶ P 1: / ( & 7 J0 / ( & v & ▶ P ( 1: / (&( 7 J0 / (&( v )&
16. ☐ 7 2 () , 0 . 20 25 30 35 Cause Contra Change Attention AHS Subscales Mean Scale Score Pool CW ProA l  (Causality)  (Change)  (Attention) 
    CW > ProA l (Contra)   
17. ☐ 2 ., 2 )0 ) ( l  CW  
     
    30 35 40 45 50 CW ProA Pool Percent Similarity Judgment Pool CW ProA
18. ☐ 2 (, .) ▶ 0 1 l#,(%'" l 
     *) 
     +&$ CW > ProA l   
    &$ ! • • 20 30 40 50 60 70 Breaking Up Chess Story Estimated Probability Pool • CW ProA
19. ☐ ,, ) ( 3 3 & 3 ▶ SM ; Y ; l => ProA > CW l
     => CW > ProA 2 3 4 Self Paycuts Firings Families Crime Target Responsibility Pool CW ProA
20. P C W
21. ☐ 3 S ▶ 89 2 /,0 /,0 5 1 6 9 2 3 ) 1( S
22. • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • 0 1000 2000 3000 4000 ValidateCC(50) ValidateCC(30) BeliefCC(98) BeliefCC(62) Survey Duration Sample CW ProA 58h03m 09h08m N = 500 Q = 50 03h39m 04h44m N = 404 Q = 30 03h04m 03h59m N = 301 Q = 98 10h15m 09h01m N = 506 Q = 62
23. 
     ☐  @?&%  ▶ * 'B1(. ▶ 36: &%$# 7-)4  ▶ ;<+, !2 Ὂ 5/  9:  Ὂ 5>1 Ὂ 8A:0= "C Ὂ 
      
    
24. 
        ☐ ▶ S ▶ ▶ ▶ ▶ ) ( ▶ ▶ 
      
    
25. P C C
26. 
     Chandler, J., & Shapiro, D. (2016). Conducting clinical research using crowdsourced convenience samples. Annual Review of Clinical Psychology, 12, 53-81. doi:10.1146/annurev-clinpsy-021815-093623 Lutz, J. (2016). The Validity of Crowdsourcing Data in Studying Anger and Aggressive Behavior. Social Psychology, 47(1), 38-51. doi:10.1027/1864-9335/a000256 Majima, Y. (2017). The Feasibility of a Japanese Crowdsourcing Service for Experimental Research in Psychology. SAGE Open. 7(1),. doi: 10.1177/2158244017698731 Majima Y, Nishiyama K, Nishihara A and Hata R (2017). Conducting Online Behavioral Research Using Crowdsourcing Services in Japan. Frontiers in Psychology. 8:378. doi: 10.3389/fpsyg.2017.00378 Paolacci, G., & Chandler, J. (2014). Inside the Turk: Understanding mechanical Turk as a participant pool. Current Directions in Psychological Science, 23, 184-188. doi:10.1177/0963721414531598 Peer, E., Brandimarte, L., Samat, S., & Acquisti, A. (2017). Beyond the Turk: Alternative platforms for crowdsourcing behavioral research. Journal of Experimental Social Psychology, 70, 153-163. doi:10.1016/j.jesp.2017.01.006
27. 
      ☐ C 7 : ▶ ) 0 0 , 4 0 9 52 (- 3 ▶ ) 0 0 2 34 7 1 K1 0 52 3
29. ☐ ▶ ☐ ▶ S e ▶ i
30.  
     ☐ i S ☐ e ▶ ▶