Feryal  M  P  Behbahani     Brain  and  Behavior  Lab   Cartoon  by  Daniele  Quercia   

•  Cogni,ve  science:  a  process  of  reverse  engineering     •  the  only  sources  of  methods  we  have  to  reverse  engineer  any   natural    system  is  the  engineering  ideas  from  the  relevant   domains     –  Machine  learning:  provides  an  engineering  toolkit              Cogni,ve  science  draws  on  machine  learning  for  hypotheses              And  provides  machine  learning  with  interes,ng  challenges   

Cogni9ve  science   •  Focus  on  specific     experimental  paradigms   •  Embedded  in  psychology   •  Aiming  to  be  cogni,vely   and/or  neurally  plausible     Machine  learning   •  Focus  on  standard  learning   problems   •  Embedded  in  computer   science  and  engineering   •  Aim  for  a  working  system,   whether  mimicking  the   brain  or  not   Is  machine  learning  be=er  off  without  cogni9ve  science?!     

•  Computa9onal   –  What  problem  is  the  brain  solving?  What  informa,on  is   required?   •  Algorithmic   –  What  algorithms  are  computed?   •  Implementa9onal   –  How  are  those  algorithms  implemented   

No content

How  do  people  represent  categories?   ? Cat   Tiger   

Prototype   Cat   

Cat   Cat   Cat   Cat   Cat   Cat   All  instances  (exemplars)     are  stored  in  memory   

C   C   X   X   P(C,X)   P(C|X)       "Essen9ally,  all  models  are  wrong,  but  some  are  useful"   Box  1973   P(X|C)  P(C  )       

•  Categoriza,on  is  a  classic  induc,ve  problem                                                  data:  s,mulus  x                          hypotheses:  category  c     •  We  can  apply  Bayes’  rule:          and  choose  c  such  that  P(c|x)  is  maximized   P(c | x) = p(x |c)P(c) p(x |c)P(c) c ∑ 

Discrimina9on  Boundary   

Discrimina9on  Boundary   

Discrimina9on  Boundary   ç Observed  shiO  in  classifica,on  boundary:   Predicted  only  by  implied  widening  of   genera,ve  representa,on  of  A   

Screen   Subject     •  Two  symbols  from  an  ar,ficial  language   

Subject   Screen     •  Two  s,ck-­‐figure  animals   

A   B   A   B   

B   A   B   A   Machine  Learner   

B   A   B   A   B   A   Armadilo   Horse   Machine  Learner   Human  Learner   

No content

350°   T1   T2   A   B   B   A   B   A   

350°   T1   T2   A   B   B   A   B   A   

22   1.    Cogni9ve  science  and  machine  learning     brain  is  the  only  intelligent  system  we  know  about  and  also  the  brain   defines  many  of  the  problems  that  machine  learning  cares  about     cogni,ve  science  depends  on  machine  learning  and  other  engineering   techniques  since  they  are  the  only  source  of  deep  insights  that  a  reverse   engineer  can  possibly  draw  on     2.    Marr’s  3  Levels  of  explana9on     3.    Human  categorisa9on  vs  machine  classifica9on     

Human  categorisa,on  behaviour  is  not  consistent  with  discrimina,ve  strategies;  rather,   it  can  be  best  explained  through  Bayesian  genera,ve  classifica,on.               Cartoon  by  Daniele  Quercia   

No content

Ques9ons?   

p(x) = 1 2πσ exp{−(x − µ)2 /2σ2} Probability density p(x) (x-­‐µ)/σ   mean standard deviation variance = σ2 

No content

Hsu  &  Griffiths,  2010   Kalish  et  al,  2010   Bayesian  Decision  Theory  has  emerged  as  a  principled  way  to  explain  how  the  brain  has  to   act  in  the  face  of  uncertainty  and  was  very  successful  in  explaining  behavior  in  perceptual   and  motor  tasks  (Ernst  &  Banks,  2002,  Kording  &  Wolpert,  2002,  Faisal  et  al.,  2008).     

ILLUSTRATION: BAYESIAN COGNITIVE SCIENCE ACROSS THE LEVELS? •  Computa,onal   •  Algorithmic   •  Implementa,onal   •  Bayesian  picture  of  structure  of   reasoning   –  Consistancy   –  Bayesian  upda,ng   –  Specific  priors   •  Graphical  models,  MCMC   learning,  etc.   •  Bayesian  neural  calcula,ons   (e.g.,  Latham,  Pouget,  Shadlen   etc)   

No content