Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Could simplified stimuli change how the brain p...
Search
David Nicholson
November 23, 2021
Research
0
85
Could simplified stimuli change how the brain performs visual search tasks?
flash talk for Neuromatch 4.0
David Nicholson
November 23, 2021
Tweet
Share
More Decks by David Nicholson
See All by David Nicholson
VocalPy: a core Python package for acoustic communication research
nickledave
0
36
sorry-no-chatgpt-PyCon-2023-lightning-talk
nickledave
0
72
pyvanot
nickledave
0
71
vak: software for automated annotation of vocalizations with neural networks
nickledave
0
87
scipy-2019-visual-search-Tensorflow-talk
nickledave
0
96
scipy-2019-lightning-talk
nickledave
0
140
Automated Annotation of Animal Vocalizations
nickledave
0
78
Neural networks for segmentation of vocalizations
nickledave
0
400
Teaching Data Science to Scientists
nickledave
0
190
Other Decks in Research
See All in Research
Panopticon: Advancing Any-Sensor Foundation Models for Earth Observation
satai
3
240
Combining Deep Learning and Street View Imagery to Map Smallholder Crop Types
satai
3
110
CoRL2025速報
rpc
1
2.3k
Minimax and Bayes Optimal Best-arm Identification: Adaptive Experimental Design for Treatment Choice
masakat0
0
180
GPUを利用したStein Particle Filterによる点群6自由度モンテカルロSLAM
takuminakao
0
400
Google Agent Development Kit (ADK) 入門 🚀
mickey_kubo
2
2.2k
Galileo: Learning Global & Local Features of Many Remote Sensing Modalities
satai
3
370
論文読み会 SNLP2025 Learning Dynamics of LLM Finetuning. In: ICLR 2025
s_mizuki_nlp
0
290
論文紹介:Not All Tokens Are What You Need for Pretraining
kosuken
0
200
2025/7/5 応用音響研究会招待講演@北海道大学
takuma_okamoto
1
230
Mechanistic Interpretability:解釈可能性研究の新たな潮流
koshiro_aoki
1
480
EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues
satai
3
250
Featured
See All Featured
Six Lessons from altMBA
skipperchong
29
4k
Designing for Performance
lara
610
69k
Into the Great Unknown - MozCon
thekraken
40
2.1k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
34
2.3k
A better future with KSS
kneath
239
18k
Art, The Web, and Tiny UX
lynnandtonic
303
21k
The Psychology of Web Performance [Beyond Tellerrand 2023]
tammyeverts
49
3.1k
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
52
5.7k
Code Reviewing Like a Champion
maltzj
526
40k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
9
930
[RailsConf 2023] Rails as a piece of cake
palkan
57
5.9k
Fashionably flexible responsive web design (full day workshop)
malarkey
407
66k
Transcript
Could simplified stimuli change how the brain performs visual search
tasks? David Nicholson NMC4 December 2021
Introduction Visual search: a real-world behavior we engage in constantly
Introduction In the laboratory, visual search tasks use simplified stimuli
Peelen and Kastner, 2014
Introduction Hallmark of behavior exhibited in laboratory visual search tasks:
set size effects
Introduction The visual system is optimized to search natural images
Peelen and Kastner, 2014
Introduction → simplified stimuli change visual search behavior How could
we test this? Peelen and Kastner, 2014
Methods deep neural networks for image classification AlexNet DNN architecture
"plane"
Methods ~ state-of-the-art models of object recognition in the visual
system adapted from DiCarlo and Cox 2007 AlexNet ANN architecture: ~ primate ventral visual stream "retina space" "inferior temporal cortex space" separating hyperplane
Methods deep neural networks optimized for image classification (Kell McDermott
2019) step
Methods Transfer learning to adapt pre-trained DNNs to visual search
tasks https://github.com/NickleDave/searchstims
Methods Transfer learning to adapt pre-trained DNNs to visual search
tasks the Visual Search Difficulty dataset "How Hard Can It Be? Estimating the Difficulty of Visual Search in an Image". Ionescu, et al. 2016
Results DNNs exhibit set size effects
Results Set size effects result from optimizing DNNs to classify
natural images
Results Optimizing DNNs with natural images --> improved, human-like behavior
on search tasks with natural images
Results Optimizing DNNs with natural images --> improved, human-like behavior
on search tasks with natural images Training method Source dataset DNN architecture Accuracy (largest object) (mean (S. D.)) transfer ImageNet VGG16 0.786 (0.007) transfer ImageNet AlexNet 0.652 (0.010) initialize Pascal VOC AlexNet 0.390 (0.010) initialize Pascal VOC VGG16 0.353 (0.060) transfer search stimuli VGG16 0.262 (0.004) transfer search stimuli AlexNet 0.208 (0.000)
Results Optimizing DNNs with natural images --> improved, human-like behavior
on search tasks with natural images Training method Source dataset DNN architecture Accuracy (largest object) (mean (S. D.)) transfer ImageNet VGG16 0.786 (0.007) transfer ImageNet AlexNet 0.652 (0.010) initialize Pascal VOC AlexNet 0.390 (0.010) initialize Pascal VOC VGG16 0.353 (0.060) transfer search stimuli VGG16 0.262 (0.004) transfer search stimuli AlexNet 0.208 (0.000)
Results Optimizing DNNs with natural images --> improved, human-like behavior
on search tasks with natural images Training method Source dataset DNN architecture Accuracy (largest object) (mean (S. D.)) transfer ImageNet VGG16 0.786 (0.007) transfer ImageNet AlexNet 0.652 (0.010) initialize Pascal VOC AlexNet 0.390 (0.010) initialize Pascal VOC VGG16 0.353 (0.060) transfer search stimuli VGG16 0.262 (0.004) transfer search stimuli AlexNet 0.208 (0.000)
Results Optimizing DNNs with natural images --> improved, human-like behavior
on search tasks with natural images
Discussion Mismatch may be impeding our ability to understand visual
search behavior
Discussion Future work could compare behavior of different models on
a benchmark set of stimuli and tasks Guided Search 6.0, Wolfe 2021
NickleDave Thank you! Lifelong Learning Machines program, DARPA HR0011-18-2-0019 2017
William K. and Katherine W. Estes Fund to F. Pestilli, R. Goldstone and L. Smith, Indiana University Bloomington. nicholdav