Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Could simplified stimuli change how the brain p...
Search
David Nicholson
November 23, 2021
Research
0
84
Could simplified stimuli change how the brain performs visual search tasks?
flash talk for Neuromatch 4.0
David Nicholson
November 23, 2021
Tweet
Share
More Decks by David Nicholson
See All by David Nicholson
VocalPy: a core Python package for acoustic communication research
nickledave
0
33
sorry-no-chatgpt-PyCon-2023-lightning-talk
nickledave
0
70
pyvanot
nickledave
0
67
vak: software for automated annotation of vocalizations with neural networks
nickledave
0
83
scipy-2019-visual-search-Tensorflow-talk
nickledave
0
85
scipy-2019-lightning-talk
nickledave
0
140
Automated Annotation of Animal Vocalizations
nickledave
0
74
Neural networks for segmentation of vocalizations
nickledave
0
390
Teaching Data Science to Scientists
nickledave
0
180
Other Decks in Research
See All in Research
SkySense : A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagery
satai
3
240
Computational OT #1 - Monge and Kantorovitch
gpeyre
0
180
20250605_新交通システム推進議連_熊本都市圏「車1割削減、渋滞半減、公共交通2倍」から考える地方都市交通政策
trafficbrain
0
420
さくらインターネット研究所 アップデート2025年
matsumoto_r
PRO
0
640
EarthMarker: A Visual Prompting Multimodal Large Language Model for Remote Sensing
satai
3
340
データサイエンティストの就労意識~2015→2024 一般(個人)会員アンケートより
datascientistsociety
PRO
0
660
SSII2025 [SS2] 横浜DeNAベイスターズの躍進を支えたAIプロダクト
ssii
PRO
7
3.4k
なめらかなシステムと運用維持の終わらぬ未来 / dicomo2025_coherently_fittable_system
monochromegane
0
280
近似動的計画入門
mickey_kubo
4
970
Large Language Model Agent: A Survey on Methodology, Applications and Challenges
shunk031
12
8.1k
SSII2025 [TS1] 光学・物理原理に基づく深層画像生成
ssii
PRO
4
3.5k
大規模な2値整数計画問題に対する 効率的な重み付き局所探索法
mickey_kubo
1
240
Featured
See All Featured
Embracing the Ebb and Flow
colly
86
4.7k
The Web Performance Landscape in 2024 [PerfNow 2024]
tammyeverts
8
670
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
53
2.8k
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
29
9.5k
Build The Right Thing And Hit Your Dates
maggiecrowley
36
2.8k
A Modern Web Designer's Workflow
chriscoyier
694
190k
Connecting the Dots Between Site Speed, User Experience & Your Business [WebExpo 2025]
tammyeverts
5
210
Music & Morning Musume
bryan
46
6.6k
Why You Should Never Use an ORM
jnunemaker
PRO
57
9.4k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
357
30k
Code Review Best Practice
trishagee
68
18k
The MySQL Ecosystem @ GitHub 2015
samlambert
251
13k
Transcript
Could simplified stimuli change how the brain performs visual search
tasks? David Nicholson NMC4 December 2021
Introduction Visual search: a real-world behavior we engage in constantly
Introduction In the laboratory, visual search tasks use simplified stimuli
Peelen and Kastner, 2014
Introduction Hallmark of behavior exhibited in laboratory visual search tasks:
set size effects
Introduction The visual system is optimized to search natural images
Peelen and Kastner, 2014
Introduction → simplified stimuli change visual search behavior How could
we test this? Peelen and Kastner, 2014
Methods deep neural networks for image classification AlexNet DNN architecture
"plane"
Methods ~ state-of-the-art models of object recognition in the visual
system adapted from DiCarlo and Cox 2007 AlexNet ANN architecture: ~ primate ventral visual stream "retina space" "inferior temporal cortex space" separating hyperplane
Methods deep neural networks optimized for image classification (Kell McDermott
2019) step
Methods Transfer learning to adapt pre-trained DNNs to visual search
tasks https://github.com/NickleDave/searchstims
Methods Transfer learning to adapt pre-trained DNNs to visual search
tasks the Visual Search Difficulty dataset "How Hard Can It Be? Estimating the Difficulty of Visual Search in an Image". Ionescu, et al. 2016
Results DNNs exhibit set size effects
Results Set size effects result from optimizing DNNs to classify
natural images
Results Optimizing DNNs with natural images --> improved, human-like behavior
on search tasks with natural images
Results Optimizing DNNs with natural images --> improved, human-like behavior
on search tasks with natural images Training method Source dataset DNN architecture Accuracy (largest object) (mean (S. D.)) transfer ImageNet VGG16 0.786 (0.007) transfer ImageNet AlexNet 0.652 (0.010) initialize Pascal VOC AlexNet 0.390 (0.010) initialize Pascal VOC VGG16 0.353 (0.060) transfer search stimuli VGG16 0.262 (0.004) transfer search stimuli AlexNet 0.208 (0.000)
Results Optimizing DNNs with natural images --> improved, human-like behavior
on search tasks with natural images Training method Source dataset DNN architecture Accuracy (largest object) (mean (S. D.)) transfer ImageNet VGG16 0.786 (0.007) transfer ImageNet AlexNet 0.652 (0.010) initialize Pascal VOC AlexNet 0.390 (0.010) initialize Pascal VOC VGG16 0.353 (0.060) transfer search stimuli VGG16 0.262 (0.004) transfer search stimuli AlexNet 0.208 (0.000)
Results Optimizing DNNs with natural images --> improved, human-like behavior
on search tasks with natural images Training method Source dataset DNN architecture Accuracy (largest object) (mean (S. D.)) transfer ImageNet VGG16 0.786 (0.007) transfer ImageNet AlexNet 0.652 (0.010) initialize Pascal VOC AlexNet 0.390 (0.010) initialize Pascal VOC VGG16 0.353 (0.060) transfer search stimuli VGG16 0.262 (0.004) transfer search stimuli AlexNet 0.208 (0.000)
Results Optimizing DNNs with natural images --> improved, human-like behavior
on search tasks with natural images
Discussion Mismatch may be impeding our ability to understand visual
search behavior
Discussion Future work could compare behavior of different models on
a benchmark set of stimuli and tasks Guided Search 6.0, Wolfe 2021
NickleDave Thank you! Lifelong Learning Machines program, DARPA HR0011-18-2-0019 2017
William K. and Katherine W. Estes Fund to F. Pestilli, R. Goldstone and L. Smith, Indiana University Bloomington. nicholdav