© 2015 Aptima, Inc._v3 Geographic Analysis in Context A Visual Search Task Comparing Zooming Metaphors Aptima Ryan Mullins Chad A. Weiss Adam Fouse Stacy Pfautz Visual Attention Lab Krista Ehinger Avigael M. Aizenman Jeremy Wolfe 

© 2015 Aptima, Inc._v3 2 § Background – Geographic Analysis in Context – Electric Light Tables – Zooming Metaphors § Experiment – Research Questions – Experimental Conditions – Task Description – Participants and Environment § Results § Meaning Overview 

© 2015 Aptima, Inc._v3 Background 

© 2015 Aptima, Inc._v3 4 § Geographic Analysis ➡ Imagery Analysis – Extracting information from imagery – Useful in Military, Disaster Response, other applications – Othro, oblique images § Context – How does surrounding geography affect location, object? – What can we infer about an object given its surroundings? – How does this context shape decisions, actions? – Account for both Human and Physical components Geographic Analysis in Context 

© 2015 Aptima, Inc._v3 5 Click to edit Master title style § Table-sized light box – Analyzing photographic imagery § Advantages – Spatiality of the experience – Easy to see layer intermix § Disadvantages – Not digital – Large space requirements – Dedicated hardware Electric Light Tables Loupe – Small magnifying lens – Enables quick transition between spatial contexts 

© 2015 Aptima, Inc._v3 6 Click to edit Master title style § Analog light table features, digital package § Advantages – Dynamic filtering, layering – Storage capacity, scalability – Analytic extensibility § Disadvantages – Lacks “spatiality” – Poor user experience – Frequent context switching § Geographic § Functional (tools/features) Digital Light Tables Textron Systems RemoteView Exelis Visual Information Studios ENVI 

© 2015 Aptima, Inc._v3 Experiment 

© 2015 Aptima, Inc._v3 8 Is there a best way to digitally emulate the experience of using a light table and a loupe for imagery analysis? Comparing Zooming Metaphors 

© 2015 Aptima, Inc._v3 9 Click to edit Master title style Slippy Map Style – Pinch-to-zoom base map – Layer toggles in title bar Hypothesis: 1 of 3 Metaphors Zoom Window with Toggle – No zoom on base map – Pinch-to-zoom in windows – Layer toggles in zoom Window Side-by-side Zoom Windows – No zoom on base map – Pinch-to-zoom in windows – 1 window per layer, same footprint 

© 2015 Aptima, Inc._v3 10 Click to edit Master title style Semantic Events § Timestamp § Location (Lat, Lon) § Event Type § Annotation Type § Participant ID § Map ID § Condition ID Visual Search Task Task – Find, mark buildings in aerial image § 3 Training, 9 Real – Classify as damaged, destroyed § No deduction for incorrect classification Use Case – Humanitarian Aid/Disaster Response – 2010 Haiti Earthquake Imagery § Digital Globe QuickBird § RIT IPLER Metrics – Hit Rate § Mark damaged/destroyed building – Time Delta Damaged Destroyed Icons from GlyphIcons 

© 2015 Aptima, Inc._v3 11 § 10 College Students – 5 Female – 5 Male – Ages 19-24 § All novices in imagery analysis § All familiar with touch-enabled technology § Using 23” Multi-Touch Monitor – Dell Model S2340T Capacitive touch screen Participants 

© 2015 Aptima, Inc._v3 Results 

© 2015 Aptima, Inc._v3 13 Click to edit Master title style Nope But there might be a loser… Zoom Window with Toggle § Lowest Hit Rate – Largest Deviation § Longest Time Delta Is There A Superior Metaphor? 

© 2015 Aptima, Inc._v3 14 Click to edit Master title style Interface Marks Hits Rate Dev ΔT Slippy Map 41 22 67.6% 18.3% 7.5s Side-by-Side Zoom Windows 30 19 65.0% 15.4% 9.3s Toggle Zoom Window 36 17 61.6% 18.9% 10.2s Comparing Zooming Metaphors 

© 2015 Aptima, Inc._v3 Meaning 

© 2015 Aptima, Inc._v3 16 Click to edit Master title style Slippy Map Style § Best performance – Shortest Time – Most accurate § Most familiar interaction § Zoom means diff context Side-by-Side Zoom Windows § Second best Performance – Lowest variance § Easiest to compare § Large footprint on screen Balancing Benefits 

© 2015 Aptima, Inc._v3 17 Click to edit Master title style Slippy Map Style § Small screens (30 inches) § Single User Systems – Context in analysts mind Side-by-Side Zoom Windows § Big displays (50+ inches) § Multiple analysts – Shared general context – Individualized zoom context The best modality depends on display size, number of collaborating analysts. Screen Size Hypothesis http://www.engadget.com/2012/07/09/microsoft- acquires-perceptive-pixel/ 

© 2015 Aptima, Inc._v3 Ryan S Mullins | Research Engineer Lead, Interactive Intelligent Systems [email protected] Direct: 781.496.2452 Aptima, Inc. | www.aptima.com 12 Gill Street, Suite 1400 Woburn, MA 01801