Peripheral representation by summary statistics: An alternative to 3-D shape and lighting direction as basic features for search

ruth rosenholtz,xuetao zhang,jie huang
DOI: https://doi.org/10.1167/12.9.267
2012-01-01
Journal of Vision
Abstract:Searching for a side-lit shaded cube among top-lit is efficient (~8 ms/item), compared to search using "equivalent" 2-D items (>20 ms/item), or to search for top-lit shaded cubes among side-lit (21 ms/item) (Enns & Rensink, 1990). Arguably these results are puzzling, from the point of view of some theories of search, as they suggest that 3-D shape and direction of illumination might be available preattentively, whereas distinguishing between, say, a ‘T’ and an ‘L’ supposedly requires attention. We have argued that the information available in peripheral vision is a key determinant of search difficulty (Rosenholtz et al, in review), and that this information is strongly limited by early representation in terms of summary statistics (Balas et al, 2009). Here we revisit Enns & Rensink's results in light of this rethinking of search. Experiment 1 tests the association between peripheral discriminability and search performance. Observers were asked whether a peripheral item, flanked by 1-4 distractors, was a target or distractor. Experiment 2 tests whether the information available in our hypothesized set of local summary statistics can predict search performance. We extracted a number of target-present and target-absent patches of varying set size (2-5) from search displays. For each one, we synthesized patches with approximately the same summary statistics as the original (Portilla & Simoncelli, 2000). Observers were asked whether each synthesized patch came from a target-present or target-absent original. Conditions corresponded to Enns & Rensink’s Experiments 2ABC and 3AB. Statistical discriminability predicts peripheral discriminability (R2=0.77). Both measures predict search difficulty (R2= 0.65 & 0.55), including easier search for 3-D vs. 2-D items, and an asymmetry for lighting direction (though the latter may be an issue of criteria setting rather than a difference in available information). Peripheral representation in terms of summary statistics provides a parsimonious account of search with 3-D vs. 2-D items. Meeting abstract presented at VSS 2012
What problem does this paper attempt to address?