A Caltech Library Service

Mice and primates use distinct strategies for visual segmentation

Luongo, Francisco J. and Liu, Lu and Ho, Chun Lum Andy and Hesse, Janis K. and Wekselblatt, Joseph B. and Lanfranchi, Francesco and Huber, Daniel and Tsao, Doris Y. (2021) Mice and primates use distinct strategies for visual segmentation. . (Unpublished)

[img] PDF - Submitted Version
See Usage Policy.


Use this Persistent URL to link to this item:


The rodent visual system has attracted great interest in recent years due to its experimental tractability, but the fundamental mechanisms used by the mouse to represent the visual world remain unclear. In the primate, researchers have argued from both behavioral and neural evidence that a key step in visual representation is “figure-ground segmentation,” the delineation of figures as distinct from backgrounds [1–4]. To determine if mice also show behavioral and neural signatures of figure-ground segmentation, we trained mice on a figure-ground segmentation task where figures were defined by gratings and naturalistic textures moving counterphase to the background. Unlike primates, mice were severely limited in their ability to segment figure from ground using the opponent motion cue, with segmentation behavior strongly dependent on the specific carrier pattern. Remarkably, when mice were forced to localize naturalistic patterns defined by opponent motion, they adopted a strategy of brute force memorization of texture patterns. In contrast, primates, including humans, macaques, and mouse lemurs, could readily segment figures independent of carrier pattern using the opponent motion cue. Consistent with mouse behavior, neural responses to the same stimuli recorded in mouse visual areas V1, RL, and LM also did not support texture-invariant segmentation of figures using opponent motion. Modeling revealed that the texture dependence of both the mouse’s behavior and neural responses could be explained by a feedforward neural network lacking explicit segmentation capabilities. These findings reveal a fundamental limitation in the ability of mice to segment visual objects compared to primates.

Item Type:Report or Paper (Discussion Paper)
Related URLs:
URLURL TypeDescription Paper ItemExtended Data Movie 1 ItemExtended Data Movie 2
Huber, Daniel0000-0001-8832-4488
Tsao, Doris Y.0000-0003-1083-1919
Additional Information:The copyright holder for this preprint is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. This version posted July 5, 2021. This work was supported by NIH (DP1-NS083063) and the Howard Hughes Medical Institute. We thank Audo Flores and Daniel Wagenaar for technical support, Sotiris Masmanidis for supplying the silicon recording probes, and David Fitzpatrick and Yong-Gang Yau for invaluable help setting up a tree shrew colony. F.J.L. was supported by an Arnold O. Beckman postdoctoral fellowship and a Burroughs Wellcome PDEP Award. D.H and C.L.A.H. were supported by the Swiss National Science Foundation (310030E_190060) and the Human Frontiers Science Program (RGP0024/2016). Author contributions: F.J.L., L.L., and D.Y.T. designed the experiments. F.J.L. and L.L. collected mouse data, C.L.A.H. and D.H. collected mouse lemur data, J.H. collected macaque data, and J.B.W, F.L., and F.J.L. collected treeshrew data. F.J.L. and L.L analyzed all the data. F.J.L., L.L., and D.Y.T. interpreted the results and wrote the paper, with feedback from other authors. The authors have declared no competing interest.
Funding AgencyGrant Number
Howard Hughes Medical Institute (HHMI)UNSPECIFIED
Arnold and Mabel Beckman FoundationUNSPECIFIED
Burroughs Wellcome FundUNSPECIFIED
Swiss National Science Foundation (SNSF)310030E_190060
Human Frontier Science ProgramRGP0024/2016
Subject Keywords:mouse vision, segmentation, motion perception, object localization
Record Number:CaltechAUTHORS:20210714-154215512
Persistent URL:
Official Citation:Mice and primates use distinct strategies for visual segmentation. Francisco J. Luongo, Lu Liu, Chun Lum Andy Ho, Janis K. Hesse, Joseph B. Wekselblatt, Francesco Lanfranchi, Daniel Huber, Doris Y. Tsao. bioRxiv 2021.07.04.451059; doi:
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:109807
Deposited By: Tony Diaz
Deposited On:14 Jul 2021 18:13
Last Modified:14 Jul 2021 18:13

Repository Staff Only: item control page