Abstract:How do newborns learn to see? We propose that visual systems are space-time fitters, meaning visual development can be understood as a blind fitting process (akin to evolution) in which visual systems gradually adapt to the spatiotemporal data distributions in the newborn's environment. To test whether space-time fitting is a viable theory for learning how to see, we performed parallel controlled-rearing experiments on newborn chicks and deep neural networks (DNNs), including CNNs and transformers. First, we raised newborn chicks in impoverished environments containing a single object, then simulated those environments in a video game engine. Second, we recorded first-person images from agents moving through the virtual animal chambers and used those images to train DNNs. Third, we compared the viewpoint-invariant object recognition performance of the chicks and DNNs. When DNNs received the same visual diet (training data) as chicks, the models developed common object recognition skills as chicks. DNNs that used time as a teaching signal—space-time fitters—also showed common patterns of successes and failures across the test viewpoints as chicks. Thus, DNNs can learn object recognition in the same impoverished environments as newborn animals. We argue that space-time fitters can serve as formal scientific models of newborn visual systems, providing image-computable models for studying how newborns learn to see from raw visual experiences. Do machines learn like brains? The performance of all learning systems depends on both the learning machinery and experiences (training data) from which the system learns, so answering this question will require giving machines and brains the same training data. To do so, we introduce a digital twin method for running parallel controlled-rearing studies on newborn animals and deep neural networks. We show that when deep neural networks (CNNs and transformers) are trained in the same visual environments as newborn chicks, the models develop the same object recognition skills as chicks. Both newborn chicks and deep neural networks can learn invariant object representations that generalize across novel viewpoints, even when learning occurs in an impoverished environment containing a single object seen from a limited 60° viewpoint range. Our study shows that blind fitting processes (variation + selection learning) can mimic the rapid visual learning of precocial newborn animals, in the absence of innate (hardcoded) knowledge about objects or space. We argue that visual development can be understood as space-time fitting, in which visual systems gradually adapt to the spatiotemporal data distributions in the environment.

First-sight recognition of touched objects shows that chicks can solve Molyneux's problem

Newly Hatched Chicks Solve the Visual Binding Problem

SENSITIVITY TO SOCIAL VISUAL CUES IN THE DOMESTIC CHICK

Bumble bees display cross-modal object recognition between visual and tactile senses

Rapid Integration of Tactile and Visual Information by a Newly Sighted Child.

Rapid Development of Reaching/grasping and Intersensory Recognition in a Previously Blind Tibetan Girl

Object permanence in newborn chicks is robust against opposing evidence

Recognition of Shapes across Modalities by Infants

Hearing Better with the Right Eye? The Lateralization of Multisensory Processing Affects Auditory Learning in Northern Bobwhite Quail (Colinus Virginianus) Chicks

Parallel development of object recognition in newborn chicks and deep neural networks

A newborn embodied Turing test for view-invariant object recognition

Modeling Object Recognition in Newborn Chicks using Deep Neural Networks

Innate sensitivity to face-to-face biological motion

Innate face-selectivity in the brain of young domestic chicks

Chimpanzees process structural isomorphisms across sensory modalities

Innate face detectors in the nidopallium of young domestic chicks

Colour vision of domestic chicks

Object recognition via echoes: quantifying the crossmodal transfer of three-dimensional shape information between echolocation, vision, and haptics

Assessing preferences for adult versus juvenile features in young animals: Newly hatched chicks spontaneously approach red and large stimuli

Infant's recognition of three‐dimensional form: Mirror image and structurally distinct objects

Auditory–visual intermodal matching based on individual recognition in a chimpanzee (Pan troglodytes)