Study suggests a paradigm shift for vision science and artificial intelligence

The receptive field (RF) of a neuron is the term applied to the space in which the presence of a stimulus alters the response of the same neuron.

The responses of visual neurons, as well as visual perception phenomena in general, are highly nonlinear functions of the visual input (in mathematics, nonlinear systems represent phenomena whose behaviour cannot be expressed as the sum of the behaviours of its descriptors).

Conversely, vision models used in science are based on the notion of linear receptive field; in artificial intelligence and machine learning, as artificial neural networks are based on classical models of vision, also use linear receptive fields.

Modelling vision based on a linear receptive field poses several inherent problems: it changes with each input, it presupposes a set of basis functions for the visual system, and it conflicts with recent studies on dendritic computations."

Marcelo Bertalmío, Study First Author, Universitat Pompeu Fabra - Barcelona

The study was recently published in the journal of the group Nature, Scientific Reports. The paper proposes modelling the receptive field in a nonlinear manner, introducing the concept of intrinsically nonlinear receptive field or INRF

The paper proposes modelling the receptive field in a nonlinear manner, introducing the intrinsically nonlinear receptive field or INRF. A study conducted by Marcelo Bertalmío, Alex Gómez-Villa, Adrián Martín, Javier Vázquez-Corral and David Kane, researchers with the UPF Department of Information and Communication Technologies (DTIC), together with Jesús Malo, a researcher from the University of Valencia.

An approach with broad implications

The INRF, apart from being more physiologically plausible and embodying the efficient representation principle, has a key property of wide-ranging implications: for several vision science phenomena where a linear RF must vary with the input in order to predict responses, while an RF linear varies for each stimulus, the INRF can remain constant under different stimuli.

Bertalmío adds: "We have also proved that artificial neural networks with INRF modules instead of linear filters have a remarkably improved performance and better emulate basic human perception". This research highlights the intrinsically nonlinear nature of receptive fields in vision and suggests a paradigm shift for both vision science and for artificial intelligence.