Coupled computations of three-dimensional shape and material

SummaryRetinal image structure arises from the interaction between a surface’s three-dimensional shape, its reflectance and transmittance properties, and the surrounding light field. Any local image structure can be generated by an infinite number of different combinations of surface properties, which suggests that the visual system must somehow constrain the possible scene interpretations. The research on this has searched for such constraints in statistical regularities of two-dimensional image structure [1,2]. Here, we present a new class of displays in which the perception of material properties cannot be explained with two-dimensional image properties. The displays manipulate the perceived three-dimensional shape of identical luminance gratings, and demonstrate that perceived three-dimensional shape can alter perceived surface reflectance