[Paper Review] Deformation Lamps: A Projection Technique to Make Static Objects Perceptually Dynamic

Takahiro Kawabe, Taiki Fukiage+2 more|arXiv (Cornell University)|Mar 3, 2016

Visual perception and processing mechanisms55 references33 citations

TL;DR

This paper introduces 'Deformation Lamps,' a projection technique that induces vivid, realistic perceptual motion and deformation in static 2D and 3D objects by projecting dynamic luminance patterns while preserving original color and texture. The brain automatically corrects spatial inconsistencies between luminance and static visual attributes, creating compelling illusions of movement without physical change.

ABSTRACT

Light projection is a powerful technique that can be used to edit the appearance of objects in the real world. Based on pixel-wise modification of light transport, previous techniques have successfully modified static surface properties such as surface color, dynamic range, gloss, and shading. Here, we propose an alternative light projection technique that adds a variety of illusory yet realistic distortions to a wide range of static 2D and 3D projection targets. The key idea of our technique, referred to as (Deformation Lamps), is to project only dynamic luminance information, which effectively activates the motion (and shape) processing in the visual system while preserving the color and texture of the original object. Although the projected dynamic luminance information is spatially inconsistent with the color and texture of the target object, the observer's brain automatically combines these sensory signals in such a way as to correct the inconsistency across visual attributes. We conducted a psychophysical experiment to investigate the characteristics of the inconsistency correction and found that the correction was critically dependent on the retinal magnitude of the inconsistency. Another experiment showed that the perceived magnitude of image deformation produced by our techniques was underestimated. The results ruled out the possibility that the effect obtained by our technique stemmed simply from the physical change in an object's appearance by light projection. Finally, we discuss how our techniques can make the observers perceive a vivid and natural movement, deformation, or oscillation of a variety of static objects, including drawn pictures, printed photographs, sculptures with 3D shading, and objects with natural textures including human bodies.

Motivation & Objective

• To develop a novel light projection technique that creates the illusion of dynamic deformation in static physical objects.
• To investigate how the visual system integrates inconsistent visual attributes—specifically dynamic luminance with static color and texture—into a coherent perceptual experience.
• To determine the perceptual limits and mechanisms underlying the illusion of motion and deformation induced by luminance-only projection.
• To rule out alternative explanations such as physical appearance changes due to light projection as the cause of the observed perceptual effects.

Proposed method

• Project dynamic luminance patterns onto static 2D and 3D objects while preserving their original color and texture.
• Leverage the visual system's motion and shape processing pathways by modulating luminance over time without altering spatial structure.
• Use spatially inconsistent luminance signals to trigger perceptual motion and deformation, relying on the brain’s automatic correction of sensory inconsistencies.
• Conduct psychophysical experiments to measure the retinal magnitude of inconsistency and its effect on perceptual correction.
• Apply controlled luminance patterns to various targets, including drawings, photographs, 3D sculptures, and human bodies with natural textures.
• Use perceptual scaling tasks to assess whether observers accurately report the magnitude of perceived deformation.

Experimental results

Research questions

• RQ1 How does the visual system resolve spatial inconsistencies between dynamic luminance and static color/texture to produce illusory motion and deformation?
• RQ2 What is the role of retinal magnitude of inconsistency in determining the strength and realism of the perceptual illusion?
• RQ3 To what extent is the perceived deformation magnitude underestimated by observers, and how does this affect the perceived realism?
• RQ4 Can the illusion of dynamic deformation be reliably induced across diverse static objects, including those with complex textures and 3D shading?
• RQ5 Is the observed effect due to perceptual integration or simply physical changes in the object’s appearance from light projection?

Key findings

• The visual system automatically corrects spatial inconsistencies between dynamic luminance and static visual attributes, enabling strong perceptual illusions of motion and deformation.
• The strength of the perceptual correction was critically dependent on the retinal magnitude of the inconsistency, with larger inconsistencies producing more compelling illusions.
• Observers systematically underestimated the magnitude of the perceived image deformation, indicating a perceptual bias that may enhance the illusion’s realism.
• The illusion effect persisted across diverse static targets, including drawn pictures, printed photographs, 3D sculptures, and human bodies with natural textures.
• The results ruled out physical appearance change as the primary cause of the effect, confirming that the illusion arises from perceptual integration, not physical alteration.
• The technique successfully induced vivid, naturalistic perceptions of movement, deformation, and oscillation in static objects without any physical motion.