Entry Date:
May 21, 2014

Camouflaging an Object from Many Viewpoints

Principal Investigator William Freeman


We address the problem of camouflaging a 3D object from the many viewpoints that one might see it from. Given photographs of an object's surroundings, we produce a surface texture that will make the object difficult for a human to detect. To do this, we introduce several background matching algorithms that attempt to make the object look like whatever is behind it. Of course, it is impossible to exactly match the background from every possible viewpoint. Thus our models are forced to make trade-offs between different perceptual factors, such as the conspicuousness of the occlusion boundaries and the amount of texture distortion. We use experiments with human subjects to evaluate the effectiveness of these models for the task of camouflaging a cube, finding that they significantly outperform näive strategies.

Results from selected scenes. This video shows virtual 3D boxes that have been camouflaged using our algorithms. These algorithms produce patterns that we "paint" onto the boxes, making them hard to see from many viewpoints. We show each box from the viewpoints that it has been camouflaged from. For each scene, we show the result from the algorithm with the best score (as measured by confusion rate).