A team I'm working with and myself are trying to make sense of the projection for the images below...
"The side of the box perpendicular to the table plane shows up here both in depth and in color images. We see the depth gradient and it intuitively makes sense. However, the top of the box and the table plane all have the same depth values. This means that the projection of the depth is done with respect to the plane of the camera, otherwise the depth values would not be the same. If this is the case, the box side should be perpendicular to the projection plane and should not show up at all."
What I am looking for is to capture the gradation of the z-depth of a plane that is perpendicular to the camera. I am trying to mimic what happens with a real world camera that captures depth. i.e. a RealSense depth camera
screen-shot-2017-12-16-at-14522-pm.pngperspective.jpgboxview.jpg