The issue with just using the geometry from the 3D engine/api and rendering it as stereoscopic is that not everything occupies a specific location in space.

Most notable are UIs which are going to vary wildly in exactly how they’re drawn. Also anything that works on screen space or per pixel basis is going to behave in strange ways.

None of it is unsolvable, but it’s definitely nontrivial.