Not really. The biggest issue is motion sickness. A lot of games have you teleport around for that reason. I can personally handle it quite well, but some games still mess me up e.g. subnortica.

That said, some people do have eyes that are slightly off level with each other. That can cause interesting problems for them. It’s not hugely common however.