Well yeah, they are. Some more exerting than others. They vary from drag races to endurance ones, and some go really fast.

My point is rather that in driving, the physical exertion mostly comes from having to keep up mental focus and a static position — much like when gaming.