According to Russ from Retro Game Corps (YouTube), in Windos, without Steam running, the new Steam Controller acts like a keyboard (mapping the d-pad to WASD, etc).

He also said that Rocknix (a Linux distro for Rockchip-based handhelds) already recognizes the Steam Controller, suggesting that other Linux distros could pretty easily include drivers as well if they haven’t already.