I was just about to mention the Xperia Play until I read your post. It wasnt the best phone, but it let you play pretty much anything up to the PS1 era on your phone with a physical game pad.

Its crazy that it still seems ahead of some of the android retro consoles you can find today, given the sliding screen and, at least in my option, decent ergonomics.