In phone numbers we can often mix oh and zero, but you’d very rarely (if ever) use zero in time. Perhaps in the military (or similar organisations): zero/oh six hundred hours. I’d naturally say oh.

When telling the time, I get my students to say: six oh five, three oh eight, five oh two, etc. The alternatives would be ‘past’ and approximations: five past six, and just after six.