You'll be fine. The raw, unfermented wort is very susceptible to infection but once the yeast have done their thing the beer's pretty stable. So long as you didn't aerate it too much you'll be ok.
I'd second the advice above about drinking it quickly just in case though, but that would be...