If the raccoon thinks you're a threat to them or invading there space then they might become aggressive towards you.
Always be cautious around raccoon's but I've been around them and they've never harmed me but I never really went up to them.
I just leave them alone and they leave me alone.