Code Enforcement cannot legally come onto your property and snoop around without your permission.
A code enforcement officer is not actually real law enforcement anyway and as a code enforcement officer the powers of the code enforcement officer is very limited.
I worked as a code enforcement officer for a few years and I had to take a course about what I could and could not do.
In that course I took to become a code enforcement officer it stated that people had rights that I could not violate and it stated that I could not trespass on peoples property without the property owners permission.
To inspect I had to have the property owners permission to be on their property or had to view the property from a public street, public sidewalk etc.
You could have the code enforcement officer arrested for trespassing if you document them being on your property.
Although it would be hard to actually get a decent officer to actually arrest a code enforcement officer but it has happened.
Code enforcement officers must have a warrant issued by a magistrate judge to go onto a persons property or seize a persons property.
Also to tear down a house or building the city or town and code enforcement officer must also have a warrant to do so.
Municipal courts cannot issue those warrants as only a magistrate judge can do so.