Your IP address does affect your spam score or "IP reputation" which also directly influences your email spam score and can determine whether or not your messages are marked as spam or if they reach the inbox when you send an email.
ISPs or internet service providers also monitor your IP reputation and evaluate factors such as past sending behavior, bounce rates and even complaints to decide if an IP address is trustworthy or not.
Having a poor IP reputation from any past malicious activities even if it was from someone else that had your IP address or having user complaints can result in any legitimate emails being flagged as spam.
The IP reputation is a rating of your IP address's trustworthiness, which is similar to how your offline reputation is also judged.
ISPs or internet service providers as well as email providers such as Gmail also evaluate your IP reputation to filter out any unwanted emails.
And if your IP address has a bad reputation, your emails are then more likely to be sent to recipients spam folders instead of their actual inbox.
And in severe enough cases of a poor IP reputation, emails from an IP with a poor reputation may be blocked completely.