Yes babies can certainly feel your love for them and can tell when you don't like them.
Babies can also love some people while hating other people just like we can as adults.
When I was a baby my mom said I would cry and and cry and cry if my aunt tried to hold me but if my other aunt held me I didn't cry. lol
I don't remember things when I was an infant however I know that I loved my mom and dad as a baby and I still do today.