When a baby stares at you it usually means that you're attractive and they love you.
It could also mean that the baby just loves you or could even think what you're doing is awkward etc.
When a baby stares at you it could because a variety of reasons just like an adult or kid would stare at you constantly they could be thinking that you're awkward or they really like you or like what you're doing.