Yes coconut flour does have a taste to it even when you bake with it.
The coconut flour has a coconut flavor taste to it so if you bake something with the coconut flour then the baked goods will have a coconut taste.
If you do not like the taste of coconut then you won't likely like the taste of anything baked using coconut flour.
Coconut flour is a good flour to bake with but if you don't want the coconut taste in the baked goods then using coconut flour would not be a good idea.
You're better off using regular flour to bake something when you don't want it tasting like coconut.
Coconut flour does make good baked goods though but it's up to the person as to whether they like the taste or not.
Some people like the coconut flour taste and some people do not.