Some clothes are sometimes safe to wash with Towels but I wouldn't do it.
Some clothes washed with Towels can cause the clothes to change colors or allow a lot of lint to collect on the clothing from the towels.
It's always best to wash your clothes separate from your Towels to avoid any color bleeding problems or lint problems.