No one can say for certain or will know for sure how long horses have been around on earth.
But it's estimated horses have been around at least 55 million years and around as far back as 4000 BC is when horses started becoming domesticated by humans.
When horses were first around they were multi toed creatures and then later evolved into single toed horses over the years.