Paying off a collection agency is good but it doesn't always come off your credit report automatically.
Sometimes you will have to get a credit repair company involved or a court involved in the process and hire a credit attorney.
Not all collection agencies will report your debt as paid off.
But if they do report the account as paid then the collections should be removed from your credit report within 6 months to a year.