Most times when you pay off a collection agency they will fail to report your debt paid in full. So when they don't report your debt paid then your credit score won't increase at all.
If the collection agency doesn't eventually report your debt paid in full to the credit bureau's you may have to contact an attorney who helps fight debt collections and get them to have the collection agency remove the debt from your credit report and report your debt as paid.