The time it takes for points to be removed form your driving record depends on how serious the driving offense was that caused you to get a point or points put on your driving record.
Less serious offenses such as not coming to a complete stop, illegal turns, going over the speed limit etc will cause points to stay on your driving record for 36 months which is 3 years.
If the driving offense was a more serious offense such as DUI or hit and run offenses those offenses and points will stay on your driving record for 10 years and there's really no way to remove those points any sooner than that.