Most Banks are not open on Columbus Day.
On Columbus Day most banks will be closed in observance of Columbus day.
However you can still use online banking, ATM machines etc or even make deposits to your checking or savings account through the banks drop box.
There are some banks that are still open on Columbus day but most of the banks are closed on Columbus day as well as other Holidays.
If you need to do banking on Holidays you can either use online banking, ATM Machines or do the banking the day or so before Columbus Day or other Holidays.
If not then you have to wait until the next day until the banks open.