Ally Bank does provide a debit card to access your funds from your Ally Bank account however they'll be separate debit cards for each type of bank account.
If you have a checking account and a savings account with Ally Bank then you'll be given an Ally Checking Debit Card and an Ally Savings debit card.
You can only access your checking account funds with the Checking account Debit card and only your savings account funds with the savings account Debit card.
But if you only have a checking or savings account then yes you'll still have a debit card issued to you for use of your Ally bank funds.