Yes the thunder can shake your house if the thunder is close enough when it starts thundering.
The thunder creates shock waves when the heat expands the air rapidly.
When you hear loud claps of thunder as well those are shock waves and the shock waves are what causes your house to shake or shudder during a thunderstorm.
Although it can be scary there's usually nothing to worry about and usually no damage to your home will occur.