It's possible for the battery to explode in the cell phone if there's something wrong with the battery and it gets overcharged.
It's very rare for the phones battery to explode although it has happened. I wouldn't worry about the cell phone exploding though.
It's a very small chance although it can happen.