You can put pizza in the oven with the cardboard but keep the oven temperature on around 200 F and never above.
A good thing to do is to remove the Pizza from the cardboard box and place it in aluminum or tin foil and then place it on a pizza pan to keep it warm.
Although don't keep the pizza in the oven longer than an hour otherwise it may burn the pizza and make it hard to eat.