As long as the glass dish is oven safe the glass dish can be used in a toaster oven.
For example if you have a glass baking dish then that glass baking dish that is made for baking in the oven could be used in the toaster oven as long as it fits.
Just don't put any glass dishes in the toaster oven that are not oven safe.
Pyrex baking dishes can be put in a toaster oven as long as they fit.
You can preheat the toaster oven if you want too and it's highly recommended that you do preheat your toaster oven before placing the food in the toaster oven to cook.
The reason you should preheat your toaster oven is to allow the food to start cooking faster since the toaster oven would already be hot and not cold.
However you do not have to preheat a toaster oven before cooking food in them if you do not want too.
But while I prepare my food to be put into the toaster oven I go ahead and get the toaster oven preheated.
That way the toaster oven is warmed up to the desired temperature and the food begins cooking immediately without having it starting from cold.