Wearing socks is a great way to keep your feet from drying out since the socks will help to keep moisture in and around your feet.
A good way to keep feet moist and keep your feet from drying out is to apply some moisturizing lotion or Petroleum Jelly to your feet and then put your socks on to help keep moisture on your feet.
You can also wrap your feet in plastic wrap overnight to keep your feet from drying out and doing either of these will help keep your feet soft.