Pakistan itself is a pretty safe country as long as you remain in the safer areas of Pakistan.
There are some parts of Pakistan that are considered to be extremely dangerous and you should avoid those areas if you're planning to visit Pakistan.
Just be sure to do research on the areas of Pakistan that you plan to visit to be sure you're not visiting a dangerous area of Pakistan and keep an eye out for you and your families safety.
Just anywhere else that can have good areas and bad areas Pakistan does as well.
Places in Pakistan like Peshawar or the Swat Valley Pakistan are a bit dangerous so you need to be careful in those areas but most other parts of Pakistan are pretty safe.