This is when you should try answering with the question, "Why do you ask?" It may not always work, but it can often help deflect that question you don't really want to answer.