You and your husband are adults and have the right to decide who you associate with. Whether you maintain a relationship with his former girlfriend or not is YOUR decision, not your son's. You said you wish you could find a way to keep you -- you have a way, just reach out to her. She clearly needs you.