Is this contempt of the custody order?

Speak to your lawyer to have this clarified. Unless you have a written agreement of a 'alternative' pickup person, you keep the child. Don't worry about starting a fight .... worry about where your child will be taken ... and by whom.