I feel that animal empathy should have an adverse effect on hostile summoned animals and animal companions. Though I don't think they should change hands. Instead I think they should be feared or lose attack bonus for a few rounds on a successful animal empathy check to represent their unwillingness to fight.