As the title says, I'm not sure if there is a particular mechanical balancing reason for this, but as it stands I think familiars could be more interesting than just buff/utility bots that you immediately unsummon away. Maybe making it so that you cannot summon them again for an entire reset after their death, but I believe removing the XP penalty would encourage more varied use out of them.
seems reasonable they follow the same rules as animal companions