Nybor's gentle reminder not applying full penalty

[SemStar]

The spell is supposed to apply a 1 round daze, and a -2 to AB, Saves, and skills. After quite a few tests of this spell, it seems that after the daze only a -1 penalty is applying.

the PC casting has GSF:Enchantment and is an Enchanter Specialist.