Give credit where credit is due:

The implication is that even if we are reluctant to praise someone, we should do so if the praise is deserved.