They don't hurt your stats. Your Pokemon just won't get any EVs or Effort Values to help increase its stats. So, in a way, the Pokemon won't get the best stats they can, but if you use it after all 510 EVs have been used, then it's safe to use Rare Candies.
So Long Answer short, yes it will, but you can get around the problem.