Can I recover a candidate I accidentally rejected?

Yes. You can move a rejected candidate back into any active stage the same way you'd move any other candidate, there's no separate undo needed.