You are being too hard on yourself and this won’t set you back whatsoever. If anything it’ll set you back a few hours to a few days. No big deal whatsoever.
Here’s another thing to keep in mind…the yeast will live on the food you eat, candida diet or not. There is no way to not feed the yeast.