Indeed the sugars will set you back.
Regardless of the origin, sugar is the primary food of candida, and any chance they get, they will use it to continue making you feel worse.
The thing to consider is that fruits contain many vital nutrients, some of which will help you fight this illness. But unfortunately the sugar will offset that goodness.
Natural sugar is is obviously tons better than processed, but still not recommended for the diet.
Some low sugar fruits include
Limes, Lemons, apricots and berries.
The best is lemons, since they are antimicrobial, so they can kill candida and parasites, but also your beneficial flora, so go easy on them. The rest you can decide for yourself how much you can tolerate based on your candida symptoms. I would only consume these later on after a few weeks/months into the diet.