The diet is half of the battle and the other half of the battle is supplements. What are you taking as far as antifungals and probiotics? Are you taking any vitamins abcde? Your diet sounds fine in my opinion; I just feel that you may not be eating enough. Can you handle the coconut bread? Is there any side dishes you can tolerate such as buckwheat, quinoa, millet, etc?
I don’t think that eating meat can set you back that much…