You haven’t been doing the diet correctly. I failed during my first 4 weeks also, so don’t feel bad about it.
Almond butter gave me a reaction so take it off the list. Save it for phase 2.
Stop coffee if you are drinking it.
I recommend some of the “alternative flours” and start making some breads. Pumpkin bread and coconut bread from the recipes part of the forum can really help fill in the gaps in your diet.
For me personally, I was over the die-off symptoms about 2-6 weeks into diet. After that I have slowly been getting better until I started the new supplements 3 days ago. I am into week 13 of the diet and still not better, but progressing. I had a very severe case of candida/leaky gut, so it has been hard to get over. Most people don’t have as severe as I do.