My advice. I would start a strict version of the diet as soon as possible. All your symptoms are the beginning stages of a fungal problem. If you keep dancing around this thing it will just become worse and worse. The faster you take care of it the easier it is to go away. I started having strange food allergies 3 years ago and then 6 months ago my life felt like I was living in tunnel vision and my digestive system felt like it completely shut down. I have been on the diet for a few months with different ups and downs, but overall my health has gotten better.
Give you and possibly your significant other a good body detox to get this stuff out of you.