Your better off cutting it out for a little while, then re-introducing it.
I have asked Dr. Bakker this very question recently.
His response ->
I’ve not found coffee really to be an issue, unless a person consumes many (more than two) cups per day, and has coffee with sugar. Try and have coffee in the morning, preferably before lunch time. Too much coffee can stimulate the nervous system, and adversely affect the digestive system.