I get bad cramps when I eat anything spicy?

I love spicy food, and cannot cut it out of my diet, I do limit what I eat and how much of it I do eat. Whenever I eat it I am up half the night with really bad cramps. What finally makes them go away is drinking acid reliever, and then taking 1500 mg of tylenol..do you think there could be something like an ulcer or something going on? It only happens when I eat spicy foods..