The avoidance of spicy foods is primary, but most health professionals also advise to avoid
milk.... I realize you had some relief but that's temporary due to the coating action. Milk stimulates production of acid in the stomach... read here, for one discussion:
Milk can make your ulcer worse. Milk provides brief relief of ulcer pain because it coats the stomach lining. But milk can also stimulate your stomach to produce more acid and digestive juices, which can aggravate ulcers.
(Source:
http://www.webmd.com/content/article/90/100627 .htm ... Best of luck!