It's simple, if I eat cheese I get violently ill. Wasn't able to drink Milk products when I was a kid either. I grew out of the Milk issue and I'm not lactose intolerant. A couple of doctors told me I must be allergic to the molding process for cheese.
Even if that was a non factor I don't like the smell or the taste.