Actually, it was part of a joke, taken out of context, and the joke actually highlights that he bought his son the doll house. It was anything but a negative gay joke. Chappelle talked about it in one of the specials too.
That's why he didn't apologize. The outrage was fake, or better put it was based on a fake incident, an out of context quote from a joke he was telling.
Just a crazy story all around, totally fukked up for Kevin Hart.