You don't have to go out of your way to hate LGBT people to be a homophobe. Nor do you have to go out of your way to hate [random ethnic group] to be racist. For that matter, the fact that there are jokes about race or sexual orientation or what have you that are funny (if, perhaps, in a limited context) doesn't mean that all such jokes have an acceptable context.