The ideal is a very liberal one, tolerance of everyone. I do think it begins to be a problem where tolerance in of itself is in conflict. There does need a “do not harm others” baseline before tolerance. For example, I just had a conversation the other day about “armed groups” where the other person was in favor of militarizing against oppression, which is an intolerant position (War and warmongering is intolerance.) If my opinion is that I want you dead, it’s not an opinion or a view but an incitement to violence.