It’s not racist to discuss race. It’s not racist for an entire discussion to be centered around race. It’s not racism to say that race was the primary or even sole factor in a situation.
It is racist when race is used to oppress a minority based upon race.
So if a racial majority member says to a racial minority member, “You keep making it all about race. Shush – nobody wants to hear it and you’re being racist” – that is racism in action because of the direction.