That is considered racial prejudice and racial discrimination and bigotry. There are words and phrases for those things.
Those are a part of racism but are not enough for it to be racism.
By eliminating the distinction of what makes racism distinct from racial discrimination/racial prejudice/bigotry – that is, the power difference removed from it – it no longer becomes a useful word of its own.
It becomes just a synonym for a bunch of other words and can be called “meaningless” and “anybody can make it mean anything”
It’s possible to refer to racial prejudice against white people as “Reverse-Racism”. There are laws on the books for that and cases and such.
That’s still not racism though. It’s reverse-racism.