I’m a white person but I know that the word “our” doesn’t apply evenly even though it _should_.
Being a public space, replying here becomes a public broadcast so no, you did not comment only to him, even if you intended to.
I’m glad you clarified but don’t blame others for the nature of public spaces. You’re a broadcaster here as am I.