Its called the circle game. And yea, I have seen that game used out of context toa ccuse someone of being a racist.
Thats exactly why 4chan choose the symbol. It is so absolutely widely used to think of it as a hate symbol means 99% of the people you accuse will likely be on your side. Or at the very least certainly not a Nazi.