But it is used to silence, just differently. Per OP: Noticing privilege is proof of privilege existing in society. Not noticing privilege is proof of privilege and proof of the observer's oblivious-ness.
If all answers are supposedly proof of your claim, that's just another way to silence dissent by invalidating opposing claims and viewpoints.
Same can be said for current usage of "privilege" and "equity".