I did, but I was already looking for work as I saw the levels of inflexibility not experienced before so I lucked out and was able to say no with near zero repercussions. I am saying near zero, because I am kinda looking again and long story short, the VP I said no to is still there and clearly seething over me leaving, because of the RTO mandate. Long story short, I was told in no uncertain way that I can't come back there..
Moral of the story is: thread carefully.