Maybe the "stealing out jobs crowd" are the ones competing for the lower wage jobs. I got the impression that Brexit voters were often towards the lower and of the earning spectrum. While I am for staying in the EU myself I can see why these people don't feel like they get much out of EU membership.