I'm using Fastmail with that feature enabled (download images only when the sender is in your contacts) but it doesn't prevent them from emailing me at least once per week.