I believe if you just call said vagrants/thieves what they are: gypsies, Bulgarians will be less likely to be insulted.

Us Romanians are more used to being confused with gypsies than Bulgarians, I guess. Gypsies even when to the trouble of renaming themselves to "Rroms", so they are more easily confused with Romanians.