The problem is people don't "just" want cheap housing - they want the character of the area to remain the same. But, those two things are frequently incompatible.