It becomes change and following avant garde for the sake of it and a group of people trying to be different in all the same boring ways.
No one will care if you build 1000th replica of a nice building. It's just not interesting to anyone and actually becomes boring very fast. People may live in it but no one will come from afar to visit it because of its beauty. It will become another one in a row of the same.
If you build a striking, exceptional building, it can become a big success (like Gehry's in Bilbao which is a success story for the whole city), so people who commission buildings sometimes select for that.
And also there is a sizable group of people who actually enjoy interesting buildings, like people who enjoy haute couture or haute cuisine etc., so it's not like there is no market for that.