That building looks normal to me. Any building would feel ugly if its less inhabited and full of druggies and homeless.

Its not about high mindedness. Tell me suppose you took steel started making cuboids out of it and sanding it rough then stacking it with cement. Does that in any way do justice to steel or is it a complete waste and misuse of the substance? What these people are trying to imagine as their ideal are not as extreme as forcing steel to behave like brick but it is on the same spectrum. Neoclassical buildings are another good example. They are completely fake. I would bet they mix wildly different centuries apart greek and roman designs. And we know they are steel and concrete structures internally just facaded over with marble, not structural load bearing all-marble like the original greek stuff. Brutalism is just a more honest form of those massive neoclassical buildgings, the scale and power of it minus the fake marble nonsense. But I am not even saying you have to be brutalist, it's just one example of an honest medium.

If I only have hand tools and solid wood, I would make Colonial furniture for example. If I have stainless steel tubing and plywood I would make bent tube legs and plywood rests.

Plywood is an amazing substance why do people hate it? It uses wood to make large panels that lack the directional weakness of wood and to quite an extent the movement issues of wood are also avoided. Concrete is pourable rock. Steel is a flexible and easy to cut and join structural substance. You may disagree with certain design ideas that use these substances snd cwn say we could try different designs but I think its ridiculous to cargo cult brick and mortar or marble for instance (which are perfectly fine materials for their tooling and design) and wholly reject modern substances.

Brick cuboids don't grown on trees or are found in nature either. I would say the funniest one is people calling structures like hypar shaped halls as unnatural. That's as natural as it gets, nature itself leaves the hypar the only shape that is optimal to be supported atop a grid of columns, not the flat roof. These curves are more natural that flat and square walls. At least people should be wrested of the naturalist argument if they use it against designs like this.