No, why would you say that? When America and Europe built their wealth, they were mainly (though not exclusively) producing and selling manufactured goods for themselves. This whole idea of a poor country developing by building polluting factories to make items for rich countries is a more recent and different thing.
Europe and America insisting on certain labor and environmental standards as a condition of trade wouldn't mean poor countries can't build factories for themselves. At worst, you just split the current one big market into two smaller markets: an expensive and clean one, and a dirty and cheap one.
Do we let other countries wage war, pillage, etc. because others gathered wealth that way previously?