I'd venture that the north's earlier industrialization built up experience and supporting infrastructure which made it a dubious business prospect for any southerner that might have considered building a factory, along with the fact that making textiles by manpower alone made less money than picking cotton and exporting it.