None of these vehicles are considered "large" in the US. I've seen Vitaras, they're a mid-size crossover by American standards.
Also, this whole idea that "every American drives a cartoonishly large vehicle" is bullshit, and it was especially bullshit in 2012 when Suzuki entered the US market. The recession was driving sales of smaller, more affordable cars. Ford brought back the Fiesta, GM introduced the Volt and Cruze, and all of those sold really well for a time.
Suzuki just did zero marketing. Almost no non-nerd knew they were even here, and dealerships were hard to come by. And why would you buy a Kisashi or an SX4 when a Fiesta cost the same and came from a brand that isn't better known domestically for snowmobiles and motorcycles?
I actually test drove both a Fiesta and a Suzuki Swift in 2013. They were comparably priced but the Fiesta was better equipped and a nicer drive, and I (rightly) figured that part and maintenance would be easier for the Ford over my ownership.