Yes, but the difference also has to do with geography/preference. Brown and Polar bears can and do produce viable offspring, but because they're generally geographically separated we consider them separate species. Same for birds; many could mate but they choose not to (different mating calls, etc), and for that reason combined with different looks we classify them as separate species. Neanderthal, who are accepted as being a different species of human, interbred with humans before going extinct.
It's my opinion that if aliens visited earth 30k years ago and used our definition of the word, they would classify us as different species. To be clear I'm not advocating that we should refer to humans as different species, just that because we're capable of such advanced thought we should abide by different rules than we hold other animals to.