I remember reading (sorry, can't find the article now) that to make a smartphone, you'll need licenses for thousands of patents. If you don't have a large patent portfolio yourself, you have nothing to trade with when it comes to cross-licensing. That is why we don't see any small handset manufacturers.
Having said that, I sincerely hope Canonical can buck the trend. But I'm not very hopeful.