Wikipedia says that while they're actually common, they're spread so thin that they're hard to get, and therefore *seem* rare. You find a spot where they're concentrated (and those spots actually are rare), or you process a huge amount of rock for a tiny amount of metal.