The desert full of desperadoes immediately adjacent belongs to Saudi Arabia, no? Undoubtedly the colonial powers of the later 20th Century took full advantage in picking over the carcass of Ottoman Empire to settle things to their own advantage. Yet it's not clear to me that there were larger nearby populations with a compelling claim to the Gulf sultanates.