Former Sports Minister Sir Hugh Robertson says he was told bidding for the 2018 and 2022 World Cups was a "Wild West" process.