Staging the Olympics is detrimental to the tourism growth trends of both the host cities and countries, according to industry research.