The decision was made by the Japanese organizing committee in agreement with the International Olympic Committee, the International Paralympic Committee, the city of Tokyo, and the Japanese government. Only Japanese spectators are allowed on the Olympic site. 

Obviously, the athletes and their entourage are allowed in Tokyo but need to follow very strict corona measures. 

It is the first time in history that there won't be spectators allowed at the Olympic Games.