Prime Minister Narendra Modi is not allowed to enter this temple