The Spoils of War - 8:34
Why should they not deserve the torment of Allah while they bar others from the Holy Mosque? Yet they are not its guardians. Its true guardians are the believers, but many do not know it.
The guardians of the Holy Mosque are not disbelievers:
The Repentance/9:17
The idolaters should not frequent the mosques of Allah, while they are witnesses of their own disbelief. Their deeds have come to naught. They will abide in the Fire forever.
The Repentance/9:18
Only those who believe in Allah and the Last Day, who observe prayer, pay the zakat, and fear none but Allah, visit the mosques of Allah frequently. They are of those who find the right path.
The Repentance/9:28
O you who believe, the idolaters are unclean; let them not approach the Holy Mosque after this year. If you fear poverty, Allah will, if He wills, enrich you with His bounty. Allah is All-Knowing, All-Wise.