• Your shopping cart is empty!

Whitelist Search Engine Crawlers in Firewall

Do you want to whitelist robots by search engine?

Select the search engines you want to whitelist, output format and press the "Download" button.

The output formats supported are Apache .htaccess, iptables (CIDR), Netmask, Inverse Netmask, IIS web.config and Cisco ACL. Please find the details below:

Format Sample Output
Apache .htaccess allow allow from 8.8.8.0/24
Apache .htaccess deny deny from 8.8.8.0/24
CIDR 8.8.8.0/24
Linux iptables iptables -A INPUT -s 8.8.8.8/24 -j DROP
Netmask 8.8.8.0/255.255.255.0
Inverse Netmask 8.8.8.0 0.0.0.255
Web.config allow <ipSecurity allowUnlisted="false">
<add ipAddress="8.8.8.0" subnetMask="255.255.255.0"/>
Web.config deny <ipSecurity allowUnlisted="true">
<add ipAddress="8.8.8.0" subnetMask="255.255.255.0"/>
Cisco ACL deny ip 8.8.8.0 0.0.0.255 any

Download List

Unregistered users can generate table for 1 search engine at one time. Registered users can generate all engines at one time. Register your free account today.