VexelSearchBot

Information about Vexel's web crawler, for site owners and network administrators.

In short: VexelSearchBot-1.0 is the automated crawler that powers Vexel, a search engine with its own independent index. It obeys robots.txt, respects nofollow, and applies per-site crawl delays. It does not attack, scan for vulnerabilities, or attempt unauthorized access to any system.

User-Agent String

VexelSearchBot-1.0 (+https://vexel.cc/bot-info; support@vexel.cc)

What This Crawler Does

VexelSearchBot-1.0 fetches publicly accessible web pages in order to build Vexel's search index, the same way crawlers from Google, Bing, and other search engines operate. It follows links it discovers, downloads page content, and processes it for indexing.

Obeys robots.txt	Yes
Respects rel="nofollow"	Yes
Per-site crawl delay	Yes
Attempts unauthorized access	No
Port/vulnerability scanning	No

Crawler IP Addresses

VexelSearchBot-1.0 crawls from the following IP addresses, as we expand we will add more ips for crawling:

23.81.36.18
23.81.33.222
95.111.230.224

We operate other infrastructure (search serving, our advertising platform, and other services) that is entirely separate from crawling; only the ip addresses listed should ever be treated as VexelSearchBot-1.0.

Blocking VexelSearchBot-1.0

If you'd prefer VexelSearchBot-1.0 not crawl your site, add the following to your robots.txt file:

User-agent: VexelSearchBot-1.0 (+https://vexel.cc/bot-info; support@vexel.cc)
Disallow: /

We check and respect robots.txt directives before crawling. If you'd like a specific site or IP excluded immediately without waiting on a robots.txt update, contact us directly (see below) and we'll add it right away.

Allowing VexelSearchBot-1.0

If you'd like your site to be indexed and appear in Vexel search results, no action is needed beyond having a standard, crawlable robots.txt (or none at all, which permits crawling by default).

Reporting an Issue

If you believe VexelSearchBot-1.0 is behaving unexpectedly — crawling too aggressively, ignoring robots.txt, or anything else — please contact us directly rather than only filing an abuse report with our hosting provider, so we can investigate and respond quickly.

Contact

Email: support@vexel.cc