businesstelegraph.co.uk Review

Titletag	Descriptiontag	language
Business Telegraph \| Business, Tech, Crypto & Industry News		en-gb

Alexarank
436653

Ip adress

46.30.215.165

Nameserver

ns01.one.com
ns02.one.com

Status code

200

robots.txt -http://businesstelegraph.co.uk/robots.txt

 # GLOBAL CRAWL DELAY (10 seconds baseline)
User-agent: *
Crawl-delay: 10
Disallow: /admin/
Disallow: /private/
Disallow: /login/
Disallow: /cgi-bin/

# ALLOW SEARCH ENGINE BOTS (Priority crawling)
User-agent: Googlebot
Allow: /
Crawl-delay: 1

User-agent: Bingbot
Allow: /
Crawl-delay: 1

User-agent: DuckDuckBot
Allow: /
Crawl-delay: 1

User-agent: Applebot
Allow: /
Crawl-delay: 1

User-agent: Yandex
Allow: /
Crawl-delay: 1

User-agent: Baiduspider
Allow: /
Crawl-delay: 1

# BLOCK BAD/SCRAPING BOTS (Aggressive throttling)
User-agent: PetalBot
Disallow: /
Crawl-delay: 30

User-agent: AhrefsBot
Disallow: /
Crawl-delay: 30

User-agent: MJ12bot
Disallow: /
Crawl-delay: 30

User-agent: SemrushBot
Disallow: /
Crawl-delay: 30

User-agent: DotBot
Disallow: /
Crawl-delay: 30

User-agent: BLEXBot
Disallow: /
Crawl-delay: 30

User-agent: CCBot
Disallow: /
Crawl-delay: 30

User-agent: Bytespider
Disallow: /
Crawl-delay: 30

User-agent: Sogou Spider
Disallow: /
Crawl-delay: 30

User-agent: Nutch
Disallow: /
Crawl-delay: 30

User-agent: Scrapy
Disallow: /
Crawl-delay: 30

User-agent: HTTrack
Disallow: /
Crawl-delay: 30

User-agent: 360Spider
Disallow: /
Crawl-delay: 30

User-agent: ZoominfoBot
Disallow: /
Crawl-delay: 30

User-agent: SeekportBot
Disallow: /
Crawl-delay: 30

User-agent: archive.org_bot
Disallow: /
Crawl-delay: 30

User-agent: NetcraftSurveyAgent
Disallow: /
Crawl-delay: 30

User-agent: TrendictionBot
Disallow: /
Crawl-delay: 30

User-agent: LinkedInBot
Disallow: /
Crawl-delay: 30

User-agent: GPTBot
Disallow: /
Crawl-delay: 30

User-agent: ClaudeBot
Disallow: /
Crawl-delay: 30

User-agent: PerplexityBot
Disallow: /
Crawl-delay: 30

User-agent: OAI-SearchBot
Disallow: /
Crawl-delay: 30

User-agent: DataForSeoBot
Disallow: /
Crawl-delay: 30

User-agent: HeadlessChrome
Disallow: /
Crawl-delay: 30

User-agent: Amazonbot
Disallow: /
Crawl-delay: 30

Sitemap: https://businesstelegraph.co.uk/sitemap.xml

HTTP/1.1 301 Moved Permanently
Date: Sat, 23 Aug 2025 08:35:54 GMT
Server: Apache
X-Powered-By: PHP/8.4.10
X-Redirect-By: WordPress - Really Simple Security
Vary: Accept-Encoding
Location: https://businesstelegraph.co.uk/
Cache-Control: max-age=0
Expires: Sat, 23 Aug 2025 08:35:54 GMT
Content-Length: 0
Content-Type: text/html; charset=UTF-8
X-Varnish: 19063506383 17926886404
Age: 55447
Via: 1.1 webcache2 (Varnish/trunk)
Connection: keep-alive

HTTP/1.1 200 OK
Date: Sat, 23 Aug 2025 08:35:03 GMT
Server: Apache
X-Powered-By: PHP/8.4.10
Link: ; rel="https://api.w.org/"
Vary: Accept-Encoding
Last-Modified: Sat, 23 Aug 2025 08:35:05 GMT
Cache-Control: max-age=0
Expires: Sat, 23 Aug 2025 08:35:03 GMT
Content-Encoding: gzip
Content-Type: text/html; charset=UTF-8
X-Varnish: 18976053224 18003329608
Age: 55498
Via: 1.1 webcache2 (Varnish/trunk)
Accept-Ranges: bytes
Content-Length: 26835
Connection: keep-alive

iframe