toldot.com Review

 User-agent: *
Host: https://toldot.com
Disallow: /main/$
Disallow: /admin/
Disallow: /cgi-bin/
Disallow: /gallery/
Disallow: /includes/
Disallow: /jfamily/adam/adam-ask/?link=*
Disallow: /jfamily/children/children-ask/?link=*
Disallow: /lists/
Disallow: /media/
Disallow: /money/payment/*
Disallow: /netcat/
Disallow: /pages/
Disallow: /peredelka/
Disallow: /rus_gmach.php
Disallow: /test/
Disallow: /torah/
Disallow: /work-zone/
Disallow: *template=111
Disallow: *template=168
Disallow: /send-email/
Disallow: /search/
Disallow: /gsearch/
Disallow: /blogs/*/?tag=*
Disallow: /blogs/abre/*

User-agent: heritrix
Disallow: /
User-agent: archive.org_bot
Disallow: /
User-agent: GPTBot
Disallow: /

Sitemap: https://toldot.com/rss/sitemaps/themes/?from=0&length=50000
Sitemap: https://toldot.com/rss/sitemaps/cemeteries/?from=0&length=100
Sitemap: https://toldot.com/rss/sitemaps/surnames/?from=0&length=100
Sitemap: https://toldot.com/rss/sitemaps/audio/?from=0&length=100
Sitemap: https://toldot.com/rss/sitemaps/video/?from=0&length=100
Sitemap: https://toldot.com/rss/sitemaps/articles/?from=0&length=100
Sitemap: https://toldot.com/rss/sitemaps/voprosy/?from=0&length=100
Sitemap: https://toldot.com/rss/sitemaps/photo/?from=0&length=100
Sitemap: https://toldot.com/rss/sitemaps/blogs/?from=0&length=100

HTTP/1.1 301 Moved Permanently
Server: nginx
Date: Sat, 23 Aug 2025 19:19:03 GMT
Content-Type: text/html
Content-Length: 162
Connection: keep-alive
Location: https://toldot.com/

HTTP/1.1 200 OK
Server: nginx
Date: Sat, 23 Aug 2025 19:19:04 GMT
Content-Type: text/html; charset=utf-8
Transfer-Encoding: chunked
Connection: keep-alive
Set-Cookie: ced=g9c96ovm8c3493pauaidmr6102; path=/; secure; HttpOnly; SameSite=Lax
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Pragma: no-cache
Cache-Control: no-store, no-cache, must-revalidate
Cache-Control: post-check=0, pre-check=0
Set-Cookie: DateLP=2025-08-23%2022%3A18%3A05; path=/
Set-Cookie: ts=1; path=/
Set-Cookie: QUICK_BAR_CLOSED=-1; expires=Mon, 22-Sep-2025 19:19:04 GMT; Max-Age=2592000; path=/
Strict-Transport-Security: max-age=63072000
Content-Encoding: gzip