| Titletag | Descriptiontag | language |
|---|---|---|
| Home - Flexmls Platform by FBS | en-us |
| Alexarank |
|---|
| 7976 |
| Ip adress | 151.101.65.91 | Nameserver | dns1.p08.nsone.net dns2.p08.nsone.net dns3.p08.nsone.net dns4.p08.nsone.net |
Status code | 200 |
# ============================================================================= # FLEXMLS Robots Policy # ============================================================================= # By default, most crawling is allowed. Additional bot-specific paths are # further defined. # # Last updated: 2025-04-16 # ============================================================================= # ----------------------------------------------------------------------------- # DEFAULT: Allow everything with some basic exceptions # ----------------------------------------------------------------------------- User-agent: * Allow: / Disallow: /wp-admin/ Disallow: /platform-mls-conversions/ Disallow: /mls-administrators/ Allow: /wp-admin/admin-ajax.php # ----------------------------------------------------------------------------- # BOT-SPECIFIC OVERRIDES, SAFETY CHECKS # ----------------------------------------------------------------------------- # ClaudeBot – Universally Denied User-agent: ClaudeBot Disallow: / # GPTBot – Universally Denied User-agent: GPTBot Disallow: / # ChatGPT-User – Universally Denied User-agent: ChatGPT-User Disallow: / # MJ12bot – Universally Denied User-agent: MJ12bot Disallow: / # Dotbot – Universally Denied User-agent: Dotbot Disallow: / # BLEXBot – Universally Denied User-agent: BLEXBot Disallow: / # CCBot – Universally Denied User-agent: CCBot Disallow: / # Voltron - Universally Denied User-agent: voltron Disallow: / # Awario bots - Univerally Denied User-agent: AwarioRssBot User-agent: AwarioSmartBot Disallow: / # ----------------------------------------------------------------------------- # BOT-SPECIFIC ALLOWANCES AND EXCEPTIONS # ----------------------------------------------------------------------------- # AhrefsBot – Allowed only for specific marketing and sitemap paths User-agent: AhrefsBot # Disallow everything (for Product/Hosting) Disallow: / # Allow select marketing content Allow: /sitemap.xml Allow: /sitemap_index.xml Allow: /page-sitemap.xml Allow: /post-sitemap.xml Allow: /category-sitemap.xml Allow: /post_tag-sitemap.xml Allow: /author-sitemap.xml Allow: /main-sitemap.xsl Allow: /flexmls-academy/ Allow: /customer-showcase/ Allow: /product/ # SemrushBot – Same allowances as AhrefsBot User-agent: SemrushBot # Disallow everything (for Product/Hosting) Disallow: / # Allow select marketing content Allow: /sitemap.xml Allow: /sitemap_index.xml Allow: /page-sitemap.xml Allow: /post-sitemap.xml Allow: /category-sitemap.xml Allow: /post_tag-sitemap.xml Allow: /author-sitemap.xml Allow: /main-sitemap.xsl Allow: /flexmls-academy/ Allow: /customer-showcase/ Allow: /product/ # ----------------------------------------------------------------------------- # SITEMAP # ----------------------------------------------------------------------------- Sitemap: https://flexmls.com/sitemap_index.xml