# Disallow all crawlers access. User-agent: * Disallow: *?__* Disallow: *?utm* Disallow: /*?* Disallow: /thank-you/ Disallow: /thankyou/ Disallow: /wp-admin Disallow: /wp-admin/ Disallow: /wp-login.php Disallow: /wp-includes Disallow: /wp-content/ Disallow: /lp/ Disallow: /post-form.php Disallow: /careers/*/ Disallow: /privacy-policy/ Disallow: /terms-of-use/ Disallow: /blog/?* Disallow: /blog/author/* Disallow: /feed # disable duggmirror User-agent: duggmirror Disallow: / # Disallow Following crawlers access to site. User-agent: ia_archiver-web.archive.org Disallow: / User-agent: ia_archiver Disallow: / User-agent: TurnitinBot/2.1 Disallow: / User-agent: TurnitinBot Disallow: / User-agent: SurveyBot Disallow: / User-agent: EmailWolf Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailCollector Disallow: / User-agent: AboutUsBot Disallow: / User-agent: robtexbot Disallow: / Sitemap: https://www.cubix.co/sitemap-index.xml