User-agent: * Allow: / Disallow: /admin Disallow: /login Disallow: /register Disallow: /dashboard Disallow: /links # AdSense's own crawler: allowed on the homepage (/$), every blog post, # topic hub and info page, plus static assets. Everything else (shortener # short-code redirects, dashboard, auth, admin) stays blocked. User-agent: Mediapartners-Google Disallow: / Allow: /blog Allow: /about Allow: /faq Allow: /editorial-guidelines Allow: /contact Allow: /privacy Allow: /terms Allow: /disclaimer Allow: /$ Allow: /topics Allow: /editorial-policy Allow: /static Allow: /sitemap.xml Allow: /feed.xml Allow: /llms.txt Allow: /ads.txt Sitemap: https://guruxurl.tech/sitemap.xml # LLM-friendly summary of the blog: https://guruxurl.tech/llms.txt