User-agent: * Allow: / Disallow: /admin/ Disallow: /cgi-bin/ # JSON endpoints (RajaBot, app, homepage calculator): not pages. Googlebot # found them in scripts and reported them as "crawled - not indexed". Disallow: /api/ Disallow: /fare-estimate/ Disallow: /booking/quote/ Disallow: /booking/check-fare/ Disallow: /invoice/ # /booking-success/ and /contact-success/ are deliberately NOT disallowed. # They carry , and a page # blocked here can never be crawled — so Google would never read the noindex # and could keep the URL in the index with no content, which is exactly the # Soft 404 shape we are trying to clear. Allow the crawl, let the tag work. # The index first, then every child listed individually. # # Listing the children is redundancy that earned itself: the day the index # went live Google read it mid-deploy, could not fetch the children during # the Passenger restart, and reported "Couldn't fetch" with 0 discovered # pages against a sitemap that had been reporting 571. The files were fine # minutes later, but for a site already fighting an indexing problem, # discovery should not hang on one fetch of one file. # # Submitting the children individually in Search Console is also what makes # per-section coverage numbers appear, which is the whole reason the sitemap # was split. Sitemap: https://rajadroptaxi.com/sitemap.xml Sitemap: https://rajadroptaxi.com/sitemap-routes.xml Sitemap: https://rajadroptaxi.com/sitemap-cities.xml Sitemap: https://rajadroptaxi.com/sitemap-places.xml Sitemap: https://rajadroptaxi.com/sitemap-localities.xml Sitemap: https://rajadroptaxi.com/sitemap-static.xml Sitemap: https://rajadroptaxi.com/sitemap-blogdetails.xml