Task № 0214 · Completed 2022 · Home goods retailer

robots.txt Customization

A retailer with leftover code from multiple old themes had search engines indexing pages they shouldn't, and wanted the crawl rules cleaned up.

Want one like this?

Tell us about your store and we'll send a flat-rate quote within 24 hours. No commitment until you approve.

Request a quote

2 to 4 business days

Turnaround, from quote to live

Medium

Task complexity

Retina

Out of the Sandbox theme

2022

Year completed

01

The request

“We've had several templates in use and have leftover old code. Search engines are indexing pages that shouldn't be indexed. We need the robots rules and the old code cleaned up.”

Typical request

Paraphrased from merchant tickets in this category

Crawl clutter from years of theme changes.

02

The approach

We removed the leftover code, set robots rules to exclude the pages that shouldn't be indexed, and confirmed the sitemap only contained the pages that should.

03

What we shipped

Leftover theme code removed
Robots rules updated
Sitemap cleaned
Verified in Search Console

How a task moves from submission to live

Getting your task done with TaskHusky is super-easy and fast

1

Tell us about your task

URL, theme, screenshots if you have them. Two minutes.

2

Approve your quote

We respond in 24 hours with scope, price, and timeline. Commit only if it makes sense.

3

We get to work

We start the moment you confirm. Pay-as-you-go, no minimums.

4

Get it done

Built on a duplicate theme, QA'd, pushed live with a walkthrough.

Submit your task

Browse the collection

Have a Sitemap & Robots.txt task in mind?

We've completed 41 Sitemap & Robots.txt tasks since 2016. Submit yours and we'll quote it within 24 hours.