Videos and Webinars
How do I Block the Entire Site From the Search Engines Via Robots.txt?
Search

Block Entire Site From the Search Engines Via Robots.txt

In some cases, you may need to actively prevent search engines from indexing your Shift4Shop store. This is typically needed when you are developing a copy of your store on Shift4Shop and - since it likely contains the same product information as your live store - you need to prevent the development store from being indexed to avoid information from being interpreted as "duplicate content."

The best way to do this is to edit your robots.txt files to prevent all indexing on the store. Here's how:

  1. Log into your Shift4Shop Online Store Manager.

  2. Using the left navigation menu, go to Marketing > SEO Tools.

  3. Under "SEO Settings," locate the "Robots.txt" section and click on the Edit Robots.txt File link.

  4. Remove all of the information in the Robots.txt section and replace it with the following:

User-agent: *
Disallow: /

  1. Then click Save at the top right to commit your changes.