Help Center


Open 9:00am - 11:00pm EST
Call us 1 (800) 575-NEAR
Email us support@near.shop
Help Technical Support Why aren't you following our robots.txt file?

Why aren't you following our robots.txt file?

We've heard this one a couple of times but after investigation, we haven't found a case where we're actually indexing content you're asking us to avoid. In most cases our bot may have visited a page that had something embedded in it that you had blocked in your robots.txt file. Rest-assured, we didn't store that information and didn't want it in the first place. Our only goal is to gather product information. If one of our bots stumbles across something it didn't need, that data is discarded and quickly forgotten.