Log in

View Full Version : robots.txt



marain
03-15-2019, 06:32 PM
Folks,

Can robots.txt statements include "pattern" directives, using DOS-type wild cards? For example, if I want a directive to disallow any page with filename beginning with abc, will Disallow: /abc*.* do the job?

Thanks.

A.

juansann
05-14-2019, 08:14 PM
Hello,
Yes, is possible to write directives in robots.txt. You can find more information about directives and rules of robots.txt in this page: https://support.google.com/webmasters/answer/6062596?hl=es