marain
03-15-2019, 06:32 PM
Folks,
Can robots.txt statements include "pattern" directives, using DOS-type wild cards? For example, if I want a directive to disallow any page with filename beginning with abc, will Disallow: /abc*.* do the job?
Thanks.
A.
Can robots.txt statements include "pattern" directives, using DOS-type wild cards? For example, if I want a directive to disallow any page with filename beginning with abc, will Disallow: /abc*.* do the job?
Thanks.
A.