Results 1 to 2 of 2

Thread: robots.txt

  1. #1
    Join Date
    Apr 2012
    Location
    Central New Jersey
    Posts
    214
    Thanks
    77
    Thanked 3 Times in 3 Posts

    Default robots.txt

    Folks,

    Can robots.txt statements include "pattern" directives, using DOS-type wild cards? For example, if I want a directive to disallow any page with filename beginning with abc, will Disallow: /abc*.* do the job?

    Thanks.

    A.

  2. #2
    Join Date
    Mar 2019
    Posts
    4
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    Hello,
    Yes, is possible to write directives in robots.txt. You can find more information about directives and rules of robots.txt in this page: https://support.google.com/webmaster.../6062596?hl=es

Similar Threads

  1. robots.txt
    By marain in forum PHP
    Replies: 1
    Last Post: 10-20-2012, 09:06 PM
  2. robots.txt only allow index
    By onestopplay in forum HTML
    Replies: 0
    Last Post: 12-18-2010, 06:19 PM
  3. robots.txt and .htaccess
    By chechu in forum Looking for such a script or service
    Replies: 1
    Last Post: 08-10-2008, 09:11 AM
  4. Robots Text Script
    By snail in forum Looking for such a script or service
    Replies: 1
    Last Post: 06-15-2007, 09:11 PM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •