Scribd Logo
Upload

Welcome to Scribd!

  • Custom Robot

    Uploaded by

    Kheno Atmojo
    2 views1 page
    The document contains a robots.txt file that disallows search crawling but allows all other crawling. It lists 7 sitemap files located at a URL that each contain up to 500 items to help crawlers comprehensively index the site content. The sitemaps were generated using a Blogger robots.txt generator tool.

    Original Description:

    cuntom robot

    Copyright

    © © All Rights Reserved

    Available Formats

    TXT, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    The document contains a robots.txt file that disallows search crawling but allows all other crawling. It lists 7 sitemap files located at a URL that each contain up to 500 items to help crawlers comprehensively index the site content. The sitemaps were generated using a Blogger robots.txt generator tool.

    Copyright:

    © All Rights Reserved
    Download as TXT, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    2 views1 page

    Custom Robot

    Uploaded by

    Kheno Atmojo
    The document contains a robots.txt file that disallows search crawling but allows all other crawling. It lists 7 sitemap files located at a URL that each contain up to 500 items to help crawlers comprehensively index the site content. The sitemaps were generated using a Blogger robots.txt generator tool.

    Copyright:

    © All Rights Reserved
    Download as TXT, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    of 1

    User-agent: *

    Disallow: /search
    Allow: /

    Sitemap: https://gurupenggerakbergerak.blogspot.com//atom.xml?redirect=false&start-
    index=1&max-results=500
    Sitemap: https://gurupenggerakbergerak.blogspot.com//atom.xml?redirect=false&start-
    index=501&max-results=500
    Sitemap: https://gurupenggerakbergerak.blogspot.com//atom.xml?redirect=false&start-
    index=1001&max-results=500
    Sitemap: https://gurupenggerakbergerak.blogspot.com//atom.xml?redirect=false&start-
    index=1501&max-results=500
    Sitemap: https://gurupenggerakbergerak.blogspot.com//atom.xml?redirect=false&start-
    index=2001&max-results=500
    Sitemap: https://gurupenggerakbergerak.blogspot.com//atom.xml?redirect=false&start-
    index=2501&max-results=500
    Sitemap: https://gurupenggerakbergerak.blogspot.com//atom.xml?redirect=false&start-
    index=3001&max-results=500

    # Sitemap built with https://walterpinem.me/projects/tools/blogger-robots-txt-


    generator/

    You might also like