Ho inserito un file robots.txt fatto copiando pressoché pedissequamente le istruzioni che si trovano qui. Eccolo:
User-agent: *
Allow: /blog/*/200*/*/*/*/
Disallow: /*/200
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-vault
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /*/trackback
Disallow: /*/comments
Disallow: /archives/
Disallow: /category/
Disallow: /tag/
Disallow: /tags/
Disallow: /*/trackback
Disallow: /*/comments
Disallow: /search/
Disallow: /*?*
Disallow: /*?
Allow: /wp-content/uploads# Google Image
User-agent: Googlebot-Image
Disallow:
Allow: /*# Google AdSense
User-agent: Mediapartners-Google*
Disallow:
Allow: /*# Internet Archiver Wayback Machine
User-agent: ia_archiver
Disallow: /Sitemap: http://me.quasidot.com/sitemap.xml.gz
Post a Comment