Skip to content

Tag Archives: robots.txt

Robots.txt

Ho inserito un file robots.txt fatto copiando pressoché pedissequamente le istruzioni che si trovano qui. Eccolo:
User-agent: *
Allow: /blog/*/200*/*/*/*/
Disallow: /*/200
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-vault
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /*/trackback
Disallow: /*/comments
Disallow: /archives/
Disallow: /category/
Disallow: /tag/
Disallow: /tags/
Disallow: /*/trackback
Disallow: /*/comments
Disallow: /search/
Disallow: /*?*
Disallow: /*?
Allow: /wp-content/uploads
# Google Image
User-agent: Googlebot-Image
Disallow:
Allow: /*
# Google AdSense
User-agent: Mediapartners-Google*
Disallow:
Allow: /*
# Internet Archiver Wayback Machine
User-agent: ia_archiver
Disallow: /
Sitemap: http://me.quasidot.com/sitemap.xml.gz

Sitemap

La Sitemap è finalmente aggiornata, ed è stato creato un embrione di file robots.txt dal plugin Google (XML) Sitemap Generator, al solito eccellente. Peccato che Yahoo! abbia dato forfait alla prima richiesta…