# robots.txt @ www.mm-schilders.nl # 31 december 2009 ##################################### # laat alle zoekmachines toe... ##################################### User-agent: * # ...behalve in de volgende dirs... ##################################### Disallow: /images/ # ...en de volgende bestanden. ##################################### Disallow: kortingen.htm Disallow: Caparol.htm Disallow: Foto album.htm Disallow: Keuken schilderen.htm Disallow: start Disallow: http://www.mm-schilders.nl/start Disallow: http://www.mm-schilders.nl/Schildersbedrijf%20M&M%20Spijkenisse%20Binnenschilderwerk.htm Disallow: http://www.mm-schilders.nl/Buitenschilderwerk.htm Disallow: http://www.mm-schilders.nl/Buitenschilderwerk.htm Disallow: mm test voor meerdere linken.htm ### Robots.txt Tutorial # http://www.searchengineworld.com/robots/robots_tutorial.htm ### Robots.txt Validator # http://www.searchengineworld.com/cgi-bin/robotcheck.cgi ### Robots Exclusion Meta Tag : Using robots metatags # http://searchengineworld.com/metatag/robots.htm ### Search Indexing Robots and Robots.txt, article at searchtools.com # http://www.searchtools.com/robots/robots-txt.html ### Root of Robots Exclusion Standard directory with some interesting files # http://info.webcrawler.com/mak/projects/robots/ ### Robots.txt : The Big Crawl # http://www.searchengineworld.com/misc/robots_txt_crawl.htm ### Robots.txt on 'big' websites # http://www.cnn.com/robots.txt # http://nl.altavista.com/robots.txt # http://www.google.com/robots.txt