# -------------------------------------------- # robots.txt - instructions for web robots/spiders, # should always be present in site root, to avoid # 404 errors logged by its absence. # -------------------------------------------- User-agent: * Disallow: /hidden/ Disallow: /1918566.asp Disallow: /archive/ Disallow: /Info_page_two_pic_2_det.asp?art_id=3676&sec_id=1168 Disallow: /holidaycottagesuffolk.htm