# Google User-agent: googlebot Disallow: # Yahoo User-agent: inktomi/slurp Disallow: # MSN User-agent: msnbot Disallow: # AllTheWeb User-agent: FAST-WebCrawler Disallow: # Inktomi User-agent: slurp Disallow: # Teoma User-agent: Teoma_agent1 Disallow: # AltaVista User-agent: Scooter Disallow: # Northern Light User-agent: gulliver Disallow: # Excite User-agent: ArchitextSpider Disallow: # Lycos User-agent: Lycos_Spider_(T-Rex) Disallow: # Infoseek User-agent: UltraSeek Disallow: # Looksmart.com User-agent: MantraAgent Disallow: #ia_archiver User-agent: ia_archiver Disallow: #archive.org_bot User-agent: archive.org_bot Disallow: User-agent: * Disallow: /nav Disallow: /admin Disallow: /Connections Disallow: /divesite_maps Disallow: /divesites Disallow: /lang Disallow: /Library Disallow: /list Disallow: /ScriptLibrary Disallow: /Scripts Disallow: /SpryAssets