#roxen.domain:[www.omnext.net] # # Roxen Platform 2.2.230 Crawler mag alles, deze heeft zijn eigen rules User-agent: RoxenCrawler/1.0 Disallow: User-agent: * Disallow: /new/ Disallow: /lang/ Disallow: /internal/ Disallow: /certificates/ Disallow: /information-logstics/ Disallow: /roxen-files/ # dit zijn alle links voor de nieuwe site, tot 9april2008 Disallow: /newsletter/ Disallow: /lib/ Disallow: /intranet/ Disallow: /se/ # outdated ones Disallow: /bedrijf/ Disallow: /technologie/ # outdated ones, version 2008 Disallow: /contact/about_us/ #syndicated ones Disallow: /contact/contactinfo/ #2009 t Disallow: /2009/ #2009 t Disallow: /2008/ #2009 t Disallow: /2007/