User-agent: * Disallow: /hometest/ Disallow: /hometest Disallow: /dev/ Disallow: /dev Disallow: /2016 Disallow: /2016/ Disallow: /BU2016/ Disallow: /BU2016 Disallow: /test Disallow: /test/ Disallow: /newsite-copy/ Disallow: /newsite-copy Disallow: /newsite-main/ Disallow: /newsite-main