User-agent: * Disallow: /v1/ Disallow: /sites/ Disallow: /my-admin/ Allow: /