User-agent: * Disallow: /publisher/widget/ Disallow: /publisher/sessions/ Allow: /custom/hotelscombined/ Disallow: /custom/ Disallow: /api/ Disallow: /integrationsApplicantTest.html