# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: User-agent: SemrushBot Disallow: / User-agent: CCBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: PetalBot Disallow: / User-agent: * Allow: / Sitemap: https://v2com-newswire.com/sitemap.xml.gz Disallow: /tmp/ Disallow: /fr/connexion Disallow: /en/sign-in Disallow: /fr/compte-client/connexion Disallow: /en/client-account/sign-in Disallow: /fr/compte-media/connexion Disallow: /en/media-account/sign-in Disallow: /fr/compte-media/mot-de-passe/nouveau Disallow: /en/media-account/password/new Disallow: /fr/compte-client/mot-de-passe/nouveau Disallow: /en/client-account/password/new Disallow: /fr/private Disallow: /en/private Disallow: /fr/admins/connexion Disallow: /en/admins/sign-in Disallow: /fr/salle-de-presse/mettre-a-jour-votre-navigateur Disallow: /en/newsroom/update-your-browser