## General crawler rules User-agent: * ## Admin and core directories Disallow: /wp-admin/ ## Front-end AJAX endpoint Allow: /wp-admin/admin-ajax.php ## No need to crawl the login form Disallow: /wp-login.php ## Feeds, trackbacks and comment URLs Disallow: */trackback Disallow: /*/comments Disallow: /*/feed/ Disallow: /*/feed/rss/ Disallow: /*/*respond$ ## Parameterized duplicate URLs Disallow: /?filter_by=* Disallow: /?s=* ## WordPress system folders Disallow: /cgi-bin ## Non-HTML files Disallow: /*.php$ Disallow: /*.inc$ Disallow: /*.gz Disallow: /*.cgi ## Image search bot from Google User-agent: Googlebot-Image Disallow: ## Ads crawler from Google User-agent: Mediapartners-Google Disallow: ## Static assets used to render pages Allow: /wp-includes/* Allow: /wp-content/* Allow: /wp-content/themes/* Allow: /wp-content/plugins/* ## Images and uploaded files Allow: /wp-content/uploads/* ## Let bots load CSS and JS Allow: /wp-content/cache/* ## Static assets used to render pages Allow: /*.js$ Allow: /*.css$ Allow: */css/* Allow: */js/* ## Styles and scripts needed for rendering Allow: /wp-content*.css* Allow: /wp-content*.js* Allow: /wp-includes*.css* Allow: /wp-includes*.js* ## Sitemap location Sitemap: https://www.latribunedusport.fr/sitemap_index.xml