datahub/datahub-web-react/public/robots.txt

mirror of https://github.com/datahub-project/datahub.git synced 2025-07-03 07:09:21 +00:00
# https://www.robotstxt.org/robotstxt.html
User-agent: *
Disallow: /api
Disallow: /gms
Disallow: /search
Disallow: /logOut
feat(React Incubation): React Playground Proof of Concept (#2059) Co-authored-by: John Joyce <jjoyce0510@gmail.com> 2021-01-17 12:54:49 -08:00			`# https://www.robotstxt.org/robotstxt.html`
			`User-agent: *`
fix(ui): hide pages from web crawlers (#8738) 2023-08-29 16:47:34 -07:00			`Disallow: /api`
			`Disallow: /gms`
			`Disallow: /search`
			`Disallow: /logOut`