yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-09-03 06:13:14 +00:00
Code Issues Packages Projects Releases Wiki Activity

fix(ui): hide pages from web crawlers (#8738)

Browse Source
This commit is contained in:
Harshal Sheth 2023-08-29 16:47:34 -07:00 committed by GitHub
parent 44c9ba47dd
commit 2eb93b9ba5
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 4 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
datahub-web-react/public/robots.txt
View File

@ -1,3 +1,6 @@
# https://www.robotstxt.org/robotstxt.html # https://www.robotstxt.org/robotstxt.html
User-agent: * User-agent: *
Disallow: Disallow: /api
Disallow: /gms
Disallow: /search
Disallow: /logOut