Disallow crawling in robots.txt (#448)
This commit is contained in:
@@ -1,2 +1,3 @@
|
|||||||
# https://www.robotstxt.org/robotstxt.html
|
# https://www.robotstxt.org/robotstxt.html
|
||||||
User-agent: *
|
User-agent: *
|
||||||
|
Disallow: /
|
||||||
|
|||||||
Reference in New Issue
Block a user