Added gitea-mirror
This commit is contained in:
8
Divers/gitea-mirror/www/public/robots.txt
Normal file
8
Divers/gitea-mirror/www/public/robots.txt
Normal file
@@ -0,0 +1,8 @@
|
||||
# Robots.txt for Gitea Mirror
|
||||
User-agent: *
|
||||
Allow: /
|
||||
Sitemap: https://gitea-mirror.com/sitemap.xml
|
||||
|
||||
# Crawl-delay for responsible crawling
|
||||
User-agent: *
|
||||
Crawl-delay: 1
|
||||
Reference in New Issue
Block a user