Added gitea-mirror
This commit is contained in:
julien committed
1 parent
b956b07d1e
commit
e19aff248d
385 files changed
+81357
No files matched your search
@@ -0,0 +1,8 @@
|
||||
# Robots.txt for Gitea Mirror
|
||||
User-agent: *
|
||||
Allow: /
|
||||
Sitemap: https://gitea-mirror.com/sitemap.xml
|
||||
|
||||
# Crawl-delay for responsible crawling
|
||||
User-agent: *
|
||||
Crawl-delay: 1
|
||||
Reference in new issue
Block a user